2024-04-16T16:02:48.537 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T16:02:48.537 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi --verbose --owner scheduled_leonidus@teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} --archive /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219 -- /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/orig.config.yaml 2024-04-16T16:02:48.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T16:02:48.681 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219 branch: wip-lusov-shared-log-segment description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} email: null first_in_suite: false job_id: '7658219' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-shared-log-segment ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds debug zombie log segments: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-shared-log-segment sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f owner: scheduled_leonidus@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2402 sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f sleep_before_teardown: 0 subset: 111/111111 suite: fs suite_branch: wip-lusov-shared-log-segment suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPJHceKDWBWrA3P7NlLyWqCEfZ7PnHzplxQVWgsRWiLLAM52o1kV61YEqfhi+Z44Q974Yf+kh3R74I0q1qRzxE= smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuK7DzoqdlBifQdg4JImyaNVX1bjRkaVTmL+PsxSAWksF2pK6w3uEep/1OrX2TCA6O8pbVUHSncTFiIHceCw7I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_12:36:42 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-16T16:02:48.681 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa; will attempt to use it 2024-04-16T16:02:48.682 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks 2024-04-16T16:02:48.682 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T16:02:48.684 INFO:teuthology.task.internal:Checking packages... 2024-04-16T16:02:48.707 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f' 2024-04-16T16:02:48.707 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T16:02:48.707 INFO:teuthology.packaging:ref: None 2024-04-16T16:02:48.707 INFO:teuthology.packaging:tag: None 2024-04-16T16:02:48.707 INFO:teuthology.packaging:branch: wip-lusov-shared-log-segment 2024-04-16T16:02:48.708 INFO:teuthology.packaging:sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T16:02:48.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-shared-log-segment 2024-04-16T16:02:48.927 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2868.gc3c87ed0 2024-04-16T16:02:48.928 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T16:02:48.935 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T16:02:48.935 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T16:02:48.974 INFO:teuthology.task.internal:Saving configuration 2024-04-16T16:02:48.997 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T16:02:49.002 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T16:02:49.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:58:04.701781', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPJHceKDWBWrA3P7NlLyWqCEfZ7PnHzplxQVWgsRWiLLAM52o1kV61YEqfhi+Z44Q974Yf+kh3R74I0q1qRzxE='} 2024-04-16T16:02:49.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:58:04.703137', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuK7DzoqdlBifQdg4JImyaNVX1bjRkaVTmL+PsxSAWksF2pK6w3uEep/1OrX2TCA6O8pbVUHSncTFiIHceCw7I='} 2024-04-16T16:02:49.047 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T16:02:49.054 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-16T16:02:49.054 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-16T16:02:49.054 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T16:02:49.128 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5dd2f06160>, signals=[15]) 2024-04-16T16:02:49.128 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T16:02:49.134 INFO:teuthology.task.internal:Opening connections... 2024-04-16T16:02:49.134 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:02:49.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:02:49.242 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:02:49.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:02:49.344 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T16:02:49.352 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-04-16T16:02:49.370 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-04-16T16:02:49.370 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T16:02:49.429 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-04-16T16:02:49.430 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-04-16T16:02:49.430 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T16:02:49.430 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-04-16T16:02:49.430 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T16:02:49.430 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T16:02:49.430 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T16:02:49.431 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-04-16T16:02:49.452 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-04-16T16:02:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-04-16T16:02:49.470 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-16T16:02:49.526 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-04-16T16:02:49.526 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T16:02:49.527 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T16:02:49.528 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-16T16:02:49.543 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T16:02:49.553 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T16:02:49.559 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T16:02:49.559 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-04-16T16:02:49.561 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-04-16T16:02:49.582 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T16:02:49.589 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T16:02:49.589 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-04-16T16:02:49.619 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-04-16T16:02:49.648 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T16:02:49.699 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T16:02:49.719 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-16T16:02:49.720 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-16T16:02:49.720 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-16T16:02:49.720 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T16:02:49.721 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T16:02:49.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:02:49.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-16T16:02:49.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:02:49.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-16T16:02:49.914 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T16:02:49.914 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-16T16:02:49.914 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-04-16T16:02:49.933 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-361.el9.x86_64 2024-04-16T16:02:49.934 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T16:02:49.934 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-16T16:02:49.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum upgrade -y linux-firmware 2024-04-16T16:02:50.007 DEBUG:teuthology.task.kernel:sha1 for client.1 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T16:02:50.007 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-16T16:02:50.008 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-16T16:02:50.025 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-361.el9.x86_64 2024-04-16T16:02:50.026 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T16:02:50.026 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-16T16:02:50.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum upgrade -y linux-firmware 2024-04-16T16:02:52.223 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-04-16T16:02:52.449 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS-9 - AppStream 8.9 MB/s | 6.7 MB 00:00 2024-04-16T16:02:53.690 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-04-16T16:02:53.915 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2024-04-16T16:02:54.731 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-04-16T16:02:55.506 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-04-16T16:02:56.516 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 31 MB/s | 19 MB 00:00 2024-04-16T16:02:57.332 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-04-16T16:03:01.641 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.2 MB 00:00 2024-04-16T16:03:04.233 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.2 MB 00:04 2024-04-16T16:03:05.366 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 6.3 kB/s | 16 kB 00:02 2024-04-16T16:03:05.742 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-04-16T16:03:07.387 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-16T16:03:12.768 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-04-16T16:03:15.362 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-16T16:03:15.372 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 1 Package 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 375 M 2024-04-16T16:03:15.373 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-16T16:03:28.519 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 941 kB/s | 21 MB 00:22 2024-04-16T16:03:29.800 INFO:teuthology.orchestra.run.smithi022.stdout:linux-firmware-20240219-143.el9.noarch.rpm 26 MB/s | 375 MB 00:14 2024-04-16T16:03:29.801 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-16T16:03:29.802 INFO:teuthology.orchestra.run.smithi022.stdout:Total 26 MB/s | 375 MB 00:14 2024-04-16T16:03:29.802 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-16T16:03:29.901 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-16T16:03:29.901 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-16T16:03:32.370 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-16T16:03:32.370 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-16T16:03:33.774 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-04-16T16:03:36.324 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 1 Package 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:03:36.334 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 375 M 2024-04-16T16:03:36.335 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-16T16:03:38.937 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-16T16:03:39.193 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T16:03:39.278 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T16:03:40.477 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T16:03:40.477 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T16:03:40.904 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T16:03:40.905 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:03:40.905 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-04-16T16:03:40.905 INFO:teuthology.orchestra.run.smithi022.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-16T16:03:40.905 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:03:40.905 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-16T16:03:41.313 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-16T16:03:41.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T16:03:41.539 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-16T16:03:41.539 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-16T16:03:41.542 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi022.front.sepia.ceph.com to complete... 2024-04-16T16:03:44.125 INFO:teuthology.orchestra.run.smithi043.stdout:linux-firmware-20240219-143.el9.noarch.rpm 48 MB/s | 375 MB 00:07 2024-04-16T16:03:44.125 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-16T16:03:44.126 INFO:teuthology.orchestra.run.smithi043.stdout:Total 48 MB/s | 375 MB 00:07 2024-04-16T16:03:44.126 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-16T16:03:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-16T16:03:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-16T16:03:46.740 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-16T16:03:46.740 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-16T16:03:53.430 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-16T16:03:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T16:03:53.752 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T16:03:54.932 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T16:03:54.932 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T16:03:55.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T16:03:55.324 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:03:55.324 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-04-16T16:03:55.324 INFO:teuthology.orchestra.run.smithi043.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-16T16:03:55.324 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:03:55.324 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-16T16:03:55.745 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.1... 2024-04-16T16:03:55.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T16:03:56.071 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-16T16:03:56.072 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-16T16:03:56.074 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi043.front.sepia.ceph.com to complete... 2024-04-16T16:04:19.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16 16:04:19 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-16T16:04:19.159 INFO:teuthology.orchestra.run.smithi022.stderr:FINISHED --2024-04-16 16:04:19-- 2024-04-16T16:04:19.159 INFO:teuthology.orchestra.run.smithi022.stderr:Total wall clock time: 38s 2024-04-16T16:04:19.159 INFO:teuthology.orchestra.run.smithi022.stderr:Downloaded: 1 files, 341M in 37s (9.22 MB/s) 2024-04-16T16:04:19.163 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-16T16:04:19.163 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-16T16:04:21.312 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying... ######################################## 2024-04-16T16:04:21.367 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing... ######################################## 2024-04-16T16:04:21.452 INFO:teuthology.orchestra.run.smithi022.stdout:Updating / installing... 2024-04-16T16:04:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16 16:04:24 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-16T16:04:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:FINISHED --2024-04-16 16:04:24-- 2024-04-16T16:04:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:Total wall clock time: 28s 2024-04-16T16:04:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:Downloaded: 1 files, 341M in 28s (12.2 MB/s) 2024-04-16T16:04:24.595 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.1... 2024-04-16T16:04:24.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-16T16:04:26.745 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying... ######################################## 2024-04-16T16:04:26.804 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing... ######################################## 2024-04-16T16:04:26.889 INFO:teuthology.orchestra.run.smithi043.stdout:Updating / installing... 2024-04-16T16:04:29.754 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-16T16:04:35.339 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-16T16:04:44.486 INFO:teuthology.orchestra.run.smithi022.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T16:04:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T16:05:08.156 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-16T16:05:08.157 DEBUG:teuthology.orchestra.run.smithi022:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-16T16:05:08.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-16T16:05:08.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-16T16:05:08.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-16T16:05:08.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-16T16:05:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-16T16:05:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-16T16:05:08.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-16T16:05:08.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-16T16:05:08.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-16T16:05:08.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-16T16:05:08.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-16T16:05:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-16T16:05:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-16T16:05:08.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-16T16:05:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-16T16:05:08.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-16T16:05:08.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-16T16:05:08.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-16T16:05:08.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-16T16:05:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-16T16:05:08.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-16T16:05:08.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-16T16:05:08.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-16T16:05:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-16T16:05:08.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-16T16:05:08.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-16T16:05:08.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-16T16:05:08.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-16T16:05:08.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-16T16:05:08.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-16T16:05:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-16T16:05:08.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-16T16:05:08.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-16T16:05:08.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-16T16:05:08.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-16T16:05:08.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-16T16:05:08.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-16T16:05:08.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-16T16:05:08.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-16T16:05:08.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-16T16:05:08.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-16T16:05:08.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-16T16:05:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-16T16:05:08.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-16T16:05:08.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-16T16:05:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-16T16:05:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-16T16:05:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-16T16:05:08.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-16T16:05:08.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-16T16:05:08.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-16T16:05:08.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-16T16:05:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-16T16:05:08.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-16T16:05:08.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-16T16:05:08.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-16T16:05:08.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-16T16:05:08.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-16T16:05:08.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-16T16:05:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-16T16:05:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-16T16:05:08.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-16T16:05:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-16T16:05:08.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-16T16:05:08.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-16T16:05:08.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-16T16:05:08.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-16T16:05:08.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-16T16:05:08.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-16T16:05:08.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-16T16:05:08.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-16T16:05:08.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-16T16:05:08.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-16T16:05:08.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-16T16:05:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-16T16:05:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-16T16:05:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-16T16:05:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-16T16:05:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-16T16:05:08.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-16T16:05:08.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-16T16:05:08.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-16T16:05:08.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-16T16:05:08.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-16T16:05:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-16T16:05:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-16T16:05:08.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-16T16:05:08.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-16T16:05:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-16T16:05:08.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-16T16:05:08.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-16T16:05:08.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-16T16:05:08.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-16T16:05:08.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-16T16:05:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-16T16:05:08.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-16T16:05:08.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-16T16:05:08.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-16T16:05:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-16T16:05:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-16T16:05:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-16T16:05:08.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-16T16:05:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-16T16:05:08.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-16T16:05:08.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-16T16:05:08.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-16T16:05:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-16T16:05:08.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-16T16:05:08.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-16T16:05:08.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-16T16:05:08.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-16T16:05:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-16T16:05:08.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-16T16:05:08.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-16T16:05:08.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-16T16:05:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-16T16:05:08.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-16T16:05:08.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-16T16:05:08.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-16T16:05:08.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-16T16:05:08.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-16T16:05:08.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-16T16:05:08.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-16T16:05:08.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-16T16:05:08.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-16T16:05:08.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-16T16:05:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-16T16:05:08.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-16T16:05:08.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-16T16:05:08.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-16T16:05:08.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-16T16:05:08.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-16T16:05:08.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-16T16:05:08.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-16T16:05:08.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-16T16:05:08.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-16T16:05:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-16T16:05:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-16T16:05:08.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-16T16:05:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-16T16:05:08.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-16T16:05:08.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-16T16:05:08.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-16T16:05:08.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T16:05:08.379 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:08.379 DEBUG:teuthology.orchestra.run.smithi022:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:postinstall scriptlet (using /bin/sh): 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:for file in vmlinuz System.map config; do 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T16:05:08.402 INFO:teuthology.orchestra.run.smithi022.stdout: fi 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:done 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-04-16T16:05:08.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2024-04-16T16:05:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2024-04-16T16:05:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2024-04-16T16:05:08.483 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 68.el9 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8264254 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2024-04-16T16:05:08.484 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2024-04-16T16:05:08.485 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:05:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T16:05:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T16:05:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T16:05:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2024-04-16T16:05:08.485 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:05:08.485 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T16:05:08.486 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T16:05:08.486 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:08.486 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T16:05:09.084 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-04-16T16:05:10.499 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T16:05:10.530 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-04-16T16:05:10.533 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-04-16T16:05:10.548 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.dPfFvdOLgZ 2024-04-16T16:05:10.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dPfFvdOLgZ 2024-04-16T16:05:10.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.dPfFvdOLgZ 2024-04-16T16:05:10.768 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.dPfFvdOLgZ is 6KB 2024-04-16T16:05:10.817 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.dPfFvdOLgZ 2024-04-16T16:05:10.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T16:05:10.900 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T16:05:10.901 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T16:05:10.901 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T16:05:10.901 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-16T16:05:10.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:11.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-04-16T16:05:14.121 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-16T16:05:14.122 DEBUG:teuthology.orchestra.run.smithi043:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-16T16:05:14.196 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:14.196 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:14.196 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:14.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-16T16:05:14.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-16T16:05:14.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-16T16:05:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-16T16:05:14.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-16T16:05:14.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-16T16:05:14.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-16T16:05:14.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-16T16:05:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-16T16:05:14.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-16T16:05:14.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-16T16:05:14.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-16T16:05:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-16T16:05:14.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-16T16:05:14.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-16T16:05:14.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-16T16:05:14.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-16T16:05:14.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-16T16:05:14.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-16T16:05:14.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-16T16:05:14.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-16T16:05:14.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-16T16:05:14.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-16T16:05:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-16T16:05:14.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-16T16:05:14.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-16T16:05:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-16T16:05:14.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-16T16:05:14.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-16T16:05:14.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-16T16:05:14.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-16T16:05:14.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-16T16:05:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-16T16:05:14.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-16T16:05:14.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-16T16:05:14.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-16T16:05:14.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-16T16:05:14.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-16T16:05:14.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-16T16:05:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-16T16:05:14.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-16T16:05:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-16T16:05:14.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-16T16:05:14.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-16T16:05:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-16T16:05:14.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-16T16:05:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-16T16:05:14.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-16T16:05:14.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-16T16:05:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-16T16:05:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-16T16:05:14.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-16T16:05:14.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-16T16:05:14.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-16T16:05:14.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-16T16:05:14.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-16T16:05:14.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-16T16:05:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-16T16:05:14.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-16T16:05:14.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-16T16:05:14.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-16T16:05:14.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-16T16:05:14.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-16T16:05:14.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-16T16:05:14.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-16T16:05:14.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-16T16:05:14.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-16T16:05:14.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-16T16:05:14.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-16T16:05:14.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-16T16:05:14.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-16T16:05:14.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-16T16:05:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-16T16:05:14.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-16T16:05:14.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-16T16:05:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-16T16:05:14.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-16T16:05:14.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-16T16:05:14.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-16T16:05:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-16T16:05:14.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-16T16:05:14.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-16T16:05:14.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-16T16:05:14.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-16T16:05:14.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-16T16:05:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-16T16:05:14.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-16T16:05:14.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-16T16:05:14.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-16T16:05:14.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-16T16:05:14.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-16T16:05:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-16T16:05:14.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-16T16:05:14.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-16T16:05:14.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-16T16:05:14.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-16T16:05:14.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-16T16:05:14.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-16T16:05:14.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-16T16:05:14.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-16T16:05:14.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-16T16:05:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-16T16:05:14.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-16T16:05:14.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-16T16:05:14.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-16T16:05:14.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-16T16:05:14.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-16T16:05:14.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-16T16:05:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-16T16:05:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-16T16:05:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-16T16:05:14.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-16T16:05:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-16T16:05:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-16T16:05:14.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-16T16:05:14.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-16T16:05:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-16T16:05:14.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-16T16:05:14.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-16T16:05:14.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-16T16:05:14.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-16T16:05:14.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-16T16:05:14.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-16T16:05:14.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-16T16:05:14.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-16T16:05:14.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-16T16:05:14.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-16T16:05:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-16T16:05:14.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-16T16:05:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-16T16:05:14.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-16T16:05:14.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-16T16:05:14.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-16T16:05:14.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-16T16:05:14.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-16T16:05:14.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-16T16:05:14.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-16T16:05:14.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-16T16:05:14.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-16T16:05:14.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-16T16:05:14.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-16T16:05:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-16T16:05:14.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-16T16:05:14.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-16T16:05:14.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T16:05:14.342 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:14.343 DEBUG:teuthology.orchestra.run.smithi043:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-16T16:05:14.368 INFO:teuthology.orchestra.run.smithi043.stdout:postinstall scriptlet (using /bin/sh): 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout:for file in vmlinuz System.map config; do 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout: fi 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout:done 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T16:05:14.369 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-04-16T16:05:14.370 INFO:teuthology.orchestra.run.smithi043.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-16T16:05:14.370 INFO:teuthology.orchestra.run.smithi043.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:14.370 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-04-16T16:05:14.370 INFO:teuthology.orchestra.run.smithi043.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-16T16:05:14.370 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T16:05:14.370 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:14.370 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-04-16T16:05:14.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-04-16T16:05:14.453 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-04-16T16:05:14.454 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-04-16T16:05:14.454 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-04-16T16:05:14.454 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 68.el9 2024-04-16T16:05:14.454 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-04-16T16:05:14.454 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T16:05:14.454 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-04-16T16:05:14.454 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8264254 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T16:05:14.455 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T16:05:14.456 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-04-16T16:05:14.456 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:05:14.456 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T16:05:14.457 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T16:05:14.457 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:14.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T16:05:15.138 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-04-16T16:05:16.548 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T16:05:16.584 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-04-16T16:05:16.595 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-16T16:05:16.652 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.GmTrA9mVwU 2024-04-16T16:05:16.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GmTrA9mVwU 2024-04-16T16:05:16.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.GmTrA9mVwU 2024-04-16T16:05:16.875 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.GmTrA9mVwU is 6KB 2024-04-16T16:05:16.924 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.GmTrA9mVwU 2024-04-16T16:05:16.939 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T16:05:17.007 INFO:teuthology.orchestra.run.smithi043.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T16:05:17.008 INFO:teuthology.orchestra.run.smithi043.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T16:05:17.008 INFO:teuthology.orchestra.run.smithi043.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T16:05:17.008 INFO:teuthology.orchestra.run.smithi043.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-16T16:05:17.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:05:17.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-04-16T16:05:41.083 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-16T16:05:41.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-16T16:05:41.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:05:47.174 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-16T16:05:47.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-16T16:05:47.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:06:41.139 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T16:06:47.182 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T16:06:50.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-16T16:06:50.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:06:50.605 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-04-16T16:06:51.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-16T16:06:51.341 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-16T16:06:51.341 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-04-16T16:06:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:06:51.384 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:06:51.384 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T16:06:51.384 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T16:06:52.388 DEBUG:teuthology.parallel:result is None 2024-04-16T16:06:56.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-16T16:06:56.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:06:56.567 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-16T16:06:57.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-16T16:06:57.277 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-16T16:06:57.277 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-16T16:06:57.321 INFO:teuthology.orchestra.run.smithi043.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:06:57.321 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T16:06:57.321 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T16:06:57.321 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T16:06:58.324 DEBUG:teuthology.parallel:result is None 2024-04-16T16:06:58.324 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T16:06:58.331 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T16:06:58.331 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T16:06:58.337 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T16:06:58.384 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T16:06:58.391 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T16:06:58.402 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T16:06:58.402 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T16:06:58.424 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T16:06:58.488 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T16:06:58.496 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T16:06:58.497 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T16:06:58.512 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T16:06:58.672 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T16:06:58.681 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T16:06:58.762 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T16:06:58.892 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T16:06:58.898 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T16:06:58.909 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T16:06:58.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T16:06:58.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T16:06:59.008 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T16:06:59.020 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T16:06:59.020 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T16:06:59.024 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T16:06:59.073 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T16:06:59.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T16:06:59.268 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T16:06:59.335 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T16:06:59.424 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:06:59.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T16:06:59.494 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T16:06:59.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T16:06:59.659 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T16:06:59.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T16:06:59.824 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:06:59.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T16:06:59.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-04-16T16:06:59.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-04-16T16:07:00.022 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T16:07:00.051 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T16:07:00.382 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T16:07:00.391 INFO:teuthology.task.internal:Starting timer... 2024-04-16T16:07:00.391 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T16:07:00.418 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T16:07:00.501 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-16T16:07:00.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-04-16T16:07:00.624 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-04-16T16:07:00.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-04-16T16:07:00.759 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-04-16T16:07:00.763 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T16:07:00.764 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-04-16T16:07:00.824 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-04-16T16:07:00.825 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-04-16T16:07:00.885 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-04-16T16:07:00.885 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi043.front.sepia.ceph.com': 'permissive'} 2024-04-16T16:07:00.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T16:07:00.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:07:00.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T16:07:01.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:07:01.044 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T16:07:01.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-04-16T16:07:01.134 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-04-16T16:07:01.316 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T16:07:01.328 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T16:07:01.346 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T16:07:01.347 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi043.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T16:13:21.657 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi043.front.sepia.ceph.com')] 2024-04-16T16:13:21.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-16T16:13:21.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:13:21.831 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-04-16T16:13:22.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-16T16:13:22.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-16T16:13:22.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T16:13:22.152 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-16T16:13:22.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-16T16:13:22.307 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T16:13:22.317 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T16:13:22.318 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T16:13:22.318 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T16:13:22.323 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T16:13:22.324 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T16:13:22.429 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T16:13:22.433 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T16:13:22.484 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T16:13:22.492 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T16:13:22.584 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-04-16T16:13:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-04-16T16:13:22.628 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-04-16T16:13:22.632 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-04-16T16:13:22.683 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T16:13:22.685 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T16:13:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T16:13:22.740 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T16:13:22.894 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-04-16T16:13:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-04-16T16:13:22.904 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T16:13:22.904 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-16T16:13:22.904 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.904 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.904 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.904 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.908 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T16:13:22.908 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-04-16T16:13:22.908 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.908 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.908 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.908 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:13:22.910 INFO:teuthology.run_tasks:Running task install... 2024-04-16T16:13:22.918 DEBUG:teuthology.task.install:project ceph 2024-04-16T16:13:22.918 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}} 2024-04-16T16:13:22.918 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'} 2024-04-16T16:13:22.918 INFO:teuthology.task.install:Using flavor: default 2024-04-16T16:13:22.924 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T16:13:22.924 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-16T16:13:22.924 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T16:13:22.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T16:13:22.927 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T16:13:22.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T16:13:23.098 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T16:13:23.099 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T16:13:23.140 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T16:13:23.141 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T16:13:23.208 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T16:13:23.208 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:13:23.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T16:13:23.248 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T16:13:23.248 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:13:23.248 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T16:13:23.316 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T16:13:23.317 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T16:13:23.357 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T16:13:23.357 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T16:13:23.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T16:13:23.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T16:13:23.605 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T16:13:23.643 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T16:13:23.701 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-04-16T16:13:23.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-04-16T16:13:23.741 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-04-16T16:13:23.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-04-16T16:13:24.066 INFO:teuthology.orchestra.run.smithi043.stdout:74 files removed 2024-04-16T16:13:24.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T16:13:24.128 INFO:teuthology.orchestra.run.smithi022.stdout:74 files removed 2024-04-16T16:13:24.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T16:13:25.049 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 199 kB/s | 83 kB 00:00 2024-04-16T16:13:25.239 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 154 kB/s | 83 kB 00:00 2024-04-16T16:13:25.633 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-04-16T16:13:25.706 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-16T16:13:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-04-16T16:13:26.274 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-04-16T16:13:27.027 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - AppStream 9.9 MB/s | 6.7 MB 00:00 2024-04-16T16:13:27.054 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.7 MB 00:00 2024-04-16T16:13:28.745 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-04-16T16:13:28.771 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS-9 - BaseOS 4.7 MB/s | 2.0 MB 00:00 2024-04-16T16:13:29.741 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T16:13:29.950 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-16T16:13:31.709 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-04-16T16:13:34.368 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 19 MB 00:03 2024-04-16T16:13:36.184 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-16T16:13:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-16T16:13:38.910 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-16T16:13:39.895 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-04-16T16:13:40.519 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-04-16T16:13:43.388 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 21 MB 00:02 2024-04-16T16:13:46.020 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-16T16:13:49.098 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T16:13:49.099 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T16:13:49.123 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T16:13:49.124 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T16:13:49.126 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T16:13:49.128 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T16:13:49.130 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T16:13:49.134 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T16:13:49.136 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T16:13:49.229 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T16:13:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T16:13:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T16:13:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T16:13:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T16:13:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T16:13:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T16:13:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T16:13:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T16:13:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T16:13:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T16:13:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T16:13:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T16:13:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T16:13:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2024-04-16T16:13:49.262 INFO:teuthology.orchestra.run.smithi022.stdout:Install 150 Packages 2024-04-16T16:13:49.263 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 24 Packages 2024-04-16T16:13:49.263 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:13:49.263 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 228 M 2024-04-16T16:13:49.263 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-16T16:13:49.520 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-16T16:13:50.796 INFO:teuthology.orchestra.run.smithi022.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-16T16:13:51.863 INFO:teuthology.orchestra.run.smithi022.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 835 kB/s | 890 kB 00:01 2024-04-16T16:13:52.063 INFO:teuthology.orchestra.run.smithi022.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 727 kB/s | 145 kB 00:00 2024-04-16T16:13:52.568 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T16:13:52.583 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T16:13:52.592 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T16:13:52.593 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T16:13:52.595 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T16:13:52.596 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T16:13:52.599 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T16:13:52.602 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T16:13:52.604 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T16:13:52.699 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================================ 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================================ 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T16:13:52.724 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T16:13:52.725 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T16:13:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T16:13:52.727 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T16:13:52.728 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T16:13:52.729 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T16:13:52.730 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T16:13:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T16:13:52.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T16:13:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T16:13:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T16:13:52.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T16:13:52.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T16:13:52.737 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================================ 2024-04-16T16:13:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:Install 150 Packages 2024-04-16T16:13:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 24 Packages 2024-04-16T16:13:52.739 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:13:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 228 M 2024-04-16T16:13:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-16T16:13:53.105 INFO:teuthology.orchestra.run.smithi022.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-04-16T16:13:53.605 INFO:teuthology.orchestra.run.smithi022.stdout:(5/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-04-16T16:13:53.655 INFO:teuthology.orchestra.run.smithi022.stdout:(6/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-04-16T16:13:53.872 INFO:teuthology.orchestra.run.smithi043.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-16T16:13:54.664 INFO:teuthology.orchestra.run.smithi022.stdout:(7/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 4.4 MB/s | 4.7 MB 00:01 2024-04-16T16:13:55.131 INFO:teuthology.orchestra.run.smithi043.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 708 kB/s | 890 kB 00:01 2024-04-16T16:13:55.339 INFO:teuthology.orchestra.run.smithi043.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 699 kB/s | 145 kB 00:00 2024-04-16T16:13:56.406 INFO:teuthology.orchestra.run.smithi022.stdout:(8/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x86 6.1 MB/s | 17 MB 00:02 2024-04-16T16:13:56.464 INFO:teuthology.orchestra.run.smithi022.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 448 kB/s | 25 kB 00:00 2024-04-16T16:13:56.497 INFO:teuthology.orchestra.run.smithi043.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-04-16T16:13:57.006 INFO:teuthology.orchestra.run.smithi043.stdout:(5/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 2.9 MB/s | 1.5 MB 00:00 2024-04-16T16:13:57.423 INFO:teuthology.orchestra.run.smithi043.stdout:(6/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 1.3 MB/s | 5.4 MB 00:04 2024-04-16T16:13:57.473 INFO:teuthology.orchestra.run.smithi022.stdout:(10/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el 3.6 MB/s | 10 MB 00:02 2024-04-16T16:13:57.665 INFO:teuthology.orchestra.run.smithi022.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 1.2 MB/s | 225 kB 00:00 2024-04-16T16:13:57.765 INFO:teuthology.orchestra.run.smithi022.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 273 kB/s | 27 kB 00:00 2024-04-16T16:13:57.848 INFO:teuthology.orchestra.run.smithi022.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 386 kB/s | 32 kB 00:00 2024-04-16T16:13:58.099 INFO:teuthology.orchestra.run.smithi022.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 2.9 MB/s | 746 kB 00:00 2024-04-16T16:13:58.165 INFO:teuthology.orchestra.run.smithi043.stdout:(7/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 4.1 MB/s | 4.7 MB 00:01 2024-04-16T16:13:58.182 INFO:teuthology.orchestra.run.smithi022.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 1.9 MB/s | 163 kB 00:00 2024-04-16T16:13:58.274 INFO:teuthology.orchestra.run.smithi022.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 1.4 MB/s | 127 kB 00:00 2024-04-16T16:13:58.483 INFO:teuthology.orchestra.run.smithi022.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 2.4 MB/s | 500 kB 00:00 2024-04-16T16:13:59.883 INFO:teuthology.orchestra.run.smithi022.stdout:(18/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 3.7 MB/s | 5.2 MB 00:01 2024-04-16T16:13:59.983 INFO:teuthology.orchestra.run.smithi022.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 457 kB/s | 45 kB 00:00 2024-04-16T16:14:00.101 INFO:teuthology.orchestra.run.smithi022.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 1.1 MB/s | 135 kB 00:00 2024-04-16T16:14:00.184 INFO:teuthology.orchestra.run.smithi022.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 1.9 MB/s | 161 kB 00:00 2024-04-16T16:14:00.285 INFO:teuthology.orchestra.run.smithi022.stdout:(22/174): python3-rados-19.0.0-2868.gc3c87ed0.e 3.2 MB/s | 320 kB 00:00 2024-04-16T16:14:00.377 INFO:teuthology.orchestra.run.smithi022.stdout:(23/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 3.2 MB/s | 298 kB 00:00 2024-04-16T16:14:00.502 INFO:teuthology.orchestra.run.smithi022.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 801 kB/s | 99 kB 00:00 2024-04-16T16:14:00.786 INFO:teuthology.orchestra.run.smithi022.stdout:(25/174): ceph-common-19.0.0-2868.gc3c87ed0.el9 2.0 MB/s | 21 MB 00:10 2024-04-16T16:14:00.811 INFO:teuthology.orchestra.run.smithi022.stdout:(26/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 277 kB/s | 85 kB 00:00 2024-04-16T16:14:00.911 INFO:teuthology.orchestra.run.smithi022.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-16T16:14:00.923 INFO:teuthology.orchestra.run.smithi043.stdout:(8/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el9 3.6 MB/s | 10 MB 00:02 2024-04-16T16:14:00.986 INFO:teuthology.orchestra.run.smithi022.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 462 kB/s | 34 kB 00:00 2024-04-16T16:14:00.998 INFO:teuthology.orchestra.run.smithi043.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 341 kB/s | 25 kB 00:00 2024-04-16T16:14:01.070 INFO:teuthology.orchestra.run.smithi022.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 1.7 MB/s | 142 kB 00:00 2024-04-16T16:14:01.820 INFO:teuthology.orchestra.run.smithi022.stdout:(30/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 3.0 MB/s | 3.1 MB 00:01 2024-04-16T16:14:01.896 INFO:teuthology.orchestra.run.smithi022.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 4.3 MB/s | 3.5 MB 00:00 2024-04-16T16:14:01.979 INFO:teuthology.orchestra.run.smithi022.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 3.0 MB/s | 249 kB 00:00 2024-04-16T16:14:02.054 INFO:teuthology.orchestra.run.smithi022.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 665 kB/s | 49 kB 00:00 2024-04-16T16:14:02.138 INFO:teuthology.orchestra.run.smithi022.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 199 kB/s | 16 kB 00:00 2024-04-16T16:14:02.230 INFO:teuthology.orchestra.run.smithi022.stdout:(35/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 2.8 MB/s | 264 kB 00:00 2024-04-16T16:14:02.455 INFO:teuthology.orchestra.run.smithi022.stdout:(36/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 3.3 MB/s | 762 kB 00:00 2024-04-16T16:14:02.556 INFO:teuthology.orchestra.run.smithi022.stdout:(37/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 184 kB/s | 18 kB 00:00 2024-04-16T16:14:02.756 INFO:teuthology.orchestra.run.smithi022.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.3 MB/s | 662 kB 00:00 2024-04-16T16:14:02.823 INFO:teuthology.orchestra.run.smithi022.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-04-16T16:14:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2024-04-16T16:14:02.898 INFO:teuthology.orchestra.run.smithi022.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 307 kB 00:00 2024-04-16T16:14:02.957 INFO:teuthology.orchestra.run.smithi022.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 548 kB/s | 32 kB 00:00 2024-04-16T16:14:03.157 INFO:teuthology.orchestra.run.smithi043.stdout:(10/174): ceph-common-19.0.0-2868.gc3c87ed0.el9 2.1 MB/s | 21 MB 00:09 2024-04-16T16:14:03.257 INFO:teuthology.orchestra.run.smithi043.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 2.2 MB/s | 225 kB 00:00 2024-04-16T16:14:03.399 INFO:teuthology.orchestra.run.smithi043.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 192 kB/s | 27 kB 00:00 2024-04-16T16:14:03.574 INFO:teuthology.orchestra.run.smithi022.stdout:(43/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 6.8 MB/s | 49 MB 00:07 2024-04-16T16:14:03.633 INFO:teuthology.orchestra.run.smithi043.stdout:(13/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x8 2.7 MB/s | 17 MB 00:06 2024-04-16T16:14:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.3 MB/s | 3.0 MB 00:00 2024-04-16T16:14:03.658 INFO:teuthology.orchestra.run.smithi043.stdout:(14/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 123 kB/s | 32 kB 00:00 2024-04-16T16:14:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 184 kB/s | 17 kB 00:00 2024-04-16T16:14:03.717 INFO:teuthology.orchestra.run.smithi022.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 175 kB/s | 10 kB 00:00 2024-04-16T16:14:03.733 INFO:teuthology.orchestra.run.smithi043.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 2.2 MB/s | 163 kB 00:00 2024-04-16T16:14:03.750 INFO:teuthology.orchestra.run.smithi022.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 159 kB 00:00 2024-04-16T16:14:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 688 kB/s | 44 kB 00:00 2024-04-16T16:14:03.792 INFO:teuthology.orchestra.run.smithi043.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 2.2 MB/s | 127 kB 00:00 2024-04-16T16:14:03.825 INFO:teuthology.orchestra.run.smithi043.stdout:(17/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 3.8 MB/s | 746 kB 00:00 2024-04-16T16:14:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-04-16T16:14:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.4 MB/s | 578 kB 00:00 2024-04-16T16:14:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 763 kB/s | 46 kB 00:00 2024-04-16T16:14:03.917 INFO:teuthology.orchestra.run.smithi043.stdout:(18/174): libradosstriper1-19.0.0-2868.gc3c87ed 3.9 MB/s | 500 kB 00:00 2024-04-16T16:14:03.943 INFO:teuthology.orchestra.run.smithi022.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-04-16T16:14:03.968 INFO:teuthology.orchestra.run.smithi043.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 918 kB/s | 45 kB 00:00 2024-04-16T16:14:03.977 INFO:teuthology.orchestra.run.smithi022.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 187 kB 00:00 2024-04-16T16:14:04.011 INFO:teuthology.orchestra.run.smithi022.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-04-16T16:14:04.026 INFO:teuthology.orchestra.run.smithi043.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 2.3 MB/s | 135 kB 00:00 2024-04-16T16:14:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 591 kB/s | 34 kB 00:00 2024-04-16T16:14:04.093 INFO:teuthology.orchestra.run.smithi043.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 2.4 MB/s | 161 kB 00:00 2024-04-16T16:14:04.216 INFO:teuthology.orchestra.run.smithi043.stdout:(22/174): python3-rados-19.0.0-2868.gc3c87ed0.e 2.6 MB/s | 320 kB 00:00 2024-04-16T16:14:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:(56/174): ceph-mgr-diskprediction-local-19.0.0- 3.1 MB/s | 7.4 MB 00:02 2024-04-16T16:14:04.294 INFO:teuthology.orchestra.run.smithi043.stdout:(23/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 3.8 MB/s | 298 kB 00:00 2024-04-16T16:14:04.344 INFO:teuthology.orchestra.run.smithi043.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 2.0 MB/s | 99 kB 00:00 2024-04-16T16:14:04.394 INFO:teuthology.orchestra.run.smithi043.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-16T16:14:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-04-16T16:14:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 3.4 MB/s | 1.5 MB 00:00 2024-04-16T16:14:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 2.7 MB/s | 817 kB 00:00 2024-04-16T16:14:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 132 kB 00:00 2024-04-16T16:14:04.662 INFO:teuthology.orchestra.run.smithi022.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 7.7 MB/s | 1.0 MB 00:00 2024-04-16T16:14:04.770 INFO:teuthology.orchestra.run.smithi043.stdout:(26/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 5.5 MB/s | 5.2 MB 00:00 2024-04-16T16:14:04.820 INFO:teuthology.orchestra.run.smithi043.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 3.4 MB/s | 170 kB 00:00 2024-04-16T16:14:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:(62/174): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2024-04-16T16:14:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 841 kB/s | 34 kB 00:00 2024-04-16T16:14:04.872 INFO:teuthology.orchestra.run.smithi022.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 245 kB/s | 78 kB 00:00 2024-04-16T16:14:04.912 INFO:teuthology.orchestra.run.smithi043.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 2.8 MB/s | 142 kB 00:00 2024-04-16T16:14:05.005 INFO:teuthology.orchestra.run.smithi043.stdout:(30/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 5.1 MB/s | 3.1 MB 00:00 2024-04-16T16:14:05.005 INFO:teuthology.orchestra.run.smithi022.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-04-16T16:14:05.061 INFO:teuthology.orchestra.run.smithi022.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 114 kB/s | 24 kB 00:00 2024-04-16T16:14:05.088 INFO:teuthology.orchestra.run.smithi022.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 91 kB/s | 18 kB 00:00 2024-04-16T16:14:05.131 INFO:teuthology.orchestra.run.smithi022.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 789 kB/s | 32 kB 00:00 2024-04-16T16:14:05.189 INFO:teuthology.orchestra.run.smithi022.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2024-04-16T16:14:05.314 INFO:teuthology.orchestra.run.smithi022.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2024-04-16T16:14:05.331 INFO:teuthology.orchestra.run.smithi022.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-04-16T16:14:05.356 INFO:teuthology.orchestra.run.smithi022.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-04-16T16:14:05.407 INFO:teuthology.orchestra.run.smithi022.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 855 kB/s | 41 kB 00:00 2024-04-16T16:14:05.432 INFO:teuthology.orchestra.run.smithi022.stdout:(73/174): python3-packaging-20.9-5.el9.noarch.r 931 kB/s | 69 kB 00:00 2024-04-16T16:14:05.446 INFO:teuthology.orchestra.run.smithi043.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 6.6 MB/s | 3.5 MB 00:00 2024-04-16T16:14:05.482 INFO:teuthology.orchestra.run.smithi022.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 238 kB 00:00 2024-04-16T16:14:05.507 INFO:teuthology.orchestra.run.smithi022.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 132 kB 00:00 2024-04-16T16:14:05.530 INFO:teuthology.orchestra.run.smithi043.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 3.0 MB/s | 249 kB 00:00 2024-04-16T16:14:05.532 INFO:teuthology.orchestra.run.smithi022.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 994 kB/s | 47 kB 00:00 2024-04-16T16:14:05.558 INFO:teuthology.orchestra.run.smithi022.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2024-04-16T16:14:05.580 INFO:teuthology.orchestra.run.smithi043.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 1.0 MB/s | 49 kB 00:00 2024-04-16T16:14:05.583 INFO:teuthology.orchestra.run.smithi022.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 579 kB/s | 43 kB 00:00 2024-04-16T16:14:05.747 INFO:teuthology.orchestra.run.smithi043.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 99 kB/s | 16 kB 00:00 2024-04-16T16:14:05.831 INFO:teuthology.orchestra.run.smithi043.stdout:(35/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 3.1 MB/s | 264 kB 00:00 2024-04-16T16:14:05.892 INFO:teuthology.orchestra.run.smithi022.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 136 kB/s | 39 kB 00:00 2024-04-16T16:14:05.917 INFO:teuthology.orchestra.run.smithi022.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 133 kB/s | 41 kB 00:00 2024-04-16T16:14:05.964 INFO:teuthology.orchestra.run.smithi043.stdout:(36/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 5.6 MB/s | 762 kB 00:00 2024-04-16T16:14:06.015 INFO:teuthology.orchestra.run.smithi043.stdout:(37/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 372 kB/s | 18 kB 00:00 2024-04-16T16:14:06.126 INFO:teuthology.orchestra.run.smithi022.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-16T16:14:06.151 INFO:teuthology.orchestra.run.smithi022.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 153 kB/s | 35 kB 00:00 2024-04-16T16:14:06.184 INFO:teuthology.orchestra.run.smithi022.stdout:(83/174): qatlib-24.02.0-1.el9.x86_64.rpm 840 kB/s | 220 kB 00:00 2024-04-16T16:14:06.207 INFO:teuthology.orchestra.run.smithi043.stdout:(38/174): ceph-mgr-diskprediction-local-19.0.0- 6.2 MB/s | 7.4 MB 00:01 2024-04-16T16:14:06.210 INFO:teuthology.orchestra.run.smithi022.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 46 kB 00:00 2024-04-16T16:14:06.243 INFO:teuthology.orchestra.run.smithi022.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 300 kB 00:00 2024-04-16T16:14:06.293 INFO:teuthology.orchestra.run.smithi022.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 788 kB/s | 63 kB 00:00 2024-04-16T16:14:06.323 INFO:teuthology.orchestra.run.smithi043.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 662 kB 00:00 2024-04-16T16:14:06.374 INFO:teuthology.orchestra.run.smithi043.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 920 kB 00:00 2024-04-16T16:14:06.400 INFO:teuthology.orchestra.run.smithi043.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-04-16T16:14:06.433 INFO:teuthology.orchestra.run.smithi043.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-04-16T16:14:06.435 INFO:teuthology.orchestra.run.smithi022.stdout:(87/174): uuid-1.6.2-55.el9.x86_64.rpm 254 kB/s | 56 kB 00:00 2024-04-16T16:14:06.450 INFO:teuthology.orchestra.run.smithi043.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 677 kB/s | 32 kB 00:00 2024-04-16T16:14:06.460 INFO:teuthology.orchestra.run.smithi022.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 204 kB/s | 44 kB 00:00 2024-04-16T16:14:06.486 INFO:teuthology.orchestra.run.smithi022.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 413 kB/s | 79 kB 00:00 2024-04-16T16:14:06.528 INFO:teuthology.orchestra.run.smithi022.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-04-16T16:14:06.558 INFO:teuthology.orchestra.run.smithi043.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-16T16:14:06.575 INFO:teuthology.orchestra.run.smithi043.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 17 kB 00:00 2024-04-16T16:14:06.586 INFO:teuthology.orchestra.run.smithi022.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2024-04-16T16:14:06.609 INFO:teuthology.orchestra.run.smithi043.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 314 kB/s | 10 kB 00:00 2024-04-16T16:14:06.611 INFO:teuthology.orchestra.run.smithi022.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 824 kB/s | 103 kB 00:00 2024-04-16T16:14:06.637 INFO:teuthology.orchestra.run.smithi022.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-04-16T16:14:06.643 INFO:teuthology.orchestra.run.smithi043.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-04-16T16:14:06.660 INFO:teuthology.orchestra.run.smithi043.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 919 kB/s | 44 kB 00:00 2024-04-16T16:14:06.670 INFO:teuthology.orchestra.run.smithi022.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.3 MB/s | 187 kB 00:00 2024-04-16T16:14:06.710 INFO:teuthology.orchestra.run.smithi043.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 661 kB 00:00 2024-04-16T16:14:06.769 INFO:teuthology.orchestra.run.smithi043.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 5.6 MB/s | 578 kB 00:00 2024-04-16T16:14:06.794 INFO:teuthology.orchestra.run.smithi043.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 600 kB/s | 46 kB 00:00 2024-04-16T16:14:06.804 INFO:teuthology.orchestra.run.smithi022.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 988 kB/s | 187 kB 00:00 2024-04-16T16:14:06.828 INFO:teuthology.orchestra.run.smithi043.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-16T16:14:06.837 INFO:teuthology.orchestra.run.smithi022.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-16T16:14:06.861 INFO:teuthology.orchestra.run.smithi043.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-04-16T16:14:06.863 INFO:teuthology.orchestra.run.smithi022.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-16T16:14:06.895 INFO:teuthology.orchestra.run.smithi043.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-04-16T16:14:06.913 INFO:teuthology.orchestra.run.smithi022.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-04-16T16:14:06.920 INFO:teuthology.orchestra.run.smithi043.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 613 kB/s | 34 kB 00:00 2024-04-16T16:14:06.938 INFO:teuthology.orchestra.run.smithi022.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-04-16T16:14:06.989 INFO:teuthology.orchestra.run.smithi022.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 204 kB/s | 25 kB 00:00 2024-04-16T16:14:07.054 INFO:teuthology.orchestra.run.smithi043.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-16T16:14:07.113 INFO:teuthology.orchestra.run.smithi043.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 8.7 MB/s | 1.5 MB 00:00 2024-04-16T16:14:07.155 INFO:teuthology.orchestra.run.smithi043.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 9.3 MB/s | 817 kB 00:00 2024-04-16T16:14:07.180 INFO:teuthology.orchestra.run.smithi043.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 132 kB 00:00 2024-04-16T16:14:07.214 INFO:teuthology.orchestra.run.smithi022.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 893 kB/s | 245 kB 00:00 2024-04-16T16:14:07.239 INFO:teuthology.orchestra.run.smithi022.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 993 kB/s | 248 kB 00:00 2024-04-16T16:14:07.289 INFO:teuthology.orchestra.run.smithi022.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-04-16T16:14:07.306 INFO:teuthology.orchestra.run.smithi022.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 336 kB/s | 22 kB 00:00 2024-04-16T16:14:07.330 INFO:teuthology.orchestra.run.smithi043.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2024-04-16T16:14:07.397 INFO:teuthology.orchestra.run.smithi043.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-04-16T16:14:07.422 INFO:teuthology.orchestra.run.smithi043.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 944 kB/s | 78 kB 00:00 2024-04-16T16:14:07.549 INFO:teuthology.orchestra.run.smithi022.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-04-16T16:14:07.589 INFO:teuthology.orchestra.run.smithi043.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-04-16T16:14:07.606 INFO:teuthology.orchestra.run.smithi043.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 146 kB/s | 24 kB 00:00 2024-04-16T16:14:07.623 INFO:teuthology.orchestra.run.smithi043.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 562 kB/s | 18 kB 00:00 2024-04-16T16:14:07.648 INFO:teuthology.orchestra.run.smithi043.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2024-04-16T16:14:07.666 INFO:teuthology.orchestra.run.smithi043.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 798 kB/s | 32 kB 00:00 2024-04-16T16:14:07.674 INFO:teuthology.orchestra.run.smithi022.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-04-16T16:14:07.724 INFO:teuthology.orchestra.run.smithi022.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 396 kB/s | 19 kB 00:00 2024-04-16T16:14:07.799 INFO:teuthology.orchestra.run.smithi022.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-04-16T16:14:07.849 INFO:teuthology.orchestra.run.smithi022.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 528 kB/s | 26 kB 00:00 2024-04-16T16:14:07.941 INFO:teuthology.orchestra.run.smithi022.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 541 kB/s | 49 kB 00:00 2024-04-16T16:14:07.950 INFO:teuthology.orchestra.run.smithi043.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2024-04-16T16:14:07.983 INFO:teuthology.orchestra.run.smithi043.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 695 kB/s | 217 kB 00:00 2024-04-16T16:14:08.017 INFO:teuthology.orchestra.run.smithi043.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 174 kB 00:00 2024-04-16T16:14:08.034 INFO:teuthology.orchestra.run.smithi043.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 69 kB 00:00 2024-04-16T16:14:08.042 INFO:teuthology.orchestra.run.smithi022.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-16T16:14:08.059 INFO:teuthology.orchestra.run.smithi043.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-04-16T16:14:08.068 INFO:teuthology.orchestra.run.smithi022.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 537 kB/s | 67 kB 00:00 2024-04-16T16:14:08.095 INFO:teuthology.orchestra.run.smithi043.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.1 MB/s | 238 kB 00:00 2024-04-16T16:14:08.118 INFO:teuthology.orchestra.run.smithi043.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 132 kB 00:00 2024-04-16T16:14:08.151 INFO:teuthology.orchestra.run.smithi043.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2024-04-16T16:14:08.168 INFO:teuthology.orchestra.run.smithi022.stdout:(113/174): openssl-devel-3.0.7-27.el9.x86_64.rp 3.3 MB/s | 4.1 MB 00:01 2024-04-16T16:14:08.177 INFO:teuthology.orchestra.run.smithi043.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 843 kB/s | 47 kB 00:00 2024-04-16T16:14:08.194 INFO:teuthology.orchestra.run.smithi043.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2024-04-16T16:14:08.201 INFO:teuthology.orchestra.run.smithi022.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 957 kB/s | 151 kB 00:00 2024-04-16T16:14:08.263 INFO:teuthology.orchestra.run.smithi022.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 752 kB/s | 43 kB 00:00 2024-04-16T16:14:08.293 INFO:teuthology.orchestra.run.smithi022.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-04-16T16:14:08.318 INFO:teuthology.orchestra.run.smithi022.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 559 kB/s | 32 kB 00:00 2024-04-16T16:14:08.361 INFO:teuthology.orchestra.run.smithi043.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 241 kB/s | 39 kB 00:00 2024-04-16T16:14:08.369 INFO:teuthology.orchestra.run.smithi022.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-04-16T16:14:08.403 INFO:teuthology.orchestra.run.smithi022.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-16T16:14:08.436 INFO:teuthology.orchestra.run.smithi022.stdout:(120/174): python3-asyncssh-2.13.2-5.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-04-16T16:14:08.470 INFO:teuthology.orchestra.run.smithi022.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-04-16T16:14:08.495 INFO:teuthology.orchestra.run.smithi022.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 612 kB/s | 35 kB 00:00 2024-04-16T16:14:08.529 INFO:teuthology.orchestra.run.smithi022.stdout:(123/174): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-04-16T16:14:08.562 INFO:teuthology.orchestra.run.smithi022.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-04-16T16:14:08.604 INFO:teuthology.orchestra.run.smithi022.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-16T16:14:08.630 INFO:teuthology.orchestra.run.smithi022.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 162 kB/s | 11 kB 00:00 2024-04-16T16:14:08.663 INFO:teuthology.orchestra.run.smithi022.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 308 kB/s | 18 kB 00:00 2024-04-16T16:14:08.669 INFO:teuthology.orchestra.run.smithi043.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-04-16T16:14:08.686 INFO:teuthology.orchestra.run.smithi043.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 132 kB/s | 41 kB 00:00 2024-04-16T16:14:08.688 INFO:teuthology.orchestra.run.smithi022.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 400 kB/s | 23 kB 00:00 2024-04-16T16:14:08.713 INFO:teuthology.orchestra.run.smithi022.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 391 kB/s | 19 kB 00:00 2024-04-16T16:14:08.720 INFO:teuthology.orchestra.run.smithi043.stdout:(81/174): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 35 kB 00:00 2024-04-16T16:14:08.772 INFO:teuthology.orchestra.run.smithi022.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2024-04-16T16:14:08.782 INFO:teuthology.orchestra.run.smithi043.stdout:(82/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 755 kB/s | 46 kB 00:00 2024-04-16T16:14:08.812 INFO:teuthology.orchestra.run.smithi043.stdout:(83/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2024-04-16T16:14:08.830 INFO:teuthology.orchestra.run.smithi022.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-04-16T16:14:08.846 INFO:teuthology.orchestra.run.smithi043.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.9 MB/s | 300 kB 00:00 2024-04-16T16:14:08.856 INFO:teuthology.orchestra.run.smithi022.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 561 kB/s | 46 kB 00:00 2024-04-16T16:14:08.863 INFO:teuthology.orchestra.run.smithi043.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.2 MB/s | 56 kB 00:00 2024-04-16T16:14:08.880 INFO:teuthology.orchestra.run.smithi043.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-04-16T16:14:08.889 INFO:teuthology.orchestra.run.smithi022.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-16T16:14:08.897 INFO:teuthology.orchestra.run.smithi043.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-16T16:14:08.922 INFO:teuthology.orchestra.run.smithi043.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-04-16T16:14:08.923 INFO:teuthology.orchestra.run.smithi022.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 873 kB/s | 58 kB 00:00 2024-04-16T16:14:08.956 INFO:teuthology.orchestra.run.smithi043.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-04-16T16:14:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-16T16:14:08.982 INFO:teuthology.orchestra.run.smithi022.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2024-04-16T16:14:09.006 INFO:teuthology.orchestra.run.smithi043.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-04-16T16:14:09.024 INFO:teuthology.orchestra.run.smithi022.stdout:(137/174): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-04-16T16:14:09.031 INFO:teuthology.orchestra.run.smithi043.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-04-16T16:14:09.049 INFO:teuthology.orchestra.run.smithi022.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 427 kB/s | 28 kB 00:00 2024-04-16T16:14:09.056 INFO:teuthology.orchestra.run.smithi043.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-04-16T16:14:09.074 INFO:teuthology.orchestra.run.smithi022.stdout:(139/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 774 kB/s | 90 kB 00:00 2024-04-16T16:14:09.090 INFO:teuthology.orchestra.run.smithi043.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-04-16T16:14:09.099 INFO:teuthology.orchestra.run.smithi022.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 413 kB/s | 31 kB 00:00 2024-04-16T16:14:09.133 INFO:teuthology.orchestra.run.smithi022.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-16T16:14:09.192 INFO:teuthology.orchestra.run.smithi022.stdout:(142/174): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-04-16T16:14:09.217 INFO:teuthology.orchestra.run.smithi022.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-04-16T16:14:09.240 INFO:teuthology.orchestra.run.smithi043.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-16T16:14:09.242 INFO:teuthology.orchestra.run.smithi022.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 470 kB/s | 51 kB 00:00 2024-04-16T16:14:09.285 INFO:teuthology.orchestra.run.smithi022.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-16T16:14:09.307 INFO:teuthology.orchestra.run.smithi043.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-04-16T16:14:09.310 INFO:teuthology.orchestra.run.smithi022.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 969 kB/s | 90 kB 00:00 2024-04-16T16:14:09.336 INFO:teuthology.orchestra.run.smithi022.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 405 kB/s | 20 kB 00:00 2024-04-16T16:14:09.341 INFO:teuthology.orchestra.run.smithi043.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-04-16T16:14:09.374 INFO:teuthology.orchestra.run.smithi043.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-16T16:14:09.379 INFO:teuthology.orchestra.run.smithi022.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-04-16T16:14:09.420 INFO:teuthology.orchestra.run.smithi022.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-16T16:14:09.450 INFO:teuthology.orchestra.run.smithi043.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 199 kB/s | 21 kB 00:00 2024-04-16T16:14:09.475 INFO:teuthology.orchestra.run.smithi043.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-04-16T16:14:09.663 INFO:teuthology.orchestra.run.smithi022.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-04-16T16:14:09.684 INFO:teuthology.orchestra.run.smithi043.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.2 MB/s | 245 kB 00:00 2024-04-16T16:14:09.793 INFO:teuthology.orchestra.run.smithi043.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 2.3 MB/s | 248 kB 00:00 2024-04-16T16:14:09.862 INFO:teuthology.orchestra.run.smithi022.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-04-16T16:14:09.960 INFO:teuthology.orchestra.run.smithi043.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 565 kB/s | 94 kB 00:00 2024-04-16T16:14:10.060 INFO:teuthology.orchestra.run.smithi043.stdout:(103/174): openssl-devel-3.0.7-27.el9.x86_64.rp 6.8 MB/s | 4.1 MB 00:00 2024-04-16T16:14:10.087 INFO:teuthology.orchestra.run.smithi022.stdout:(152/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 4.7 MB/s | 3.1 MB 00:00 2024-04-16T16:14:10.110 INFO:teuthology.orchestra.run.smithi043.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 149 kB/s | 22 kB 00:00 2024-04-16T16:14:10.146 INFO:teuthology.orchestra.run.smithi022.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 6.4 MB/s | 1.8 MB 00:00 2024-04-16T16:14:10.171 INFO:teuthology.orchestra.run.smithi022.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 515 kB/s | 41 kB 00:00 2024-04-16T16:14:10.205 INFO:teuthology.orchestra.run.smithi022.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-04-16T16:14:10.239 INFO:teuthology.orchestra.run.smithi022.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.9 MB/s | 321 kB 00:00 2024-04-16T16:14:10.297 INFO:teuthology.orchestra.run.smithi022.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 810 kB/s | 71 kB 00:00 2024-04-16T16:14:10.323 INFO:teuthology.orchestra.run.smithi022.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 441 kB/s | 36 kB 00:00 2024-04-16T16:14:10.402 INFO:teuthology.orchestra.run.smithi043.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-04-16T16:14:10.406 INFO:teuthology.orchestra.run.smithi022.stdout:(159/174): librados2-19.0.0-2868.gc3c87ed0.el9. 3.3 MB/s | 3.4 MB 00:01 2024-04-16T16:14:10.439 INFO:teuthology.orchestra.run.smithi022.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.3 MB/s | 192 kB 00:00 2024-04-16T16:14:10.453 INFO:teuthology.orchestra.run.smithi043.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-04-16T16:14:10.486 INFO:teuthology.orchestra.run.smithi043.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 3.7 MB/s | 309 kB 00:00 2024-04-16T16:14:10.494 INFO:teuthology.orchestra.run.smithi022.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.5 MB/s | 256 kB 00:00 2024-04-16T16:14:10.503 INFO:teuthology.orchestra.run.smithi043.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 420 kB/s | 19 kB 00:00 2024-04-16T16:14:10.524 INFO:teuthology.orchestra.run.smithi022.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 198 kB/s | 23 kB 00:00 2024-04-16T16:14:10.549 INFO:teuthology.orchestra.run.smithi022.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-04-16T16:14:10.574 INFO:teuthology.orchestra.run.smithi022.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.9 MB/s | 155 kB 00:00 2024-04-16T16:14:10.599 INFO:teuthology.orchestra.run.smithi022.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-04-16T16:14:10.625 INFO:teuthology.orchestra.run.smithi022.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 582 kB/s | 29 kB 00:00 2024-04-16T16:14:10.650 INFO:teuthology.orchestra.run.smithi022.stdout:(167/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-04-16T16:14:10.670 INFO:teuthology.orchestra.run.smithi043.stdout:(109/174): libarrow-9.0.0-10.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-04-16T16:14:10.687 INFO:teuthology.orchestra.run.smithi043.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 142 kB/s | 26 kB 00:00 2024-04-16T16:14:10.725 INFO:teuthology.orchestra.run.smithi022.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-04-16T16:14:10.729 INFO:teuthology.orchestra.run.smithi043.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-04-16T16:14:10.754 INFO:teuthology.orchestra.run.smithi043.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-16T16:14:10.812 INFO:teuthology.orchestra.run.smithi043.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-04-16T16:14:10.817 INFO:teuthology.orchestra.run.smithi022.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-04-16T16:14:10.859 INFO:teuthology.orchestra.run.smithi022.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 3.4 MB/s | 465 kB 00:00 2024-04-16T16:14:10.862 INFO:teuthology.orchestra.run.smithi043.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.7 MB/s | 838 kB 00:00 2024-04-16T16:14:10.884 INFO:teuthology.orchestra.run.smithi022.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 471 kB/s | 31 kB 00:00 2024-04-16T16:14:10.921 INFO:teuthology.orchestra.run.smithi043.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 9.4 MB/s | 548 kB 00:00 2024-04-16T16:14:10.938 INFO:teuthology.orchestra.run.smithi043.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 589 kB/s | 43 kB 00:00 2024-04-16T16:14:10.968 INFO:teuthology.orchestra.run.smithi022.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.2 MB/s | 2.3 MB 00:00 2024-04-16T16:14:10.992 INFO:teuthology.orchestra.run.smithi043.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 289 kB/s | 15 kB 00:00 2024-04-16T16:14:11.009 INFO:teuthology.orchestra.run.smithi022.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-04-16T16:14:11.017 INFO:teuthology.orchestra.run.smithi043.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 416 kB/s | 32 kB 00:00 2024-04-16T16:14:11.035 INFO:teuthology.orchestra.run.smithi022.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 498 kB/s | 74 kB 00:00 2024-04-16T16:14:11.043 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-16T16:14:11.044 INFO:teuthology.orchestra.run.smithi022.stdout:Total 10 MB/s | 228 MB 00:21 2024-04-16T16:14:11.050 INFO:teuthology.orchestra.run.smithi043.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-16T16:14:11.084 INFO:teuthology.orchestra.run.smithi043.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 5.4 MB/s | 358 kB 00:00 2024-04-16T16:14:11.118 INFO:teuthology.orchestra.run.smithi043.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.7 MB/s | 303 kB 00:00 2024-04-16T16:14:11.143 INFO:teuthology.orchestra.run.smithi043.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 641 kB/s | 35 kB 00:00 2024-04-16T16:14:11.177 INFO:teuthology.orchestra.run.smithi043.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.5 MB/s | 203 kB 00:00 2024-04-16T16:14:11.269 INFO:teuthology.orchestra.run.smithi043.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-16T16:14:11.303 INFO:teuthology.orchestra.run.smithi043.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-16T16:14:11.348 INFO:teuthology.orchestra.run.smithi043.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 139 kB/s | 11 kB 00:00 2024-04-16T16:14:11.378 INFO:teuthology.orchestra.run.smithi043.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 238 kB/s | 18 kB 00:00 2024-04-16T16:14:11.404 INFO:teuthology.orchestra.run.smithi043.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 432 kB/s | 23 kB 00:00 2024-04-16T16:14:11.429 INFO:teuthology.orchestra.run.smithi043.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 396 kB/s | 19 kB 00:00 2024-04-16T16:14:11.454 INFO:teuthology.orchestra.run.smithi043.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 400 kB/s | 20 kB 00:00 2024-04-16T16:14:11.505 INFO:teuthology.orchestra.run.smithi043.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-04-16T16:14:11.530 INFO:teuthology.orchestra.run.smithi043.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 732 kB/s | 46 kB 00:00 2024-04-16T16:14:11.547 INFO:teuthology.orchestra.run.smithi043.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-04-16T16:14:11.580 INFO:teuthology.orchestra.run.smithi043.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2024-04-16T16:14:11.614 INFO:teuthology.orchestra.run.smithi043.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-16T16:14:11.639 INFO:teuthology.orchestra.run.smithi043.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 297 kB/s | 16 kB 00:00 2024-04-16T16:14:11.664 INFO:teuthology.orchestra.run.smithi043.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-16T16:14:11.690 INFO:teuthology.orchestra.run.smithi043.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 582 kB/s | 28 kB 00:00 2024-04-16T16:14:11.715 INFO:teuthology.orchestra.run.smithi043.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 629 kB/s | 31 kB 00:00 2024-04-16T16:14:11.749 INFO:teuthology.orchestra.run.smithi043.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-04-16T16:14:11.782 INFO:teuthology.orchestra.run.smithi043.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 921 kB/s | 59 kB 00:00 2024-04-16T16:14:11.807 INFO:teuthology.orchestra.run.smithi043.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 627 kB/s | 36 kB 00:00 2024-04-16T16:14:11.833 INFO:teuthology.orchestra.run.smithi043.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-16T16:14:11.883 INFO:teuthology.orchestra.run.smithi043.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-16T16:14:11.908 INFO:teuthology.orchestra.run.smithi043.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-16T16:14:11.950 INFO:teuthology.orchestra.run.smithi043.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 6.4 MB/s | 427 kB 00:00 2024-04-16T16:14:11.967 INFO:teuthology.orchestra.run.smithi043.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 374 kB/s | 20 kB 00:00 2024-04-16T16:14:12.001 INFO:teuthology.orchestra.run.smithi043.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-04-16T16:14:12.059 INFO:teuthology.orchestra.run.smithi043.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-16T16:14:12.220 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-16T16:14:12.535 INFO:teuthology.orchestra.run.smithi043.stdout:(150/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-04-16T16:14:12.624 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-16T16:14:12.624 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-16T16:14:12.627 INFO:teuthology.orchestra.run.smithi043.stdout:(151/174): librados2-19.0.0-2868.gc3c87ed0.el9. 5.6 MB/s | 3.4 MB 00:00 2024-04-16T16:14:12.711 INFO:teuthology.orchestra.run.smithi043.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-04-16T16:14:12.894 INFO:teuthology.orchestra.run.smithi043.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 7.2 MB/s | 1.8 MB 00:00 2024-04-16T16:14:12.920 INFO:teuthology.orchestra.run.smithi043.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 202 kB/s | 41 kB 00:00 2024-04-16T16:14:12.945 INFO:teuthology.orchestra.run.smithi043.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.9 MB/s | 248 kB 00:00 2024-04-16T16:14:12.979 INFO:teuthology.orchestra.run.smithi043.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.7 MB/s | 321 kB 00:00 2024-04-16T16:14:13.029 INFO:teuthology.orchestra.run.smithi043.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 891 kB/s | 71 kB 00:00 2024-04-16T16:14:13.054 INFO:teuthology.orchestra.run.smithi043.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 490 kB/s | 36 kB 00:00 2024-04-16T16:14:13.096 INFO:teuthology.orchestra.run.smithi043.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-16T16:14:13.138 INFO:teuthology.orchestra.run.smithi043.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-04-16T16:14:13.163 INFO:teuthology.orchestra.run.smithi043.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 349 kB/s | 23 kB 00:00 2024-04-16T16:14:13.197 INFO:teuthology.orchestra.run.smithi043.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-04-16T16:14:13.230 INFO:teuthology.orchestra.run.smithi043.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-04-16T16:14:13.256 INFO:teuthology.orchestra.run.smithi043.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-04-16T16:14:13.281 INFO:teuthology.orchestra.run.smithi043.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-04-16T16:14:13.306 INFO:teuthology.orchestra.run.smithi043.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 581 kB/s | 29 kB 00:00 2024-04-16T16:14:13.398 INFO:teuthology.orchestra.run.smithi043.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2024-04-16T16:14:13.491 INFO:teuthology.orchestra.run.smithi043.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-04-16T16:14:13.549 INFO:teuthology.orchestra.run.smithi043.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 7.9 MB/s | 465 kB 00:00 2024-04-16T16:14:13.617 INFO:teuthology.orchestra.run.smithi043.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-04-16T16:14:13.642 INFO:teuthology.orchestra.run.smithi043.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 342 kB/s | 31 kB 00:00 2024-04-16T16:14:13.709 INFO:teuthology.orchestra.run.smithi043.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-04-16T16:14:13.725 INFO:teuthology.orchestra.run.smithi043.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 900 kB/s | 74 kB 00:00 2024-04-16T16:14:15.237 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-16T16:14:15.237 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-16T16:14:16.101 INFO:teuthology.orchestra.run.smithi043.stdout:(174/174): ceph-test-19.0.0-2868.gc3c87ed0.el9. 3.2 MB/s | 49 MB 00:15 2024-04-16T16:14:16.114 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-16T16:14:16.114 INFO:teuthology.orchestra.run.smithi043.stdout:Total 9.7 MB/s | 228 MB 00:23 2024-04-16T16:14:17.308 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-16T16:14:17.700 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-16T16:14:17.700 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-16T16:14:20.288 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-16T16:14:20.288 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-16T16:14:22.816 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-16T16:14:22.925 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T16:14:23.110 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T16:14:23.153 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T16:14:23.200 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T16:14:23.292 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T16:14:23.395 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T16:14:23.491 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T16:14:23.527 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T16:14:23.613 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T16:14:24.033 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T16:14:24.083 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T16:14:24.242 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T16:14:24.294 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T16:14:24.430 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T16:14:24.475 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T16:14:24.542 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T16:14:24.916 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T16:14:24.973 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T16:14:24.997 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T16:14:25.164 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T16:14:25.198 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T16:14:25.299 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T16:14:25.351 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T16:14:25.383 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T16:14:25.449 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T16:14:25.718 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T16:14:25.759 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T16:14:25.801 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T16:14:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T16:14:26.324 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T16:14:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T16:14:26.634 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T16:14:26.685 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T16:14:27.047 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T16:14:27.244 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T16:14:27.380 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T16:14:27.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T16:14:27.453 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T16:14:27.516 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T16:14:27.640 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T16:14:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T16:14:27.759 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T16:14:27.842 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-16T16:14:27.853 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T16:14:27.905 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T16:14:27.969 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T16:14:27.976 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T16:14:28.033 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T16:14:28.037 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T16:14:28.077 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T16:14:28.078 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T16:14:28.125 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T16:14:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T16:14:28.214 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T16:14:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T16:14:28.305 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T16:14:28.329 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T16:14:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T16:14:28.390 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T16:14:28.427 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T16:14:28.465 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T16:14:28.517 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T16:14:28.525 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T16:14:28.628 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T16:14:28.814 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T16:14:28.887 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T16:14:28.946 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T16:14:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T16:14:29.163 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T16:14:29.209 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T16:14:29.338 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T16:14:29.375 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T16:14:29.446 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T16:14:29.626 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T16:14:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T16:14:29.776 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T16:14:29.833 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T16:14:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T16:14:29.857 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T16:14:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T16:14:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T16:14:30.006 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T16:14:30.034 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T16:14:30.132 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T16:14:30.178 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T16:14:30.227 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T16:14:30.304 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T16:14:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T16:14:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T16:14:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T16:14:30.633 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T16:14:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T16:14:30.679 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T16:14:30.745 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T16:14:31.096 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T16:14:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T16:14:31.265 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T16:14:31.335 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T16:14:31.339 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T16:14:31.438 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T16:14:31.495 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T16:14:31.556 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T16:14:31.603 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T16:14:31.703 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T16:14:31.760 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T16:14:31.854 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T16:14:31.950 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T16:14:31.961 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T16:14:32.001 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T16:14:32.051 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T16:14:32.122 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T16:14:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T16:14:32.167 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T16:14:32.257 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T16:14:32.258 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T16:14:32.302 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T16:14:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T16:14:32.338 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T16:14:32.400 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T16:14:32.514 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T16:14:32.524 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T16:14:32.572 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T16:14:32.598 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T16:14:32.634 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T16:14:32.646 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T16:14:32.683 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T16:14:32.750 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T16:14:32.805 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T16:14:32.815 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T16:14:32.841 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T16:14:32.882 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T16:14:32.885 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T16:14:32.915 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T16:14:32.930 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T16:14:32.938 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T16:14:32.969 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T16:14:33.041 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T16:14:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T16:14:33.141 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T16:14:33.176 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T16:14:33.202 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T16:14:33.216 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T16:14:33.321 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T16:14:33.363 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T16:14:33.381 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T16:14:33.437 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T16:14:33.483 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T16:14:33.513 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T16:14:33.597 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T16:14:33.668 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T16:14:33.727 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T16:14:33.855 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T16:14:33.923 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T16:14:34.103 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T16:14:34.158 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T16:14:34.193 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T16:14:34.251 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T16:14:34.302 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T16:14:34.336 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T16:14:34.380 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T16:14:34.426 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T16:14:34.454 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T16:14:34.457 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T16:14:34.553 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T16:14:34.582 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T16:14:34.615 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T16:14:34.676 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T16:14:34.681 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T16:14:34.745 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T16:14:34.749 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T16:14:34.779 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T16:14:34.785 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T16:14:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T16:14:34.938 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T16:14:34.940 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T16:14:34.993 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T16:14:35.042 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T16:14:35.057 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T16:14:35.117 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T16:14:35.153 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T16:14:35.213 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T16:14:35.367 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T16:14:35.445 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T16:14:35.453 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T16:14:35.679 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T16:14:35.755 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T16:14:35.841 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T16:14:36.069 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T16:14:36.126 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T16:14:36.206 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T16:14:36.299 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T16:14:36.350 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T16:14:36.391 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T16:14:36.450 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T16:14:36.488 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T16:14:36.511 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T16:14:36.550 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T16:14:36.567 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T16:14:36.601 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T16:14:36.602 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T16:14:36.660 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T16:14:36.775 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T16:14:36.796 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T16:14:36.818 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T16:14:36.854 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T16:14:36.892 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T16:14:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T16:14:37.064 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T16:14:37.070 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T16:14:37.107 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T16:14:37.107 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T16:14:37.151 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T16:14:37.180 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T16:14:37.203 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T16:14:37.248 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T16:14:37.353 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T16:14:37.535 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T16:14:37.677 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T16:14:37.725 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T16:14:37.787 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T16:14:37.896 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T16:14:38.136 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T16:14:38.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T16:14:38.212 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T16:14:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T16:14:38.387 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T16:14:38.434 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T16:14:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T16:14:38.504 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T16:14:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T16:14:38.590 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T16:14:38.642 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T16:14:38.691 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T16:14:38.732 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T16:14:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T16:14:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T16:14:38.994 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T16:14:39.345 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T16:14:39.398 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T16:14:39.564 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T16:14:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T16:14:39.748 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T16:14:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T16:14:39.842 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T16:14:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T16:14:39.995 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T16:14:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T16:14:40.069 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T16:14:40.108 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T16:14:40.138 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T16:14:40.189 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T16:14:40.568 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T16:14:40.610 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T16:14:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T16:14:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T16:14:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T16:14:41.085 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T16:14:41.139 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T16:14:41.180 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T16:14:41.232 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T16:14:41.342 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T16:14:41.381 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T16:14:41.389 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T16:14:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T16:14:41.521 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T16:14:41.547 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T16:14:41.626 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T16:14:41.653 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T16:14:41.755 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T16:14:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T16:14:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T16:14:44.283 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T16:14:44.328 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T16:14:44.366 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T16:14:44.456 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T16:14:44.494 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T16:14:44.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T16:14:44.548 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T16:14:44.968 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T16:14:44.997 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T16:14:45.009 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T16:14:45.056 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T16:14:45.118 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T16:14:45.161 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T16:14:45.229 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T16:14:45.254 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T16:14:45.255 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T16:14:45.255 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T16:14:45.255 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:14:45.299 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T16:14:45.791 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T16:14:45.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T16:14:45.949 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T16:14:45.977 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T16:14:48.741 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T16:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T16:14:49.456 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T16:14:49.501 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T16:14:49.673 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T16:14:49.674 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T16:14:49.674 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T16:14:49.674 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:14:49.719 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T16:14:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T16:14:58.422 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-04-16T16:14:58.422 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-04-16T16:14:58.422 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-04-16T16:14:58.423 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-04-16T16:14:58.423 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-04-16T16:14:58.423 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-04-16T16:14:58.423 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-04-16T16:14:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:14:58.647 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T16:14:58.694 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T16:14:58.694 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:14:58.694 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T16:14:58.694 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T16:15:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T16:15:00.438 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:00.438 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T16:15:00.438 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T16:15:00.438 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T16:15:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T16:15:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T16:15:00.791 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:00.791 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T16:15:00.791 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T16:15:00.791 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T16:15:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:01.333 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T16:15:01.415 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T16:15:01.415 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:01.415 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T16:15:01.415 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T16:15:01.415 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T16:15:01.415 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:01.544 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T16:15:02.189 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T16:15:02.228 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T16:15:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T16:15:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T16:15:02.424 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-04-16T16:15:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:03.400 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T16:15:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T16:15:03.457 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:03.457 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T16:15:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:03.783 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T16:15:03.826 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T16:15:04.986 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T16:15:05.017 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T16:15:05.143 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T16:15:05.170 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T16:15:05.237 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T16:15:05.237 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:05.237 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T16:15:05.237 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T16:15:05.238 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T16:15:05.238 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:05.349 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T16:15:05.426 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T16:15:05.501 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T16:15:05.525 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T16:15:05.525 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:05.525 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T16:15:05.525 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T16:15:05.525 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T16:15:05.525 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:05.572 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T16:15:05.572 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:05.572 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T16:15:05.572 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T16:15:05.572 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T16:15:05.572 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:05.587 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T16:15:05.631 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T16:15:05.715 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T16:15:06.086 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T16:15:06.159 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T16:15:06.159 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:06.159 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T16:15:06.159 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T16:15:06.159 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T16:15:06.159 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:06.279 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T16:15:06.770 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T16:15:06.806 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T16:15:06.893 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T16:15:06.893 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:06.893 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T16:15:06.893 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T16:15:06.893 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T16:15:06.893 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:06.931 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T16:15:06.940 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T16:15:06.972 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T16:15:07.027 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T16:15:07.039 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T16:15:07.039 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:07.039 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T16:15:07.039 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:07.124 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T16:15:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T16:15:07.176 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T16:15:07.224 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T16:15:07.224 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:07.224 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T16:15:07.224 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T16:15:07.224 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T16:15:07.224 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:07.616 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T16:15:07.700 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T16:15:07.700 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:07.700 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T16:15:07.700 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T16:15:07.700 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T16:15:07.701 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:08.539 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T16:15:08.578 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T16:15:09.734 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T16:15:09.752 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T16:15:09.904 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T16:15:10.095 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T16:15:10.122 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T16:15:10.198 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T16:15:10.198 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:10.198 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T16:15:10.198 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T16:15:10.199 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T16:15:10.199 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:10.256 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T16:15:10.296 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T16:15:10.384 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T16:15:11.467 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T16:15:11.499 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T16:15:11.574 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T16:15:11.574 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:11.574 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T16:15:11.574 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T16:15:11.574 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T16:15:11.574 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:11.625 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T16:15:11.712 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T16:15:11.712 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:11.712 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T16:15:11.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:11.801 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T16:15:11.882 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T16:15:11.882 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:11.882 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T16:15:11.882 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T16:15:11.882 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T16:15:11.882 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:12.284 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T16:15:12.359 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T16:15:12.360 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T16:15:12.360 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T16:15:12.360 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T16:15:12.360 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T16:15:12.360 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:13.059 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T16:15:13.116 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T16:15:13.157 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T16:15:13.221 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T16:15:13.510 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T16:15:13.638 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T16:15:13.690 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T16:15:13.748 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T16:15:13.806 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T16:15:13.851 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T16:15:13.882 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T16:15:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T16:15:13.996 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T16:15:14.087 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T16:15:14.201 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T16:15:14.231 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T16:15:15.132 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T16:15:15.186 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T16:15:15.246 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T16:15:16.716 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T16:15:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T16:15:16.890 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T16:15:17.061 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T16:15:17.096 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T16:15:17.130 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T16:15:17.164 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T16:15:17.207 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T16:15:17.208 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T16:15:17.384 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T16:15:17.434 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T16:15:17.435 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T16:15:17.572 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T16:15:17.611 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T16:15:17.636 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T16:15:17.670 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T16:15:17.706 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T16:15:17.711 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T16:15:17.747 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T16:15:17.754 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T16:15:17.787 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T16:15:17.870 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T16:15:17.954 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T16:15:18.000 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T16:15:18.028 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T16:15:18.034 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T16:15:18.067 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T16:15:18.130 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T16:15:18.156 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T16:15:18.167 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T16:15:18.205 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T16:15:18.206 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T16:15:18.210 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T16:15:18.268 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T16:15:18.450 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T16:15:18.528 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T16:15:18.559 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T16:15:18.560 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T16:15:18.575 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T16:15:18.625 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T16:15:18.677 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T16:15:18.715 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T16:15:18.765 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T16:15:18.766 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T16:15:18.795 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T16:15:18.832 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T16:15:18.872 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T16:15:18.883 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T16:15:18.916 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T16:15:18.995 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T16:15:19.282 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T16:15:19.283 INFO:teuthology.orchestra.run.smithi022.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-16T16:15:19.283 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:19.934 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T16:15:19.989 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T16:15:20.048 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T16:15:21.532 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T16:15:21.627 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T16:15:21.679 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T16:15:21.813 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T16:15:21.854 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T16:15:21.888 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T16:15:21.922 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T16:15:21.964 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T16:15:21.964 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T16:15:22.136 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T16:15:22.185 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T16:15:22.185 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T16:15:22.319 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T16:15:22.360 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T16:15:22.412 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T16:15:22.454 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T16:15:22.487 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T16:15:22.563 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T16:15:22.652 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T16:15:22.708 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T16:15:22.741 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T16:15:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T16:15:22.809 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T16:15:22.841 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T16:15:22.880 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T16:15:22.881 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T16:15:23.226 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T16:15:23.226 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T16:15:23.365 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T16:15:23.408 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T16:15:23.437 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T16:15:23.473 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T16:15:23.513 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T16:15:23.637 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T16:15:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T16:15:23.906 INFO:teuthology.orchestra.run.smithi043.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-16T16:15:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T16:15:24.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T16:15:24.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T16:15:24.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T16:15:24.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T16:15:24.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T16:15:24.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T16:15:24.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T16:15:24.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T16:15:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T16:15:24.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T16:15:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T16:15:24.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T16:15:24.793 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T16:15:24.794 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T16:15:24.794 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T16:15:24.794 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T16:15:24.794 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T16:15:24.794 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T16:15:24.794 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T16:15:27.364 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T16:15:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.366 INFO:teuthology.orchestra.run.smithi022.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.367 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: jq-1.6-16.el9.x86_64 2024-04-16T16:15:27.369 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.370 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T16:15:27.371 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T16:15:27.372 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T16:15:27.373 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T16:15:27.374 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T16:15:27.375 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T16:15:27.376 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T16:15:27.377 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T16:15:27.378 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T16:15:27.378 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T16:15:27.378 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T16:15:27.378 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T16:15:27.378 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:27.378 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-16T16:15:28.131 DEBUG:teuthology.parallel:result is None 2024-04-16T16:15:29.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T16:15:29.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T16:15:29.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T16:15:29.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T16:15:29.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T16:15:29.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T16:15:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T16:15:29.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T16:15:29.320 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T16:15:29.321 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T16:15:29.322 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T16:15:29.323 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T16:15:29.324 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T16:15:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T16:15:29.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T16:15:29.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T16:15:29.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T16:15:29.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T16:15:29.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T16:15:29.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T16:15:29.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T16:15:29.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T16:15:29.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T16:15:29.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T16:15:29.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T16:15:32.118 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T16:15:32.119 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.120 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.121 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: jq-1.6-16.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T16:15:32.122 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T16:15:32.123 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T16:15:32.124 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T16:15:32.125 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T16:15:32.126 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T16:15:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T16:15:32.128 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T16:15:32.129 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T16:15:32.130 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T16:15:32.130 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T16:15:32.130 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:32.130 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-16T16:15:32.833 DEBUG:teuthology.parallel:result is None 2024-04-16T16:15:32.833 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T16:15:32.972 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T16:15:33.050 INFO:teuthology.orchestra.run.smithi022.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T16:15:33.050 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T16:15:33.051 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T16:15:33.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T16:15:33.189 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T16:15:33.247 INFO:teuthology.orchestra.run.smithi043.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T16:15:33.247 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T16:15:33.248 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T16:15:33.249 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T16:15:33.249 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:33.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T16:15:33.351 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:33.351 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T16:15:33.432 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T16:15:33.432 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:33.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T16:15:33.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T16:15:33.699 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:33.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T16:15:33.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T16:15:33.900 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T16:15:33.900 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:33.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T16:15:33.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T16:15:34.140 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:34.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T16:15:34.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T16:15:34.330 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T16:15:34.331 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:34.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T16:15:34.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T16:15:34.535 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:34.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T16:15:34.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T16:15:34.714 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T16:15:34.791 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-16T16:15:34.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2024-04-16T16:15:34.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-04-16T16:15:34.895 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-16T16:15:34.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T16:15:34.900 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T16:15:34.993 INFO:tasks.ceph:Creating extra log directories... 2024-04-16T16:15:34.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T16:15:34.998 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T16:15:35.098 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-16T16:15:35.098 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-16T16:15:35.098 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-16T16:15:35.098 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:35.098 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T16:15:35.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T16:15:35.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T16:15:35.538 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:35.538 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T16:15:35.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T16:15:35.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T16:15:35.888 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-16T16:15:35.888 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T16:15:35.888 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219', 'branch': 'wip-lusov-shared-log-segment', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}}', 'email': None, 'first_in_suite': False, 'job_id': '7658219', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-shared-log-segment'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-shared-log-segment', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2402, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'sleep_before_teardown': 0, 'subset': '111/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-shared-log-segment', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi022.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPJHceKDWBWrA3P7NlLyWqCEfZ7PnHzplxQVWgsRWiLLAM52o1kV61YEqfhi+Z44Q974Yf+kh3R74I0q1qRzxE=', 'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuK7DzoqdlBifQdg4JImyaNVX1bjRkaVTmL+PsxSAWksF2pK6w3uEep/1OrX2TCA6O8pbVUHSncTFiIHceCw7I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_12:36:42', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T16:15:35.889 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T16:15:35.896 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T16:15:35.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T16:15:35.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T16:15:36.055 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:36.055 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T16:15:36.112 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T16:15:36.112 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-04-16T16:15:36.167 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T16:15:36.167 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:36.167 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-16T16:15:36.167 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:36.168 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:36.168 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-16 16:15:19.773122933 +0000 2024-04-16T16:15:36.168 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-16 16:12:47.465070456 +0000 2024-04-16T16:15:36.168 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-16 16:12:47.465070456 +0000 2024-04-16T16:15:36.168 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-04-16 16:12:47.465070456 +0000 2024-04-16T16:15:36.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T16:15:36.256 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:15:36.256 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:15:36.256 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000219808 s, 2.3 MB/s 2024-04-16T16:15:36.259 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T16:15:36.317 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-04-16T16:15:36.370 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-16 16:15:19.774122920 +0000 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-16 16:12:48.070062614 +0000 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-16 16:12:48.070062614 +0000 2024-04-16T16:15:36.371 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-04-16 16:12:48.070062614 +0000 2024-04-16T16:15:36.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T16:15:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:15:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:15:36.462 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00022954 s, 2.2 MB/s 2024-04-16T16:15:36.466 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T16:15:36.527 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-16 16:15:19.775122907 +0000 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-16 16:12:48.691054565 +0000 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-16 16:12:48.691054565 +0000 2024-04-16T16:15:36.582 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-04-16 16:12:48.691054565 +0000 2024-04-16T16:15:36.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T16:15:36.676 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:15:36.677 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:15:36.677 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00025958 s, 2.0 MB/s 2024-04-16T16:15:36.681 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T16:15:36.741 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-04-16T16:15:36.795 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-16 16:15:19.776122894 +0000 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-16 16:12:49.330046283 +0000 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-16 16:12:49.330046283 +0000 2024-04-16T16:15:36.796 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-04-16 16:12:49.330046283 +0000 2024-04-16T16:15:36.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T16:15:36.892 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:15:36.892 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:15:36.892 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000255471 s, 2.0 MB/s 2024-04-16T16:15:36.897 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T16:15:36.954 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:36.954 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:36.954 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T16:15:37.015 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T16:15:37.015 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-04-16T16:15:37.064 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T16:15:37.064 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:37.064 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-16T16:15:37.064 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:37.065 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:37.065 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-16 16:15:24.367116822 +0000 2024-04-16T16:15:37.065 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-16 16:12:47.481204768 +0000 2024-04-16T16:15:37.065 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-16 16:12:47.481204768 +0000 2024-04-16T16:15:37.065 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-16 16:12:47.481204768 +0000 2024-04-16T16:15:37.065 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T16:15:37.156 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-16T16:15:37.156 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-16T16:15:37.156 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000557374 s, 919 kB/s 2024-04-16T16:15:37.160 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T16:15:37.211 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-04-16T16:15:37.263 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T16:15:37.263 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:37.263 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-16T16:15:37.264 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:37.264 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:37.264 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-16 16:15:24.367116822 +0000 2024-04-16T16:15:37.264 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-16 16:12:48.087197358 +0000 2024-04-16T16:15:37.264 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-16 16:12:48.087197358 +0000 2024-04-16T16:15:37.264 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-16 16:12:48.087197358 +0000 2024-04-16T16:15:37.264 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T16:15:37.350 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-16T16:15:37.350 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-16T16:15:37.350 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000269615 s, 1.9 MB/s 2024-04-16T16:15:37.354 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T16:15:37.408 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-04-16T16:15:37.458 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T16:15:37.458 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:37.458 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-16T16:15:37.458 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:37.458 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:37.458 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-16 16:15:24.369116797 +0000 2024-04-16T16:15:37.459 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-16 16:12:48.736189422 +0000 2024-04-16T16:15:37.459 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-16 16:12:48.736189422 +0000 2024-04-16T16:15:37.459 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-16 16:12:48.736189422 +0000 2024-04-16T16:15:37.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T16:15:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-16T16:15:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-16T16:15:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000256218 s, 2.0 MB/s 2024-04-16T16:15:37.554 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T16:15:37.611 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-04-16T16:15:37.663 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T16:15:37.663 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T16:15:37.663 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-16T16:15:37.664 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T16:15:37.664 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T16:15:37.664 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-16 16:15:24.370116785 +0000 2024-04-16T16:15:37.664 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-16 16:12:49.351181901 +0000 2024-04-16T16:15:37.664 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-16 16:12:49.351181901 +0000 2024-04-16T16:15:37.664 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-16 16:12:49.351181901 +0000 2024-04-16T16:15:37.664 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T16:15:37.755 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-16T16:15:37.755 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-16T16:15:37.755 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000283245 s, 1.8 MB/s 2024-04-16T16:15:37.760 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T16:15:37.820 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:37.820 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T16:15:37.820 INFO:tasks.ceph:Generating config... 2024-04-16T16:15:37.822 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-16T16:15:37.822 INFO:tasks.ceph:[client] debug client = 20 2024-04-16T16:15:37.822 INFO:tasks.ceph:[client] debug ms = 1 2024-04-16T16:15:37.822 INFO:tasks.ceph:[client] pid file = 2024-04-16T16:15:37.822 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-16T16:15:37.822 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-16T16:15:37.822 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-16T16:15:37.822 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-16T16:15:37.822 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-16T16:15:37.822 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-16T16:15:37.822 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-16T16:15:37.822 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-16T16:15:37.822 INFO:tasks.ceph:[mds] mds debug zombie log segments = True 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-16T16:15:37.823 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-16T16:15:37.823 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-16T16:15:37.824 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-16T16:15:37.825 INFO:tasks.ceph:Setting up mon.a... 2024-04-16T16:15:37.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-16T16:15:37.976 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2024-04-16T16:15:37.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-16T16:15:38.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T16:15:38.215 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22'), ('mon.b', '172.21.15.43'), ('mon.c', '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]')] 2024-04-16T16:15:38.215 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.22,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-16T16:15:38.216 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:38.216 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T16:15:38.271 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.22 --add b 172.21.15.43 --addv c '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:38.427 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:38.427 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid 96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf 2024-04-16T16:15:38.427 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-04-16T16:15:38.427 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2024-04-16T16:15:38.427 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf 2024-04-16T16:15:38.427 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2024-04-16T16:15:38.429116+0000 2024-04-16T16:15:38.428 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-04-16T16:15:38.429116+0000 2024-04-16T16:15:38.428 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 17 (quincy) 2024-04-16T16:15:38.428 INFO:teuthology.orchestra.run.smithi022.stdout:election_strategy: 1 2024-04-16T16:15:38.428 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-04-16T16:15:38.428 INFO:teuthology.orchestra.run.smithi022.stdout:1: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-04-16T16:15:38.428 INFO:teuthology.orchestra.run.smithi022.stdout:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-04-16T16:15:38.428 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-16T16:15:38.431 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T16:15:38.485 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf... 2024-04-16T16:15:38.486 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T16:15:38.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T16:15:38.660 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-04-16T16:15:38.660 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2024-04-16T16:15:38.660 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T16:15:38.660 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2024-04-16T16:15:38.660 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T16:15:38.661 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2024-04-16T16:15:38.662 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "172.21.15.22,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on skipped message = False 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2024-04-16T16:15:38.663 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock profile = high_recovery_ops 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug trim objects = true 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.664 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: bdev async discard = True 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: bdev enable discard = True 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore allocator = bitmap 2024-04-16T16:15:38.665 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 1/20 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 1/20 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 4/10 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2024-04-16T16:15:38.666 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug finisher = 20 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-04-16T16:15:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T16:15:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: # 1m isn't quite enough 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: mon_down_mkfs_grace = 2m 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_filestore_osds = false 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: mon down mkfs grace = 300 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: mon op complaint time = 120 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T16:15:38.669 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout: client mount timeout = 600 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = "" 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:[mds] 2024-04-16T16:15:38.670 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds = 20 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds balancer = 20 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug frag = True 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug scatterstat = True 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug zombie log segments = True 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: mds op complaint time = 180 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: mds verify scatter = True 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2024-04-16T16:15:38.671 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-04-16T16:15:38.678 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-04-16T16:15:38.679 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-04-16T16:15:38.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.22,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.681 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-04-16T16:15:38.682 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-16T16:15:38.683 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-16T16:15:38.684 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: debug finisher = 20 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.685 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: mon op complaint time = 120 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-04-16T16:15:38.686 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: client mount timeout = 600 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-16T16:15:38.687 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds = 20 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds balancer = 20 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug frag = True 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = True 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug zombie log segments = True 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: mds op complaint time = 180 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = True 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2024-04-16T16:15:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2024-04-16T16:15:38.723 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-16T16:15:38.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-16T16:15:38.877 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T16:15:38.877 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:38.877 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-16T16:15:38.932 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:38.932 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-16T16:15:38.984 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:15:38.984 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:38.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T16:15:38.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T16:15:39.142 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:15:39.142 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:39.242 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:15:39.242 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:39.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T16:15:39.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T16:15:39.407 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:15:39.407 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:39.508 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T16:15:39.508 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T16:15:39.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T16:15:39.695 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T16:15:39.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T16:15:39.913 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T16:15:39.925 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T16:15:39.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T16:15:40.131 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T16:15:40.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-16T16:15:40.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T16:15:40.416 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T16:15:40.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-16T16:15:40.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T16:15:40.712 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T16:15:40.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-16T16:15:40.822 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T16:15:41.016 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T16:15:41.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-16T16:15:41.126 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T16:15:41.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-16T16:15:41.265 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-16T16:15:41.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-16T16:15:41.463 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-16T16:15:41.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-16T16:15:41.665 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-16T16:15:41.720 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-16T16:15:41.852 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-16T16:15:41.905 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T16:15:41.906 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T16:15:41.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-16T16:15:42.001 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:42.001 INFO:tasks.ceph:role: osd.0 2024-04-16T16:15:42.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:15:42.001 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:42.097 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:42.098 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:42.098 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:42.131 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-04-16T16:15:42.138 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-04-16T16:15:42.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-16T16:15:42.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-16T16:15:42.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-16T16:15:42.422 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:42.422 INFO:tasks.ceph:role: osd.1 2024-04-16T16:15:42.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:15:42.422 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T16:15:42.507 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:42.507 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:42.507 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:42.507 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:42.507 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:42.508 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:42.508 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:42.508 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:42.508 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:42.508 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:42.542 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-04-16T16:15:42.547 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-04-16T16:15:42.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-16T16:15:42.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-16T16:15:42.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-16T16:15:42.812 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:42.813 INFO:tasks.ceph:role: osd.2 2024-04-16T16:15:42.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:15:42.813 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T16:15:42.895 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:42.895 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:42.895 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:42.895 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:42.896 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:42.896 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:42.896 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:42.896 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:42.896 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:42.896 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:42.930 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-04-16T16:15:42.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-04-16T16:15:42.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-16T16:15:43.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-16T16:15:43.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-16T16:15:43.197 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:43.197 INFO:tasks.ceph:role: osd.3 2024-04-16T16:15:43.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:15:43.197 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:43.272 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:43.305 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-04-16T16:15:43.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-04-16T16:15:43.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-16T16:15:43.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-16T16:15:43.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:43.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:43.656+0000 7f289880e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-16T16:15:43.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:43.656+0000 7f289880e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-16T16:15:43.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:43.656+0000 7f289880e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T16:15:43.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:43.656+0000 7f289880e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T16:15:43.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:43.656+0000 7f289880e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T16:15:43.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:43.660+0000 7f289880e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-16T16:15:46.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T16:15:46.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:46.865+0000 7f21b700f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-16T16:15:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:46.866+0000 7f21b700f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-16T16:15:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:46.866+0000 7f21b700f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T16:15:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:46.866+0000 7f21b700f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T16:15:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:46.866+0000 7f21b700f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T16:15:46.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:46.869+0000 7f21b700f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-16T16:15:49.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T16:15:49.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:50.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:50.099+0000 7f23bb124640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-16T16:15:50.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:50.099+0000 7f23bb124640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-16T16:15:50.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:50.099+0000 7f23bb124640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T16:15:50.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:50.099+0000 7f23bb124640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T16:15:50.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:50.099+0000 7f23bb124640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T16:15:50.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:50.101+0000 7f23bb124640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-16T16:15:53.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T16:15:53.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:53.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:53.339+0000 7f45ace14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-16T16:15:53.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:53.339+0000 7f45ace14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-16T16:15:53.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:53.339+0000 7f45ace14640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T16:15:53.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:53.339+0000 7f45ace14640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T16:15:53.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:53.339+0000 7f45ace14640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T16:15:53.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:15:53.342+0000 7f45ace14640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-16T16:15:56.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T16:15:56.426 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-16T16:15:56.535 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:56.535 INFO:tasks.ceph:role: osd.4 2024-04-16T16:15:56.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:15:56.536 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T16:15:56.632 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:56.632 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:56.632 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:56.632 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:56.632 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:56.633 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:56.633 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:56.633 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:56.633 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:56.633 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:56.666 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-16T16:15:56.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-16T16:15:56.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-16T16:15:56.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-16T16:15:56.882 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-16T16:15:56.965 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:56.966 INFO:tasks.ceph:role: osd.5 2024-04-16T16:15:56.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:15:56.966 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:57.059 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:57.093 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-16T16:15:57.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-16T16:15:57.098 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-16T16:15:57.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-16T16:15:57.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-16T16:15:57.368 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:57.368 INFO:tasks.ceph:role: osd.6 2024-04-16T16:15:57.368 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:15:57.368 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T16:15:57.461 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:57.461 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:57.462 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:57.462 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:57.462 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:57.496 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-16T16:15:57.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-16T16:15:57.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-16T16:15:57.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-16T16:15:57.698 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-16T16:15:57.785 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T16:15:57.785 INFO:tasks.ceph:role: osd.7 2024-04-16T16:15:57.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:15:57.786 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T16:15:57.877 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T16:15:57.911 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-16T16:15:57.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-16T16:15:57.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-16T16:15:58.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-16T16:15:58.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:15:58.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:15:58.294+0000 7fe925106640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-16T16:15:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:15:58.295+0000 7fe925106640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-16T16:15:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:15:58.295+0000 7fe925106640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T16:15:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:15:58.295+0000 7fe925106640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T16:15:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:15:58.295+0000 7fe925106640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T16:15:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:15:58.298+0000 7fe925106640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-16T16:16:01.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T16:16:01.341 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:16:01.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:01.487+0000 7f3c27c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-16T16:16:01.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:01.488+0000 7f3c27c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-16T16:16:01.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:01.488+0000 7f3c27c11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T16:16:01.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:01.488+0000 7f3c27c11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T16:16:01.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:01.488+0000 7f3c27c11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T16:16:01.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:01.490+0000 7f3c27c11640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-16T16:16:04.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T16:16:04.573 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:16:04.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:04.719+0000 7f49e3a0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-16T16:16:04.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:04.720+0000 7f49e3a0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-16T16:16:04.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:04.720+0000 7f49e3a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T16:16:04.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:04.720+0000 7f49e3a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T16:16:04.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:04.720+0000 7f49e3a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T16:16:04.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:04.722+0000 7f49e3a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-16T16:16:05.890 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:16:05.898 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:16:07.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-16T16:16:08.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:16:08.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:08.194+0000 7fd86d411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-16T16:16:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:08.195+0000 7fd86d411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-16T16:16:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:08.195+0000 7fd86d411640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T16:16:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:08.195+0000 7fd86d411640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T16:16:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:08.195+0000 7fd86d411640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T16:16:08.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:08.198+0000 7fd86d411640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-16T16:16:11.416 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-16T16:16:11.517 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T16:16:11.518 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:11.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-16T16:16:11.623 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:11.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-16T16:16:11.720 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:11.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-16T16:16:11.821 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:11.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-16T16:16:11.924 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:11.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-16T16:16:12.022 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:12.022 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-16T16:16:12.122 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:12.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-16T16:16:12.228 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:12.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-16T16:16:12.331 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:12.332 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-16T16:16:12.430 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:12.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-16T16:16:12.532 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:12.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-16T16:16:12.637 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:12.637 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-16T16:16:12.736 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:12.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-16T16:16:12.834 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:12.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-16T16:16:12.930 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:12.930 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-16T16:16:12.991 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:12.991 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-16T16:16:13.050 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:13.050 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-16T16:16:13.108 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:13.108 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-16T16:16:13.164 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T16:16:13.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T16:16:13.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T16:16:13.262 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2024-04-16T16:16:13.262 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQArpB5mcdOSKRAAF92yoRpysHC1g6FsLdqIYw== 2024-04-16T16:16:13.262 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2024-04-16T16:16:13.262 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAspB5maPz2BxAAivyrcX8Q0RVwbHZKA4d4Qw== 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAspB5mqenxGBAAjtp8wD4KQJxzHvXwFiGhOw== 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAvpB5mOTo2JxAAv8ODGhoblmotI4MCQe6yFg== 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAypB5m+sawMxAAnAne7tM6gWBZtKrFrv53WA== 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQA2pB5mr/n9BRAA8Cg5a95OxPY//SZrLgt5iQ== 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQA5pB5mzNRPFBAArNK/lgB2DkkAP/cZ8uD+Vg== 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQArpB5mApKSNhAAAgDOhVl6JdS2WqfiNmMpQQ== 2024-04-16T16:16:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAspB5mWRiSKhAANQmBIwdBnXhI5EGtK2c86g== 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5mjhgTARAAGaEgDRX6W3PVFW0MCREAlg== 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQA+pB5mW52mERAAub8dzTaWbs/HB3ZLiwua+Q== 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBBpB5mXWImHRAAWuZAlqR/+YQikJD4n34FUQ== 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBEpB5mgBf6KhAAqcT5kTzdBSoQR6+MdHRIBA== 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBIpB5mhwmwCxAA33jQ9ARJ1dCc0D2CjzyaZA== 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-04-16T16:16:13.264 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw== 2024-04-16T16:16:13.265 INFO:teuthology.orchestra.run.smithi022.stdout:[client.2] 2024-04-16T16:16:13.265 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5mfNS0GxAAeD6JDkePBk6Zlda+ku47+g== 2024-04-16T16:16:13.265 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2024-04-16T16:16:13.265 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5mnxe/JxAAbmM9S9qN7oeLgRvCGkAxMA== 2024-04-16T16:16:13.265 INFO:teuthology.orchestra.run.smithi022.stdout:[client.3] 2024-04-16T16:16:13.265 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5mumHtMhAA4utGeU4f5JWOEHCvpo3Onw== 2024-04-16T16:16:13.266 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-04-16T16:16:13.266 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQArpB5mcdOSKRAAF92yoRpysHC1g6FsLdqIYw== 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAspB5maPz2BxAAivyrcX8Q0RVwbHZKA4d4Qw== 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAspB5mqenxGBAAjtp8wD4KQJxzHvXwFiGhOw== 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAvpB5mOTo2JxAAv8ODGhoblmotI4MCQe6yFg== 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAypB5m+sawMxAAnAne7tM6gWBZtKrFrv53WA== 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQA2pB5mr/n9BRAA8Cg5a95OxPY//SZrLgt5iQ== 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQA5pB5mzNRPFBAArNK/lgB2DkkAP/cZ8uD+Vg== 2024-04-16T16:16:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQArpB5mApKSNhAAAgDOhVl6JdS2WqfiNmMpQQ== 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAspB5mWRiSKhAANQmBIwdBnXhI5EGtK2c86g== 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAtpB5mjhgTARAAGaEgDRX6W3PVFW0MCREAlg== 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQA+pB5mW52mERAAub8dzTaWbs/HB3ZLiwua+Q== 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBBpB5mXWImHRAAWuZAlqR/+YQikJD4n34FUQ== 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBEpB5mgBf6KhAAqcT5kTzdBSoQR6+MdHRIBA== 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBIpB5mhwmwCxAA33jQ9ARJ1dCc0D2CjzyaZA== 2024-04-16T16:16:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-04-16T16:16:13.269 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw== 2024-04-16T16:16:13.269 INFO:teuthology.orchestra.run.smithi043.stdout:[client.2] 2024-04-16T16:16:13.269 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAtpB5mfNS0GxAAeD6JDkePBk6Zlda+ku47+g== 2024-04-16T16:16:13.269 INFO:teuthology.orchestra.run.smithi043.stdout:[client.1] 2024-04-16T16:16:13.269 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAtpB5mnxe/JxAAbmM9S9qN7oeLgRvCGkAxMA== 2024-04-16T16:16:13.269 INFO:teuthology.orchestra.run.smithi043.stdout:[client.3] 2024-04-16T16:16:13.269 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAtpB5mumHtMhAA4utGeU4f5JWOEHCvpo3Onw== 2024-04-16T16:16:13.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T16:16:13.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T16:16:13.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:13.441 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:13.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:13.600 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:13.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:13.767 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:13.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:13.927 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:14.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:14.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:14.223 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:14.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:14.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T16:16:14.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T16:16:14.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:14.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:14.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:14.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T16:16:14.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:14.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:15.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:15.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:15.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:15.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:15.322 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:15.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T16:16:15.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:15.481 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:15.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:15.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:15.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:15.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:15.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:15.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T16:16:16.128 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T16:16:16.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-16T16:16:16.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T16:16:16.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-16T16:16:16.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-16T16:16:16.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T16:16:16.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-16T16:16:16.829 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-16T16:16:16.927 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T16:16:17.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-16T16:16:17.179 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:16:17.187 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T16:16:17.243 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-16T16:16:17.243 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-16T16:16:17.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-16T16:16:17.250 INFO:tasks.ceph.mon.a:Started 2024-04-16T16:16:17.251 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-16T16:16:17.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-16T16:16:17.256 INFO:tasks.ceph.mon.b:Started 2024-04-16T16:16:17.256 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-16T16:16:17.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-16T16:16:17.261 INFO:tasks.ceph.mon.c:Started 2024-04-16T16:16:17.262 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-16T16:16:17.262 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-16T16:16:17.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-16T16:16:17.269 INFO:tasks.ceph.mgr.y:Started 2024-04-16T16:16:17.270 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-16T16:16:17.270 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-16T16:16:17.274 INFO:tasks.ceph.mgr.x:Started 2024-04-16T16:16:17.275 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T16:16:17.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2024-04-16T16:16:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.461+0000 7f901da00640 1 Processor -- start 2024-04-16T16:16:17.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.461+0000 7f901da00640 1 -- start start 2024-04-16T16:16:17.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.462+0000 7f901da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:17.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.462+0000 7f901da00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:17.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.462+0000 7f901da00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90180b5a70 con 0x7f90180b41a0 2024-04-16T16:16:17.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.462+0000 7f901da00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9018071700 con 0x7f90180b2b30 2024-04-16T16:16:17.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.462+0000 7f901da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9018072b00 con 0x7f9018164030 2024-04-16T16:16:17.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9016a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:17.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9017400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:17.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9016a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:36660/0 (socket says 172.21.15.22:36660) 2024-04-16T16:16:17.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 learned_addr learned my addr 172.21.15.22:0/2000043953 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:17.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T16:16:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T16:16:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T16:16:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.463+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.664+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.664+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.664+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.664+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.664+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.665+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.665+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.665+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.665+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:17.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:17.665+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.066+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.066+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:18.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.067+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T16:16:18.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.868+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T16:16:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:18.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T16:16:18.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T16:16:18.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:18.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:18.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:18.869+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.462+0000 7f9014c00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180711c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.462+0000 7f9014c00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180711c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.462+0000 7f9014c00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 msgr2=0x7f9018160160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.462+0000 7f9014c00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.22:3300/0 conn(0x7f90180b2b30 0x7f9018160160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.462+0000 7f9014c00640 1 -- 172.21.15.22:0/2000043953 >> v1:172.21.15.22:6789/0 conn(0x7f90180b41a0 legacy=0x7f90180b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.463+0000 7f9014c00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.463+0000 7f9014c00640 1 -- 172.21.15.22:0/2000043953 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9018164410 con 0x7f8ff40036a0 2024-04-16T16:16:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.463+0000 7f9014c00640 1 -- 172.21.15.22:0/2000043953 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9018071700 con 0x7f8ff4007350 2024-04-16T16:16:20.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.464+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:20.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.464+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T16:16:20.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.464+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:20.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.464+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:20.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.464+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T16:16:20.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.665+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:20.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.666+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T16:16:20.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.666+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:20.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.666+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:20.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:20.666+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T16:16:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.068+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.068+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T16:16:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.068+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.068+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.068+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T16:16:21.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.870+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:21.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.870+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T16:16:21.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.870+0000 7f900fe00640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T16:16:21.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.870+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T16:16:21.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:21.870+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T16:16:22.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.512+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673625267 0 0) 0x7f9018164410 con 0x7f8ff40036a0 2024-04-16T16:16:22.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.512+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ffc003520 con 0x7f8ff40036a0 2024-04-16T16:16:22.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.518+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 <== mon.1 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3241730424 0 0) 0x7f8ffc003520 con 0x7f8ff40036a0 2024-04-16T16:16:22.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.518+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 msgr2=0x7f8ff40097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T16:16:22.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.518+0000 7f9016000640 1 --2- 172.21.15.22:0/2000043953 >> v2:172.21.15.43:3300/0 conn(0x7f8ff4007350 0x7f8ff40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.518+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff400aef0 con 0x7f8ff40036a0 2024-04-16T16:16:22.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.518+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 <== mon.1 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f900800f040 con 0x7f8ff40036a0 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.518+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 >> v1:172.21.15.43:6789/0 conn(0x7f8ff40036a0 legacy=0x7f8ff4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.519+0000 7f9017400640 1 -- 172.21.15.22:0/2000043953 reap_dead start 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.519+0000 7f9016000640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f8ffc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.519+0000 7f9016000640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f8ffc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.519+0000 7f9016000640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f8ffc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.519+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9018071700 con 0x7f8ffc004e60 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.519+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc005680 con 0x7f8ffc004060 2024-04-16T16:16:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.519+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc00bf00 con 0x7f9018164030 2024-04-16T16:16:22.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.520+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f8ffc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:22.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.520+0000 7f900fe00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f8ffc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:22.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.521+0000 7f9017400640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f8ffc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:22.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.521+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 msgr2=0x7f8ffc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:22.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.521+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f8ffc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.521+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 msgr2=0x7f8ffc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.521+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f8ffc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.521+0000 7f9016a00640 1 -- 172.21.15.22:0/2000043953 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc003520 con 0x7f9018164030 2024-04-16T16:16:22.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.526+0000 7f9016a00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f8ffc003a00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f900800cf60 tx=0x7f8ffc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b1e87bbd65af28 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:22.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.527+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008033070 con 0x7f9018164030 2024-04-16T16:16:22.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.527+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900802d8e0 con 0x7f9018164030 2024-04-16T16:16:22.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.527+0000 7f9016000640 1 -- 172.21.15.22:0/2000043953 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900800cbb0 con 0x7f9018164030 2024-04-16T16:16:22.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.528+0000 7f901da00640 1 -- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f8ffc003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:22.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.528+0000 7f901da00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f8ffc003a00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f900800cf60 tx=0x7f8ffc005830 comp rx=0 tx=0).stop 2024-04-16T16:16:22.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.528+0000 7f901da00640 1 -- 172.21.15.22:0/2000043953 shutdown_connections 2024-04-16T16:16:22.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.528+0000 7f901da00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f8ffc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.528+0000 7f901da00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f8ffc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.528+0000 7f901da00640 1 --2- 172.21.15.22:0/2000043953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f8ffc003a00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.528+0000 7f901da00640 1 -- 172.21.15.22:0/2000043953 >> 172.21.15.22:0/2000043953 conn(0x7f9018062440 msgr2=0x7f9018062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:22.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.529+0000 7f901da00640 1 -- 172.21.15.22:0/2000043953 shutdown_connections 2024-04-16T16:16:22.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.529+0000 7f901da00640 1 -- 172.21.15.22:0/2000043953 wait complete. 2024-04-16T16:16:22.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.532+0000 7f901da00640 1 Processor -- start 2024-04-16T16:16:22.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.533+0000 7f901da00640 1 -- start start 2024-04-16T16:16:22.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.534+0000 7f901da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f9018158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:22.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.534+0000 7f901da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f90180b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.534+0000 7f901da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.534+0000 7f901da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9018072d30 con 0x7f8ffc004e60 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.534+0000 7f901da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90180b5290 con 0x7f8ffc004060 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.534+0000 7f901da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9018073010 con 0x7f9018164030 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9017400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9016a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f9018158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9017400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:43834/0 (socket says 172.21.15.22:43834) 2024-04-16T16:16:22.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9017400640 1 -- 172.21.15.22:0/4175615976 learned_addr learned my addr 172.21.15.22:0/4175615976 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:22.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f900fe00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f90180b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:22.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9016a00640 1 -- 172.21.15.22:0/4175615976 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 msgr2=0x7f90180b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:22.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9016a00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9016a00640 1 -- 172.21.15.22:0/4175615976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 msgr2=0x7f90180b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9016a00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f90180b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.535+0000 7f9016a00640 1 -- 172.21.15.22:0/4175615976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90180b1450 con 0x7f8ffc004060 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.536+0000 7f9016a00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f9018158e90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9008035000 tx=0x7f90080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.536+0000 7f900ea00640 1 -- 172.21.15.22:0/4175615976 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008046020 con 0x7f8ffc004060 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.536+0000 7f900ea00640 1 -- 172.21.15.22:0/4175615976 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008040660 con 0x7f8ffc004060 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.536+0000 7f900ea00640 1 -- 172.21.15.22:0/4175615976 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900800f040 con 0x7f8ffc004060 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.536+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90180b1730 con 0x7f8ffc004060 2024-04-16T16:16:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.536+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901815a830 con 0x7f8ffc004060 2024-04-16T16:16:22.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.537+0000 7f900ea00640 1 -- 172.21.15.22:0/4175615976 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9008049020 con 0x7f8ffc004060 2024-04-16T16:16:22.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.537+0000 7f900ea00640 1 -- 172.21.15.22:0/4175615976 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9008042d70 con 0x7f8ffc004060 2024-04-16T16:16:22.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.538+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901804fd90 con 0x7f8ffc004060 2024-04-16T16:16:22.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.542+0000 7f900ea00640 1 -- 172.21.15.22:0/4175615976 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9008050030 con 0x7f8ffc004060 2024-04-16T16:16:22.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.620+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f90180b1140 con 0x7f8ffc004060 2024-04-16T16:16:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.627+0000 7f900ea00640 1 -- 172.21.15.22:0/4175615976 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f900800cc30 con 0x7f8ffc004060 2024-04-16T16:16:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.628+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 msgr2=0x7f9018158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.628+0000 7f901da00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f9018158e90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9008035000 tx=0x7f90080046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.629+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 shutdown_connections 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.629+0000 7f901da00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9018164030 0x7f90180b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.629+0000 7f901da00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc004e60 0x7f90180b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.629+0000 7f901da00640 1 --2- 172.21.15.22:0/4175615976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ffc004060 0x7f9018158e90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.629+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 >> 172.21.15.22:0/4175615976 conn(0x7f9018062440 msgr2=0x7f9018161af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.629+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 shutdown_connections 2024-04-16T16:16:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:22.629+0000 7f901da00640 1 -- 172.21.15.22:0/4175615976 wait complete. 2024-04-16T16:16:22.646 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T16:16:22.647 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-16T16:16:22.647 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:22.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-16T16:16:22.729 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:22.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-16T16:16:22.866 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:22.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-16T16:16:22.962 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:16:22.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-16T16:16:23.052 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:23.052 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-16T16:16:23.133 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:23.134+0000 7f0568a37040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T16:16:23.148 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:23.148 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-16T16:16:23.148 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:23.148+0000 7ff900a3a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T16:16:23.199 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:23.201+0000 7f0568a37040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T16:16:23.218 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:23.219+0000 7ff900a3a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T16:16:23.237 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:23.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-16T16:16:23.328 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:16:23.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-16T16:16:23.462 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e 0 2024-04-16T16:16:23.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.657+0000 7f2cbea00640 1 Processor -- start 2024-04-16T16:16:23.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.657+0000 7f2cbea00640 1 -- start start 2024-04-16T16:16:23.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2cbea00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2cb8155cb0 0x7f2cb8162780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb815fa00 0x7f2cb80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2cbea00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb8156090 con 0x7f2cb815fe80 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2cbea00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb8163100 con 0x7f2cb8155cb0 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2cbea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb8072df0 con 0x7f2cb815fa00 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2cb7e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2cb8155cb0 0x7f2cb8162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2caf400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb815fa00 0x7f2cb80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2caf400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb815fa00 0x7f2cb80b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:44174/0 (socket says 172.21.15.43:44174) 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.659+0000 7f2cb7e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2cb8155cb0 0x7f2cb8162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52586/0 (socket says 172.21.15.43:52586) 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.660+0000 7f2caf400640 1 -- 172.21.15.43:0/22118945 learned_addr learned my addr 172.21.15.43:0/22118945 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.660+0000 7f2caf400640 1 -- 172.21.15.43:0/22118945 >> v2:172.21.15.43:3300/0 conn(0x7f2cb8155cb0 msgr2=0x7f2cb8162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:23.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.660+0000 7f2caf400640 1 --2- 172.21.15.43:0/22118945 >> v2:172.21.15.43:3300/0 conn(0x7f2cb8155cb0 0x7f2cb8162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.660+0000 7f2caf400640 1 -- 172.21.15.43:0/22118945 >> v1:172.21.15.22:6789/0 conn(0x7f2cb815fe80 legacy=0x7f2cb8062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.660+0000 7f2caf400640 1 -- 172.21.15.43:0/22118945 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb80730d0 con 0x7f2cb815fa00 2024-04-16T16:16:23.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.660+0000 7f2cb7e00640 1 --2- 172.21.15.43:0/22118945 >> v2:172.21.15.43:3300/0 conn(0x7f2cb8155cb0 0x7f2cb8162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:23.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.661+0000 7f2caf400640 1 --2- 172.21.15.43:0/22118945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb815fa00 0x7f2cb80b61a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009870 tx=0x7f2ca002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e2b3a49f7536a0c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:23.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cb7400640 1 -- 172.21.15.43:0/22118945 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0035020 con 0x7f2cb815fa00 2024-04-16T16:16:23.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cb7400640 1 -- 172.21.15.43:0/22118945 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca0031640 con 0x7f2cb815fa00 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cb7400640 1 -- 172.21.15.43:0/22118945 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca002d040 con 0x7f2cb815fa00 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cbea00640 1 -- 172.21.15.43:0/22118945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb815fa00 msgr2=0x7f2cb80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cbea00640 1 --2- 172.21.15.43:0/22118945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb815fa00 0x7f2cb80b61a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009870 tx=0x7f2ca002b8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cbea00640 1 -- 172.21.15.43:0/22118945 shutdown_connections 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cbea00640 1 --2- 172.21.15.43:0/22118945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb815fa00 0x7f2cb80b61a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cbea00640 1 --2- 172.21.15.43:0/22118945 >> v2:172.21.15.43:3300/0 conn(0x7f2cb8155cb0 0x7f2cb8162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cbea00640 1 -- 172.21.15.43:0/22118945 >> 172.21.15.43:0/22118945 conn(0x7f2cb80b3410 msgr2=0x7f2cb80b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.662+0000 7f2cbea00640 1 -- 172.21.15.43:0/22118945 shutdown_connections 2024-04-16T16:16:23.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.663+0000 7f2cbea00640 1 -- 172.21.15.43:0/22118945 wait complete. 2024-04-16T16:16:23.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.664+0000 7f2cbea00640 1 Processor -- start 2024-04-16T16:16:23.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.664+0000 7f2cbea00640 1 -- start start 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.665+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb8155cb0 0x7f2cb80d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.665+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb815fa00 0x7f2cb8152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.665+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb815fe80 0x7f2cb80b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.665+0000 7f2cbea00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb8162e00 con 0x7f2cb815fa00 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.665+0000 7f2cbea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb815f4e0 con 0x7f2cb815fe80 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.665+0000 7f2cbea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb815f140 con 0x7f2cb8155cb0 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb8155cb0 0x7f2cb80d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb8155cb0 0x7f2cb80d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:44188/0 (socket says 172.21.15.43:44188) 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 -- 172.21.15.43:0/3833929639 learned_addr learned my addr 172.21.15.43:0/3833929639 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cbca00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb815fe80 0x7f2cb80b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2caf400640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb815fa00 0x7f2cb8152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 -- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb815fe80 msgr2=0x7f2cb80b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb815fe80 0x7f2cb80b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 -- 172.21.15.43:0/3833929639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb815fa00 msgr2=0x7f2cb8152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb815fa00 0x7f2cb8152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 -- 172.21.15.43:0/3833929639 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb8151940 con 0x7f2cb8155cb0 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2caf400640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb815fa00 0x7f2cb8152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.666+0000 7f2cb7e00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb8155cb0 0x7f2cb80d0570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800efc0 tx=0x7f2ca800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.667+0000 7f2cb4c00640 1 -- 172.21.15.43:0/3833929639 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8018020 con 0x7f2cb8155cb0 2024-04-16T16:16:23.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.667+0000 7f2cb4c00640 1 -- 172.21.15.43:0/3833929639 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8014680 con 0x7f2cb8155cb0 2024-04-16T16:16:23.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.667+0000 7f2cb4c00640 1 -- 172.21.15.43:0/3833929639 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8014a50 con 0x7f2cb8155cb0 2024-04-16T16:16:23.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.667+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb8151c20 con 0x7f2cb8155cb0 2024-04-16T16:16:23.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.667+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb81521e0 con 0x7f2cb8155cb0 2024-04-16T16:16:23.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.667+0000 7f2cb4c00640 1 -- 172.21.15.43:0/3833929639 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ca8005d10 con 0x7f2cb8155cb0 2024-04-16T16:16:23.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.667+0000 7f2cb4c00640 1 -- 172.21.15.43:0/3833929639 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2ca80133e0 con 0x7f2cb8155cb0 2024-04-16T16:16:23.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.668+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb804fd90 con 0x7f2cb8155cb0 2024-04-16T16:16:23.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.671+0000 7f2cb4c00640 1 -- 172.21.15.43:0/3833929639 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2ca8022030 con 0x7f2cb8155cb0 2024-04-16T16:16:23.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.750+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e", "id": 0} v 0) -- 0x7f2cb8072870 con 0x7f2cb8155cb0 2024-04-16T16:16:23.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.757+0000 7f2cb4c00640 1 -- 172.21.15.43:0/3833929639 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2ca8010040 con 0x7f2cb8155cb0 2024-04-16T16:16:23.757 INFO:teuthology.orchestra.run.smithi043.stdout:0 2024-04-16T16:16:23.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb8155cb0 msgr2=0x7f2cb80d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb8155cb0 0x7f2cb80d0570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800efc0 tx=0x7f2ca800c490 comp rx=0 tx=0).stop 2024-04-16T16:16:23.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 shutdown_connections 2024-04-16T16:16:23.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb815fe80 0x7f2cb80b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb815fa00 0x7f2cb8152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 --2- 172.21.15.43:0/3833929639 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cb8155cb0 0x7f2cb80d0570 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 >> 172.21.15.43:0/3833929639 conn(0x7f2cb80b3410 msgr2=0x7f2cb80d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:23.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.758+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 shutdown_connections 2024-04-16T16:16:23.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.759+0000 7f2cbea00640 1 -- 172.21.15.43:0/3833929639 wait complete. 2024-04-16T16:16:23.775 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new e089ea0f-e418-4308-b2b4-895e33dfd0c9 1 2024-04-16T16:16:23.845 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:23.846+0000 7f0568a37040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T16:16:23.890 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:23.891+0000 7ff900a3a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T16:16:23.912 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:23.913+0000 7f0568a37040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T16:16:23.959 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:23.959+0000 7ff900a3a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T16:16:23.966 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:23.967+0000 7f0568a37040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T16:16:23.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.969+0000 7efc90600640 1 Processor -- start 2024-04-16T16:16:23.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.969+0000 7efc90600640 1 -- start start 2024-04-16T16:16:23.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc90600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc880b3d60 0x7efc880d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc90600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efc880cfb10 0x7efc880cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc90600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc88162d00 0x7efc88163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc90600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7efc880d04b0 con 0x7efc88162d00 2024-04-16T16:16:23.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc90600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7efc88163a30 con 0x7efc880cfb10 2024-04-16T16:16:23.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc90600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efc880d2f70 con 0x7efc880b3d60 2024-04-16T16:16:23.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc8d200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efc880cfb10 0x7efc880cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc8dc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc880b3d60 0x7efc880d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc8d200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efc880cfb10 0x7efc880cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52606/0 (socket says 172.21.15.43:52606) 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.971+0000 7efc8d200640 1 -- 172.21.15.43:0/3276018623 learned_addr learned my addr 172.21.15.43:0/3276018623 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.972+0000 7efc8e600640 1 --2- 172.21.15.43:0/3276018623 >> v2:172.21.15.22:3300/0 conn(0x7efc88162d00 0x7efc88163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.972+0000 7efc8dc00640 1 -- 172.21.15.43:0/3276018623 >> v2:172.21.15.43:3300/0 conn(0x7efc880cfb10 msgr2=0x7efc880cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.972+0000 7efc8dc00640 1 --2- 172.21.15.43:0/3276018623 >> v2:172.21.15.43:3300/0 conn(0x7efc880cfb10 0x7efc880cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.972+0000 7efc8dc00640 1 -- 172.21.15.43:0/3276018623 >> v2:172.21.15.22:3300/0 conn(0x7efc88162d00 msgr2=0x7efc88163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.972+0000 7efc8dc00640 1 --2- 172.21.15.43:0/3276018623 >> v2:172.21.15.22:3300/0 conn(0x7efc88162d00 0x7efc88163190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.972+0000 7efc8dc00640 1 -- 172.21.15.43:0/3276018623 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc880d3250 con 0x7efc880b3d60 2024-04-16T16:16:23.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.973+0000 7efc8dc00640 1 --2- 172.21.15.43:0/3276018623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc880b3d60 0x7efc880d3d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc8808d290 tx=0x7efc7c02b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6583bd6fc23ad17 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:23.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.973+0000 7efc87e00640 1 -- 172.21.15.43:0/3276018623 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c038070 con 0x7efc880b3d60 2024-04-16T16:16:23.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.973+0000 7efc87e00640 1 -- 172.21.15.43:0/3276018623 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7c031710 con 0x7efc880b3d60 2024-04-16T16:16:23.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.973+0000 7efc87e00640 1 -- 172.21.15.43:0/3276018623 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c031ae0 con 0x7efc880b3d60 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 -- 172.21.15.43:0/3276018623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc880b3d60 msgr2=0x7efc880d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 --2- 172.21.15.43:0/3276018623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc880b3d60 0x7efc880d3d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc8808d290 tx=0x7efc7c02b7b0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 -- 172.21.15.43:0/3276018623 shutdown_connections 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 --2- 172.21.15.43:0/3276018623 >> v2:172.21.15.22:3300/0 conn(0x7efc88162d00 0x7efc88163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 --2- 172.21.15.43:0/3276018623 >> v2:172.21.15.43:3300/0 conn(0x7efc880cfb10 0x7efc880cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 --2- 172.21.15.43:0/3276018623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc880b3d60 0x7efc880d3d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 -- 172.21.15.43:0/3276018623 >> 172.21.15.43:0/3276018623 conn(0x7efc88062860 msgr2=0x7efc88062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 -- 172.21.15.43:0/3276018623 shutdown_connections 2024-04-16T16:16:23.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.974+0000 7efc90600640 1 -- 172.21.15.43:0/3276018623 wait complete. 2024-04-16T16:16:23.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.976+0000 7efc90600640 1 Processor -- start 2024-04-16T16:16:23.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.976+0000 7efc90600640 1 -- start start 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc90600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc880b3d60 0x7efc88157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc90600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc880cfb10 0x7efc88158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc90600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc88162d00 0x7efc88148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc90600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc880d4270 con 0x7efc880b3d60 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc90600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc880d3810 con 0x7efc880cfb10 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc90600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efc880b4140 con 0x7efc88162d00 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc8d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc880cfb10 0x7efc88158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc8e600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc88162d00 0x7efc88148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc8d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc880cfb10 0x7efc88158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52614/0 (socket says 172.21.15.43:52614) 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc8d200640 1 -- 172.21.15.43:0/1894140979 learned_addr learned my addr 172.21.15.43:0/1894140979 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.977+0000 7efc8dc00640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc880b3d60 0x7efc88157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:23.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc8e600640 1 -- 172.21.15.43:0/1894140979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc880cfb10 msgr2=0x7efc88158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc8e600640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc880cfb10 0x7efc88158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc8e600640 1 -- 172.21.15.43:0/1894140979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc880b3d60 msgr2=0x7efc88157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc8e600640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc880b3d60 0x7efc88157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc8e600640 1 -- 172.21.15.43:0/1894140979 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8815a010 con 0x7efc88162d00 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc8e600640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc88162d00 0x7efc88148f10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc80007d20 tx=0x7efc8000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc85600640 1 -- 172.21.15.43:0/1894140979 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8000edd0 con 0x7efc88162d00 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc85600640 1 -- 172.21.15.43:0/1894140979 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc80003990 con 0x7efc88162d00 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc85600640 1 -- 172.21.15.43:0/1894140979 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80003d80 con 0x7efc88162d00 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc8815a2f0 con 0x7efc88162d00 2024-04-16T16:16:23.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.978+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc8815a8b0 con 0x7efc88162d00 2024-04-16T16:16:23.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.979+0000 7efc85600640 1 -- 172.21.15.43:0/1894140979 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc8001b020 con 0x7efc88162d00 2024-04-16T16:16:23.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.979+0000 7efc85600640 1 -- 172.21.15.43:0/1894140979 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efc80014a50 con 0x7efc88162d00 2024-04-16T16:16:23.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.979+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc8804fd90 con 0x7efc88162d00 2024-04-16T16:16:23.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:23.982+0000 7efc85600640 1 -- 172.21.15.43:0/1894140979 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7efc80014ca0 con 0x7efc88162d00 2024-04-16T16:16:24.015 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.016+0000 7ff900a3a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T16:16:24.031 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.033+0000 7f0568a37040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T16:16:24.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.061+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e089ea0f-e418-4308-b2b4-895e33dfd0c9", "id": 1} v 0) -- 0x7efc880d29f0 con 0x7efc88162d00 2024-04-16T16:16:24.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.069+0000 7efc85600640 1 -- 172.21.15.43:0/1894140979 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e089ea0f-e418-4308-b2b4-895e33dfd0c9", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efc80014420 con 0x7efc88162d00 2024-04-16T16:16:24.068 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-16T16:16:24.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.070+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc88162d00 msgr2=0x7efc88148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.070+0000 7efc90600640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc88162d00 0x7efc88148f10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc80007d20 tx=0x7efc8000e4b0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.070+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 shutdown_connections 2024-04-16T16:16:24.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.070+0000 7efc90600640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc88162d00 0x7efc88148f10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.070+0000 7efc90600640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc880cfb10 0x7efc88158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.070+0000 7efc90600640 1 --2- 172.21.15.43:0/1894140979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc880b3d60 0x7efc88157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.070+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 >> 172.21.15.43:0/1894140979 conn(0x7efc88062860 msgr2=0x7efc880cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.071+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 shutdown_connections 2024-04-16T16:16:24.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.071+0000 7efc90600640 1 -- 172.21.15.43:0/1894140979 wait complete. 2024-04-16T16:16:24.083 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.083+0000 7ff900a3a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T16:16:24.084 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.085+0000 7f0568a37040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T16:16:24.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 9742e41f-89fa-446a-813d-f3670dfdf6ce 2 2024-04-16T16:16:24.140 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.140+0000 7ff900a3a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T16:16:24.223 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.224+0000 7f0568a37040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T16:16:24.280 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.281+0000 7ff900a3a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T16:16:24.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.281+0000 7f4197e00640 1 Processor -- start 2024-04-16T16:16:24.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.281+0000 7f4197e00640 1 -- start start 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f419815eb80 0x7f41980d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41980d1100 0x7f41980d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41980d3000 con 0x7f41980d40a0 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f41980d1a90 con 0x7f419815eb80 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f41980d32e0 con 0x7f41980d1100 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41980d1100 0x7f41980d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41980d1100 0x7f41980d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52622/0 (socket says 172.21.15.43:52622) 2024-04-16T16:16:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4197400640 1 -- 172.21.15.43:0/1856981417 learned_addr learned my addr 172.21.15.43:0/1856981417 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:24.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.283+0000 7f4196a00640 1 --2- 172.21.15.43:0/1856981417 >> v2:172.21.15.22:3300/0 conn(0x7f419815eb80 0x7f41980d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.284+0000 7f4197400640 1 -- 172.21.15.43:0/1856981417 >> v2:172.21.15.22:3300/0 conn(0x7f419815eb80 msgr2=0x7f41980d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:24.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.284+0000 7f4197400640 1 --2- 172.21.15.43:0/1856981417 >> v2:172.21.15.22:3300/0 conn(0x7f419815eb80 0x7f41980d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.284+0000 7f4197400640 1 -- 172.21.15.43:0/1856981417 >> v1:172.21.15.22:6789/0 conn(0x7f41980d40a0 legacy=0x7f41980ba250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:24.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.284+0000 7f4197400640 1 -- 172.21.15.43:0/1856981417 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41980d35c0 con 0x7f41980d1100 2024-04-16T16:16:24.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.285+0000 7f4197400640 1 --2- 172.21.15.43:0/1856981417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41980d1100 0x7f41980d1550 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4198162620 tx=0x7f419002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba3401186fade27 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:24.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.285+0000 7f4195600640 1 -- 172.21.15.43:0/1856981417 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419002cb20 con 0x7f41980d1100 2024-04-16T16:16:24.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.285+0000 7f4195600640 1 -- 172.21.15.43:0/1856981417 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f419002ccc0 con 0x7f41980d1100 2024-04-16T16:16:24.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.285+0000 7f4195600640 1 -- 172.21.15.43:0/1856981417 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190034610 con 0x7f41980d1100 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 -- 172.21.15.43:0/1856981417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41980d1100 msgr2=0x7f41980d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 --2- 172.21.15.43:0/1856981417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41980d1100 0x7f41980d1550 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4198162620 tx=0x7f419002bf80 comp rx=0 tx=0).stop 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 -- 172.21.15.43:0/1856981417 shutdown_connections 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 --2- 172.21.15.43:0/1856981417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41980d1100 0x7f41980d1550 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 --2- 172.21.15.43:0/1856981417 >> v2:172.21.15.22:3300/0 conn(0x7f419815eb80 0x7f41980d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 -- 172.21.15.43:0/1856981417 >> 172.21.15.43:0/1856981417 conn(0x7f4198072460 msgr2=0x7f4198072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 -- 172.21.15.43:0/1856981417 shutdown_connections 2024-04-16T16:16:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.286+0000 7f4197e00640 1 -- 172.21.15.43:0/1856981417 wait complete. 2024-04-16T16:16:24.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.288+0000 7f4197e00640 1 Processor -- start 2024-04-16T16:16:24.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.289+0000 7f4197e00640 1 -- start start 2024-04-16T16:16:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f41980d1100 0x7f41980b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41980d40a0 0x7f41981f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f419815eb80 0x7f419814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f419815ef60 con 0x7f41980d40a0 2024-04-16T16:16:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f41980d3b80 con 0x7f419815eb80 2024-04-16T16:16:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f41980d4530 con 0x7f41980d1100 2024-04-16T16:16:24.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4196a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f41980d1100 0x7f41980b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f419815eb80 0x7f419814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4196a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f41980d1100 0x7f41980b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:44224/0 (socket says 172.21.15.43:44224) 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4197400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f419815eb80 0x7f419814d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52626/0 (socket says 172.21.15.43:52626) 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4196a00640 1 -- 172.21.15.43:0/1365065992 learned_addr learned my addr 172.21.15.43:0/1365065992 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.290+0000 7f4196000640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41980d40a0 0x7f41981f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4196a00640 1 -- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f419815eb80 msgr2=0x7f419814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4196a00640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f419815eb80 0x7f419814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4196a00640 1 -- 172.21.15.43:0/1365065992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41980d40a0 msgr2=0x7f41981f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4196a00640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41980d40a0 0x7f41981f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4196a00640 1 -- 172.21.15.43:0/1365065992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419814b210 con 0x7f41980d1100 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4197400640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f419815eb80 0x7f419814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4196000640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41980d40a0 0x7f41981f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:24.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4196a00640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f41980d1100 0x7f41980b4960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f418800d800 tx=0x7f418800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:24.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f418ea00640 1 -- 172.21.15.43:0/1365065992 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418800b6c0 con 0x7f41980d1100 2024-04-16T16:16:24.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f418ea00640 1 -- 172.21.15.43:0/1365065992 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4188019070 con 0x7f41980d1100 2024-04-16T16:16:24.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f418ea00640 1 -- 172.21.15.43:0/1365065992 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418800ba80 con 0x7f41980d1100 2024-04-16T16:16:24.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419814b4f0 con 0x7f41980d1100 2024-04-16T16:16:24.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.291+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f419814bab0 con 0x7f41980d1100 2024-04-16T16:16:24.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.292+0000 7f418ea00640 1 -- 172.21.15.43:0/1365065992 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f418800bc20 con 0x7f41980d1100 2024-04-16T16:16:24.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.292+0000 7f418ea00640 1 -- 172.21.15.43:0/1365065992 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f418801e880 con 0x7f41980d1100 2024-04-16T16:16:24.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.292+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4198075f30 con 0x7f41980d1100 2024-04-16T16:16:24.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.295+0000 7f418ea00640 1 -- 172.21.15.43:0/1365065992 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f418801ea80 con 0x7f41980d1100 2024-04-16T16:16:24.307 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.308+0000 7f0568a37040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T16:16:24.363 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.365+0000 7f0568a37040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T16:16:24.367 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.368+0000 7ff900a3a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T16:16:24.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.374+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9742e41f-89fa-446a-813d-f3670dfdf6ce", "id": 2} v 0) -- 0x7f41981f7e80 con 0x7f41980d1100 2024-04-16T16:16:24.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.383+0000 7f418ea00640 1 -- 172.21.15.43:0/1365065992 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9742e41f-89fa-446a-813d-f3670dfdf6ce", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f418801e460 con 0x7f41980d1100 2024-04-16T16:16:24.382 INFO:teuthology.orchestra.run.smithi043.stdout:2 2024-04-16T16:16:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f41980d1100 msgr2=0x7f41980b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f41980d1100 0x7f41980b4960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f418800d800 tx=0x7f418800dcc0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 shutdown_connections 2024-04-16T16:16:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f419815eb80 0x7f419814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41980d40a0 0x7f41981f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 --2- 172.21.15.43:0/1365065992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f41980d1100 0x7f41980b4960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 >> 172.21.15.43:0/1365065992 conn(0x7f4198072460 msgr2=0x7f41980cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 shutdown_connections 2024-04-16T16:16:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.384+0000 7f4197e00640 1 -- 172.21.15.43:0/1365065992 wait complete. 2024-04-16T16:16:24.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 6b93b718-b634-453a-88bc-c7f5f4661eb5 3 2024-04-16T16:16:24.426 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.427+0000 7ff900a3a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T16:16:24.427 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.429+0000 7f0568a37040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T16:16:24.485 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.486+0000 7f0568a37040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T16:16:24.492 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.492+0000 7ff900a3a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T16:16:24.553 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:24.553+0000 7ff900a3a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T16:16:24.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.582+0000 7f61d8800640 1 Processor -- start 2024-04-16T16:16:24.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.582+0000 7f61d8800640 1 -- start start 2024-04-16T16:16:24.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.584+0000 7f61d8800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f61d0162220 0x7f61d01631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.584+0000 7f61d8800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d0163710 con 0x7f61d00d1ff0 2024-04-16T16:16:24.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.584+0000 7f61d8800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d00cf310 con 0x7f61d00b37a0 2024-04-16T16:16:24.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.584+0000 7f61d8800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f61d00cff20 con 0x7f61d0162220 2024-04-16T16:16:24.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.584+0000 7f61d5e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f61d0162220 0x7f61d01631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.584+0000 7f61d5e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f61d0162220 0x7f61d01631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52632/0 (socket says 172.21.15.43:52632) 2024-04-16T16:16:24.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.584+0000 7f61d5e00640 1 -- 172.21.15.43:0/551095479 learned_addr learned my addr 172.21.15.43:0/551095479 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:24.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.585+0000 7f61d5e00640 1 -- 172.21.15.43:0/551095479 >> v1:172.21.15.43:6789/0 conn(0x7f61d00b37a0 legacy=0x7f61d00d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.585+0000 7f61d5e00640 1 -- 172.21.15.43:0/551095479 >> v1:172.21.15.22:6789/0 conn(0x7f61d00d1ff0 legacy=0x7f61d00d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:24.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.585+0000 7f61d5e00640 1 -- 172.21.15.43:0/551095479 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d00cf5f0 con 0x7f61d0162220 2024-04-16T16:16:24.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.586+0000 7f61d5e00640 1 --2- 172.21.15.43:0/551095479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d0162220 0x7f61d01631d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61d01638e0 tx=0x7f61c402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c201b086f1f853c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:24.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.586+0000 7f61d4a00640 1 -- 172.21.15.43:0/551095479 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4035020 con 0x7f61d0162220 2024-04-16T16:16:24.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.586+0000 7f61d4a00640 1 -- 172.21.15.43:0/551095479 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c4031640 con 0x7f61d0162220 2024-04-16T16:16:24.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.586+0000 7f61d4a00640 1 -- 172.21.15.43:0/551095479 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c402d040 con 0x7f61d0162220 2024-04-16T16:16:24.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.587+0000 7f61d8800640 1 -- 172.21.15.43:0/551095479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d0162220 msgr2=0x7f61d01631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.587+0000 7f61d8800640 1 --2- 172.21.15.43:0/551095479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d0162220 0x7f61d01631d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61d01638e0 tx=0x7f61c402b8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.587+0000 7f61d8800640 1 -- 172.21.15.43:0/551095479 shutdown_connections 2024-04-16T16:16:24.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.587+0000 7f61d8800640 1 --2- 172.21.15.43:0/551095479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d0162220 0x7f61d01631d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.587+0000 7f61d8800640 1 -- 172.21.15.43:0/551095479 >> 172.21.15.43:0/551095479 conn(0x7f61d0062620 msgr2=0x7f61d0062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:24.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.587+0000 7f61d8800640 1 -- 172.21.15.43:0/551095479 shutdown_connections 2024-04-16T16:16:24.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.587+0000 7f61d8800640 1 -- 172.21.15.43:0/551095479 wait complete. 2024-04-16T16:16:24.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.589+0000 7f61d8800640 1 Processor -- start 2024-04-16T16:16:24.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.589+0000 7f61d8800640 1 -- start start 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d8800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61d00b37a0 0x7f61d0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d8800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d00d1ff0 0x7f61d014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d8800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0162220 0x7f61d00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d8800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00cfbb0 con 0x7f61d0162220 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d8800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00d03b0 con 0x7f61d00d1ff0 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d8800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f61d00d3630 con 0x7f61d00b37a0 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61d00b37a0 0x7f61d0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d00d1ff0 0x7f61d014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61d00b37a0 0x7f61d0150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:44234/0 (socket says 172.21.15.43:44234) 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 -- 172.21.15.43:0/985288110 learned_addr learned my addr 172.21.15.43:0/985288110 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d6800640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0162220 0x7f61d00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 -- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d00d1ff0 msgr2=0x7f61d014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d00d1ff0 0x7f61d014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 -- 172.21.15.43:0/985288110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0162220 msgr2=0x7f61d00b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0162220 0x7f61d00b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5e00640 1 -- 172.21.15.43:0/985288110 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d01f8210 con 0x7f61d00b37a0 2024-04-16T16:16:24.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.590+0000 7f61d5400640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d00d1ff0 0x7f61d014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.591+0000 7f61d5e00640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61d00b37a0 0x7f61d0150400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f61c4000c00 tx=0x7f61c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.591+0000 7f61ca000640 1 -- 172.21.15.43:0/985288110 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c403ac60 con 0x7f61d00b37a0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.591+0000 7f61ca000640 1 -- 172.21.15.43:0/985288110 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c403ae20 con 0x7f61d00b37a0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.591+0000 7f61ca000640 1 -- 172.21.15.43:0/985288110 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4044630 con 0x7f61d00b37a0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.591+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d01f84f0 con 0x7f61d00b37a0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.591+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d01f8ab0 con 0x7f61d00b37a0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.592+0000 7f61ca000640 1 -- 172.21.15.43:0/985288110 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61c404b060 con 0x7f61d00b37a0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.592+0000 7f61ca000640 1 -- 172.21.15.43:0/985288110 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f61c4031550 con 0x7f61d00b37a0 2024-04-16T16:16:24.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.592+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d0152410 con 0x7f61d00b37a0 2024-04-16T16:16:24.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.595+0000 7f61ca000640 1 -- 172.21.15.43:0/985288110 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f61c403f070 con 0x7f61d00b37a0 2024-04-16T16:16:24.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.675+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b93b718-b634-453a-88bc-c7f5f4661eb5", "id": 3} v 0) -- 0x7f61d004fd90 con 0x7f61d00b37a0 2024-04-16T16:16:24.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.682+0000 7f61ca000640 1 -- 172.21.15.43:0/985288110 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b93b718-b634-453a-88bc-c7f5f4661eb5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f61c404d450 con 0x7f61d00b37a0 2024-04-16T16:16:24.682 INFO:teuthology.orchestra.run.smithi043.stdout:3 2024-04-16T16:16:24.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.683+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61d00b37a0 msgr2=0x7f61d0150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.683+0000 7f61d8800640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61d00b37a0 0x7f61d0150400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f61c4000c00 tx=0x7f61c40046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.683+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 shutdown_connections 2024-04-16T16:16:24.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.683+0000 7f61d8800640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0162220 0x7f61d00b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.683+0000 7f61d8800640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61d00d1ff0 0x7f61d014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.683+0000 7f61d8800640 1 --2- 172.21.15.43:0/985288110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61d00b37a0 0x7f61d0150400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.683+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 >> 172.21.15.43:0/985288110 conn(0x7f61d0062620 msgr2=0x7f61d00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:24.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.684+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 shutdown_connections 2024-04-16T16:16:24.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.684+0000 7f61d8800640 1 -- 172.21.15.43:0/985288110 wait complete. 2024-04-16T16:16:24.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new c2b47158-c1b8-4efb-b3c6-2ce29849d207 4 2024-04-16T16:16:24.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.936+0000 7fc013e00640 1 Processor -- start 2024-04-16T16:16:24.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.936+0000 7fc013e00640 1 -- start start 2024-04-16T16:16:24.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.937+0000 7fc013e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc0141461d0 0x7fc014072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.937+0000 7fc013e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc0140d1bb0 0x7fc0140628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0140d2240 con 0x7fc014062440 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc0140d2020 con 0x7fc0141461d0 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc0141465b0 con 0x7fc0140d1bb0 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc0140d1bb0 0x7fc0140628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc0140d1bb0 0x7fc0140628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52648/0 (socket says 172.21.15.43:52648) 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013400640 1 -- 172.21.15.43:0/704193084 learned_addr learned my addr 172.21.15.43:0/704193084 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013400640 1 -- 172.21.15.43:0/704193084 >> v2:172.21.15.22:3300/0 conn(0x7fc0141461d0 msgr2=0x7fc014072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013400640 1 --2- 172.21.15.43:0/704193084 >> v2:172.21.15.22:3300/0 conn(0x7fc0141461d0 0x7fc014072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013400640 1 -- 172.21.15.43:0/704193084 >> v1:172.21.15.22:6789/0 conn(0x7fc014062440 legacy=0x7fc0140d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.938+0000 7fc013400640 1 -- 172.21.15.43:0/704193084 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0140721b0 con 0x7fc0140d1bb0 2024-04-16T16:16:24.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.939+0000 7fc013400640 1 --2- 172.21.15.43:0/704193084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0140d1bb0 0x7fc0140628f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b6aa0 tx=0x7fc00c02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554c127815721cc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:24.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc012000640 1 -- 172.21.15.43:0/704193084 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c02c9f0 con 0x7fc0140d1bb0 2024-04-16T16:16:24.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc012000640 1 -- 172.21.15.43:0/704193084 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c02cb90 con 0x7fc0140d1bb0 2024-04-16T16:16:24.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc012000640 1 -- 172.21.15.43:0/704193084 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0343f0 con 0x7fc0140d1bb0 2024-04-16T16:16:24.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc013e00640 1 -- 172.21.15.43:0/704193084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0140d1bb0 msgr2=0x7fc0140628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc013e00640 1 --2- 172.21.15.43:0/704193084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0140d1bb0 0x7fc0140628f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b6aa0 tx=0x7fc00c02be50 comp rx=0 tx=0).stop 2024-04-16T16:16:24.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc013e00640 1 -- 172.21.15.43:0/704193084 shutdown_connections 2024-04-16T16:16:24.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc013e00640 1 --2- 172.21.15.43:0/704193084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0140d1bb0 0x7fc0140628f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc013e00640 1 --2- 172.21.15.43:0/704193084 >> v2:172.21.15.22:3300/0 conn(0x7fc0141461d0 0x7fc014072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc013e00640 1 -- 172.21.15.43:0/704193084 >> 172.21.15.43:0/704193084 conn(0x7fc014074a40 msgr2=0x7fc014074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:24.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.940+0000 7fc013e00640 1 -- 172.21.15.43:0/704193084 shutdown_connections 2024-04-16T16:16:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.941+0000 7fc013e00640 1 -- 172.21.15.43:0/704193084 wait complete. 2024-04-16T16:16:24.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.942+0000 7fc013e00640 1 Processor -- start 2024-04-16T16:16:24.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.942+0000 7fc013e00640 1 -- start start 2024-04-16T16:16:24.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc013e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc014062440 0x7fc01415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc013e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0140d1bb0 0x7fc0141e8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc013e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0141461d0 0x7fc0141e8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:24.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc013e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc014072800 con 0x7fc0140d1bb0 2024-04-16T16:16:24.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc013e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc014071f60 con 0x7fc014062440 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc013e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc0140731d0 con 0x7fc0141461d0 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc012a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc014062440 0x7fc01415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc013400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0141461d0 0x7fc0141e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc012a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc014062440 0x7fc01415bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52662/0 (socket says 172.21.15.43:52662) 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.943+0000 7fc012a00640 1 -- 172.21.15.43:0/3842394290 learned_addr learned my addr 172.21.15.43:0/3842394290 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc00be00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0140d1bb0 0x7fc0141e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc012a00640 1 -- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0141461d0 msgr2=0x7fc0141e8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc012a00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0141461d0 0x7fc0141e8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc012a00640 1 -- 172.21.15.43:0/3842394290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0140d1bb0 msgr2=0x7fc0141e8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc012a00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0140d1bb0 0x7fc0141e8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc012a00640 1 -- 172.21.15.43:0/3842394290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc014142740 con 0x7fc014062440 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc013400640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0141461d0 0x7fc0141e8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc012a00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc014062440 0x7fc01415bde0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc00400b410 tx=0x7fc00400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:24.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.944+0000 7fc00aa00640 1 -- 172.21.15.43:0/3842394290 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004015020 con 0x7fc014062440 2024-04-16T16:16:24.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.945+0000 7fc00aa00640 1 -- 172.21.15.43:0/3842394290 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc004011850 con 0x7fc014062440 2024-04-16T16:16:24.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.945+0000 7fc00aa00640 1 -- 172.21.15.43:0/3842394290 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004011c40 con 0x7fc014062440 2024-04-16T16:16:24.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.945+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc014142a20 con 0x7fc014062440 2024-04-16T16:16:24.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.945+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc014142fe0 con 0x7fc014062440 2024-04-16T16:16:24.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.945+0000 7fc00aa00640 1 -- 172.21.15.43:0/3842394290 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc004018020 con 0x7fc014062440 2024-04-16T16:16:24.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.945+0000 7fc00aa00640 1 -- 172.21.15.43:0/3842394290 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc004011de0 con 0x7fc014062440 2024-04-16T16:16:24.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.946+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc014075f30 con 0x7fc014062440 2024-04-16T16:16:24.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:24.949+0000 7fc00aa00640 1 -- 172.21.15.43:0/3842394290 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc00401f020 con 0x7fc014062440 2024-04-16T16:16:24.961 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:24.962+0000 7f0568a37040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T16:16:25.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.029+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c2b47158-c1b8-4efb-b3c6-2ce29849d207", "id": 4} v 0) -- 0x7fc0140cdbf0 con 0x7fc014062440 2024-04-16T16:16:25.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.037+0000 7fc00aa00640 1 -- 172.21.15.43:0/3842394290 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2b47158-c1b8-4efb-b3c6-2ce29849d207", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fc00401a790 con 0x7fc014062440 2024-04-16T16:16:25.037 INFO:teuthology.orchestra.run.smithi043.stdout:4 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc014062440 msgr2=0x7fc01415bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc014062440 0x7fc01415bde0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc00400b410 tx=0x7fc00400b8d0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 shutdown_connections 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0141461d0 0x7fc0141e8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0140d1bb0 0x7fc0141e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 --2- 172.21.15.43:0/3842394290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc014062440 0x7fc01415bde0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 >> 172.21.15.43:0/3842394290 conn(0x7fc014074a40 msgr2=0x7fc01415f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 shutdown_connections 2024-04-16T16:16:25.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.039+0000 7fc013e00640 1 -- 172.21.15.43:0/3842394290 wait complete. 2024-04-16T16:16:25.039 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.039+0000 7ff900a3a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T16:16:25.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 5aedead8-fa25-48b9-a7a4-45253da9f6aa 5 2024-04-16T16:16:25.131 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:25.132+0000 7f0568a37040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T16:16:25.211 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.211+0000 7ff900a3a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T16:16:25.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.241+0000 7f5942400640 1 Processor -- start 2024-04-16T16:16:25.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.241+0000 7f5942400640 1 -- start start 2024-04-16T16:16:25.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f5942400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f593c159400 0x7f593c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f5942400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f593c06eb50 0x7f593c06beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f5942400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593c06f190 con 0x7f593c06ba20 2024-04-16T16:16:25.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f5942400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f593c0b4e00 con 0x7f593c159400 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f5942400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f593c0b47b0 con 0x7f593c06eb50 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f593be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f593c06eb50 0x7f593c06beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f593be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f593c06eb50 0x7f593c06beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52678/0 (socket says 172.21.15.43:52678) 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.243+0000 7f593be00640 1 -- 172.21.15.43:0/1299247452 learned_addr learned my addr 172.21.15.43:0/1299247452 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.244+0000 7f593b400640 1 --2- 172.21.15.43:0/1299247452 >> v2:172.21.15.22:3300/0 conn(0x7f593c159400 0x7f593c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.244+0000 7f593be00640 1 -- 172.21.15.43:0/1299247452 >> v2:172.21.15.22:3300/0 conn(0x7f593c159400 msgr2=0x7f593c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.244+0000 7f593be00640 1 --2- 172.21.15.43:0/1299247452 >> v2:172.21.15.22:3300/0 conn(0x7f593c159400 0x7f593c15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.244+0000 7f593be00640 1 -- 172.21.15.43:0/1299247452 >> v1:172.21.15.43:6789/0 conn(0x7f593c06ba20 legacy=0x7f593c06e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.244+0000 7f593be00640 1 -- 172.21.15.43:0/1299247452 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c0b4a90 con 0x7f593c06eb50 2024-04-16T16:16:25.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.244+0000 7f593a000640 1 -- 172.21.15.43:0/1299247452 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534962010 0 0) 0x7f593c06f190 con 0x7f593c06ba20 2024-04-16T16:16:25.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.245+0000 7f593be00640 1 --2- 172.21.15.43:0/1299247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06eb50 0x7f593c06beb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f593c0b4430 tx=0x7f593402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6530d7c13eb11a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:25.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.245+0000 7f593a000640 1 -- 172.21.15.43:0/1299247452 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593402cb20 con 0x7f593c06eb50 2024-04-16T16:16:25.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.245+0000 7f593a000640 1 -- 172.21.15.43:0/1299247452 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593402ccc0 con 0x7f593c06eb50 2024-04-16T16:16:25.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.245+0000 7f593a000640 1 -- 172.21.15.43:0/1299247452 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934034610 con 0x7f593c06eb50 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 -- 172.21.15.43:0/1299247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06eb50 msgr2=0x7f593c06beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 --2- 172.21.15.43:0/1299247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06eb50 0x7f593c06beb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f593c0b4430 tx=0x7f593402bf80 comp rx=0 tx=0).stop 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 -- 172.21.15.43:0/1299247452 shutdown_connections 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 --2- 172.21.15.43:0/1299247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06eb50 0x7f593c06beb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 --2- 172.21.15.43:0/1299247452 >> v2:172.21.15.22:3300/0 conn(0x7f593c159400 0x7f593c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 -- 172.21.15.43:0/1299247452 >> 172.21.15.43:0/1299247452 conn(0x7f593c0b3410 msgr2=0x7f593c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 -- 172.21.15.43:0/1299247452 shutdown_connections 2024-04-16T16:16:25.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.246+0000 7f5942400640 1 -- 172.21.15.43:0/1299247452 wait complete. 2024-04-16T16:16:25.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.248+0000 7f5942400640 1 Processor -- start 2024-04-16T16:16:25.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.248+0000 7f5942400640 1 -- start start 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f5942400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06ba20 0x7f593c1f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f5942400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f593c06eb50 0x7f593c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f5942400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f593c159400 0x7f593c1e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f5942400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f593c0b5290 con 0x7f593c06eb50 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f5942400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1597e0 con 0x7f593c06ba20 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f5942400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f593c0b5410 con 0x7f593c159400 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f593b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06ba20 0x7f593c1f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f593b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06ba20 0x7f593c1f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52684/0 (socket says 172.21.15.43:52684) 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f593b400640 1 -- 172.21.15.43:0/4127323550 learned_addr learned my addr 172.21.15.43:0/4127323550 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f593be00640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f593c159400 0x7f593c1e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f593aa00640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f593c06eb50 0x7f593c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f593b400640 1 -- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f593c159400 msgr2=0x7f593c1e4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.249+0000 7f593b400640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f593c159400 0x7f593c1e4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f593b400640 1 -- 172.21.15.43:0/4127323550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f593c06eb50 msgr2=0x7f593c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f593b400640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f593c06eb50 0x7f593c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f593b400640 1 -- 172.21.15.43:0/4127323550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c1f4b00 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f593b400640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06ba20 0x7f593c1f45c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e870 tx=0x7f592c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f5933400640 1 -- 172.21.15.43:0/4127323550 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c017070 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f5933400640 1 -- 172.21.15.43:0/4127323550 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592c00c940 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f5933400640 1 -- 172.21.15.43:0/4127323550 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c00cd30 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c0ceb20 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.250+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c1f5080 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.251+0000 7f5933400640 1 -- 172.21.15.43:0/4127323550 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f592c01a070 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.251+0000 7f5933400640 1 -- 172.21.15.43:0/4127323550 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f592c006020 con 0x7f593c06ba20 2024-04-16T16:16:25.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.251+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c04fd90 con 0x7f593c06ba20 2024-04-16T16:16:25.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.254+0000 7f5933400640 1 -- 172.21.15.43:0/4127323550 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f592c0064d0 con 0x7f593c06ba20 2024-04-16T16:16:25.282 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:25.283+0000 7f0568a37040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T16:16:25.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.333+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5aedead8-fa25-48b9-a7a4-45253da9f6aa", "id": 5} v 0) -- 0x7f593c062690 con 0x7f593c06ba20 2024-04-16T16:16:25.338 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:25.339+0000 7f0568a37040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T16:16:25.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.341+0000 7f5933400640 1 -- 172.21.15.43:0/4127323550 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5aedead8-fa25-48b9-a7a4-45253da9f6aa", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f592c0066b0 con 0x7f593c06ba20 2024-04-16T16:16:25.341 INFO:teuthology.orchestra.run.smithi043.stdout:5 2024-04-16T16:16:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06ba20 msgr2=0x7f593c1f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06ba20 0x7f593c1f45c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e870 tx=0x7f592c00ed30 comp rx=0 tx=0).stop 2024-04-16T16:16:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 shutdown_connections 2024-04-16T16:16:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f593c159400 0x7f593c1e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f593c06eb50 0x7f593c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 --2- 172.21.15.43:0/4127323550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f593c06ba20 0x7f593c1f45c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 >> 172.21.15.43:0/4127323550 conn(0x7f593c0b3410 msgr2=0x7f593c0b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 shutdown_connections 2024-04-16T16:16:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.343+0000 7f5942400640 1 -- 172.21.15.43:0/4127323550 wait complete. 2024-04-16T16:16:25.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 515ff6c1-422b-4756-8a85-9d2670478df5 6 2024-04-16T16:16:25.362 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.362+0000 7ff900a3a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T16:16:25.419 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.419+0000 7ff900a3a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T16:16:25.472 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:25.473+0000 7f0568a37040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T16:16:25.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.541+0000 7ff56be00640 1 Processor -- start 2024-04-16T16:16:25.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.541+0000 7ff56be00640 1 -- start start 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff56c0d09c0 0x7ff56c0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff56c0b3dd0 con 0x7ff56c0d12e0 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56be00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff56c0b04c0 con 0x7ff56c0d09c0 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c0b27a0 con 0x7ff56c0d3200 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56aa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff56c0d09c0 0x7ff56c0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56aa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff56c0d09c0 0x7ff56c0d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52700/0 (socket says 172.21.15.43:52700) 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:44252/0 (socket says 172.21.15.43:44252) 2024-04-16T16:16:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.543+0000 7ff56aa00640 1 -- 172.21.15.43:0/3195345326 learned_addr learned my addr 172.21.15.43:0/3195345326 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.544+0000 7ff56aa00640 1 -- 172.21.15.43:0/3195345326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 msgr2=0x7ff56c160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.544+0000 7ff56aa00640 1 --2- 172.21.15.43:0/3195345326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.544+0000 7ff56aa00640 1 -- 172.21.15.43:0/3195345326 >> v1:172.21.15.22:6789/0 conn(0x7ff56c0d12e0 legacy=0x7ff56c15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.544+0000 7ff56aa00640 1 -- 172.21.15.43:0/3195345326 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c0b2a80 con 0x7ff56c0d09c0 2024-04-16T16:16:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.545+0000 7ff56aa00640 1 --2- 172.21.15.43:0/3195345326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c0d0da0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009870 tx=0x7ff55c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bd4dfb8da05aadc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.545+0000 7ff569600640 1 -- 172.21.15.43:0/3195345326 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c034070 con 0x7ff56c0d09c0 2024-04-16T16:16:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.545+0000 7ff569600640 1 -- 172.21.15.43:0/3195345326 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55c030840 con 0x7ff56c0d09c0 2024-04-16T16:16:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.545+0000 7ff569600640 1 -- 172.21.15.43:0/3195345326 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c030c10 con 0x7ff56c0d09c0 2024-04-16T16:16:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 -- 172.21.15.43:0/3195345326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 msgr2=0x7ff56c0d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 --2- 172.21.15.43:0/3195345326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c0d0da0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009870 tx=0x7ff55c02b980 comp rx=0 tx=0).stop 2024-04-16T16:16:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 -- 172.21.15.43:0/3195345326 shutdown_connections 2024-04-16T16:16:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 --2- 172.21.15.43:0/3195345326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 --2- 172.21.15.43:0/3195345326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c0d0da0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 -- 172.21.15.43:0/3195345326 >> 172.21.15.43:0/3195345326 conn(0x7ff56c0d26e0 msgr2=0x7ff56c0d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 -- 172.21.15.43:0/3195345326 shutdown_connections 2024-04-16T16:16:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.546+0000 7ff56be00640 1 -- 172.21.15.43:0/3195345326 wait complete. 2024-04-16T16:16:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.548+0000 7ff56be00640 1 Processor -- start 2024-04-16T16:16:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.548+0000 7ff56be00640 1 -- start start 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56c0d12e0 0x7ff56c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c0b33f0 con 0x7ff56c0d12e0 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c0b3270 con 0x7ff56c0d09c0 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c0af4b0 con 0x7ff56c0d3200 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52716/0 (socket says 172.21.15.43:52716) 2024-04-16T16:16:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56aa00640 1 -- 172.21.15.43:0/440469832 learned_addr learned my addr 172.21.15.43:0/440469832 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56a000640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56c0d12e0 0x7ff56c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56b400640 1 -- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 msgr2=0x7ff56c151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56b400640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56b400640 1 -- 172.21.15.43:0/440469832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56c0d12e0 msgr2=0x7ff56c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56b400640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56c0d12e0 0x7ff56c06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56b400640 1 -- 172.21.15.43:0/440469832 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c0cddb0 con 0x7ff56c0d3200 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56a000640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56c0d12e0 0x7ff56c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.549+0000 7ff56aa00640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff56b400640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c06d550 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff56400eba0 tx=0x7ff56400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff563400640 1 -- 172.21.15.43:0/440469832 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564018020 con 0x7ff56c0d3200 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff563400640 1 -- 172.21.15.43:0/440469832 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56400cd20 con 0x7ff56c0d3200 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c0ce090 con 0x7ff56c0d3200 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff563400640 1 -- 172.21.15.43:0/440469832 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5640146c0 con 0x7ff56c0d3200 2024-04-16T16:16:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c0c9a90 con 0x7ff56c0d3200 2024-04-16T16:16:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff563400640 1 -- 172.21.15.43:0/440469832 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff564005d10 con 0x7ff56c0d3200 2024-04-16T16:16:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.550+0000 7ff563400640 1 -- 172.21.15.43:0/440469832 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7ff56401dd10 con 0x7ff56c0d3200 2024-04-16T16:16:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.551+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56c075f30 con 0x7ff56c0d3200 2024-04-16T16:16:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.554+0000 7ff563400640 1 -- 172.21.15.43:0/440469832 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff564022030 con 0x7ff56c0d3200 2024-04-16T16:16:25.559 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.560+0000 7ff900a3a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T16:16:25.589 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:25.591+0000 7f0568a37040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T16:16:25.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.633+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "515ff6c1-422b-4756-8a85-9d2670478df5", "id": 6} v 0) -- 0x7ff56c160f90 con 0x7ff56c0d3200 2024-04-16T16:16:25.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.641+0000 7ff563400640 1 -- 172.21.15.43:0/440469832 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "515ff6c1-422b-4756-8a85-9d2670478df5", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7ff564010040 con 0x7ff56c0d3200 2024-04-16T16:16:25.641 INFO:teuthology.orchestra.run.smithi043.stdout:6 2024-04-16T16:16:25.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.642+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 msgr2=0x7ff56c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.642+0000 7ff56be00640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c06d550 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff56400eba0 tx=0x7ff56400c490 comp rx=0 tx=0).stop 2024-04-16T16:16:25.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.643+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 shutdown_connections 2024-04-16T16:16:25.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.643+0000 7ff56be00640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff56c0d3200 0x7ff56c06d550 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.643+0000 7ff56be00640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56c0d12e0 0x7ff56c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.643+0000 7ff56be00640 1 --2- 172.21.15.43:0/440469832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff56c0d09c0 0x7ff56c151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.643+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 >> 172.21.15.43:0/440469832 conn(0x7ff56c0d26e0 msgr2=0x7ff56c0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:25.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.643+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 shutdown_connections 2024-04-16T16:16:25.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.643+0000 7ff56be00640 1 -- 172.21.15.43:0/440469832 wait complete. 2024-04-16T16:16:25.659 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 6a25f11e-2222-4e6d-8a6e-da1ddf1c6271 7 2024-04-16T16:16:25.679 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.680+0000 7ff900a3a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T16:16:25.776 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:25.777+0000 7f0568a37040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T16:16:25.828 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:25.829+0000 7f0568a37040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T16:16:25.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.848+0000 7fec5f200640 1 Processor -- start 2024-04-16T16:16:25.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.848+0000 7fec5f200640 1 -- start start 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.849+0000 7fec5f200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec6015eb60 0x7fec600cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.849+0000 7fec5f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec600d35f0 0x7fec600d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.849+0000 7fec5f200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec600d3ef0 con 0x7fec600d3a30 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.849+0000 7fec5f200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fec600d41d0 con 0x7fec6015eb60 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.849+0000 7fec5f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fec600d44b0 con 0x7fec600d35f0 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec57e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec600d35f0 0x7fec600d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec57e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec600d35f0 0x7fec600d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:44274/0 (socket says 172.21.15.43:44274) 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec57e00640 1 -- 172.21.15.43:0/921194703 learned_addr learned my addr 172.21.15.43:0/921194703 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec5de00640 1 --2- 172.21.15.43:0/921194703 >> v2:172.21.15.22:3300/0 conn(0x7fec6015eb60 0x7fec600cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec57e00640 1 -- 172.21.15.43:0/921194703 >> v2:172.21.15.22:3300/0 conn(0x7fec6015eb60 msgr2=0x7fec600cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec57e00640 1 --2- 172.21.15.43:0/921194703 >> v2:172.21.15.22:3300/0 conn(0x7fec6015eb60 0x7fec600cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec57e00640 1 -- 172.21.15.43:0/921194703 >> v1:172.21.15.22:6789/0 conn(0x7fec600d3a30 legacy=0x7fec600d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.850+0000 7fec57e00640 1 -- 172.21.15.43:0/921194703 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec600b7db0 con 0x7fec600d35f0 2024-04-16T16:16:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.851+0000 7fec57e00640 1 --2- 172.21.15.43:0/921194703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec600d35f0 0x7fec600d17a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec48009870 tx=0x7fec4802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5a6127a5db128b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.852+0000 7fec5d400640 1 -- 172.21.15.43:0/921194703 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48035020 con 0x7fec600d35f0 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.852+0000 7fec5d400640 1 -- 172.21.15.43:0/921194703 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec48031640 con 0x7fec600d35f0 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.852+0000 7fec5d400640 1 -- 172.21.15.43:0/921194703 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4802d040 con 0x7fec600d35f0 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.852+0000 7fec5f200640 1 -- 172.21.15.43:0/921194703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec600d35f0 msgr2=0x7fec600d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.852+0000 7fec5f200640 1 --2- 172.21.15.43:0/921194703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec600d35f0 0x7fec600d17a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec48009870 tx=0x7fec4802b8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.853+0000 7fec5f200640 1 -- 172.21.15.43:0/921194703 shutdown_connections 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.853+0000 7fec5f200640 1 --2- 172.21.15.43:0/921194703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec600d35f0 0x7fec600d17a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.853+0000 7fec5f200640 1 --2- 172.21.15.43:0/921194703 >> v2:172.21.15.22:3300/0 conn(0x7fec6015eb60 0x7fec600cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.853+0000 7fec5f200640 1 -- 172.21.15.43:0/921194703 >> 172.21.15.43:0/921194703 conn(0x7fec60072460 msgr2=0x7fec60072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.853+0000 7fec5f200640 1 -- 172.21.15.43:0/921194703 shutdown_connections 2024-04-16T16:16:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.853+0000 7fec5f200640 1 -- 172.21.15.43:0/921194703 wait complete. 2024-04-16T16:16:25.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.854+0000 7fec5f200640 1 Processor -- start 2024-04-16T16:16:25.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.855+0000 7fec5f200640 1 -- start start 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.855+0000 7fec5f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec600d35f0 0x7fec600c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.855+0000 7fec5f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec600d3a30 0x7fec60154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec6015eb60 0x7fec600cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fec600b9460 con 0x7fec600d3a30 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fec600b92e0 con 0x7fec600d35f0 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fec600b95e0 con 0x7fec6015eb60 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec6015eb60 0x7fec600cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec600d35f0 0x7fec600c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec6015eb60 0x7fec600cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:44286/0 (socket says 172.21.15.43:44286) 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 -- 172.21.15.43:0/3835831924 learned_addr learned my addr 172.21.15.43:0/3835831924 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-16T16:16:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec57e00640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec600d3a30 0x7fec60154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 -- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec600d35f0 msgr2=0x7fec600c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec600d35f0 0x7fec600c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 -- 172.21.15.43:0/3835831924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec600d3a30 msgr2=0x7fec60154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec600d3a30 0x7fec60154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5e800640 1 -- 172.21.15.43:0/3835831924 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec600c9210 con 0x7fec6015eb60 2024-04-16T16:16:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.856+0000 7fec5de00640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec600d35f0 0x7fec600c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.857+0000 7fec5e800640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec6015eb60 0x7fec600cda40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c780 tx=0x7fec5800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.857+0000 7fec56000640 1 -- 172.21.15.43:0/3835831924 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58016020 con 0x7fec6015eb60 2024-04-16T16:16:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.857+0000 7fec56000640 1 -- 172.21.15.43:0/3835831924 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5800aa50 con 0x7fec6015eb60 2024-04-16T16:16:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.857+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec600c94f0 con 0x7fec6015eb60 2024-04-16T16:16:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.857+0000 7fec56000640 1 -- 172.21.15.43:0/3835831924 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5800ce30 con 0x7fec6015eb60 2024-04-16T16:16:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.857+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec600c9d90 con 0x7fec6015eb60 2024-04-16T16:16:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.857+0000 7fec56000640 1 -- 172.21.15.43:0/3835831924 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fec58019020 con 0x7fec6015eb60 2024-04-16T16:16:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.858+0000 7fec56000640 1 -- 172.21.15.43:0/3835831924 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fec580127b0 con 0x7fec6015eb60 2024-04-16T16:16:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.858+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec600c96c0 con 0x7fec6015eb60 2024-04-16T16:16:25.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.861+0000 7fec56000640 1 -- 172.21.15.43:0/3835831924 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fec58020020 con 0x7fec6015eb60 2024-04-16T16:16:25.871 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.872+0000 7ff900a3a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T16:16:25.924 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:25.924+0000 7ff900a3a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T16:16:25.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.940+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6a25f11e-2222-4e6d-8a6e-da1ddf1c6271", "id": 7} v 0) -- 0x7fec60075f30 con 0x7fec6015eb60 2024-04-16T16:16:25.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.948+0000 7fec56000640 1 -- 172.21.15.43:0/3835831924 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a25f11e-2222-4e6d-8a6e-da1ddf1c6271", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fec5801b400 con 0x7fec6015eb60 2024-04-16T16:16:25.948 INFO:teuthology.orchestra.run.smithi043.stdout:7 2024-04-16T16:16:25.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec6015eb60 msgr2=0x7fec600cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:25.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec6015eb60 0x7fec600cda40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c780 tx=0x7fec5800cc40 comp rx=0 tx=0).stop 2024-04-16T16:16:25.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 shutdown_connections 2024-04-16T16:16:25.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec6015eb60 0x7fec600cda40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec600d3a30 0x7fec60154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 --2- 172.21.15.43:0/3835831924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec600d35f0 0x7fec600c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 >> 172.21.15.43:0/3835831924 conn(0x7fec60072460 msgr2=0x7fec60072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 shutdown_connections 2024-04-16T16:16:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:16:25.950+0000 7fec5f200640 1 -- 172.21.15.43:0/3835831924 wait complete. 2024-04-16T16:16:25.966 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-16T16:16:25.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-16T16:16:25.972 INFO:tasks.ceph.osd.0:Started 2024-04-16T16:16:25.972 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-16T16:16:25.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-16T16:16:25.979 INFO:tasks.ceph.osd.1:Started 2024-04-16T16:16:25.979 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-16T16:16:25.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-16T16:16:25.984 INFO:tasks.ceph.osd.2:Started 2024-04-16T16:16:25.985 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-16T16:16:25.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-16T16:16:25.990 INFO:tasks.ceph.osd.3:Started 2024-04-16T16:16:25.990 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-16T16:16:25.990 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-16T16:16:26.013 INFO:tasks.ceph.osd.4:Started 2024-04-16T16:16:26.013 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-16T16:16:26.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-16T16:16:26.020 INFO:tasks.ceph.osd.5:Started 2024-04-16T16:16:26.020 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-16T16:16:26.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-16T16:16:26.024 INFO:tasks.ceph.osd.6:Started 2024-04-16T16:16:26.024 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-16T16:16:26.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-16T16:16:26.026 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:26.027+0000 7f0568a37040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T16:16:26.029 INFO:tasks.ceph.osd.7:Started 2024-04-16T16:16:26.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:26.128 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:26.128+0000 7ff900a3a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T16:16:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.277+0000 7f0580000640 1 Processor -- start 2024-04-16T16:16:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.278+0000 7f0580000640 1 -- start start 2024-04-16T16:16:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f0580000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05780b3f50 0x7f05780cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f0580000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05780cba10 con 0x7f0578162330 2024-04-16T16:16:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f0580000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05780d1de0 con 0x7f0578162710 2024-04-16T16:16:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f0580000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f05780d4460 con 0x7f05780b3f50 2024-04-16T16:16:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f057cc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05780b3f50 0x7f05780cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f057d600640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0578162330 0x7f05780d3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46288/0 (socket says 172.21.15.22:46288) 2024-04-16T16:16:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f057d600640 1 -- 172.21.15.22:0/2679756488 learned_addr learned my addr 172.21.15.22:0/2679756488 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f057cc00640 1 -- 172.21.15.22:0/2679756488 >> v1:172.21.15.43:6789/0 conn(0x7f0578162710 legacy=0x7f05780b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:26.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.279+0000 7f057cc00640 1 -- 172.21.15.22:0/2679756488 >> v1:172.21.15.22:6789/0 conn(0x7f0578162330 legacy=0x7f05780d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:26.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.280+0000 7f0577e00640 1 -- 172.21.15.22:0/2679756488 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878848625 0 0) 0x7f05780cba10 con 0x7f0578162330 2024-04-16T16:16:26.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.280+0000 7f057cc00640 1 -- 172.21.15.22:0/2679756488 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05780d4740 con 0x7f05780b3f50 2024-04-16T16:16:26.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.281+0000 7f057cc00640 1 --2- 172.21.15.22:0/2679756488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05780b3f50 0x7f05780cfb90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05640097a0 tx=0x7f056402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38f891f5aab86fb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:26.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.281+0000 7f0577e00640 1 -- 172.21.15.22:0/2679756488 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564034070 con 0x7f05780b3f50 2024-04-16T16:16:26.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.281+0000 7f0577e00640 1 -- 172.21.15.22:0/2679756488 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0564030610 con 0x7f05780b3f50 2024-04-16T16:16:26.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.281+0000 7f0577e00640 1 -- 172.21.15.22:0/2679756488 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640309e0 con 0x7f05780b3f50 2024-04-16T16:16:26.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.282+0000 7f0580000640 1 -- 172.21.15.22:0/2679756488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05780b3f50 msgr2=0x7f05780cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.282+0000 7f0580000640 1 --2- 172.21.15.22:0/2679756488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05780b3f50 0x7f05780cfb90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05640097a0 tx=0x7f056402b960 comp rx=0 tx=0).stop 2024-04-16T16:16:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.282+0000 7f0580000640 1 -- 172.21.15.22:0/2679756488 shutdown_connections 2024-04-16T16:16:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.282+0000 7f0580000640 1 --2- 172.21.15.22:0/2679756488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05780b3f50 0x7f05780cfb90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.282+0000 7f0580000640 1 -- 172.21.15.22:0/2679756488 >> 172.21.15.22:0/2679756488 conn(0x7f0578062860 msgr2=0x7f0578062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.282+0000 7f0580000640 1 -- 172.21.15.22:0/2679756488 shutdown_connections 2024-04-16T16:16:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.282+0000 7f0580000640 1 -- 172.21.15.22:0/2679756488 wait complete. 2024-04-16T16:16:26.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.283+0000 7f0580000640 1 Processor -- start 2024-04-16T16:16:26.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.284+0000 7f0580000640 1 -- start start 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.284+0000 7f0580000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05780b3f50 0x7f057815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.284+0000 7f0580000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0578162330 0x7f0578159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.284+0000 7f0580000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0578162710 0x7f05780cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.284+0000 7f0580000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f05780cf180 con 0x7f0578162330 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.284+0000 7f0580000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f05780d2380 con 0x7f0578162710 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f0580000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f05780cf6a0 con 0x7f05780b3f50 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0578162330 0x7f0578159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:26.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0578162330 0x7f0578159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49630/0 (socket says 172.21.15.22:49630) 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 -- 172.21.15.22:0/17738318 learned_addr learned my addr 172.21.15.22:0/17738318 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057d600640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05780b3f50 0x7f057815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057e000640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0578162710 0x7f05780cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 -- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05780b3f50 msgr2=0x7f057815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05780b3f50 0x7f057815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 -- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0578162710 msgr2=0x7f05780cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0578162710 0x7f05780cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057cc00640 1 -- 172.21.15.22:0/17738318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057815be60 con 0x7f0578162330 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.285+0000 7f057d600640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05780b3f50 0x7f057815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:26.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f057cc00640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0578162330 0x7f0578159bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05640098c0 tx=0x7f05640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:26.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f0575600640 1 -- 172.21.15.22:0/17738318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564034040 con 0x7f0578162330 2024-04-16T16:16:26.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f0575600640 1 -- 172.21.15.22:0/17738318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0564039a10 con 0x7f0578162330 2024-04-16T16:16:26.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057815c140 con 0x7f0578162330 2024-04-16T16:16:26.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f0575600640 1 -- 172.21.15.22:0/17738318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564039de0 con 0x7f0578162330 2024-04-16T16:16:26.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057815bae0 con 0x7f0578162330 2024-04-16T16:16:26.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f0575600640 1 -- 172.21.15.22:0/17738318 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0564037070 con 0x7f0578162330 2024-04-16T16:16:26.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.286+0000 7f0575600640 1 -- 172.21.15.22:0/17738318 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0564042ac0 con 0x7f0578162330 2024-04-16T16:16:26.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.287+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057804fd90 con 0x7f0578162330 2024-04-16T16:16:26.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.290+0000 7f0575600640 1 -- 172.21.15.22:0/17738318 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f05640305a0 con 0x7f0578162330 2024-04-16T16:16:26.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.356+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05780d0f30 con 0x7f0578162330 2024-04-16T16:16:26.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.357+0000 7f0575600640 1 -- 172.21.15.22:0/17738318 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0564042d30 con 0x7f0578162330 2024-04-16T16:16:26.355 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:26.355 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:25.943255+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0578162330 msgr2=0x7f0578159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0578162330 0x7f0578159bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05640098c0 tx=0x7f05640046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 shutdown_connections 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0578162710 0x7f05780cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0578162330 0x7f0578159bb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 --2- 172.21.15.22:0/17738318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05780b3f50 0x7f057815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 >> 172.21.15.22:0/17738318 conn(0x7f0578062860 msgr2=0x7f0578160280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 shutdown_connections 2024-04-16T16:16:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:26.358+0000 7f0580000640 1 -- 172.21.15.22:0/17738318 wait complete. 2024-04-16T16:16:26.372 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-16T16:16:26.372 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T16:16:26.685 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-04-16T16:16:26.686+0000 7f98025ac640 -1 Falling back to public interface 2024-04-16T16:16:26.694 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-04-16T16:16:26.695+0000 7fc3d6010640 -1 Falling back to public interface 2024-04-16T16:16:26.701 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-04-16T16:16:26.701+0000 7fac6600f640 -1 Falling back to public interface 2024-04-16T16:16:26.705 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-04-16T16:16:26.706+0000 7fcdd6a19640 -1 Falling back to public interface 2024-04-16T16:16:26.705 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-04-16T16:16:26.707+0000 7fd923413640 -1 Falling back to public interface 2024-04-16T16:16:26.706 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-04-16T16:16:26.707+0000 7f6cdd506640 -1 Falling back to public interface 2024-04-16T16:16:26.749 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-04-16T16:16:26.750+0000 7fcdf9c1e640 -1 Falling back to public interface 2024-04-16T16:16:26.758 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-04-16T16:16:26.758+0000 7f66ff411640 -1 Falling back to public interface 2024-04-16T16:16:27.142 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:27.143+0000 7f0568a37040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T16:16:27.177 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:27.181 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:27.181+0000 7ff900a3a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T16:16:27.340 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.341+0000 7f81aae00640 1 Processor -- start 2024-04-16T16:16:27.340 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.342+0000 7f81aae00640 1 -- start start 2024-04-16T16:16:27.342 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.343+0000 7f81aae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:27.342 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.343+0000 7f81aae00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a4160240 con 0x7f81a406ec70 2024-04-16T16:16:27.342 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.343+0000 7f81aae00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a40af9f0 con 0x7f81a4159420 2024-04-16T16:16:27.342 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.343+0000 7f81aae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f81a40b0320 con 0x7f81a415fcf0 2024-04-16T16:16:27.342 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.343+0000 7f81a8e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f81a406ec70 0x7f81a406f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46296/0 (socket says 172.21.15.22:46296) 2024-04-16T16:16:27.342 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.343+0000 7f81a8e00640 1 -- 172.21.15.22:0/651066998 learned_addr learned my addr 172.21.15.22:0/651066998 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:27.342 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.343+0000 7f819be00640 1 --2- 172.21.15.22:0/651066998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964194415 0 0) 0x7f81a4160240 con 0x7f81a406ec70 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8188003520 con 0x7f81a406ec70 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151174775 0 0) 0x7f81a40af9f0 con 0x7f81a4159420 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a4160240 con 0x7f81a4159420 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f819be00640 1 -- 172.21.15.22:0/651066998 >> v1:172.21.15.43:6789/0 conn(0x7f81a4159420 legacy=0x7f81a406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f819be00640 1 -- 172.21.15.22:0/651066998 >> v1:172.21.15.22:6789/0 conn(0x7f81a406ec70 legacy=0x7f81a406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1307904742 0 0) 0x7f8188003520 con 0x7f81a406ec70 2024-04-16T16:16:27.343 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.344+0000 7f819be00640 1 -- 172.21.15.22:0/651066998 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a40afcd0 con 0x7f81a415fcf0 2024-04-16T16:16:27.344 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.345+0000 7f819be00640 1 --2- 172.21.15.22:0/651066998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a406dd30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f818c0097d0 tx=0x7f818c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68adf545c6cd2a35 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:27.344 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.345+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c037070 con 0x7f81a415fcf0 2024-04-16T16:16:27.344 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.345+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818c030510 con 0x7f81a415fcf0 2024-04-16T16:16:27.344 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.345+0000 7f81a3400640 1 -- 172.21.15.22:0/651066998 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c0019f0 con 0x7f81a415fcf0 2024-04-16T16:16:27.345 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.346+0000 7f81aae00640 1 -- 172.21.15.22:0/651066998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 msgr2=0x7f81a406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:27.345 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.346+0000 7f81aae00640 1 --2- 172.21.15.22:0/651066998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a406dd30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f818c0097d0 tx=0x7f818c02b800 comp rx=0 tx=0).stop 2024-04-16T16:16:27.345 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.346+0000 7f81aae00640 1 -- 172.21.15.22:0/651066998 shutdown_connections 2024-04-16T16:16:27.345 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.346+0000 7f81aae00640 1 --2- 172.21.15.22:0/651066998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a406dd30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:27.345 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.346+0000 7f81aae00640 1 -- 172.21.15.22:0/651066998 >> 172.21.15.22:0/651066998 conn(0x7f81a40d0ef0 msgr2=0x7f81a40d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:27.345 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.346+0000 7f81aae00640 1 -- 172.21.15.22:0/651066998 shutdown_connections 2024-04-16T16:16:27.346 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.346+0000 7f81aae00640 1 -- 172.21.15.22:0/651066998 wait complete. 2024-04-16T16:16:27.346 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.348+0000 7f81aae00640 1 Processor -- start 2024-04-16T16:16:27.347 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.348+0000 7f81aae00640 1 -- start start 2024-04-16T16:16:27.348 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81aae00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a406ec70 0x7f81a41418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:27.348 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81aae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a4159420 0x7f81a4072510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81aae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a4140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81aae00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4074cd0 con 0x7f81a406ec70 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81aae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4074b50 con 0x7f81a4159420 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81aae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f81a40b07b0 con 0x7f81a415fcf0 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81a3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a406ec70 0x7f81a41418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81a3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a406ec70 0x7f81a41418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49640/0 (socket says 172.21.15.22:49640) 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f81a3e00640 1 -- 172.21.15.22:0/463574177 learned_addr learned my addr 172.21.15.22:0/463574177 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.349+0000 7f819be00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a4159420 0x7f81a4072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a8e00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a4140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a3e00640 1 -- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 msgr2=0x7f81a4140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a3e00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a4140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a3e00640 1 -- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a4159420 msgr2=0x7f81a4072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a3e00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a4159420 0x7f81a4072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a3e00640 1 -- 172.21.15.22:0/463574177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a4073550 con 0x7f81a406ec70 2024-04-16T16:16:27.349 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a8e00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:27.350 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a3e00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a406ec70 0x7f81a41418f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f819400c4c0 tx=0x7f819400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:27.350 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a0c00640 1 -- 172.21.15.22:0/463574177 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81940052d0 con 0x7f81a406ec70 2024-04-16T16:16:27.351 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a0c00640 1 -- 172.21.15.22:0/463574177 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8194005470 con 0x7f81a406ec70 2024-04-16T16:16:27.351 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a4072cb0 con 0x7f81a406ec70 2024-04-16T16:16:27.351 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81a0c00640 1 -- 172.21.15.22:0/463574177 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194012870 con 0x7f81a406ec70 2024-04-16T16:16:27.351 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.350+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a4073270 con 0x7f81a406ec70 2024-04-16T16:16:27.351 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.351+0000 7f81a0c00640 1 -- 172.21.15.22:0/463574177 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8194012a10 con 0x7f81a406ec70 2024-04-16T16:16:27.351 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.351+0000 7f81a0c00640 1 -- 172.21.15.22:0/463574177 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8194012d00 con 0x7f81a406ec70 2024-04-16T16:16:27.351 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.352+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a404fd90 con 0x7f81a406ec70 2024-04-16T16:16:27.353 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.354+0000 7f81a0c00640 1 -- 172.21.15.22:0/463574177 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f81940035f0 con 0x7f81a406ec70 2024-04-16T16:16:27.418 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.420+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81a406fec0 con 0x7f81a406ec70 2024-04-16T16:16:27.419 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.420+0000 7f81a0c00640 1 -- 172.21.15.22:0/463574177 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8194003880 con 0x7f81a406ec70 2024-04-16T16:16:27.419 INFO:teuthology.misc.health.smithi022.stdout: 2024-04-16T16:16:27.419 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:25.943255+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a406ec70 msgr2=0x7f81a41418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a406ec70 0x7f81a41418f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f819400c4c0 tx=0x7f819400c980 comp rx=0 tx=0).stop 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 shutdown_connections 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81a415fcf0 0x7f81a4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a4159420 0x7f81a4072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 --2- 172.21.15.22:0/463574177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a406ec70 0x7f81a41418f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 >> 172.21.15.22:0/463574177 conn(0x7f81a40d0ef0 msgr2=0x7f81a40b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 shutdown_connections 2024-04-16T16:16:27.421 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:27.422+0000 7f81aae00640 1 -- 172.21.15.22:0/463574177 wait complete. 2024-04-16T16:16:27.433 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T16:16:27.478 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:27.479+0000 7f0568a37040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T16:16:27.510 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:27.511+0000 7ff900a3a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T16:16:27.541 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:27.543+0000 7f0568a37040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T16:16:27.574 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:27.575+0000 7ff900a3a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T16:16:27.680 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:27.681+0000 7f0568a37040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T16:16:27.712 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-16T16:16:27.713+0000 7ff900a3a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T16:16:28.717 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:28.718+0000 7f0509400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-16T16:16:28.720 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:16:28.722+0000 7f0509400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-16T16:16:30.093 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-04-16T16:16:30.093+0000 7fac6600f640 -1 osd.5 0 log_to_monitors true 2024-04-16T16:16:30.282 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-04-16T16:16:30.283+0000 7f98025ac640 -1 osd.2 0 log_to_monitors true 2024-04-16T16:16:30.316 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-04-16T16:16:30.317+0000 7fc3d6010640 -1 osd.1 0 log_to_monitors true 2024-04-16T16:16:30.350 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-04-16T16:16:30.351+0000 7fd923413640 -1 osd.3 0 log_to_monitors true 2024-04-16T16:16:30.360 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-04-16T16:16:30.362+0000 7fcdd6a19640 -1 osd.0 0 log_to_monitors true 2024-04-16T16:16:30.421 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-04-16T16:16:30.421+0000 7fcdf9c1e640 -1 osd.6 0 log_to_monitors true 2024-04-16T16:16:30.570 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-04-16T16:16:30.570+0000 7f6cdd506640 -1 osd.4 0 log_to_monitors true 2024-04-16T16:16:30.640 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-04-16T16:16:30.640+0000 7f66ff411640 -1 osd.7 0 log_to_monitors true 2024-04-16T16:16:33.412 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-04-16T16:16:33.413+0000 7f97fd400640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T16:16:33.418 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-04-16T16:16:33.419+0000 7f66fa200640 -1 osd.7 0 waiting for initial osdmap 2024-04-16T16:16:33.421 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-04-16T16:16:33.422+0000 7f97f3400640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:33.428 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-04-16T16:16:33.428+0000 7f66f0200640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:33.432 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-04-16T16:16:33.433+0000 7fac60a00640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T16:16:33.435 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-04-16T16:16:33.437+0000 7fd91dc00640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T16:16:33.438 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-04-16T16:16:33.438+0000 7fac56a00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:33.442 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-04-16T16:16:33.443+0000 7fd913c00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:33.457 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-04-16T16:16:33.458+0000 7fc3d0800640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T16:16:33.466 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-04-16T16:16:33.467+0000 7fc3c6800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:33.472 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-04-16T16:16:33.474+0000 7fcdd1400640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T16:16:33.483 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-04-16T16:16:33.483+0000 7fcdf4600640 -1 osd.6 0 waiting for initial osdmap 2024-04-16T16:16:33.486 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-04-16T16:16:33.487+0000 7fcdc7400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:33.488 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-04-16T16:16:33.489+0000 7f6cd8e00640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T16:16:33.496 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-04-16T16:16:33.497+0000 7f6cce400640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:33.497 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-04-16T16:16:33.498+0000 7fcdea600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T16:16:34.240 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:34.439 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.440+0000 7f5d4f000640 1 Processor -- start 2024-04-16T16:16:34.440 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.440+0000 7f5d4f000640 1 -- start start 2024-04-16T16:16:34.441 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.442+0000 7f5d4f000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5d480ba6a0 0x7f5d480d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.441 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.442+0000 7f5d4f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d480d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.441 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.442+0000 7f5d4f000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d48160ac0 con 0x7f5d480b6470 2024-04-16T16:16:34.441 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.442+0000 7f5d4f000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5d48160870 con 0x7f5d480ba6a0 2024-04-16T16:16:34.441 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.442+0000 7f5d4f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5d481616d0 con 0x7f5d480b36f0 2024-04-16T16:16:34.442 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.443+0000 7f5d47400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d480d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.442 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.443+0000 7f5d47400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d480d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:48946/0 (socket says 172.21.15.22:48946) 2024-04-16T16:16:34.442 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.443+0000 7f5d47400640 1 -- 172.21.15.22:0/418613552 learned_addr learned my addr 172.21.15.22:0/418613552 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:34.444 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.444+0000 7f5d47400640 1 -- 172.21.15.22:0/418613552 >> v2:172.21.15.43:3300/0 conn(0x7f5d480ba6a0 msgr2=0x7f5d480d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:34.444 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.444+0000 7f5d47400640 1 --2- 172.21.15.22:0/418613552 >> v2:172.21.15.43:3300/0 conn(0x7f5d480ba6a0 0x7f5d480d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.444 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.444+0000 7f5d47400640 1 -- 172.21.15.22:0/418613552 >> v1:172.21.15.43:6789/0 conn(0x7f5d480b6470 legacy=0x7f5d48161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:34.444 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.445+0000 7f5d47400640 1 -- 172.21.15.22:0/418613552 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d48160da0 con 0x7f5d480b36f0 2024-04-16T16:16:34.445 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.447+0000 7f5d47400640 1 --2- 172.21.15.22:0/418613552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d480d25c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009870 tx=0x7f5d3402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c56468f97386f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:34.447 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.448+0000 7f5d46a00640 1 -- 172.21.15.22:0/418613552 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34035020 con 0x7f5d480b36f0 2024-04-16T16:16:34.447 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.448+0000 7f5d46a00640 1 -- 172.21.15.22:0/418613552 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d34031640 con 0x7f5d480b36f0 2024-04-16T16:16:34.447 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.448+0000 7f5d46a00640 1 -- 172.21.15.22:0/418613552 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3402d040 con 0x7f5d480b36f0 2024-04-16T16:16:34.448 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.449+0000 7f5d4f000640 1 -- 172.21.15.22:0/418613552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 msgr2=0x7f5d480d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.448 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.449+0000 7f5d4f000640 1 --2- 172.21.15.22:0/418613552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d480d25c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009870 tx=0x7f5d3402b8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.448 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.449+0000 7f5d4f000640 1 -- 172.21.15.22:0/418613552 shutdown_connections 2024-04-16T16:16:34.449 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.449+0000 7f5d4f000640 1 --2- 172.21.15.22:0/418613552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d480d25c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.449 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.449+0000 7f5d4f000640 1 --2- 172.21.15.22:0/418613552 >> v2:172.21.15.43:3300/0 conn(0x7f5d480ba6a0 0x7f5d480d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.449 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.449+0000 7f5d4f000640 1 -- 172.21.15.22:0/418613552 >> 172.21.15.22:0/418613552 conn(0x7f5d48062860 msgr2=0x7f5d48062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:34.449 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.450+0000 7f5d4f000640 1 -- 172.21.15.22:0/418613552 shutdown_connections 2024-04-16T16:16:34.449 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.450+0000 7f5d4f000640 1 -- 172.21.15.22:0/418613552 wait complete. 2024-04-16T16:16:34.450 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.451+0000 7f5d4f000640 1 Processor -- start 2024-04-16T16:16:34.450 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.452+0000 7f5d4f000640 1 -- start start 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d4815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d480b6470 0x7f5d4815f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4f000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d480ba6a0 0x7f5d480b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4f000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d480d2b00 con 0x7f5d480ba6a0 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d48161360 con 0x7f5d480b6470 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5d48162270 con 0x7f5d480b36f0 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d480ba6a0 0x7f5d480b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d47e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d4815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.452 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d480ba6a0 0x7f5d480b8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37358/0 (socket says 172.21.15.22:37358) 2024-04-16T16:16:34.453 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d47e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d4815fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:48956/0 (socket says 172.21.15.22:48956) 2024-04-16T16:16:34.453 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d4d000640 1 -- 172.21.15.22:0/2219895513 learned_addr learned my addr 172.21.15.22:0/2219895513 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:34.453 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.453+0000 7f5d47400640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d480b6470 0x7f5d4815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4d000640 1 -- 172.21.15.22:0/2219895513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 msgr2=0x7f5d4815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4d000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d4815fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4d000640 1 -- 172.21.15.22:0/2219895513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d480b6470 msgr2=0x7f5d4815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4d000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d480b6470 0x7f5d4815f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4d000640 1 -- 172.21.15.22:0/2219895513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d480cd120 con 0x7f5d480ba6a0 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4d000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d480ba6a0 0x7f5d480b8460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c780 tx=0x7f5d4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d3fe00640 1 -- 172.21.15.22:0/2219895513 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40017070 con 0x7f5d480ba6a0 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d3fe00640 1 -- 172.21.15.22:0/2219895513 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40003da0 con 0x7f5d480ba6a0 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d3fe00640 1 -- 172.21.15.22:0/2219895513 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d400052b0 con 0x7f5d480ba6a0 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d480cc080 con 0x7f5d480ba6a0 2024-04-16T16:16:34.454 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.454+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d480cc640 con 0x7f5d480ba6a0 2024-04-16T16:16:34.455 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.456+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4804fd90 con 0x7f5d480ba6a0 2024-04-16T16:16:34.455 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.457+0000 7f5d3fe00640 1 -- 172.21.15.22:0/2219895513 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f5d4001a070 con 0x7f5d480ba6a0 2024-04-16T16:16:34.456 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.457+0000 7f5d3fe00640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5d2806c890 0x7f5d2806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.456 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.458+0000 7f5d3fe00640 1 -- 172.21.15.22:0/2219895513 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f5d4008aa80 con 0x7f5d480ba6a0 2024-04-16T16:16:34.456 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.458+0000 7f5d47e00640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5d2806c890 0x7f5d2806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.457 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.459+0000 7f5d47e00640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5d2806c890 0x7f5d2806ed50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d480caab0 tx=0x7f5d38009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:34.462 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.463+0000 7f5d3fe00640 1 -- 172.21.15.22:0/2219895513 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5d40058ea0 con 0x7f5d480ba6a0 2024-04-16T16:16:34.660 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.661+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d480b7180 con 0x7f5d480ba6a0 2024-04-16T16:16:34.661 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.663+0000 7f5d3fe00640 1 -- 172.21.15.22:0/2219895513 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10789 (secure 0 0 0) 0x7f5d4008ae20 con 0x7f5d480ba6a0 2024-04-16T16:16:34.662 INFO:teuthology.misc.health.smithi022.stdout: 2024-04-16T16:16:34.662 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":13,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:34.418784+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:34.664 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5d2806c890 msgr2=0x7f5d2806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.664 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5d2806c890 0x7f5d2806ed50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d480caab0 tx=0x7f5d38009060 comp rx=0 tx=0).stop 2024-04-16T16:16:34.664 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d480ba6a0 msgr2=0x7f5d480b8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.664 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d480ba6a0 0x7f5d480b8460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c780 tx=0x7f5d4000cc40 comp rx=0 tx=0).stop 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 shutdown_connections 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5d2806c890 0x7f5d2806ed50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d480ba6a0 0x7f5d480b8460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d480b6470 0x7f5d4815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 --2- 172.21.15.22:0/2219895513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d480b36f0 0x7f5d4815fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 >> 172.21.15.22:0/2219895513 conn(0x7f5d48062860 msgr2=0x7f5d480b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.665+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 shutdown_connections 2024-04-16T16:16:34.665 INFO:teuthology.misc.health.smithi022.stderr:2024-04-16T16:16:34.666+0000 7f5d4f000640 1 -- 172.21.15.22:0/2219895513 wait complete. 2024-04-16T16:16:34.678 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-16T16:16:34.678 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-16T16:16:34.678 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T16:16:34.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T16:16:34.683 INFO:tasks.ceph.mds.a:Started 2024-04-16T16:16:34.683 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T16:16:34.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T16:16:34.688 INFO:tasks.ceph.mds.c:Started 2024-04-16T16:16:34.688 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T16:16:34.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T16:16:34.696 INFO:tasks.ceph.mds.b:Started 2024-04-16T16:16:34.696 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T16:16:34.696 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T16:16:34.703 INFO:tasks.ceph.mds.d:Started 2024-04-16T16:16:34.703 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-16T16:16:34.704 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:34.837 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2024-04-16T16:16:34.840 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2024-04-16T16:16:34.859 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-04-16T16:16:34.861 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-04-16T16:16:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.888+0000 7fc36d600640 1 Processor -- start 2024-04-16T16:16:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.889+0000 7fc36d600640 1 -- start start 2024-04-16T16:16:34.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc36d600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc3680cf890 0x7fc3680cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc36d600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc3680b7c60 0x7fc3680b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc36d600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680d39a0 con 0x7fc36815ed60 2024-04-16T16:16:34.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc36d600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc3680d0240 con 0x7fc3680cf890 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc36d600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc3680d3c80 con 0x7fc3680b7c60 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc366a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc36815ed60 0x7fc3680d2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50012/0 (socket says 172.21.15.22:50012) 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc366a00640 1 -- 172.21.15.22:0/2737888926 learned_addr learned my addr 172.21.15.22:0/2737888926 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc35fe00640 1 --2- 172.21.15.22:0/2737888926 >> v2:172.21.15.22:3300/0 conn(0x7fc3680cf890 0x7fc3680cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.890+0000 7fc367400640 1 --2- 172.21.15.22:0/2737888926 >> v2:172.21.15.43:3300/0 conn(0x7fc3680b7c60 0x7fc3680b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.891+0000 7fc35fe00640 1 -- 172.21.15.22:0/2737888926 >> v2:172.21.15.43:3300/0 conn(0x7fc3680b7c60 msgr2=0x7fc3680b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.891+0000 7fc35fe00640 1 --2- 172.21.15.22:0/2737888926 >> v2:172.21.15.43:3300/0 conn(0x7fc3680b7c60 0x7fc3680b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.891+0000 7fc35fe00640 1 -- 172.21.15.22:0/2737888926 >> v1:172.21.15.22:6789/0 conn(0x7fc36815ed60 legacy=0x7fc3680d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.891+0000 7fc35fe00640 1 -- 172.21.15.22:0/2737888926 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3680d3f60 con 0x7fc3680cf890 2024-04-16T16:16:34.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.892+0000 7fc35fe00640 1 --2- 172.21.15.22:0/2737888926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3680cf890 0x7fc3680cfd00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097a0 tx=0x7fc35002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eefdf75f0b1c48f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.892+0000 7fc366000640 1 -- 172.21.15.22:0/2737888926 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350034070 con 0x7fc3680cf890 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.892+0000 7fc366000640 1 -- 172.21.15.22:0/2737888926 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc350030610 con 0x7fc3680cf890 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.892+0000 7fc366000640 1 -- 172.21.15.22:0/2737888926 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500309e0 con 0x7fc3680cf890 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 -- 172.21.15.22:0/2737888926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3680cf890 msgr2=0x7fc3680cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 --2- 172.21.15.22:0/2737888926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3680cf890 0x7fc3680cfd00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097a0 tx=0x7fc35002b960 comp rx=0 tx=0).stop 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 -- 172.21.15.22:0/2737888926 shutdown_connections 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 --2- 172.21.15.22:0/2737888926 >> v2:172.21.15.43:3300/0 conn(0x7fc3680b7c60 0x7fc3680b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 --2- 172.21.15.22:0/2737888926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3680cf890 0x7fc3680cfd00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 -- 172.21.15.22:0/2737888926 >> 172.21.15.22:0/2737888926 conn(0x7fc368062620 msgr2=0x7fc368062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 -- 172.21.15.22:0/2737888926 shutdown_connections 2024-04-16T16:16:34.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.893+0000 7fc36d600640 1 -- 172.21.15.22:0/2737888926 wait complete. 2024-04-16T16:16:34.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.894+0000 7fc36d600640 1 Processor -- start 2024-04-16T16:16:34.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.895+0000 7fc36d600640 1 -- start start 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.895+0000 7fc36d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3680b7c60 0x7fc3681f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.895+0000 7fc36d600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3680cf890 0x7fc36815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.895+0000 7fc36d600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36815ed60 0x7fc3681f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.895+0000 7fc36d600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc36815f140 con 0x7fc36815ed60 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.895+0000 7fc36d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680d4520 con 0x7fc3680b7c60 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.895+0000 7fc36d600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3680ba970 con 0x7fc3680cf890 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36815ed60 0x7fc3681f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36815ed60 0x7fc3681f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37422/0 (socket says 172.21.15.22:37422) 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 -- 172.21.15.22:0/3715927657 learned_addr learned my addr 172.21.15.22:0/3715927657 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc366a00640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3680b7c60 0x7fc3681f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc35fe00640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3680cf890 0x7fc36815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 -- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3680cf890 msgr2=0x7fc36815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3680cf890 0x7fc36815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 -- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3680b7c60 msgr2=0x7fc3681f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3680b7c60 0x7fc3681f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 -- 172.21.15.22:0/3715927657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3681603b0 con 0x7fc36815ed60 2024-04-16T16:16:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.896+0000 7fc367400640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36815ed60 0x7fc3681f7d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc360009d30 tx=0x7fc36000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.897+0000 7fc35ea00640 1 -- 172.21.15.22:0/3715927657 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360018020 con 0x7fc36815ed60 2024-04-16T16:16:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.897+0000 7fc35ea00640 1 -- 172.21.15.22:0/3715927657 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360014480 con 0x7fc36815ed60 2024-04-16T16:16:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.897+0000 7fc35ea00640 1 -- 172.21.15.22:0/3715927657 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360014870 con 0x7fc36815ed60 2024-04-16T16:16:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.897+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc368160690 con 0x7fc36815ed60 2024-04-16T16:16:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.897+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3681f4ce0 con 0x7fc36815ed60 2024-04-16T16:16:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.898+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36804fd90 con 0x7fc36815ed60 2024-04-16T16:16:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.899+0000 7fc35ea00640 1 -- 172.21.15.22:0/3715927657 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fc360005d10 con 0x7fc36815ed60 2024-04-16T16:16:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.900+0000 7fc35ea00640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc34406c8b0 0x7fc34406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.900+0000 7fc35ea00640 1 -- 172.21.15.22:0/3715927657 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fc36008beb0 con 0x7fc36815ed60 2024-04-16T16:16:34.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.900+0000 7fc366a00640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc34406c8b0 0x7fc34406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:34.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.901+0000 7fc366a00640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc34406c8b0 0x7fc34406ed70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc358007fd0 tx=0x7fc358007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:34.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:34.905+0000 7fc35ea00640 1 -- 172.21.15.22:0/3715927657 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc360022070 con 0x7fc36815ed60 2024-04-16T16:16:35.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.101+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3680d3130 con 0x7fc36815ed60 2024-04-16T16:16:35.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.102+0000 7fc35ea00640 1 -- 172.21.15.22:0/3715927657 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10789 (secure 0 0 0) 0x7fc360010040 con 0x7fc36815ed60 2024-04-16T16:16:35.101 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:34.418784+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.104+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc34406c8b0 msgr2=0x7fc34406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.104+0000 7fc36d600640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc34406c8b0 0x7fc34406ed70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc358007fd0 tx=0x7fc358007e80 comp rx=0 tx=0).stop 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.104+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36815ed60 msgr2=0x7fc3681f7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.104+0000 7fc36d600640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36815ed60 0x7fc3681f7d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc360009d30 tx=0x7fc36000c490 comp rx=0 tx=0).stop 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 shutdown_connections 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc34406c8b0 0x7fc34406ed70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36815ed60 0x7fc3681f7d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3680cf890 0x7fc36815ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 --2- 172.21.15.22:0/3715927657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3680b7c60 0x7fc3681f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 >> 172.21.15.22:0/3715927657 conn(0x7fc368062620 msgr2=0x7fc3680ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 shutdown_connections 2024-04-16T16:16:35.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.105+0000 7fc36d600640 1 -- 172.21.15.22:0/3715927657 wait complete. 2024-04-16T16:16:35.120 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-16T16:16:35.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:16:35.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.338+0000 7f1ae0c00640 1 Processor -- start 2024-04-16T16:16:35.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.338+0000 7f1ae0c00640 1 -- start start 2024-04-16T16:16:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.340+0000 7f1ae0c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1adc0d01a0 0x7f1adc0d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.340+0000 7f1ae0c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0b3410 0x7f1adc0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.340+0000 7f1ae0c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1adc0d0ac0 con 0x7f1adc0aeda0 2024-04-16T16:16:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.340+0000 7f1ae0c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1adc06d020 con 0x7f1adc0d01a0 2024-04-16T16:16:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.340+0000 7f1ae0c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc0af2b0 con 0x7f1adc0b3410 2024-04-16T16:16:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.341+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0b3410 0x7f1adc0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.341+0000 7f1adb400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1adc0d01a0 0x7f1adc0d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.341+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0b3410 0x7f1adc0ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:48998/0 (socket says 172.21.15.22:48998) 2024-04-16T16:16:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.341+0000 7f1ad2a00640 1 -- 172.21.15.22:0/1869836678 learned_addr learned my addr 172.21.15.22:0/1869836678 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.342+0000 7f1adb400640 1 -- 172.21.15.22:0/1869836678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0b3410 msgr2=0x7f1adc0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.342+0000 7f1adb400640 1 --2- 172.21.15.22:0/1869836678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0b3410 0x7f1adc0ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.342+0000 7f1adb400640 1 -- 172.21.15.22:0/1869836678 >> v1:172.21.15.43:6789/0 conn(0x7f1adc0aeda0 legacy=0x7f1adc06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.342+0000 7f1adb400640 1 -- 172.21.15.22:0/1869836678 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc0af590 con 0x7f1adc0d01a0 2024-04-16T16:16:35.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.343+0000 7f1adb400640 1 --2- 172.21.15.22:0/1869836678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc0d0580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1c2622f3a7121b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:35.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.344+0000 7f1adaa00640 1 -- 172.21.15.22:0/1869836678 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc034070 con 0x7f1adc0d01a0 2024-04-16T16:16:35.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.344+0000 7f1adaa00640 1 -- 172.21.15.22:0/1869836678 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc030610 con 0x7f1adc0d01a0 2024-04-16T16:16:35.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.344+0000 7f1adaa00640 1 -- 172.21.15.22:0/1869836678 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0309e0 con 0x7f1adc0d01a0 2024-04-16T16:16:35.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.345+0000 7f1ae0c00640 1 -- 172.21.15.22:0/1869836678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 msgr2=0x7f1adc0d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.345+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/1869836678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc0d0580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc02b960 comp rx=0 tx=0).stop 2024-04-16T16:16:35.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.346+0000 7f1ae0c00640 1 -- 172.21.15.22:0/1869836678 shutdown_connections 2024-04-16T16:16:35.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.346+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/1869836678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0b3410 0x7f1adc0ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.346+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/1869836678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc0d0580 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.346+0000 7f1ae0c00640 1 -- 172.21.15.22:0/1869836678 >> 172.21.15.22:0/1869836678 conn(0x7f1adc062440 msgr2=0x7f1adc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:35.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.346+0000 7f1ae0c00640 1 -- 172.21.15.22:0/1869836678 shutdown_connections 2024-04-16T16:16:35.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.346+0000 7f1ae0c00640 1 -- 172.21.15.22:0/1869836678 wait complete. 2024-04-16T16:16:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.348+0000 7f1ae0c00640 1 Processor -- start 2024-04-16T16:16:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.348+0000 7f1ae0c00640 1 -- start start 2024-04-16T16:16:35.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ae0c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0aeda0 0x7f1adc15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ae0c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1adc0b3410 0x7f1adc153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ae0c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc1f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ae0c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc0af870 con 0x7f1adc0b3410 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ae0c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc06d530 con 0x7f1adc0d01a0 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ae0c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc162200 con 0x7f1adc0aeda0 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1adc0b3410 0x7f1adc153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ad2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1adc0b3410 0x7f1adc153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37426/0 (socket says 172.21.15.22:37426) 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.349+0000 7f1ad2a00640 1 -- 172.21.15.22:0/2096432331 learned_addr learned my addr 172.21.15.22:0/2096432331 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1adb400640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0aeda0 0x7f1adc15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1adbe00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc1f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1ad2a00640 1 -- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0aeda0 msgr2=0x7f1adc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1ad2a00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0aeda0 0x7f1adc15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1ad2a00640 1 -- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 msgr2=0x7f1adc1f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1ad2a00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc1f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1ad2a00640 1 -- 172.21.15.22:0/2096432331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc158d90 con 0x7f1adc0b3410 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1adbe00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc1f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.350+0000 7f1ad2a00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1adc0b3410 0x7f1adc153680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400efc0 tx=0x7f1ac400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.351+0000 7f1ad3e00640 1 -- 172.21.15.22:0/2096432331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400cda0 con 0x7f1adc0b3410 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.351+0000 7f1ad3e00640 1 -- 172.21.15.22:0/2096432331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac4019070 con 0x7f1adc0b3410 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.351+0000 7f1ad3e00640 1 -- 172.21.15.22:0/2096432331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4014680 con 0x7f1adc0b3410 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.351+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc15d800 con 0x7f1adc0b3410 2024-04-16T16:16:35.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.351+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc159310 con 0x7f1adc0b3410 2024-04-16T16:16:35.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.352+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc075f30 con 0x7f1adc0b3410 2024-04-16T16:16:35.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.353+0000 7f1ad3e00640 1 -- 172.21.15.22:0/2096432331 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f1ac4005d10 con 0x7f1adc0b3410 2024-04-16T16:16:35.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.354+0000 7f1ad3e00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ab806c860 0x7f1ab806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:35.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.354+0000 7f1ad3e00640 1 -- 172.21.15.22:0/2096432331 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f1ac408bba0 con 0x7f1adc0b3410 2024-04-16T16:16:35.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.354+0000 7f1adb400640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ab806c860 0x7f1ab806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:35.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.355+0000 7f1adb400640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ab806c860 0x7f1ab806ed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1acc036000 tx=0x7f1acc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.358+0000 7f1ad3e00640 1 -- 172.21.15.22:0/2096432331 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ac4010040 con 0x7f1adc0b3410 2024-04-16T16:16:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.597+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1adc0cf8e0 con 0x7f1adc0b3410 2024-04-16T16:16:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.598+0000 7f1ad3e00640 1 -- 172.21.15.22:0/2096432331 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f1ac405a4e0 con 0x7f1adc0b3410 2024-04-16T16:16:35.597 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:35.597 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-16T16:16:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 2 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.600+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ab806c860 msgr2=0x7f1ab806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.600+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ab806c860 0x7f1ab806ed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1acc036000 tx=0x7f1acc03b040 comp rx=0 tx=0).stop 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.600+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1adc0b3410 msgr2=0x7f1adc153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.600+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1adc0b3410 0x7f1adc153680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400efc0 tx=0x7f1ac400c490 comp rx=0 tx=0).stop 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 shutdown_connections 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ab806c860 0x7f1ab806ed20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0d01a0 0x7f1adc1f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1adc0b3410 0x7f1adc153680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 --2- 172.21.15.22:0/2096432331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0aeda0 0x7f1adc15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 >> 172.21.15.22:0/2096432331 conn(0x7f1adc062440 msgr2=0x7f1adc0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 shutdown_connections 2024-04-16T16:16:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:35.601+0000 7f1ae0c00640 1 -- 172.21.15.22:0/2096432331 wait complete. 2024-04-16T16:16:36.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:16:36.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:16:37.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:16:37.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.848+0000 7f8037e00640 1 Processor -- start 2024-04-16T16:16:37.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.848+0000 7f8037e00640 1 -- start start 2024-04-16T16:16:37.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.850+0000 7f8037e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 0x7f80380b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.850+0000 7f8037e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80380af160 con 0x7f803815ea50 2024-04-16T16:16:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.850+0000 7f8037e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80380af440 con 0x7f8038072820 2024-04-16T16:16:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.850+0000 7f8037e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f80380b0740 con 0x7f803806ecf0 2024-04-16T16:16:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.850+0000 7f8036a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f803815ea50 0x7f80380ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50026/0 (socket says 172.21.15.22:50026) 2024-04-16T16:16:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.850+0000 7f8036a00640 1 -- 172.21.15.22:0/1274736124 learned_addr learned my addr 172.21.15.22:0/1274736124 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.850+0000 7f8037400640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 0x7f80380b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324559904 0 0) 0x7f80380af160 con 0x7f803815ea50 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f801c003520 con 0x7f803815ea50 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 213989619 0 0) 0x7f801c003520 con 0x7f803815ea50 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 msgr2=0x7f80380b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 0x7f80380b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 >> v1:172.21.15.43:6789/0 conn(0x7f8038072820 legacy=0x7f803806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80380af720 con 0x7f803815ea50 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f80280019f0 con 0x7f803815ea50 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 >> v1:172.21.15.22:6789/0 conn(0x7f803815ea50 legacy=0x7f80380ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c0039e0 0x7f801c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 0x7f801c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f801c004d40 0x7f801c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f80380b0740 con 0x7f801c004d40 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f801c00bad0 con 0x7f801c0039e0 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.851+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f801c00bcd0 con 0x7f803806ecf0 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f8037400640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f801c004d40 0x7f801c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f8036a00640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c0039e0 0x7f801c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f802e000640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 0x7f801c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f8037400640 1 -- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 msgr2=0x7f801c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f8037400640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803806ecf0 0x7f801c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f8037400640 1 -- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c0039e0 msgr2=0x7f801c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f8037400640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c0039e0 0x7f801c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.852+0000 7f8037400640 1 -- 172.21.15.22:0/1274736124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c003520 con 0x7f801c004d40 2024-04-16T16:16:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.853+0000 7f8037400640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f801c004d40 0x7f801c0051c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8038071750 tx=0x7f801c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308df3902cabccba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030039070 con 0x7f801c004d40 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803002c630 con 0x7f801c004d40 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8036000640 1 -- 172.21.15.22:0/1274736124 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030009690 con 0x7f801c004d40 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8037e00640 1 -- 172.21.15.22:0/1274736124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f801c004d40 msgr2=0x7f801c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8037e00640 1 --2- 172.21.15.22:0/1274736124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f801c004d40 0x7f801c0051c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8038071750 tx=0x7f801c005830 comp rx=0 tx=0).stop 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8037400640 1 -- 172.21.15.22:0/1274736124 reap_dead start 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8037e00640 1 -- 172.21.15.22:0/1274736124 shutdown_connections 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.854+0000 7f8037e00640 1 -- 172.21.15.22:0/1274736124 >> 172.21.15.22:0/1274736124 conn(0x7f80380d0d50 msgr2=0x7f80380d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.855+0000 7f8037e00640 1 -- 172.21.15.22:0/1274736124 shutdown_connections 2024-04-16T16:16:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.855+0000 7f8037e00640 1 -- 172.21.15.22:0/1274736124 wait complete. 2024-04-16T16:16:37.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.856+0000 7f8037e00640 1 Processor -- start 2024-04-16T16:16:37.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.856+0000 7f8037e00640 1 -- start start 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.857+0000 7f8037e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c004d40 0x7f803815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.857+0000 7f8037e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815f730 0x7f80381487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.857+0000 7f8037e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8038148d00 0x7f8038149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.857+0000 7f8037e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f803815ee30 con 0x7f8038148d00 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.857+0000 7f8037e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f80380afd70 con 0x7f801c004d40 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.857+0000 7f8037e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f803815efb0 con 0x7f803815f730 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8038148d00 0x7f8038149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8038148d00 0x7f8038149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37462/0 (socket says 172.21.15.22:37462) 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 -- 172.21.15.22:0/381086410 learned_addr learned my addr 172.21.15.22:0/381086410 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8036a00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c004d40 0x7f803815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f802e000640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815f730 0x7f80381487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 -- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815f730 msgr2=0x7f80381487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815f730 0x7f80381487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 -- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c004d40 msgr2=0x7f803815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c004d40 0x7f803815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.858+0000 7f8037400640 1 -- 172.21.15.22:0/381086410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803815ff60 con 0x7f8038148d00 2024-04-16T16:16:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.859+0000 7f8037400640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8038148d00 0x7f8038149180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8030037040 tx=0x7f8030004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.859+0000 7f802f400640 1 -- 172.21.15.22:0/381086410 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030039070 con 0x7f8038148d00 2024-04-16T16:16:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.859+0000 7f802f400640 1 -- 172.21.15.22:0/381086410 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8030043070 con 0x7f8038148d00 2024-04-16T16:16:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.859+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8038160240 con 0x7f8038148d00 2024-04-16T16:16:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.859+0000 7f802f400640 1 -- 172.21.15.22:0/381086410 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030009690 con 0x7f8038148d00 2024-04-16T16:16:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.859+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8038160800 con 0x7f8038148d00 2024-04-16T16:16:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.861+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8038075250 con 0x7f8038148d00 2024-04-16T16:16:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.862+0000 7f802f400640 1 -- 172.21.15.22:0/381086410 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f8030034ab0 con 0x7f8038148d00 2024-04-16T16:16:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.863+0000 7f802f400640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f801406c890 0x7f801406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.863+0000 7f802f400640 1 -- 172.21.15.22:0/381086410 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f80300ac9f0 con 0x7f8038148d00 2024-04-16T16:16:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.863+0000 7f8036a00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f801406c890 0x7f801406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.864+0000 7f8036a00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f801406c890 0x7f801406ed50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8028004d00 tx=0x7f8028006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:37.868+0000 7f802f400640 1 -- 172.21.15.22:0/381086410 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f803004c020 con 0x7f8038148d00 2024-04-16T16:16:38.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.122+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8038075f30 con 0x7f8038148d00 2024-04-16T16:16:38.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.123+0000 7f802f400640 1 -- 172.21.15.22:0/381086410 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f803007b240 con 0x7f8038148d00 2024-04-16T16:16:38.122 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:38.122 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-16T16:16:38.122 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2024-04-16T16:16:38.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.125+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f801406c890 msgr2=0x7f801406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.125+0000 7f8037e00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f801406c890 0x7f801406ed50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8028004d00 tx=0x7f8028006040 comp rx=0 tx=0).stop 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.125+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8038148d00 msgr2=0x7f8038149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.125+0000 7f8037e00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8038148d00 0x7f8038149180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8030037040 tx=0x7f8030004730 comp rx=0 tx=0).stop 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 shutdown_connections 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f801406c890 0x7f801406ed50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8038148d00 0x7f8038149180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815f730 0x7f80381487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 --2- 172.21.15.22:0/381086410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f801c004d40 0x7f803815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 >> 172.21.15.22:0/381086410 conn(0x7f80380d0d50 msgr2=0x7f8038161b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 shutdown_connections 2024-04-16T16:16:38.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.126+0000 7f8037e00640 1 -- 172.21.15.22:0/381086410 wait complete. 2024-04-16T16:16:38.143 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:38.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.352+0000 7ff17a200640 1 Processor -- start 2024-04-16T16:16:38.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.353+0000 7ff17a200640 1 -- start start 2024-04-16T16:16:38.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff17a200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff17415ecb0 0x7ff1740ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff17a200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1740d1fc0 0x7ff1740d2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff17a200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1740d34e0 con 0x7ff1740d4580 2024-04-16T16:16:38.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff17a200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff1740d32b0 con 0x7ff1740d1fc0 2024-04-16T16:16:38.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff17a200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff1740d40f0 con 0x7ff17415ecb0 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff16aa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff1740d4580 0x7ff1740d18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50040/0 (socket says 172.21.15.22:50040) 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff173e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1740d1fc0 0x7ff1740d2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.354+0000 7ff16aa00640 1 -- 172.21.15.22:0/1951461142 learned_addr learned my addr 172.21.15.22:0/1951461142 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.355+0000 7ff173400640 1 --2- 172.21.15.22:0/1951461142 >> v2:172.21.15.43:3300/0 conn(0x7ff17415ecb0 0x7ff1740ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.355+0000 7ff173e00640 1 -- 172.21.15.22:0/1951461142 >> v2:172.21.15.43:3300/0 conn(0x7ff17415ecb0 msgr2=0x7ff1740ba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.355+0000 7ff173e00640 1 --2- 172.21.15.22:0/1951461142 >> v2:172.21.15.43:3300/0 conn(0x7ff17415ecb0 0x7ff1740ba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.355+0000 7ff173e00640 1 -- 172.21.15.22:0/1951461142 >> v1:172.21.15.22:6789/0 conn(0x7ff1740d4580 legacy=0x7ff1740d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.355+0000 7ff173e00640 1 -- 172.21.15.22:0/1951461142 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1740d37c0 con 0x7ff1740d1fc0 2024-04-16T16:16:38.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.355+0000 7ff172a00640 1 -- 172.21.15.22:0/1951461142 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137029940 0 0) 0x7ff1740d34e0 con 0x7ff1740d4580 2024-04-16T16:16:38.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.357+0000 7ff173e00640 1 --2- 172.21.15.22:0/1951461142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d1fc0 0x7ff1740d2d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1740d1880 tx=0x7ff16c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2420b3ab300a19 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:38.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.357+0000 7ff172a00640 1 -- 172.21.15.22:0/1951461142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c035020 con 0x7ff1740d1fc0 2024-04-16T16:16:38.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.357+0000 7ff172a00640 1 -- 172.21.15.22:0/1951461142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff16c031830 con 0x7ff1740d1fc0 2024-04-16T16:16:38.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.357+0000 7ff172a00640 1 -- 172.21.15.22:0/1951461142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c031c00 con 0x7ff1740d1fc0 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 -- 172.21.15.22:0/1951461142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d1fc0 msgr2=0x7ff1740d2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 --2- 172.21.15.22:0/1951461142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d1fc0 0x7ff1740d2d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1740d1880 tx=0x7ff16c02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 -- 172.21.15.22:0/1951461142 shutdown_connections 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 --2- 172.21.15.22:0/1951461142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d1fc0 0x7ff1740d2d70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 --2- 172.21.15.22:0/1951461142 >> v2:172.21.15.43:3300/0 conn(0x7ff17415ecb0 0x7ff1740ba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 -- 172.21.15.22:0/1951461142 >> 172.21.15.22:0/1951461142 conn(0x7ff174062620 msgr2=0x7ff174062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 -- 172.21.15.22:0/1951461142 shutdown_connections 2024-04-16T16:16:38.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.358+0000 7ff17a200640 1 -- 172.21.15.22:0/1951461142 wait complete. 2024-04-16T16:16:38.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.360+0000 7ff17a200640 1 Processor -- start 2024-04-16T16:16:38.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.360+0000 7ff17a200640 1 -- start start 2024-04-16T16:16:38.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff17a200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1740d1fc0 0x7ff174151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff17a200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d4580 0x7ff1741e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff17a200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff17415ecb0 0x7ff1741e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff17a200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff17415f090 con 0x7ff1740d4580 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff17a200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740d3d80 con 0x7ff17415ecb0 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff17a200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff1740b7bd0 con 0x7ff1740d1fc0 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff16aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d4580 0x7ff1741e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff16aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d4580 0x7ff1741e5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37474/0 (socket says 172.21.15.22:37474) 2024-04-16T16:16:38.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff16aa00640 1 -- 172.21.15.22:0/1741966172 learned_addr learned my addr 172.21.15.22:0/1741966172 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:38.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff173400640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1740d1fc0 0x7ff174151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff173e00640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff17415ecb0 0x7ff1741e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff16aa00640 1 -- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1740d1fc0 msgr2=0x7ff174151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff16aa00640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1740d1fc0 0x7ff174151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff16aa00640 1 -- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff17415ecb0 msgr2=0x7ff1741e6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.362+0000 7ff16aa00640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff17415ecb0 0x7ff1741e6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff16aa00640 1 -- 172.21.15.22:0/1741966172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1741e7270 con 0x7ff1740d4580 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff173400640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1740d1fc0 0x7ff174151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff16aa00640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d4580 0x7ff1741e5040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00c4d0 tx=0x7ff15c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff16be00640 1 -- 172.21.15.22:0/1741966172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c018070 con 0x7ff1740d4580 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff16be00640 1 -- 172.21.15.22:0/1741966172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15c007500 con 0x7ff1740d4580 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff16be00640 1 -- 172.21.15.22:0/1741966172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c004a20 con 0x7ff1740d4580 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1741e7550 con 0x7ff1740d4580 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.363+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1741e7b10 con 0x7ff1740d4580 2024-04-16T16:16:38.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.365+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17404fd90 con 0x7ff1740d4580 2024-04-16T16:16:38.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.366+0000 7ff16be00640 1 -- 172.21.15.22:0/1741966172 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff15c01b070 con 0x7ff1740d4580 2024-04-16T16:16:38.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.366+0000 7ff16be00640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff15006c8b0 0x7ff15006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.367+0000 7ff16be00640 1 -- 172.21.15.22:0/1741966172 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff15c08ab70 con 0x7ff1740d4580 2024-04-16T16:16:38.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.367+0000 7ff173400640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff15006c8b0 0x7ff15006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.368+0000 7ff173400640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff15006c8b0 0x7ff15006ed70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff164009f50 tx=0x7ff16400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:38.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.372+0000 7ff16be00640 1 -- 172.21.15.22:0/1741966172 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff15c0593b0 con 0x7ff1740d4580 2024-04-16T16:16:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.583+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1740b8fc0 con 0x7ff1740d4580 2024-04-16T16:16:38.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.584+0000 7ff16be00640 1 -- 172.21.15.22:0/1741966172 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12764 (secure 0 0 0) 0x7ff15c058cb0 con 0x7ff1740d4580 2024-04-16T16:16:38.583 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:38.583 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:38.441560+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:38.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.586+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff15006c8b0 msgr2=0x7ff15006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.586+0000 7ff17a200640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff15006c8b0 0x7ff15006ed70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff164009f50 tx=0x7ff16400b040 comp rx=0 tx=0).stop 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.586+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d4580 msgr2=0x7ff1741e5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.586+0000 7ff17a200640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d4580 0x7ff1741e5040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00c4d0 tx=0x7ff15c00c990 comp rx=0 tx=0).stop 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 shutdown_connections 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff15006c8b0 0x7ff15006ed70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff17415ecb0 0x7ff1741e6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1740d4580 0x7ff1741e5040 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 --2- 172.21.15.22:0/1741966172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1740d1fc0 0x7ff174151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 >> 172.21.15.22:0/1741966172 conn(0x7ff174062620 msgr2=0x7ff1740caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 shutdown_connections 2024-04-16T16:16:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.587+0000 7ff17a200640 1 -- 172.21.15.22:0/1741966172 wait complete. 2024-04-16T16:16:38.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:16:38.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:16:38.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.811+0000 7f9dfd800640 1 Processor -- start 2024-04-16T16:16:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.811+0000 7f9dfd800640 1 -- start start 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.812+0000 7f9dfd800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9df80b8680 0x7f9df80b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.812+0000 7f9dfd800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9df80d2c40 0x7f9df80d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.812+0000 7f9dfd800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df80b9240 con 0x7f9df80cf780 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.812+0000 7f9dfd800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9df80ba6b0 con 0x7f9df80d2c40 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.812+0000 7f9dfd800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9df80b9000 con 0x7f9df80b8680 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df7400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9df80d2c40 0x7f9df80d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df6a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9df80cf780 0x7f9df80cfb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50042/0 (socket says 172.21.15.22:50042) 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df6a00640 1 -- 172.21.15.22:0/2381043516 learned_addr learned my addr 172.21.15.22:0/2381043516 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df6000640 1 --2- 172.21.15.22:0/2381043516 >> v2:172.21.15.43:3300/0 conn(0x7f9df80b8680 0x7f9df80b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df7400640 1 -- 172.21.15.22:0/2381043516 >> v2:172.21.15.43:3300/0 conn(0x7f9df80b8680 msgr2=0x7f9df80b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df7400640 1 --2- 172.21.15.22:0/2381043516 >> v2:172.21.15.43:3300/0 conn(0x7f9df80b8680 0x7f9df80b8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df7400640 1 -- 172.21.15.22:0/2381043516 >> v1:172.21.15.22:6789/0 conn(0x7f9df80cf780 legacy=0x7f9df80cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df7400640 1 -- 172.21.15.22:0/2381043516 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df80b9520 con 0x7f9df80d2c40 2024-04-16T16:16:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df5600640 1 -- 172.21.15.22:0/2381043516 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692504798 0 0) 0x7f9df80b9240 con 0x7f9df80cf780 2024-04-16T16:16:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.813+0000 7f9df6000640 1 --2- 172.21.15.22:0/2381043516 >> v2:172.21.15.43:3300/0 conn(0x7f9df80b8680 0x7f9df80b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.814+0000 7f9df7400640 1 --2- 172.21.15.22:0/2381043516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80d2c40 0x7f9df80d30d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9df80d5ae0 tx=0x7f9df002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70c6d48a58668ff server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9df5600640 1 -- 172.21.15.22:0/2381043516 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0039070 con 0x7f9df80d2c40 2024-04-16T16:16:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9df5600640 1 -- 172.21.15.22:0/2381043516 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df002cc80 con 0x7f9df80d2c40 2024-04-16T16:16:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9df5600640 1 -- 172.21.15.22:0/2381043516 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0034660 con 0x7f9df80d2c40 2024-04-16T16:16:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9dfd800640 1 -- 172.21.15.22:0/2381043516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80d2c40 msgr2=0x7f9df80d30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9dfd800640 1 --2- 172.21.15.22:0/2381043516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80d2c40 0x7f9df80d30d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9df80d5ae0 tx=0x7f9df002bed0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9dfd800640 1 -- 172.21.15.22:0/2381043516 shutdown_connections 2024-04-16T16:16:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9dfd800640 1 --2- 172.21.15.22:0/2381043516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80d2c40 0x7f9df80d30d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9dfd800640 1 --2- 172.21.15.22:0/2381043516 >> v2:172.21.15.43:3300/0 conn(0x7f9df80b8680 0x7f9df80b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.815+0000 7f9dfd800640 1 -- 172.21.15.22:0/2381043516 >> 172.21.15.22:0/2381043516 conn(0x7f9df8072460 msgr2=0x7f9df8072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.816+0000 7f9dfd800640 1 -- 172.21.15.22:0/2381043516 shutdown_connections 2024-04-16T16:16:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.816+0000 7f9dfd800640 1 -- 172.21.15.22:0/2381043516 wait complete. 2024-04-16T16:16:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.817+0000 7f9dfd800640 1 Processor -- start 2024-04-16T16:16:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.817+0000 7f9dfd800640 1 -- start start 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.818+0000 7f9dfd800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df80b8680 0x7f9df80b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.818+0000 7f9dfd800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80cf780 0x7f9df8155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.818+0000 7f9dfd800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df80d2c40 0x7f9df815f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.818+0000 7f9dfd800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9df80b9ae0 con 0x7f9df80cf780 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.818+0000 7f9dfd800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9df80b9e50 con 0x7f9df80d2c40 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.818+0000 7f9dfd800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9df815eea0 con 0x7f9df80b8680 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80cf780 0x7f9df8155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80cf780 0x7f9df8155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37490/0 (socket says 172.21.15.22:37490) 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 -- 172.21.15.22:0/1575168360 learned_addr learned my addr 172.21.15.22:0/1575168360 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df7400640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df80d2c40 0x7f9df815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6a00640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df80b8680 0x7f9df80b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 -- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df80b8680 msgr2=0x7f9df80b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df80b8680 0x7f9df80b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 -- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df80d2c40 msgr2=0x7f9df815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df80d2c40 0x7f9df815f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 -- 172.21.15.22:0/1575168360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df80b5170 con 0x7f9df80cf780 2024-04-16T16:16:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.819+0000 7f9df6000640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80cf780 0x7f9df8155530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9de400d7d0 tx=0x7f9de400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.820+0000 7f9deea00640 1 -- 172.21.15.22:0/1575168360 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4004030 con 0x7f9df80cf780 2024-04-16T16:16:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.820+0000 7f9deea00640 1 -- 172.21.15.22:0/1575168360 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de40041d0 con 0x7f9df80cf780 2024-04-16T16:16:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.820+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df80b5450 con 0x7f9df80cf780 2024-04-16T16:16:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.820+0000 7f9deea00640 1 -- 172.21.15.22:0/1575168360 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de40096a0 con 0x7f9df80cf780 2024-04-16T16:16:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.820+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df80b5a10 con 0x7f9df80cf780 2024-04-16T16:16:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.821+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df80b92e0 con 0x7f9df80cf780 2024-04-16T16:16:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.822+0000 7f9deea00640 1 -- 172.21.15.22:0/1575168360 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f9de4009840 con 0x7f9df80cf780 2024-04-16T16:16:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.823+0000 7f9deea00640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd806c860 0x7f9dd806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.823+0000 7f9deea00640 1 -- 172.21.15.22:0/1575168360 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9de408bab0 con 0x7f9df80cf780 2024-04-16T16:16:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.823+0000 7f9df6a00640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd806c860 0x7f9dd806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.824+0000 7f9df6a00640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd806c860 0x7f9dd806ed20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9de8000f60 tx=0x7f9de8007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:38.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:38.827+0000 7f9deea00640 1 -- 172.21.15.22:0/1575168360 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9df80b92e0 con 0x7f9df80cf780 2024-04-16T16:16:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.035+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9df804fd90 con 0x7f9df80cf780 2024-04-16T16:16:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.036+0000 7f9deea00640 1 -- 172.21.15.22:0/1575168360 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f9de405a270 con 0x7f9df80cf780 2024-04-16T16:16:39.035 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:16:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.038+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd806c860 msgr2=0x7f9dd806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.038+0000 7f9dfd800640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd806c860 0x7f9dd806ed20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9de8000f60 tx=0x7f9de8007c00 comp rx=0 tx=0).stop 2024-04-16T16:16:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.038+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80cf780 msgr2=0x7f9df8155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.038+0000 7f9dfd800640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80cf780 0x7f9df8155530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9de400d7d0 tx=0x7f9de400dc90 comp rx=0 tx=0).stop 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 shutdown_connections 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd806c860 0x7f9dd806ed20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df80d2c40 0x7f9df815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df80cf780 0x7f9df8155530 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 --2- 172.21.15.22:0/1575168360 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df80b8680 0x7f9df80b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 >> 172.21.15.22:0/1575168360 conn(0x7f9df8072460 msgr2=0x7f9df815d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 shutdown_connections 2024-04-16T16:16:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.039+0000 7f9dfd800640 1 -- 172.21.15.22:0/1575168360 wait complete. 2024-04-16T16:16:39.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T16:16:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.263+0000 7f24dbe00640 1 Processor -- start 2024-04-16T16:16:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.263+0000 7f24dbe00640 1 -- start start 2024-04-16T16:16:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.265+0000 7f24dbe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f24dc0b3410 0x7f24dc0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.265+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0aeda0 0x7f24dc06da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.265+0000 7f24dbe00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24dc0af2b0 con 0x7f24dc0d01a0 2024-04-16T16:16:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.265+0000 7f24dbe00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f24dc06d020 con 0x7f24dc0b3410 2024-04-16T16:16:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.265+0000 7f24dbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc0af590 con 0x7f24dc0aeda0 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24d2000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f24dc0b3410 0x7f24dc0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24d2000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f24dc0b3410 0x7f24dc0ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:45518/0 (socket says 172.21.15.22:45518) 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24d2000640 1 -- 172.21.15.22:0/3434450791 learned_addr learned my addr 172.21.15.22:0/3434450791 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24db400640 1 --2- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0aeda0 0x7f24dc06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24d2000640 1 -- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0aeda0 msgr2=0x7f24dc06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24d2000640 1 --2- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0aeda0 0x7f24dc06da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24d2000640 1 -- 172.21.15.22:0/3434450791 >> v1:172.21.15.43:6789/0 conn(0x7f24dc0d01a0 legacy=0x7f24dc0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.266+0000 7f24d2000640 1 -- 172.21.15.22:0/3434450791 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc06d250 con 0x7f24dc0b3410 2024-04-16T16:16:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.267+0000 7f24d2000640 1 --2- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 0x7f24dc0ae860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009870 tx=0x7f24c402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab13f178a86f8fa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:39.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.268+0000 7f24da000640 1 -- 172.21.15.22:0/3434450791 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c402f840 con 0x7f24dc0b3410 2024-04-16T16:16:39.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.268+0000 7f24da000640 1 -- 172.21.15.22:0/3434450791 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c402f9e0 con 0x7f24dc0b3410 2024-04-16T16:16:39.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.268+0000 7f24da000640 1 -- 172.21.15.22:0/3434450791 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c402fdb0 con 0x7f24dc0b3410 2024-04-16T16:16:39.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 -- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 msgr2=0x7f24dc0ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 --2- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 0x7f24dc0ae860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009870 tx=0x7f24c402ba20 comp rx=0 tx=0).stop 2024-04-16T16:16:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 -- 172.21.15.22:0/3434450791 shutdown_connections 2024-04-16T16:16:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 --2- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0aeda0 0x7f24dc06da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 --2- 172.21.15.22:0/3434450791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 0x7f24dc0ae860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 -- 172.21.15.22:0/3434450791 >> 172.21.15.22:0/3434450791 conn(0x7f24dc062440 msgr2=0x7f24dc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 -- 172.21.15.22:0/3434450791 shutdown_connections 2024-04-16T16:16:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.269+0000 7f24dbe00640 1 -- 172.21.15.22:0/3434450791 wait complete. 2024-04-16T16:16:39.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.271+0000 7f24dbe00640 1 Processor -- start 2024-04-16T16:16:39.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.271+0000 7f24dbe00640 1 -- start start 2024-04-16T16:16:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0aeda0 0x7f24dc143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 0x7f24dc160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d01a0 0x7f24dc160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24dbe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc162200 con 0x7f24dc0aeda0 2024-04-16T16:16:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24dbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc0af870 con 0x7f24dc0b3410 2024-04-16T16:16:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24dbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc162380 con 0x7f24dc0d01a0 2024-04-16T16:16:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24daa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0aeda0 0x7f24dc143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24daa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0aeda0 0x7f24dc143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37504/0 (socket says 172.21.15.22:37504) 2024-04-16T16:16:39.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24daa00640 1 -- 172.21.15.22:0/921867184 learned_addr learned my addr 172.21.15.22:0/921867184 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:39.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24d2000640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 0x7f24dc160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.272+0000 7f24db400640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d01a0 0x7f24dc160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24daa00640 1 -- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d01a0 msgr2=0x7f24dc160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24daa00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d01a0 0x7f24dc160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24daa00640 1 -- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 msgr2=0x7f24dc160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24daa00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 0x7f24dc160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24daa00640 1 -- 172.21.15.22:0/921867184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc160ff0 con 0x7f24dc0aeda0 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24daa00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0aeda0 0x7f24dc143880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00c400 tx=0x7f24cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24d3400640 1 -- 172.21.15.22:0/921867184 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0052d0 con 0x7f24dc0aeda0 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24d3400640 1 -- 172.21.15.22:0/921867184 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc005490 con 0x7f24dc0aeda0 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24d3400640 1 -- 172.21.15.22:0/921867184 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc007260 con 0x7f24dc0aeda0 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.273+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24dc1612d0 con 0x7f24dc0aeda0 2024-04-16T16:16:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.274+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24dc161890 con 0x7f24dc0aeda0 2024-04-16T16:16:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.275+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24dc075f30 con 0x7f24dc0aeda0 2024-04-16T16:16:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.276+0000 7f24d3400640 1 -- 172.21.15.22:0/921867184 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f24cc007400 con 0x7f24dc0aeda0 2024-04-16T16:16:39.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.276+0000 7f24d3400640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24b806c860 0x7f24b806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.277+0000 7f24d3400640 1 -- 172.21.15.22:0/921867184 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f24cc08abf0 con 0x7f24dc0aeda0 2024-04-16T16:16:39.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.277+0000 7f24d2000640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24b806c860 0x7f24b806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.278+0000 7f24d2000640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24b806c860 0x7f24b806ed20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24c4036000 tx=0x7f24c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:39.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.282+0000 7f24d3400640 1 -- 172.21.15.22:0/921867184 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24cc058e00 con 0x7f24dc0aeda0 2024-04-16T16:16:39.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.491+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f24dc0d07d0 con 0x7f24dc0aeda0 2024-04-16T16:16:39.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.492+0000 7f24d3400640 1 -- 172.21.15.22:0/921867184 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f24cc05d100 con 0x7f24dc0aeda0 2024-04-16T16:16:39.491 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:39.491 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-04-16T16:16:39.491 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:16:39.491 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-04-16T16:16:39.491 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-04-16T16:16:39.492 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:16:39.492 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-04-16T16:16:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24b806c860 msgr2=0x7f24b806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24b806c860 0x7f24b806ed20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24c4036000 tx=0x7f24c4008030 comp rx=0 tx=0).stop 2024-04-16T16:16:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0aeda0 msgr2=0x7f24dc143880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0aeda0 0x7f24dc143880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00c400 tx=0x7f24cc00c8c0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 shutdown_connections 2024-04-16T16:16:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24b806c860 0x7f24b806ed20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d01a0 0x7f24dc160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc0b3410 0x7f24dc160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 --2- 172.21.15.22:0/921867184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0aeda0 0x7f24dc143880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 >> 172.21.15.22:0/921867184 conn(0x7f24dc062440 msgr2=0x7f24dc071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 shutdown_connections 2024-04-16T16:16:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.495+0000 7f24dbe00640 1 -- 172.21.15.22:0/921867184 wait complete. 2024-04-16T16:16:39.514 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T16:16:39.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T16:16:39.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.731+0000 7f65f4a00640 1 Processor -- start 2024-04-16T16:16:39.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.731+0000 7f65f4a00640 1 -- start start 2024-04-16T16:16:39.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.733+0000 7f65f4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.733+0000 7f65f4a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f65f00d4380 0x7f65f00d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.733+0000 7f65f4a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00d32e0 con 0x7f65f015ed00 2024-04-16T16:16:39.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.733+0000 7f65f4a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f65f00d35c0 con 0x7f65f00d4380 2024-04-16T16:16:39.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.733+0000 7f65f4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f65f00d38a0 con 0x7f65f00d1240 2024-04-16T16:16:39.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.733+0000 7f65ee800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.734+0000 7f65ee800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00ba380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:49092/0 (socket says 172.21.15.22:49092) 2024-04-16T16:16:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.734+0000 7f65ee800640 1 -- 172.21.15.22:0/4160739995 learned_addr learned my addr 172.21.15.22:0/4160739995 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.734+0000 7f65ef200640 1 --2- 172.21.15.22:0/4160739995 >> v2:172.21.15.43:3300/0 conn(0x7f65f00d4380 0x7f65f00d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.734+0000 7f65ee800640 1 -- 172.21.15.22:0/4160739995 >> v2:172.21.15.43:3300/0 conn(0x7f65f00d4380 msgr2=0x7f65f00d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.734+0000 7f65ee800640 1 --2- 172.21.15.22:0/4160739995 >> v2:172.21.15.43:3300/0 conn(0x7f65f00d4380 0x7f65f00d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.734+0000 7f65ee800640 1 -- 172.21.15.22:0/4160739995 >> v1:172.21.15.43:6789/0 conn(0x7f65f015ed00 legacy=0x7f65f00d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.734+0000 7f65ee800640 1 -- 172.21.15.22:0/4160739995 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f00d3b80 con 0x7f65f00d1240 2024-04-16T16:16:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.736+0000 7f65ee800640 1 --2- 172.21.15.22:0/4160739995 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00ba380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009870 tx=0x7f65e002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c343bf361cebd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:39.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.736+0000 7f65ed400640 1 -- 172.21.15.22:0/4160739995 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00317c0 con 0x7f65f00d1240 2024-04-16T16:16:39.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.736+0000 7f65ed400640 1 -- 172.21.15.22:0/4160739995 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e0037070 con 0x7f65f00d1240 2024-04-16T16:16:39.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.736+0000 7f65ed400640 1 -- 172.21.15.22:0/4160739995 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0031b80 con 0x7f65f00d1240 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 -- 172.21.15.22:0/4160739995 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 msgr2=0x7f65f00ba380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 --2- 172.21.15.22:0/4160739995 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00ba380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009870 tx=0x7f65e002b860 comp rx=0 tx=0).stop 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 -- 172.21.15.22:0/4160739995 shutdown_connections 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 --2- 172.21.15.22:0/4160739995 >> v2:172.21.15.43:3300/0 conn(0x7f65f00d4380 0x7f65f00d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 --2- 172.21.15.22:0/4160739995 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00ba380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 -- 172.21.15.22:0/4160739995 >> 172.21.15.22:0/4160739995 conn(0x7f65f0072670 msgr2=0x7f65f0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 -- 172.21.15.22:0/4160739995 shutdown_connections 2024-04-16T16:16:39.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.737+0000 7f65f4a00640 1 -- 172.21.15.22:0/4160739995 wait complete. 2024-04-16T16:16:39.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.739+0000 7f65f4a00640 1 Processor -- start 2024-04-16T16:16:39.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.740+0000 7f65f4a00640 1 -- start start 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65f4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65f4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65f00d4380 0x7f65f01f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65f4a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65f015ed00 0x7f65f00cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65f4a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00b7cf0 con 0x7f65f015ed00 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65f4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00b7b70 con 0x7f65f00d4380 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65f4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f65f00b7e70 con 0x7f65f00d1240 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65ef200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65f015ed00 0x7f65f00cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65ef200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65f015ed00 0x7f65f00cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37526/0 (socket says 172.21.15.22:37526) 2024-04-16T16:16:39.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65ef200640 1 -- 172.21.15.22:0/386713262 learned_addr learned my addr 172.21.15.22:0/386713262 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:39.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65ee800640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.741+0000 7f65ede00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65f00d4380 0x7f65f01f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.742+0000 7f65ef200640 1 -- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 msgr2=0x7f65f00b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.742+0000 7f65ef200640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.742+0000 7f65ef200640 1 -- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65f00d4380 msgr2=0x7f65f01f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.742+0000 7f65ef200640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65f00d4380 0x7f65f01f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.742+0000 7f65ef200640 1 -- 172.21.15.22:0/386713262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f00b47d0 con 0x7f65f015ed00 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.742+0000 7f65ef200640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65f015ed00 0x7f65f00cde10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f65e800efc0 tx=0x7f65e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.742+0000 7f65e6a00640 1 -- 172.21.15.22:0/386713262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8018020 con 0x7f65f015ed00 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.743+0000 7f65e6a00640 1 -- 172.21.15.22:0/386713262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e8014480 con 0x7f65f015ed00 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.743+0000 7f65e6a00640 1 -- 172.21.15.22:0/386713262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8014870 con 0x7f65f015ed00 2024-04-16T16:16:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.743+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f00b5080 con 0x7f65f015ed00 2024-04-16T16:16:39.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.743+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f0156120 con 0x7f65f015ed00 2024-04-16T16:16:39.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.744+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f0075f30 con 0x7f65f015ed00 2024-04-16T16:16:39.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.745+0000 7f65e6a00640 1 -- 172.21.15.22:0/386713262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f65e8005d10 con 0x7f65f015ed00 2024-04-16T16:16:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.746+0000 7f65e6a00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f65d006c860 0x7f65d006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.746+0000 7f65e6a00640 1 -- 172.21.15.22:0/386713262 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f65e808c200 con 0x7f65f015ed00 2024-04-16T16:16:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.746+0000 7f65ee800640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f65d006c860 0x7f65d006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:39.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.747+0000 7f65ee800640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f65d006c860 0x7f65d006ed20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f65e0036000 tx=0x7f65e003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:39.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.751+0000 7f65e6a00640 1 -- 172.21.15.22:0/386713262 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65e8022070 con 0x7f65f015ed00 2024-04-16T16:16:39.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:39.954+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f65f00b3f00 con 0x7f65f015ed00 2024-04-16T16:16:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.473+0000 7f65e6a00640 1 -- 172.21.15.22:0/386713262 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f65e8010040 con 0x7f65f015ed00 2024-04-16T16:16:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-04-16T16:16:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f65d006c860 msgr2=0x7f65d006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f65d006c860 0x7f65d006ed20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f65e0036000 tx=0x7f65e003d040 comp rx=0 tx=0).stop 2024-04-16T16:16:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65f015ed00 msgr2=0x7f65f00cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65f015ed00 0x7f65f00cde10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f65e800efc0 tx=0x7f65e800c490 comp rx=0 tx=0).stop 2024-04-16T16:16:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 shutdown_connections 2024-04-16T16:16:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f65d006c860 0x7f65d006ed20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65f015ed00 0x7f65f00cde10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65f00d4380 0x7f65f01f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 --2- 172.21.15.22:0/386713262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65f00d1240 0x7f65f00b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 >> 172.21.15.22:0/386713262 conn(0x7f65f0072670 msgr2=0x7f65f00cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 shutdown_connections 2024-04-16T16:16:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.477+0000 7f65f4a00640 1 -- 172.21.15.22:0/386713262 wait complete. 2024-04-16T16:16:40.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T16:16:40.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.704+0000 7fa8dce00640 1 Processor -- start 2024-04-16T16:16:40.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.705+0000 7fa8dce00640 1 -- start start 2024-04-16T16:16:40.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.706+0000 7fa8dce00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8d815c8d0 0x7fa8d815db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.706+0000 7fa8dce00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa8d80b2b30 0x7fa8d8071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.706+0000 7fa8dce00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d8073420 con 0x7fa8d80727a0 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.706+0000 7fa8dce00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa8d8073140 con 0x7fa8d815c8d0 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.706+0000 7fa8dce00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa8d815d080 con 0x7fa8d80b2b30 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8d815c8d0 0x7fa8d815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8d815c8d0 0x7fa8d815db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58770/0 (socket says 172.21.15.22:58770) 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d5e00640 1 -- 172.21.15.22:0/296580398 learned_addr learned my addr 172.21.15.22:0/296580398 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d6800640 1 --2- 172.21.15.22:0/296580398 >> v2:172.21.15.43:3300/0 conn(0x7fa8d80b2b30 0x7fa8d8071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d5e00640 1 -- 172.21.15.22:0/296580398 >> v2:172.21.15.43:3300/0 conn(0x7fa8d80b2b30 msgr2=0x7fa8d8071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d5e00640 1 --2- 172.21.15.22:0/296580398 >> v2:172.21.15.43:3300/0 conn(0x7fa8d80b2b30 0x7fa8d8071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d5e00640 1 -- 172.21.15.22:0/296580398 >> v1:172.21.15.43:6789/0 conn(0x7fa8d80727a0 legacy=0x7fa8d80b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d5e00640 1 -- 172.21.15.22:0/296580398 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d815d360 con 0x7fa8d815c8d0 2024-04-16T16:16:40.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.707+0000 7fa8d6800640 1 --2- 172.21.15.22:0/296580398 >> v2:172.21.15.43:3300/0 conn(0x7fa8d80b2b30 0x7fa8d8071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:40.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.708+0000 7fa8d5e00640 1 --2- 172.21.15.22:0/296580398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d815c8d0 0x7fa8d815db60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8074210 tx=0x7fa8c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e741492341757ed server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:40.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.708+0000 7fa8d5400640 1 -- 172.21.15.22:0/296580398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8035020 con 0x7fa8d815c8d0 2024-04-16T16:16:40.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8d5400640 1 -- 172.21.15.22:0/296580398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c8031870 con 0x7fa8d815c8d0 2024-04-16T16:16:40.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8d5400640 1 -- 172.21.15.22:0/296580398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8031c40 con 0x7fa8d815c8d0 2024-04-16T16:16:40.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 -- 172.21.15.22:0/296580398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d815c8d0 msgr2=0x7fa8d815db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:40.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 --2- 172.21.15.22:0/296580398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d815c8d0 0x7fa8d815db60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8074210 tx=0x7fa8c802b910 comp rx=0 tx=0).stop 2024-04-16T16:16:40.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 -- 172.21.15.22:0/296580398 shutdown_connections 2024-04-16T16:16:40.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 --2- 172.21.15.22:0/296580398 >> v2:172.21.15.43:3300/0 conn(0x7fa8d80b2b30 0x7fa8d8071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 --2- 172.21.15.22:0/296580398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d815c8d0 0x7fa8d815db60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 -- 172.21.15.22:0/296580398 >> 172.21.15.22:0/296580398 conn(0x7fa8d8062440 msgr2=0x7fa8d8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:40.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 -- 172.21.15.22:0/296580398 shutdown_connections 2024-04-16T16:16:40.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.709+0000 7fa8dce00640 1 -- 172.21.15.22:0/296580398 wait complete. 2024-04-16T16:16:40.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.711+0000 7fa8dce00640 1 Processor -- start 2024-04-16T16:16:40.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.711+0000 7fa8dce00640 1 -- start start 2024-04-16T16:16:40.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.712+0000 7fa8dce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8d80727a0 0x7fa8d81f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:40.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.712+0000 7fa8dce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d80b2b30 0x7fa8d81e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:40.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.712+0000 7fa8dce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8d815c8d0 0x7fa8d81e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:40.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.712+0000 7fa8dce00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d815ce30 con 0x7fa8d80b2b30 2024-04-16T16:16:40.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.712+0000 7fa8dce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d815ccb0 con 0x7fa8d815c8d0 2024-04-16T16:16:40.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.712+0000 7fa8dce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d80d0310 con 0x7fa8d80727a0 2024-04-16T16:16:40.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.712+0000 7fa8cd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d80b2b30 0x7fa8d81e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:40.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d80b2b30 0x7fa8d81e74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58778/0 (socket says 172.21.15.22:58778) 2024-04-16T16:16:40.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 -- 172.21.15.22:0/3551700133 learned_addr learned my addr 172.21.15.22:0/3551700133 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8d5e00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8d80727a0 0x7fa8d81f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8d6800640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8d815c8d0 0x7fa8d81e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 -- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8d80727a0 msgr2=0x7fa8d81f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8d80727a0 0x7fa8d81f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 -- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8d815c8d0 msgr2=0x7fa8d81e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8d815c8d0 0x7fa8d81e79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 -- 172.21.15.22:0/3551700133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d815e470 con 0x7fa8d80b2b30 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8d6800640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8d815c8d0 0x7fa8d81e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:40.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.713+0000 7fa8cd400640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d80b2b30 0x7fa8d81e74a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c430 tx=0x7fa8c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:40.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.714+0000 7fa8cea00640 1 -- 172.21.15.22:0/3551700133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0011790 con 0x7fa8d80b2b30 2024-04-16T16:16:40.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.714+0000 7fa8cea00640 1 -- 172.21.15.22:0/3551700133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c0017070 con 0x7fa8d80b2b30 2024-04-16T16:16:40.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.714+0000 7fa8cea00640 1 -- 172.21.15.22:0/3551700133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0011bb0 con 0x7fa8d80b2b30 2024-04-16T16:16:40.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.714+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d815e750 con 0x7fa8d80b2b30 2024-04-16T16:16:40.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.714+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d815ed10 con 0x7fa8d80b2b30 2024-04-16T16:16:40.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.715+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d804fd90 con 0x7fa8d80b2b30 2024-04-16T16:16:40.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.716+0000 7fa8cea00640 1 -- 172.21.15.22:0/3551700133 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8c001c460 con 0x7fa8d80b2b30 2024-04-16T16:16:40.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.717+0000 7fa8cea00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8b406c920 0x7fa8b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:40.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.717+0000 7fa8cea00640 1 -- 172.21.15.22:0/3551700133 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fa8c008b7f0 con 0x7fa8d80b2b30 2024-04-16T16:16:40.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.717+0000 7fa8d5e00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8b406c920 0x7fa8b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:40.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.717+0000 7fa8d5e00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8b406c920 0x7fa8b406ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8036000 tx=0x7fa8c803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.722+0000 7fa8cea00640 1 -- 172.21.15.22:0/3551700133 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8c0059e00 con 0x7fa8d80b2b30 2024-04-16T16:16:40.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:40.926+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa8d806c0f0 con 0x7fa8d80b2b30 2024-04-16T16:16:41.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.479+0000 7fa8cea00640 1 -- 172.21.15.22:0/3551700133 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fa8c0059700 con 0x7fa8d80b2b30 2024-04-16T16:16:41.478 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-04-16T16:16:41.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.482+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8b406c920 msgr2=0x7fa8b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.482+0000 7fa8dce00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8b406c920 0x7fa8b406ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8036000 tx=0x7fa8c803c040 comp rx=0 tx=0).stop 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.482+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d80b2b30 msgr2=0x7fa8d81e74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.482+0000 7fa8dce00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d80b2b30 0x7fa8d81e74a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c430 tx=0x7fa8c000c8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 shutdown_connections 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8b406c920 0x7fa8b406ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8d815c8d0 0x7fa8d81e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d80b2b30 0x7fa8d81e74a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 --2- 172.21.15.22:0/3551700133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8d80727a0 0x7fa8d81f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 >> 172.21.15.22:0/3551700133 conn(0x7fa8d8062440 msgr2=0x7fa8d80ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:41.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 shutdown_connections 2024-04-16T16:16:41.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.483+0000 7fa8dce00640 1 -- 172.21.15.22:0/3551700133 wait complete. 2024-04-16T16:16:41.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T16:16:41.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.711+0000 7fe7da000640 1 Processor -- start 2024-04-16T16:16:41.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.711+0000 7fe7da000640 1 -- start start 2024-04-16T16:16:41.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.712+0000 7fe7da000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:41.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7da000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe7d40cc830 0x7fe7d40d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:41.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7da000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d415cc20 con 0x7fe7d406e930 2024-04-16T16:16:41.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7da000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d40ce390 con 0x7fe7d40cc830 2024-04-16T16:16:41.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7da000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d406dda0 con 0x7fe7d415c840 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7d3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe7d40cc830 0x7fe7d40d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7d9600640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe7d406e930 0x7fe7d4160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43624/0 (socket says 172.21.15.22:43624) 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7d9600640 1 -- 172.21.15.22:0/2204871550 learned_addr learned my addr 172.21.15.22:0/2204871550 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.713+0000 7fe7d8c00640 1 --2- 172.21.15.22:0/2204871550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.714+0000 7fe7d3e00640 1 -- 172.21.15.22:0/2204871550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 msgr2=0x7fe7d40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.714+0000 7fe7d3e00640 1 --2- 172.21.15.22:0/2204871550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.714+0000 7fe7d3e00640 1 -- 172.21.15.22:0/2204871550 >> v1:172.21.15.22:6789/0 conn(0x7fe7d406e930 legacy=0x7fe7d4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.714+0000 7fe7d3e00640 1 -- 172.21.15.22:0/2204871550 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d406d800 con 0x7fe7d40cc830 2024-04-16T16:16:41.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.715+0000 7fe7d3e00640 1 --2- 172.21.15.22:0/2204871550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d40d0840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00097a0 tx=0x7fe7c002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539942f49791d486 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:41.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.715+0000 7fe7d3400640 1 -- 172.21.15.22:0/2204871550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0035020 con 0x7fe7d40cc830 2024-04-16T16:16:41.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.715+0000 7fe7d3400640 1 -- 172.21.15.22:0/2204871550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c0031810 con 0x7fe7d40cc830 2024-04-16T16:16:41.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.715+0000 7fe7d3400640 1 -- 172.21.15.22:0/2204871550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0031be0 con 0x7fe7d40cc830 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 -- 172.21.15.22:0/2204871550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 msgr2=0x7fe7d40d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 --2- 172.21.15.22:0/2204871550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d40d0840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00097a0 tx=0x7fe7c002b8b0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 -- 172.21.15.22:0/2204871550 shutdown_connections 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 --2- 172.21.15.22:0/2204871550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d40d0840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 --2- 172.21.15.22:0/2204871550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 -- 172.21.15.22:0/2204871550 >> 172.21.15.22:0/2204871550 conn(0x7fe7d4062440 msgr2=0x7fe7d4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 -- 172.21.15.22:0/2204871550 shutdown_connections 2024-04-16T16:16:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.716+0000 7fe7da000640 1 -- 172.21.15.22:0/2204871550 wait complete. 2024-04-16T16:16:41.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.718+0000 7fe7da000640 1 Processor -- start 2024-04-16T16:16:41.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.718+0000 7fe7da000640 1 -- start start 2024-04-16T16:16:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.719+0000 7fe7da000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7d406e930 0x7fe7d414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.719+0000 7fe7da000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d4152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.719+0000 7fe7da000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.719+0000 7fe7da000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40ce8a0 con 0x7fe7d40cc830 2024-04-16T16:16:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.719+0000 7fe7da000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40ce5c0 con 0x7fe7d406e930 2024-04-16T16:16:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.719+0000 7fe7da000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d40ceb80 con 0x7fe7d415c840 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d4152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d4152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58790/0 (socket says 172.21.15.22:58790) 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 -- 172.21.15.22:0/3585430869 learned_addr learned my addr 172.21.15.22:0/3585430869 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d9600640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d8c00640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7d406e930 0x7fe7d414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 -- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 msgr2=0x7fe7d40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 -- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7d406e930 msgr2=0x7fe7d414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7d406e930 0x7fe7d414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:41.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.720+0000 7fe7d3e00640 1 -- 172.21.15.22:0/3585430869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d40b5110 con 0x7fe7d40cc830 2024-04-16T16:16:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.721+0000 7fe7d3e00640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d4152400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7c002bec0 tx=0x7fe7c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.721+0000 7fe7d0c00640 1 -- 172.21.15.22:0/3585430869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c003bd70 con 0x7fe7d40cc830 2024-04-16T16:16:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.721+0000 7fe7d0c00640 1 -- 172.21.15.22:0/3585430869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c0046450 con 0x7fe7d40cc830 2024-04-16T16:16:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.721+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d4151920 con 0x7fe7d40cc830 2024-04-16T16:16:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.721+0000 7fe7d0c00640 1 -- 172.21.15.22:0/3585430869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0046840 con 0x7fe7d40cc830 2024-04-16T16:16:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.721+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d414e320 con 0x7fe7d40cc830 2024-04-16T16:16:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.722+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d4075f30 con 0x7fe7d40cc830 2024-04-16T16:16:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.724+0000 7fe7d0c00640 1 -- 172.21.15.22:0/3585430869 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7c0038020 con 0x7fe7d40cc830 2024-04-16T16:16:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.725+0000 7fe7d0c00640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7b406c920 0x7fe7b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.725+0000 7fe7d0c00640 1 -- 172.21.15.22:0/3585430869 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fe7c00ae0c0 con 0x7fe7d40cc830 2024-04-16T16:16:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.725+0000 7fe7d8c00640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7b406c920 0x7fe7b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.726+0000 7fe7d8c00640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7b406c920 0x7fe7b406ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8006fd0 tx=0x7fe7c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:41.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.729+0000 7fe7d0c00640 1 -- 172.21.15.22:0/3585430869 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe7c0043300 con 0x7fe7d40cc830 2024-04-16T16:16:41.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:41.977+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe7d4158280 con 0x7fe7d40cc830 2024-04-16T16:16:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.529+0000 7fe7d0c00640 1 -- 172.21.15.22:0/3585430869 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe7c007c5c0 con 0x7fe7d40cc830 2024-04-16T16:16:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2024-04-16T16:16:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.539+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7b406c920 msgr2=0x7fe7b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.539+0000 7fe7da000640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7b406c920 0x7fe7b406ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8006fd0 tx=0x7fe7c8008040 comp rx=0 tx=0).stop 2024-04-16T16:16:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.539+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 msgr2=0x7fe7d4152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.539+0000 7fe7da000640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d4152400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7c002bec0 tx=0x7fe7c00046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.540+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 shutdown_connections 2024-04-16T16:16:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.540+0000 7fe7da000640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7b406c920 0x7fe7b406ede0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.540+0000 7fe7da000640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7d415c840 0x7fe7d40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.540+0000 7fe7da000640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7d40cc830 0x7fe7d4152400 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.540+0000 7fe7da000640 1 --2- 172.21.15.22:0/3585430869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7d406e930 0x7fe7d414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.540+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 >> 172.21.15.22:0/3585430869 conn(0x7fe7d4062440 msgr2=0x7fe7d40b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.541+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 shutdown_connections 2024-04-16T16:16:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.542+0000 7fe7da000640 1 -- 172.21.15.22:0/3585430869 wait complete. 2024-04-16T16:16:42.573 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.756+0000 7f016c600640 1 Processor -- start 2024-04-16T16:16:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.757+0000 7f016c600640 1 -- start start 2024-04-16T16:16:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.758+0000 7f016c600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640cf830 0x7f01640cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.758+0000 7f016c600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f01640b7b90 0x7f01640b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.758+0000 7f016c600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01640d41b0 con 0x7f016415ee70 2024-04-16T16:16:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.758+0000 7f016c600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f016415f250 con 0x7f01640b7b90 2024-04-16T16:16:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.758+0000 7f016c600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f01640d01d0 con 0x7f01640cf830 2024-04-16T16:16:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.758+0000 7f016a600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f01640b7b90 0x7f01640b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.758+0000 7f016a600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f01640b7b90 0x7f01640b8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58796/0 (socket says 172.21.15.22:58796) 2024-04-16T16:16:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.759+0000 7f016a600640 1 -- 172.21.15.22:0/3778196733 learned_addr learned my addr 172.21.15.22:0/3778196733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.759+0000 7f0169200640 1 --2- 172.21.15.22:0/3778196733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640cf830 0x7f01640cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.759+0000 7f016a600640 1 -- 172.21.15.22:0/3778196733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640cf830 msgr2=0x7f01640cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.759+0000 7f016a600640 1 --2- 172.21.15.22:0/3778196733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640cf830 0x7f01640cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.759+0000 7f016a600640 1 -- 172.21.15.22:0/3778196733 >> v1:172.21.15.43:6789/0 conn(0x7f016415ee70 legacy=0x7f01640ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.759+0000 7f016a600640 1 -- 172.21.15.22:0/3778196733 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01640d3110 con 0x7f01640b7b90 2024-04-16T16:16:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.759+0000 7f0169200640 1 --2- 172.21.15.22:0/3778196733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640cf830 0x7f01640cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.760+0000 7f016a600640 1 --2- 172.21.15.22:0/3778196733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640b7b90 0x7f01640b8020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f015c009870 tx=0x7f015c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f384e4f8e59966e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f0163e00640 1 -- 172.21.15.22:0/3778196733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c035020 con 0x7f01640b7b90 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f0163e00640 1 -- 172.21.15.22:0/3778196733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015c031640 con 0x7f01640b7b90 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f0163e00640 1 -- 172.21.15.22:0/3778196733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c02d040 con 0x7f01640b7b90 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f016c600640 1 -- 172.21.15.22:0/3778196733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640b7b90 msgr2=0x7f01640b8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f016c600640 1 --2- 172.21.15.22:0/3778196733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640b7b90 0x7f01640b8020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f015c009870 tx=0x7f015c02b8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f016c600640 1 -- 172.21.15.22:0/3778196733 shutdown_connections 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f016c600640 1 --2- 172.21.15.22:0/3778196733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640b7b90 0x7f01640b8020 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f016c600640 1 --2- 172.21.15.22:0/3778196733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640cf830 0x7f01640cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f016c600640 1 -- 172.21.15.22:0/3778196733 >> 172.21.15.22:0/3778196733 conn(0x7f0164072670 msgr2=0x7f0164062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.761+0000 7f016c600640 1 -- 172.21.15.22:0/3778196733 shutdown_connections 2024-04-16T16:16:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.762+0000 7f016c600640 1 -- 172.21.15.22:0/3778196733 wait complete. 2024-04-16T16:16:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.763+0000 7f016c600640 1 Processor -- start 2024-04-16T16:16:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.763+0000 7f016c600640 1 -- start start 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.764+0000 7f016c600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640b7b90 0x7f0164151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.764+0000 7f016c600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640cf830 0x7f01640b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.764+0000 7f016c600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f016415ee70 0x7f01640b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.764+0000 7f016c600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01640d36d0 con 0x7f01640cf830 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.764+0000 7f016c600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01640d47c0 con 0x7f016415ee70 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.764+0000 7f016c600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f01640d39b0 con 0x7f01640b7b90 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640cf830 0x7f01640b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640cf830 0x7f01640b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58798/0 (socket says 172.21.15.22:58798) 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 -- 172.21.15.22:0/1428080447 learned_addr learned my addr 172.21.15.22:0/1428080447 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169c00640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640b7b90 0x7f0164151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f016a600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f016415ee70 0x7f01640b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 -- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640b7b90 msgr2=0x7f0164151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640b7b90 0x7f0164151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 -- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f016415ee70 msgr2=0x7f01640b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f016415ee70 0x7f01640b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 -- 172.21.15.22:0/1428080447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01640ac1b0 con 0x7f01640cf830 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169c00640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640b7b90 0x7f0164151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.765+0000 7f0169200640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640cf830 0x7f01640b6920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f015000d7d0 tx=0x7f015000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.766+0000 7f0161600640 1 -- 172.21.15.22:0/1428080447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150004030 con 0x7f01640cf830 2024-04-16T16:16:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.766+0000 7f0161600640 1 -- 172.21.15.22:0/1428080447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01500041d0 con 0x7f01640cf830 2024-04-16T16:16:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.766+0000 7f0161600640 1 -- 172.21.15.22:0/1428080447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500096a0 con 0x7f01640cf830 2024-04-16T16:16:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.766+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01640ac490 con 0x7f01640cf830 2024-04-16T16:16:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.766+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01640b45d0 con 0x7f01640cf830 2024-04-16T16:16:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.767+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01640ac9b0 con 0x7f01640cf830 2024-04-16T16:16:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.768+0000 7f0161600640 1 -- 172.21.15.22:0/1428080447 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0150009840 con 0x7f01640cf830 2024-04-16T16:16:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.769+0000 7f0161600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f014406c920 0x7f014406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.769+0000 7f0161600640 1 -- 172.21.15.22:0/1428080447 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f015008be30 con 0x7f01640cf830 2024-04-16T16:16:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.769+0000 7f0169c00640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f014406c920 0x7f014406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.770+0000 7f0169c00640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f014406c920 0x7f014406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0154001d70 tx=0x7f0154009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.773+0000 7f0161600640 1 -- 172.21.15.22:0/1428080447 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01640ac9b0 con 0x7f01640cf830 2024-04-16T16:16:42.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.977+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f016404fd90 con 0x7f01640cf830 2024-04-16T16:16:42.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.980+0000 7f0161600640 1 -- 172.21.15.22:0/1428080447 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16498 (secure 0 0 0) 0x7f015005a1c0 con 0x7f01640cf830 2024-04-16T16:16:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:42.979 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:41.978504+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:42.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.982+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f014406c920 msgr2=0x7f014406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:42.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.982+0000 7f016c600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f014406c920 0x7f014406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0154001d70 tx=0x7f0154009040 comp rx=0 tx=0).stop 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.982+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640cf830 msgr2=0x7f01640b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.982+0000 7f016c600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640cf830 0x7f01640b6920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f015000d7d0 tx=0x7f015000dc90 comp rx=0 tx=0).stop 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 shutdown_connections 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f014406c920 0x7f014406ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f016415ee70 0x7f01640b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640cf830 0x7f01640b6920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 --2- 172.21.15.22:0/1428080447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01640b7b90 0x7f0164151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 >> 172.21.15.22:0/1428080447 conn(0x7f0164072670 msgr2=0x7f0164160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 shutdown_connections 2024-04-16T16:16:42.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:42.983+0000 7f016c600640 1 -- 172.21.15.22:0/1428080447 wait complete. 2024-04-16T16:16:43.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.213+0000 7fd425e00640 1 Processor -- start 2024-04-16T16:16:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.213+0000 7fd425e00640 1 -- start start 2024-04-16T16:16:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd425e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd4200707e0 0x7fd420062440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd425e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd420062980 0x7fd4200cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd425e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4200cfa80 con 0x7fd42015ca40 2024-04-16T16:16:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd425e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd420062db0 con 0x7fd420062980 2024-04-16T16:16:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd425e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd42006edd0 con 0x7fd4200707e0 2024-04-16T16:16:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd41ea00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd42015ca40 0x7fd42006e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43628/0 (socket says 172.21.15.22:43628) 2024-04-16T16:16:43.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd41ea00640 1 -- 172.21.15.22:0/579909585 learned_addr learned my addr 172.21.15.22:0/579909585 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:43.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd41f400640 1 --2- 172.21.15.22:0/579909585 >> v2:172.21.15.22:3300/0 conn(0x7fd420062980 0x7fd4200cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.215+0000 7fd416000640 1 --2- 172.21.15.22:0/579909585 >> v2:172.21.15.43:3300/0 conn(0x7fd4200707e0 0x7fd420062440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.216+0000 7fd41f400640 1 -- 172.21.15.22:0/579909585 >> v2:172.21.15.43:3300/0 conn(0x7fd4200707e0 msgr2=0x7fd420062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:43.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.216+0000 7fd41f400640 1 --2- 172.21.15.22:0/579909585 >> v2:172.21.15.43:3300/0 conn(0x7fd4200707e0 0x7fd420062440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.216+0000 7fd41f400640 1 -- 172.21.15.22:0/579909585 >> v1:172.21.15.22:6789/0 conn(0x7fd42015ca40 legacy=0x7fd42006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.216+0000 7fd41f400640 1 -- 172.21.15.22:0/579909585 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42006f0b0 con 0x7fd420062980 2024-04-16T16:16:43.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.217+0000 7fd41f400640 1 --2- 172.21.15.22:0/579909585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd420062980 0x7fd4200cff60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd420160590 tx=0x7fd41802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8b0bdd7b442782 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:43.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.217+0000 7fd41e000640 1 -- 172.21.15.22:0/579909585 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418039070 con 0x7fd420062980 2024-04-16T16:16:43.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.217+0000 7fd41e000640 1 -- 172.21.15.22:0/579909585 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41802cc70 con 0x7fd420062980 2024-04-16T16:16:43.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.217+0000 7fd41e000640 1 -- 172.21.15.22:0/579909585 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418034660 con 0x7fd420062980 2024-04-16T16:16:43.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 -- 172.21.15.22:0/579909585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd420062980 msgr2=0x7fd4200cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 --2- 172.21.15.22:0/579909585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd420062980 0x7fd4200cff60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd420160590 tx=0x7fd41802bec0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 -- 172.21.15.22:0/579909585 shutdown_connections 2024-04-16T16:16:43.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 --2- 172.21.15.22:0/579909585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd420062980 0x7fd4200cff60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 --2- 172.21.15.22:0/579909585 >> v2:172.21.15.43:3300/0 conn(0x7fd4200707e0 0x7fd420062440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 -- 172.21.15.22:0/579909585 >> 172.21.15.22:0/579909585 conn(0x7fd4200d1820 msgr2=0x7fd4200d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:43.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 -- 172.21.15.22:0/579909585 shutdown_connections 2024-04-16T16:16:43.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.218+0000 7fd425e00640 1 -- 172.21.15.22:0/579909585 wait complete. 2024-04-16T16:16:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.220+0000 7fd425e00640 1 Processor -- start 2024-04-16T16:16:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.220+0000 7fd425e00640 1 -- start start 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd425e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd420062980 0x7fd420148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd425e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4200707e0 0x7fd420146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd425e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42015ca40 0x7fd420146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd425e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd42015ce20 con 0x7fd4200707e0 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd425e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd42006f670 con 0x7fd42015ca40 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd425e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd420148a70 con 0x7fd420062980 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd416000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4200707e0 0x7fd420146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd416000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4200707e0 0x7fd420146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58818/0 (socket says 172.21.15.22:58818) 2024-04-16T16:16:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd416000640 1 -- 172.21.15.22:0/2757972621 learned_addr learned my addr 172.21.15.22:0/2757972621 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:43.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.222+0000 7fd41f400640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42015ca40 0x7fd420146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd416000640 1 -- 172.21.15.22:0/2757972621 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd420062980 msgr2=0x7fd420148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd416000640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd420062980 0x7fd420148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd416000640 1 -- 172.21.15.22:0/2757972621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42015ca40 msgr2=0x7fd420146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd416000640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42015ca40 0x7fd420146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd416000640 1 -- 172.21.15.22:0/2757972621 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4201468d0 con 0x7fd4200707e0 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd416000640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4200707e0 0x7fd420146390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd40800d800 tx=0x7fd40800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd417e00640 1 -- 172.21.15.22:0/2757972621 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40800b6c0 con 0x7fd4200707e0 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd417e00640 1 -- 172.21.15.22:0/2757972621 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd408019070 con 0x7fd4200707e0 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd417e00640 1 -- 172.21.15.22:0/2757972621 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40800ba80 con 0x7fd4200707e0 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd420147490 con 0x7fd4200707e0 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.223+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd420147a50 con 0x7fd4200707e0 2024-04-16T16:16:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.225+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42004fd90 con 0x7fd4200707e0 2024-04-16T16:16:43.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.226+0000 7fd417e00640 1 -- 172.21.15.22:0/2757972621 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd40800bc20 con 0x7fd4200707e0 2024-04-16T16:16:43.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.226+0000 7fd417e00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd3fc06c8f0 0x7fd3fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.227+0000 7fd417e00640 1 -- 172.21.15.22:0/2757972621 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd40808c060 con 0x7fd4200707e0 2024-04-16T16:16:43.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.227+0000 7fd41ea00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd3fc06c8f0 0x7fd3fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.227+0000 7fd41ea00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd3fc06c8f0 0x7fd3fc06edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd410005880 tx=0x7fd410007a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:43.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.231+0000 7fd417e00640 1 -- 172.21.15.22:0/2757972621 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd40801c360 con 0x7fd4200707e0 2024-04-16T16:16:43.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.429+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd42006e690 con 0x7fd4200707e0 2024-04-16T16:16:43.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.431+0000 7fd417e00640 1 -- 172.21.15.22:0/2757972621 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16498 (secure 0 0 0) 0x7fd40805a470 con 0x7fd4200707e0 2024-04-16T16:16:43.430 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:43.430 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:41.978504+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:43.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd3fc06c8f0 msgr2=0x7fd3fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd3fc06c8f0 0x7fd3fc06edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd410005880 tx=0x7fd410007a20 comp rx=0 tx=0).stop 2024-04-16T16:16:43.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4200707e0 msgr2=0x7fd420146390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4200707e0 0x7fd420146390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd40800d800 tx=0x7fd40800dcc0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 shutdown_connections 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd3fc06c8f0 0x7fd3fc06edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42015ca40 0x7fd420146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4200707e0 0x7fd420146390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 --2- 172.21.15.22:0/2757972621 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd420062980 0x7fd420148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.433+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 >> 172.21.15.22:0/2757972621 conn(0x7fd4200d1820 msgr2=0x7fd4200b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.434+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 shutdown_connections 2024-04-16T16:16:43.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.434+0000 7fd425e00640 1 -- 172.21.15.22:0/2757972621 wait complete. 2024-04-16T16:16:43.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T16:16:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.679+0000 7f759e200640 1 Processor -- start 2024-04-16T16:16:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.680+0000 7f759e200640 1 -- start start 2024-04-16T16:16:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.681+0000 7f759e200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f75980b4fa0 0x7f7598070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.681+0000 7f759e200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75980715c0 con 0x7f75980b33a0 2024-04-16T16:16:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.681+0000 7f759e200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75980718a0 con 0x7f759815fe30 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.681+0000 7f759e200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7598071360 con 0x7f75980b4fa0 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f759ce00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f75980b4fa0 0x7f7598070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f759ce00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f75980b4fa0 0x7f7598070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58826/0 (socket says 172.21.15.22:58826) 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f759ce00640 1 -- 172.21.15.22:0/2210083664 learned_addr learned my addr 172.21.15.22:0/2210083664 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f7597e00640 1 --1- 172.21.15.22:0/2210083664 >> v1:172.21.15.22:6789/0 conn(0x7f75980b33a0 0x7f759815f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43632/0 (socket says 172.21.15.22:43632) 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f759ce00640 1 -- 172.21.15.22:0/2210083664 >> v1:172.21.15.43:6789/0 conn(0x7f759815fe30 legacy=0x7f75980ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f759ce00640 1 -- 172.21.15.22:0/2210083664 >> v1:172.21.15.22:6789/0 conn(0x7f75980b33a0 legacy=0x7f759815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f759ce00640 1 -- 172.21.15.22:0/2210083664 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7598071b80 con 0x7f75980b4fa0 2024-04-16T16:16:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.682+0000 7f7597400640 1 -- 172.21.15.22:0/2210083664 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924574319 0 0) 0x7f75980715c0 con 0x7f75980b33a0 2024-04-16T16:16:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.683+0000 7f759ce00640 1 --2- 172.21.15.22:0/2210083664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b4fa0 0x7f7598070e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9312669eee0c7ea server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f7597400640 1 -- 172.21.15.22:0/2210083664 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c034070 con 0x7f75980b4fa0 2024-04-16T16:16:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f7597400640 1 -- 172.21.15.22:0/2210083664 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c030860 con 0x7f75980b4fa0 2024-04-16T16:16:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f7597400640 1 -- 172.21.15.22:0/2210083664 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c030c30 con 0x7f75980b4fa0 2024-04-16T16:16:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f759e200640 1 -- 172.21.15.22:0/2210083664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b4fa0 msgr2=0x7f7598070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f759e200640 1 --2- 172.21.15.22:0/2210083664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b4fa0 0x7f7598070e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c02b9a0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f759e200640 1 -- 172.21.15.22:0/2210083664 shutdown_connections 2024-04-16T16:16:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f759e200640 1 --2- 172.21.15.22:0/2210083664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b4fa0 0x7f7598070e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f759e200640 1 -- 172.21.15.22:0/2210083664 >> 172.21.15.22:0/2210083664 conn(0x7f7598075070 msgr2=0x7f7598062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f759e200640 1 -- 172.21.15.22:0/2210083664 shutdown_connections 2024-04-16T16:16:43.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.684+0000 7f759e200640 1 -- 172.21.15.22:0/2210083664 wait complete. 2024-04-16T16:16:43.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.686+0000 7f759e200640 1 Processor -- start 2024-04-16T16:16:43.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.686+0000 7f759e200640 1 -- start start 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759e200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b33a0 0x7f7598150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75980b4fa0 0x7f7598152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f759815fe30 0x7f75981528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759e200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f75980b5380 con 0x7f75980b33a0 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75980ce630 con 0x7f75980b4fa0 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f75980b5500 con 0x7f759815fe30 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759ce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b33a0 0x7f7598150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759ce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b33a0 0x7f7598150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58842/0 (socket says 172.21.15.22:58842) 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.687+0000 7f759ce00640 1 -- 172.21.15.22:0/1557918444 learned_addr learned my addr 172.21.15.22:0/1557918444 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f7597e00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75980b4fa0 0x7f7598152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f759ce00640 1 -- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f759815fe30 msgr2=0x7f75981528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f759d800640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f759815fe30 0x7f75981528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f759ce00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f759815fe30 0x7f75981528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f759ce00640 1 -- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75980b4fa0 msgr2=0x7f7598152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f759ce00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75980b4fa0 0x7f7598152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f759ce00640 1 -- 172.21.15.22:0/1557918444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7598153150 con 0x7f75980b33a0 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f7597e00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75980b4fa0 0x7f7598152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.688+0000 7f759ce00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b33a0 0x7f7598150f10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:43.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.689+0000 7f7594c00640 1 -- 172.21.15.22:0/1557918444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c048070 con 0x7f75980b33a0 2024-04-16T16:16:43.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.689+0000 7f7594c00640 1 -- 172.21.15.22:0/1557918444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c030660 con 0x7f75980b33a0 2024-04-16T16:16:43.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.689+0000 7f7594c00640 1 -- 172.21.15.22:0/1557918444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c034040 con 0x7f75980b33a0 2024-04-16T16:16:43.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.689+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7598153710 con 0x7f75980b33a0 2024-04-16T16:16:43.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.689+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7598153cd0 con 0x7f75980b33a0 2024-04-16T16:16:43.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.691+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7598153ed0 con 0x7f75980b33a0 2024-04-16T16:16:43.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.692+0000 7f7594c00640 1 -- 172.21.15.22:0/1557918444 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f758c037070 con 0x7f75980b33a0 2024-04-16T16:16:43.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.693+0000 7f7594c00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f757c06c8f0 0x7f757c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:43.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.693+0000 7f7594c00640 1 -- 172.21.15.22:0/1557918444 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f758c0adbb0 con 0x7f75980b33a0 2024-04-16T16:16:43.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.694+0000 7f7597e00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f757c06c8f0 0x7f757c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:43.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.695+0000 7f7597e00640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f757c06c8f0 0x7f757c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75980b0390 tx=0x7f7588009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:43.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.698+0000 7f7594c00640 1 -- 172.21.15.22:0/1557918444 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7598153ed0 con 0x7f75980b33a0 2024-04-16T16:16:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:43.943+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7598075f30 con 0x7f75980b33a0 2024-04-16T16:16:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.559+0000 7f7594c00640 1 -- 172.21.15.22:0/1557918444 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f758c07bfd0 con 0x7f75980b33a0 2024-04-16T16:16:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.563+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f757c06c8f0 msgr2=0x7f757c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.563+0000 7f759e200640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f757c06c8f0 0x7f757c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75980b0390 tx=0x7f7588009040 comp rx=0 tx=0).stop 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.563+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b33a0 msgr2=0x7f7598150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.563+0000 7f759e200640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b33a0 0x7f7598150f10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c004730 comp rx=0 tx=0).stop 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 shutdown_connections 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f757c06c8f0 0x7f757c06edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f759815fe30 0x7f75981528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75980b4fa0 0x7f7598152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 --2- 172.21.15.22:0/1557918444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75980b33a0 0x7f7598150f10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 >> 172.21.15.22:0/1557918444 conn(0x7f7598075070 msgr2=0x7f759815b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 shutdown_connections 2024-04-16T16:16:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.564+0000 7f759e200640 1 -- 172.21.15.22:0/1557918444 wait complete. 2024-04-16T16:16:44.583 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T16:16:44.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T16:16:44.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.810+0000 7f8dc7600640 1 Processor -- start 2024-04-16T16:16:44.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.811+0000 7f8dc7600640 1 -- start start 2024-04-16T16:16:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.812+0000 7f8dc7600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00b3d60 0x7f8dc00d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.812+0000 7f8dc7600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8dc0162d00 0x7f8dc0163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.812+0000 7f8dc7600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc0163a30 con 0x7f8dc00cfb10 2024-04-16T16:16:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.812+0000 7f8dc7600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc00d2f70 con 0x7f8dc0162d00 2024-04-16T16:16:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.812+0000 7f8dc7600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc00d3250 con 0x7f8dc00b3d60 2024-04-16T16:16:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.813+0000 7f8dc4c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00b3d60 0x7f8dc00d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.813+0000 7f8dc4c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00b3d60 0x7f8dc00d3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:35034/0 (socket says 172.21.15.22:35034) 2024-04-16T16:16:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.813+0000 7f8dc4c00640 1 -- 172.21.15.22:0/1850177498 learned_addr learned my addr 172.21.15.22:0/1850177498 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.813+0000 7f8dc5600640 1 --2- 172.21.15.22:0/1850177498 >> v2:172.21.15.43:3300/0 conn(0x7f8dc0162d00 0x7f8dc0163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.814+0000 7f8dc5600640 1 -- 172.21.15.22:0/1850177498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00b3d60 msgr2=0x7f8dc00d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.814+0000 7f8dc5600640 1 --2- 172.21.15.22:0/1850177498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00b3d60 0x7f8dc00d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.814+0000 7f8dc5600640 1 -- 172.21.15.22:0/1850177498 >> v1:172.21.15.43:6789/0 conn(0x7f8dc00cfb10 legacy=0x7f8dc00cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.814+0000 7f8dc5600640 1 -- 172.21.15.22:0/1850177498 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc00d3530 con 0x7f8dc0162d00 2024-04-16T16:16:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.815+0000 7f8dc5600640 1 --2- 172.21.15.22:0/1850177498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc0163190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8db80097a0 tx=0x7f8db802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f142dccaf7ea50 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.816+0000 7f8dbf400640 1 -- 172.21.15.22:0/1850177498 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8031780 con 0x7f8dc0162d00 2024-04-16T16:16:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.816+0000 7f8dbf400640 1 -- 172.21.15.22:0/1850177498 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db8037070 con 0x7f8dc0162d00 2024-04-16T16:16:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.816+0000 7f8dbf400640 1 -- 172.21.15.22:0/1850177498 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8031b40 con 0x7f8dc0162d00 2024-04-16T16:16:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 -- 172.21.15.22:0/1850177498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 msgr2=0x7f8dc0163190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 --2- 172.21.15.22:0/1850177498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc0163190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8db80097a0 tx=0x7f8db802b820 comp rx=0 tx=0).stop 2024-04-16T16:16:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 -- 172.21.15.22:0/1850177498 shutdown_connections 2024-04-16T16:16:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 --2- 172.21.15.22:0/1850177498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc0163190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 --2- 172.21.15.22:0/1850177498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00b3d60 0x7f8dc00d3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 -- 172.21.15.22:0/1850177498 >> 172.21.15.22:0/1850177498 conn(0x7f8dc0062860 msgr2=0x7f8dc0062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 -- 172.21.15.22:0/1850177498 shutdown_connections 2024-04-16T16:16:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.817+0000 7f8dc7600640 1 -- 172.21.15.22:0/1850177498 wait complete. 2024-04-16T16:16:44.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.819+0000 7f8dc7600640 1 Processor -- start 2024-04-16T16:16:44.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.819+0000 7f8dc7600640 1 -- start start 2024-04-16T16:16:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.820+0000 7f8dc7600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc00b3d60 0x7f8dc015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc7600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00cfb10 0x7f8dc015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc7600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc00cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc7600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc00b4140 con 0x7f8dc00b3d60 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc7600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc00d4270 con 0x7f8dc0162d00 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc7600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc01636d0 con 0x7f8dc00cfb10 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc4c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc00b3d60 0x7f8dc015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc4c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc00b3d60 0x7f8dc015a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58854/0 (socket says 172.21.15.22:58854) 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc4c00640 1 -- 172.21.15.22:0/440348376 learned_addr learned my addr 172.21.15.22:0/440348376 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dbfe00640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00cfb10 0x7f8dc015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc5600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc00cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc4c00640 1 -- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00cfb10 msgr2=0x7f8dc015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc4c00640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00cfb10 0x7f8dc015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc4c00640 1 -- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 msgr2=0x7f8dc00cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.821+0000 7f8dc4c00640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc00cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dc4c00640 1 -- 172.21.15.22:0/440348376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc015c3e0 con 0x7f8dc00b3d60 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dc5600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc00cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dc4c00640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc00b3d60 0x7f8dc015a170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8da800e8b0 tx=0x7f8da800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dbcc00640 1 -- 172.21.15.22:0/440348376 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8017070 con 0x7f8dc00b3d60 2024-04-16T16:16:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dbcc00640 1 -- 172.21.15.22:0/440348376 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da800c940 con 0x7f8dc00b3d60 2024-04-16T16:16:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc01f8000 con 0x7f8dc00b3d60 2024-04-16T16:16:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dbcc00640 1 -- 172.21.15.22:0/440348376 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da800cd10 con 0x7f8dc00b3d60 2024-04-16T16:16:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.822+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc01f85c0 con 0x7f8dc00b3d60 2024-04-16T16:16:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.823+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc004fd90 con 0x7f8dc00b3d60 2024-04-16T16:16:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.824+0000 7f8dbcc00640 1 -- 172.21.15.22:0/440348376 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8da801a070 con 0x7f8dc00b3d60 2024-04-16T16:16:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.826+0000 7f8dbcc00640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d9c06c8f0 0x7f8d9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.826+0000 7f8dbcc00640 1 -- 172.21.15.22:0/440348376 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8da808bac0 con 0x7f8dc00b3d60 2024-04-16T16:16:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.826+0000 7f8dbfe00640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d9c06c8f0 0x7f8d9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.827+0000 7f8dbfe00640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d9c06c8f0 0x7f8d9c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b5da0 tx=0x7f8db0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:44.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:44.830+0000 7f8dbcc00640 1 -- 172.21.15.22:0/440348376 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8da8059ee0 con 0x7f8dc00b3d60 2024-04-16T16:16:45.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.072+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8dc00d29f0 con 0x7f8dc00b3d60 2024-04-16T16:16:45.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.563+0000 7f8dbcc00640 1 -- 172.21.15.22:0/440348376 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f8da80597e0 con 0x7f8dc00b3d60 2024-04-16T16:16:45.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d9c06c8f0 msgr2=0x7f8d9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:45.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d9c06c8f0 0x7f8d9c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b5da0 tx=0x7f8db0009040 comp rx=0 tx=0).stop 2024-04-16T16:16:45.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc00b3d60 msgr2=0x7f8dc015a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:45.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc00b3d60 0x7f8dc015a170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8da800e8b0 tx=0x7f8da800ed70 comp rx=0 tx=0).stop 2024-04-16T16:16:45.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 shutdown_connections 2024-04-16T16:16:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d9c06c8f0 0x7f8d9c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dc0162d00 0x7f8dc00cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8dc00cfb10 0x7f8dc015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 --2- 172.21.15.22:0/440348376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc00b3d60 0x7f8dc015a170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.566+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 >> 172.21.15.22:0/440348376 conn(0x7f8dc0062860 msgr2=0x7f8dc00c8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.567+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 shutdown_connections 2024-04-16T16:16:45.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.567+0000 7f8dc7600640 1 -- 172.21.15.22:0/440348376 wait complete. 2024-04-16T16:16:45.588 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T16:16:45.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:16:45.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.814+0000 7f49e0a00640 1 Processor -- start 2024-04-16T16:16:45.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.815+0000 7f49e0a00640 1 -- start start 2024-04-16T16:16:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.816+0000 7f49e0a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49dc0d01a0 0x7f49dc0d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.816+0000 7f49e0a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f49dc0b3410 0x7f49dc0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.816+0000 7f49e0a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0aeda0 0x7f49dc06da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.816+0000 7f49e0a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f49dc06d020 con 0x7f49dc0d01a0 2024-04-16T16:16:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.816+0000 7f49e0a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f49dc0d0ac0 con 0x7f49dc0b3410 2024-04-16T16:16:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.816+0000 7f49e0a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f49dc0af2b0 con 0x7f49dc0aeda0 2024-04-16T16:16:45.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.817+0000 7f49db400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49dc0d01a0 0x7f49dc0d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.817+0000 7f49db400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49dc0d01a0 0x7f49dc0d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58856/0 (socket says 172.21.15.22:58856) 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.817+0000 7f49db400640 1 -- 172.21.15.22:0/1771078172 learned_addr learned my addr 172.21.15.22:0/1771078172 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.817+0000 7f49daa00640 1 --2- 172.21.15.22:0/1771078172 >> v2:172.21.15.43:3300/0 conn(0x7f49dc0b3410 0x7f49dc0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.817+0000 7f49dbe00640 1 --2- 172.21.15.22:0/1771078172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0aeda0 0x7f49dc06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.818+0000 7f49db400640 1 -- 172.21.15.22:0/1771078172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0aeda0 msgr2=0x7f49dc06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.818+0000 7f49db400640 1 --2- 172.21.15.22:0/1771078172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0aeda0 0x7f49dc06da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.818+0000 7f49db400640 1 -- 172.21.15.22:0/1771078172 >> v2:172.21.15.43:3300/0 conn(0x7f49dc0b3410 msgr2=0x7f49dc0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.818+0000 7f49db400640 1 --2- 172.21.15.22:0/1771078172 >> v2:172.21.15.43:3300/0 conn(0x7f49dc0b3410 0x7f49dc0ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.818+0000 7f49db400640 1 -- 172.21.15.22:0/1771078172 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc0af590 con 0x7f49dc0d01a0 2024-04-16T16:16:45.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.819+0000 7f49db400640 1 --2- 172.21.15.22:0/1771078172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0d01a0 0x7f49dc0d0580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0afed0 tx=0x7f49cc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8737470e5f94ca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:45.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49da000640 1 -- 172.21.15.22:0/1771078172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc034070 con 0x7f49dc0d01a0 2024-04-16T16:16:45.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49da000640 1 -- 172.21.15.22:0/1771078172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc030860 con 0x7f49dc0d01a0 2024-04-16T16:16:45.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49da000640 1 -- 172.21.15.22:0/1771078172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc030c30 con 0x7f49dc0d01a0 2024-04-16T16:16:45.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49e0a00640 1 -- 172.21.15.22:0/1771078172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0d01a0 msgr2=0x7f49dc0d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:45.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49e0a00640 1 --2- 172.21.15.22:0/1771078172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0d01a0 0x7f49dc0d0580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0afed0 tx=0x7f49cc02b9a0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49e0a00640 1 -- 172.21.15.22:0/1771078172 shutdown_connections 2024-04-16T16:16:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49e0a00640 1 --2- 172.21.15.22:0/1771078172 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0aeda0 0x7f49dc06da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49e0a00640 1 --2- 172.21.15.22:0/1771078172 >> v2:172.21.15.43:3300/0 conn(0x7f49dc0b3410 0x7f49dc0ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49e0a00640 1 --2- 172.21.15.22:0/1771078172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0d01a0 0x7f49dc0d0580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.820+0000 7f49e0a00640 1 -- 172.21.15.22:0/1771078172 >> 172.21.15.22:0/1771078172 conn(0x7f49dc062440 msgr2=0x7f49dc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.821+0000 7f49e0a00640 1 -- 172.21.15.22:0/1771078172 shutdown_connections 2024-04-16T16:16:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.821+0000 7f49e0a00640 1 -- 172.21.15.22:0/1771078172 wait complete. 2024-04-16T16:16:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.822+0000 7f49e0a00640 1 Processor -- start 2024-04-16T16:16:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.822+0000 7f49e0a00640 1 -- start start 2024-04-16T16:16:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.823+0000 7f49e0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0aeda0 0x7f49dc1f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.823+0000 7f49e0a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0b3410 0x7f49dc14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.823+0000 7f49e0a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0d01a0 0x7f49dc15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.823+0000 7f49e0a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc0af870 con 0x7f49dc0b3410 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.823+0000 7f49e0a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc06d530 con 0x7f49dc0aeda0 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.823+0000 7f49e0a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f49dc162200 con 0x7f49dc0d01a0 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0b3410 0x7f49dc14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0b3410 0x7f49dc14a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58862/0 (socket says 172.21.15.22:58862) 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 -- 172.21.15.22:0/2738986190 learned_addr learned my addr 172.21.15.22:0/2738986190 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49db400640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0aeda0 0x7f49dc1f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49dbe00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0d01a0 0x7f49dc15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 -- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0d01a0 msgr2=0x7f49dc15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0d01a0 0x7f49dc15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 -- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0aeda0 msgr2=0x7f49dc1f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0aeda0 0x7f49dc1f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 -- 172.21.15.22:0/2738986190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc15bd00 con 0x7f49dc0b3410 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49db400640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0aeda0 0x7f49dc1f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49dbe00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0d01a0 0x7f49dc15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.824+0000 7f49daa00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0b3410 0x7f49dc14a090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49c800e9b0 tx=0x7f49c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.825+0000 7f49d3400640 1 -- 172.21.15.22:0/2738986190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8017070 con 0x7f49dc0b3410 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.825+0000 7f49d3400640 1 -- 172.21.15.22:0/2738986190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c800c9a0 con 0x7f49dc0b3410 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.825+0000 7f49d3400640 1 -- 172.21.15.22:0/2738986190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c800cd90 con 0x7f49dc0b3410 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.825+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49dc15e4a0 con 0x7f49dc0b3410 2024-04-16T16:16:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.825+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49dc15ea60 con 0x7f49dc0b3410 2024-04-16T16:16:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.826+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49dc075f30 con 0x7f49dc0b3410 2024-04-16T16:16:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.827+0000 7f49d3400640 1 -- 172.21.15.22:0/2738986190 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49c801a070 con 0x7f49dc0b3410 2024-04-16T16:16:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.828+0000 7f49d3400640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f49bc06c920 0x7f49bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.828+0000 7f49d3400640 1 -- 172.21.15.22:0/2738986190 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f49c808bf80 con 0x7f49dc0b3410 2024-04-16T16:16:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.828+0000 7f49db400640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f49bc06c920 0x7f49bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.829+0000 7f49db400640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f49bc06c920 0x7f49bc06ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49cc036000 tx=0x7f49cc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:45.832+0000 7f49d3400640 1 -- 172.21.15.22:0/2738986190 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49c805a310 con 0x7f49dc0b3410 2024-04-16T16:16:45.877 INFO:tasks.ceph.mds.d.smithi043.stderr:2024-04-16T16:16:45.878+0000 7f11ab800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:16:46.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.075+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49dc0cf610 con 0x7f49dc0b3410 2024-04-16T16:16:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.076+0000 7f49d3400640 1 -- 172.21.15.22:0/2738986190 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f49c8059c10 con 0x7f49dc0b3410 2024-04-16T16:16:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:46.075 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:16:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f49bc06c920 msgr2=0x7f49bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f49bc06c920 0x7f49bc06ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49cc036000 tx=0x7f49cc03b040 comp rx=0 tx=0).stop 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0b3410 msgr2=0x7f49dc14a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0b3410 0x7f49dc14a090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49c800e9b0 tx=0x7f49c800ee70 comp rx=0 tx=0).stop 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 shutdown_connections 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f49bc06c920 0x7f49bc06ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49dc0d01a0 0x7f49dc15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49dc0b3410 0x7f49dc14a090 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 --2- 172.21.15.22:0/2738986190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0aeda0 0x7f49dc1f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 >> 172.21.15.22:0/2738986190 conn(0x7f49dc062440 msgr2=0x7f49dc0b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 shutdown_connections 2024-04-16T16:16:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.079+0000 7f49e0a00640 1 -- 172.21.15.22:0/2738986190 wait complete. 2024-04-16T16:16:46.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:46.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.317+0000 7f31a3200640 1 Processor -- start 2024-04-16T16:16:46.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.318+0000 7f31a3200640 1 -- start start 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.319+0000 7f31a3200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31a40cc810 0x7f31a406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.319+0000 7f31a3200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f31a406ee80 0x7f31a415c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.319+0000 7f31a3200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a406d160 con 0x7f31a406eaa0 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.319+0000 7f31a3200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f31a406cf10 con 0x7f31a40cc810 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.319+0000 7f31a3200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f31a406d440 con 0x7f31a406ee80 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f319be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31a40cc810 0x7f31a406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f319be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31a40cc810 0x7f31a406df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58876/0 (socket says 172.21.15.22:58876) 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f319be00640 1 -- 172.21.15.22:0/3821040437 learned_addr learned my addr 172.21.15.22:0/3821040437 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f31a2800640 1 --2- 172.21.15.22:0/3821040437 >> v2:172.21.15.43:3300/0 conn(0x7f31a406ee80 0x7f31a415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f319be00640 1 -- 172.21.15.22:0/3821040437 >> v2:172.21.15.43:3300/0 conn(0x7f31a406ee80 msgr2=0x7f31a415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:46.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f319be00640 1 --2- 172.21.15.22:0/3821040437 >> v2:172.21.15.43:3300/0 conn(0x7f31a406ee80 0x7f31a415c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f319be00640 1 -- 172.21.15.22:0/3821040437 >> v1:172.21.15.22:6789/0 conn(0x7f31a406eaa0 legacy=0x7f31a40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.320+0000 7f319be00640 1 -- 172.21.15.22:0/3821040437 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a406d720 con 0x7f31a40cc810 2024-04-16T16:16:46.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.321+0000 7f319be00640 1 --2- 172.21.15.22:0/3821040437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a40cc810 0x7f31a406df00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f318c009870 tx=0x7f318c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2922bd912b0cac68 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:46.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a1400640 1 -- 172.21.15.22:0/3821040437 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c034070 con 0x7f31a40cc810 2024-04-16T16:16:46.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a1400640 1 -- 172.21.15.22:0/3821040437 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c030860 con 0x7f31a40cc810 2024-04-16T16:16:46.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a1400640 1 -- 172.21.15.22:0/3821040437 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c030c30 con 0x7f31a40cc810 2024-04-16T16:16:46.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a3200640 1 -- 172.21.15.22:0/3821040437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a40cc810 msgr2=0x7f31a406df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a3200640 1 --2- 172.21.15.22:0/3821040437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a40cc810 0x7f31a406df00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f318c009870 tx=0x7f318c02b9a0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a3200640 1 -- 172.21.15.22:0/3821040437 shutdown_connections 2024-04-16T16:16:46.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a3200640 1 --2- 172.21.15.22:0/3821040437 >> v2:172.21.15.43:3300/0 conn(0x7f31a406ee80 0x7f31a415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a3200640 1 --2- 172.21.15.22:0/3821040437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a40cc810 0x7f31a406df00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a3200640 1 -- 172.21.15.22:0/3821040437 >> 172.21.15.22:0/3821040437 conn(0x7f31a4062440 msgr2=0x7f31a4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:46.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.322+0000 7f31a3200640 1 -- 172.21.15.22:0/3821040437 shutdown_connections 2024-04-16T16:16:46.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.323+0000 7f31a3200640 1 -- 172.21.15.22:0/3821040437 wait complete. 2024-04-16T16:16:46.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.324+0000 7f31a3200640 1 Processor -- start 2024-04-16T16:16:46.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.324+0000 7f31a3200640 1 -- start start 2024-04-16T16:16:46.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.325+0000 7f31a3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a406eaa0 0x7f31a40af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.325+0000 7f31a3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a406ee80 0x7f31a415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.325+0000 7f31a3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a40cc810 0x7f31a414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.325+0000 7f31a3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31a415c740 con 0x7f31a406ee80 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.325+0000 7f31a3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f31a406e440 con 0x7f31a406eaa0 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.325+0000 7f31a3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f31a415c8c0 con 0x7f31a40cc810 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a406ee80 0x7f31a415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a406ee80 0x7f31a415f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58892/0 (socket says 172.21.15.22:58892) 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 -- 172.21.15.22:0/18092381 learned_addr learned my addr 172.21.15.22:0/18092381 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f31a2800640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a40cc810 0x7f31a414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 -- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a40cc810 msgr2=0x7f31a414be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a40cc810 0x7f31a414be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 -- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a406eaa0 msgr2=0x7f31a40af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f31a1e00640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a406eaa0 0x7f31a40af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a406eaa0 0x7f31a40af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 -- 172.21.15.22:0/18092381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a40ae040 con 0x7f31a406ee80 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f31a2800640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a40cc810 0x7f31a414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f31a1e00640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a406eaa0 0x7f31a40af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.326+0000 7f319be00640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a406ee80 0x7f31a415f270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f318c02b9e0 tx=0x7f318c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.327+0000 7f319a000640 1 -- 172.21.15.22:0/18092381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c034040 con 0x7f31a406ee80 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.327+0000 7f319a000640 1 -- 172.21.15.22:0/18092381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c039d90 con 0x7f31a406ee80 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.327+0000 7f319a000640 1 -- 172.21.15.22:0/18092381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c043630 con 0x7f31a406ee80 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.327+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a40ae320 con 0x7f31a406ee80 2024-04-16T16:16:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.327+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a40ae8e0 con 0x7f31a406ee80 2024-04-16T16:16:46.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.328+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a4075f30 con 0x7f31a406ee80 2024-04-16T16:16:46.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.329+0000 7f319a000640 1 -- 172.21.15.22:0/18092381 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f318c04a060 con 0x7f31a406ee80 2024-04-16T16:16:46.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.330+0000 7f319a000640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f318006c8f0 0x7f318006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.330+0000 7f319a000640 1 -- 172.21.15.22:0/18092381 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f318c0adc50 con 0x7f31a406ee80 2024-04-16T16:16:46.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.330+0000 7f31a1e00640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f318006c8f0 0x7f318006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.331+0000 7f31a1e00640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f318006c8f0 0x7f318006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3194001680 tx=0x7f3194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.334+0000 7f319a000640 1 -- 172.21.15.22:0/18092381 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f318c03e070 con 0x7f31a406ee80 2024-04-16T16:16:46.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.538+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31a4157f70 con 0x7f31a406ee80 2024-04-16T16:16:46.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.540+0000 7f319a000640 1 -- 172.21.15.22:0/18092381 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7f318c04be90 con 0x7f31a406ee80 2024-04-16T16:16:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:46.539 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f318006c8f0 msgr2=0x7f318006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f318006c8f0 0x7f318006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3194001680 tx=0x7f3194009040 comp rx=0 tx=0).stop 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a406ee80 msgr2=0x7f31a415f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a406ee80 0x7f31a415f270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f318c02b9e0 tx=0x7f318c0046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 shutdown_connections 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f318006c8f0 0x7f318006edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a40cc810 0x7f31a414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31a406ee80 0x7f31a415f270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 --2- 172.21.15.22:0/18092381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a406eaa0 0x7f31a40af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 >> 172.21.15.22:0/18092381 conn(0x7f31a4062440 msgr2=0x7f31a4157640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:46.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 shutdown_connections 2024-04-16T16:16:46.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.543+0000 7f31a3200640 1 -- 172.21.15.22:0/18092381 wait complete. 2024-04-16T16:16:46.562 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T16:16:46.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:16:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.780+0000 7f7941400640 1 Processor -- start 2024-04-16T16:16:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.781+0000 7f7941400640 1 -- start start 2024-04-16T16:16:46.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.782+0000 7f7941400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.782+0000 7f7941400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f793c06e860 0x7f793c071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.782+0000 7f7941400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c0b47f0 con 0x7f793c0af6b0 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f7941400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f793c0b45c0 con 0x7f793c06e860 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f7941400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f793c0b4ad0 con 0x7f793c15b7e0 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793b200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f793c06e860 0x7f793c071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793b200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f793c06e860 0x7f793c071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58900/0 (socket says 172.21.15.22:58900) 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793b200640 1 -- 172.21.15.22:0/542882750 learned_addr learned my addr 172.21.15.22:0/542882750 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793a800640 1 --2- 172.21.15.22:0/542882750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793b200640 1 -- 172.21.15.22:0/542882750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 msgr2=0x7f793c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793b200640 1 --2- 172.21.15.22:0/542882750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c15cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793b200640 1 -- 172.21.15.22:0/542882750 >> v1:172.21.15.43:6789/0 conn(0x7f793c0af6b0 legacy=0x7f793c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.783+0000 7f793b200640 1 -- 172.21.15.22:0/542882750 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c0b4db0 con 0x7f793c06e860 2024-04-16T16:16:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.784+0000 7f793b200640 1 --2- 172.21.15.22:0/542882750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c071700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7934009870 tx=0x7f793402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3fe329efb688d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.785+0000 7f7939e00640 1 -- 172.21.15.22:0/542882750 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340317c0 con 0x7f793c06e860 2024-04-16T16:16:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.785+0000 7f7939e00640 1 -- 172.21.15.22:0/542882750 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7934037070 con 0x7f793c06e860 2024-04-16T16:16:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.785+0000 7f7939e00640 1 -- 172.21.15.22:0/542882750 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934031b80 con 0x7f793c06e860 2024-04-16T16:16:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 -- 172.21.15.22:0/542882750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 msgr2=0x7f793c071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 --2- 172.21.15.22:0/542882750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c071700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7934009870 tx=0x7f793402b860 comp rx=0 tx=0).stop 2024-04-16T16:16:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 -- 172.21.15.22:0/542882750 shutdown_connections 2024-04-16T16:16:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 --2- 172.21.15.22:0/542882750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c071700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 --2- 172.21.15.22:0/542882750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c15cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 -- 172.21.15.22:0/542882750 >> 172.21.15.22:0/542882750 conn(0x7f793c062440 msgr2=0x7f793c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 -- 172.21.15.22:0/542882750 shutdown_connections 2024-04-16T16:16:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.786+0000 7f7941400640 1 -- 172.21.15.22:0/542882750 wait complete. 2024-04-16T16:16:46.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.788+0000 7f7941400640 1 Processor -- start 2024-04-16T16:16:46.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.788+0000 7f7941400640 1 -- start start 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f7941400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f7941400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f793c0af6b0 0x7f793c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f7941400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c0723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f7941400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f793c15bd40 con 0x7f793c06e860 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f7941400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f793c15bbc0 con 0x7f793c0af6b0 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f7941400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f793c0afb10 con 0x7f793c15b7e0 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f793a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f793a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58906/0 (socket says 172.21.15.22:58906) 2024-04-16T16:16:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f793a800640 1 -- 172.21.15.22:0/3542062031 learned_addr learned my addr 172.21.15.22:0/3542062031 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f793a800640 1 -- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 msgr2=0x7f793c0723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f7931e00640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f793c0af6b0 0x7f793c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f793b200640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c0723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.789+0000 7f793a800640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c0723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f793a800640 1 -- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f793c0af6b0 msgr2=0x7f793c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f793a800640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f793c0af6b0 0x7f793c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f793a800640 1 -- 172.21.15.22:0/3542062031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c151b30 con 0x7f793c06e860 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f7931e00640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f793c0af6b0 0x7f793c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f793b200640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c0723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f793a800640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c142290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f792c007e70 tx=0x7f792c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f7933400640 1 -- 172.21.15.22:0/3542062031 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c014620 con 0x7f793c06e860 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f7933400640 1 -- 172.21.15.22:0/3542062031 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c019070 con 0x7f793c06e860 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c151e10 con 0x7f793c06e860 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f7933400640 1 -- 172.21.15.22:0/3542062031 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c014a00 con 0x7f793c06e860 2024-04-16T16:16:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.790+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c1523d0 con 0x7f793c06e860 2024-04-16T16:16:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.791+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c04fd90 con 0x7f793c06e860 2024-04-16T16:16:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.793+0000 7f7933400640 1 -- 172.21.15.22:0/3542062031 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f792c014ba0 con 0x7f793c06e860 2024-04-16T16:16:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.793+0000 7f7933400640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f791806c920 0x7f791806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.794+0000 7f7933400640 1 -- 172.21.15.22:0/3542062031 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f792c08c2c0 con 0x7f793c06e860 2024-04-16T16:16:46.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.794+0000 7f7931e00640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f791806c920 0x7f791806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:46.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.794+0000 7f7931e00640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f791806c920 0x7f791806ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f793c151860 tx=0x7f7924009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:46.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.798+0000 7f7933400640 1 -- 172.21.15.22:0/3542062031 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f792c05a780 con 0x7f793c06e860 2024-04-16T16:16:46.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:46.999+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f793c0b3e50 con 0x7f791806c920 2024-04-16T16:16:47.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.020+0000 7f7933400640 1 -- 172.21.15.22:0/3542062031 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f7924055840 con 0x7f791806c920 2024-04-16T16:16:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:47.023 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f791806c920 msgr2=0x7f791806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f791806c920 0x7f791806ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f793c151860 tx=0x7f7924009040 comp rx=0 tx=0).stop 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 msgr2=0x7f793c142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c142290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f792c007e70 tx=0x7f792c00e4b0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 shutdown_connections 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f791806c920 0x7f791806ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793c15b7e0 0x7f793c0723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f793c0af6b0 0x7f793c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 --2- 172.21.15.22:0/3542062031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f793c06e860 0x7f793c142290 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.025+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 >> 172.21.15.22:0/3542062031 conn(0x7f793c062440 msgr2=0x7f793c158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:47.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.026+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 shutdown_connections 2024-04-16T16:16:47.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.026+0000 7f7941400640 1 -- 172.21.15.22:0/3542062031 wait complete. 2024-04-16T16:16:47.043 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-16T16:16:45.705091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252604,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722116,"statfs":{"total":773094113280,"available":772835446784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.230463"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556501+0000","last_change":"2024-04-16T16:16:42.559736+0000","last_active":"2024-04-16T16:16:43.556501+0000","last_peered":"2024-04-16T16:16:43.556501+0000","last_clean":"2024-04-16T16:16:43.556501+0000","last_became_active":"2024-04-16T16:16:42.559419+0000","last_became_peered":"2024-04-16T16:16:42.559419+0000","last_unstale":"2024-04-16T16:16:43.556501+0000","last_undegraded":"2024-04-16T16:16:43.556501+0000","last_fullsized":"2024-04-16T16:16:43.556501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536010+0000","last_change":"2024-04-16T16:16:42.545904+0000","last_active":"2024-04-16T16:16:43.536010+0000","last_peered":"2024-04-16T16:16:43.536010+0000","last_clean":"2024-04-16T16:16:43.536010+0000","last_became_active":"2024-04-16T16:16:42.545527+0000","last_became_peered":"2024-04-16T16:16:42.545527+0000","last_unstale":"2024-04-16T16:16:43.536010+0000","last_undegraded":"2024-04-16T16:16:43.536010+0000","last_fullsized":"2024-04-16T16:16:43.536010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693597+0000","last_change":"2024-04-16T16:16:42.541313+0000","last_active":"2024-04-16T16:16:43.693597+0000","last_peered":"2024-04-16T16:16:43.693597+0000","last_clean":"2024-04-16T16:16:43.693597+0000","last_became_active":"2024-04-16T16:16:42.540978+0000","last_became_peered":"2024-04-16T16:16:42.540978+0000","last_unstale":"2024-04-16T16:16:43.693597+0000","last_undegraded":"2024-04-16T16:16:43.693597+0000","last_fullsized":"2024-04-16T16:16:43.693597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:35.789405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541482+0000","last_change":"2024-04-16T16:16:42.544651+0000","last_active":"2024-04-16T16:16:43.541482+0000","last_peered":"2024-04-16T16:16:43.541482+0000","last_clean":"2024-04-16T16:16:43.541482+0000","last_became_active":"2024-04-16T16:16:42.542011+0000","last_became_peered":"2024-04-16T16:16:42.542011+0000","last_unstale":"2024-04-16T16:16:43.541482+0000","last_undegraded":"2024-04-16T16:16:43.541482+0000","last_fullsized":"2024-04-16T16:16:43.541482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555229+0000","last_change":"2024-04-16T16:16:42.551072+0000","last_active":"2024-04-16T16:16:43.555229+0000","last_peered":"2024-04-16T16:16:43.555229+0000","last_clean":"2024-04-16T16:16:43.555229+0000","last_became_active":"2024-04-16T16:16:42.550775+0000","last_became_peered":"2024-04-16T16:16:42.550775+0000","last_unstale":"2024-04-16T16:16:43.555229+0000","last_undegraded":"2024-04-16T16:16:43.555229+0000","last_fullsized":"2024-04-16T16:16:43.555229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541943+0000","last_change":"2024-04-16T16:16:42.539682+0000","last_active":"2024-04-16T16:16:43.541943+0000","last_peered":"2024-04-16T16:16:43.541943+0000","last_clean":"2024-04-16T16:16:43.541943+0000","last_became_active":"2024-04-16T16:16:42.539350+0000","last_became_peered":"2024-04-16T16:16:42.539350+0000","last_unstale":"2024-04-16T16:16:43.541943+0000","last_undegraded":"2024-04-16T16:16:43.541943+0000","last_fullsized":"2024-04-16T16:16:43.541943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554743+0000","last_change":"2024-04-16T16:16:42.548040+0000","last_active":"2024-04-16T16:16:43.554743+0000","last_peered":"2024-04-16T16:16:43.554743+0000","last_clean":"2024-04-16T16:16:43.554743+0000","last_became_active":"2024-04-16T16:16:42.547751+0000","last_became_peered":"2024-04-16T16:16:42.547751+0000","last_unstale":"2024-04-16T16:16:43.554743+0000","last_undegraded":"2024-04-16T16:16:43.554743+0000","last_fullsized":"2024-04-16T16:16:43.554743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692888+0000","last_change":"2024-04-16T16:16:42.568826+0000","last_active":"2024-04-16T16:16:43.692888+0000","last_peered":"2024-04-16T16:16:43.692888+0000","last_clean":"2024-04-16T16:16:43.692888+0000","last_became_active":"2024-04-16T16:16:42.568499+0000","last_became_peered":"2024-04-16T16:16:42.568499+0000","last_unstale":"2024-04-16T16:16:43.692888+0000","last_undegraded":"2024-04-16T16:16:43.692888+0000","last_fullsized":"2024-04-16T16:16:43.692888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556655+0000","last_change":"2024-04-16T16:16:42.572131+0000","last_active":"2024-04-16T16:16:43.556655+0000","last_peered":"2024-04-16T16:16:43.556655+0000","last_clean":"2024-04-16T16:16:43.556655+0000","last_became_active":"2024-04-16T16:16:42.571817+0000","last_became_peered":"2024-04-16T16:16:42.571817+0000","last_unstale":"2024-04-16T16:16:43.556655+0000","last_undegraded":"2024-04-16T16:16:43.556655+0000","last_fullsized":"2024-04-16T16:16:43.556655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:54.665217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559687+0000","last_change":"2024-04-16T16:16:42.564515+0000","last_active":"2024-04-16T16:16:43.559687+0000","last_peered":"2024-04-16T16:16:43.559687+0000","last_clean":"2024-04-16T16:16:43.559687+0000","last_became_active":"2024-04-16T16:16:42.564233+0000","last_became_peered":"2024-04-16T16:16:42.564233+0000","last_unstale":"2024-04-16T16:16:43.559687+0000","last_undegraded":"2024-04-16T16:16:43.559687+0000","last_fullsized":"2024-04-16T16:16:43.559687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559928+0000","last_change":"2024-04-16T16:16:42.564502+0000","last_active":"2024-04-16T16:16:43.559928+0000","last_peered":"2024-04-16T16:16:43.559928+0000","last_clean":"2024-04-16T16:16:43.559928+0000","last_became_active":"2024-04-16T16:16:42.563916+0000","last_became_peered":"2024-04-16T16:16:42.563916+0000","last_unstale":"2024-04-16T16:16:43.559928+0000","last_undegraded":"2024-04-16T16:16:43.559928+0000","last_fullsized":"2024-04-16T16:16:43.559928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540676+0000","last_change":"2024-04-16T16:16:42.542716+0000","last_active":"2024-04-16T16:16:43.540676+0000","last_peered":"2024-04-16T16:16:43.540676+0000","last_clean":"2024-04-16T16:16:43.540676+0000","last_became_active":"2024-04-16T16:16:42.542395+0000","last_became_peered":"2024-04-16T16:16:42.542395+0000","last_unstale":"2024-04-16T16:16:43.540676+0000","last_undegraded":"2024-04-16T16:16:43.540676+0000","last_fullsized":"2024-04-16T16:16:43.540676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694675+0000","last_change":"2024-04-16T16:16:42.544561+0000","last_active":"2024-04-16T16:16:43.694675+0000","last_peered":"2024-04-16T16:16:43.694675+0000","last_clean":"2024-04-16T16:16:43.694675+0000","last_became_active":"2024-04-16T16:16:42.544242+0000","last_became_peered":"2024-04-16T16:16:42.544242+0000","last_unstale":"2024-04-16T16:16:43.694675+0000","last_undegraded":"2024-04-16T16:16:43.694675+0000","last_fullsized":"2024-04-16T16:16:43.694675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693350+0000","last_change":"2024-04-16T16:16:42.538809+0000","last_active":"2024-04-16T16:16:43.693350+0000","last_peered":"2024-04-16T16:16:43.693350+0000","last_clean":"2024-04-16T16:16:43.693350+0000","last_became_active":"2024-04-16T16:16:42.538530+0000","last_became_peered":"2024-04-16T16:16:42.538530+0000","last_unstale":"2024-04-16T16:16:43.693350+0000","last_undegraded":"2024-04-16T16:16:43.693350+0000","last_fullsized":"2024-04-16T16:16:43.693350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:14:47.747590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535308+0000","last_change":"2024-04-16T16:16:42.530478+0000","last_active":"2024-04-16T16:16:43.535308+0000","last_peered":"2024-04-16T16:16:43.535308+0000","last_clean":"2024-04-16T16:16:43.535308+0000","last_became_active":"2024-04-16T16:16:42.529997+0000","last_became_peered":"2024-04-16T16:16:42.529997+0000","last_unstale":"2024-04-16T16:16:43.535308+0000","last_undegraded":"2024-04-16T16:16:43.535308+0000","last_fullsized":"2024-04-16T16:16:43.535308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540875+0000","last_change":"2024-04-16T16:16:42.555498+0000","last_active":"2024-04-16T16:16:43.540875+0000","last_peered":"2024-04-16T16:16:43.540875+0000","last_clean":"2024-04-16T16:16:43.540875+0000","last_became_active":"2024-04-16T16:16:42.539784+0000","last_became_peered":"2024-04-16T16:16:42.539784+0000","last_unstale":"2024-04-16T16:16:43.540875+0000","last_undegraded":"2024-04-16T16:16:43.540875+0000","last_fullsized":"2024-04-16T16:16:43.540875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543881+0000","last_change":"2024-04-16T16:16:42.565804+0000","last_active":"2024-04-16T16:16:43.543881+0000","last_peered":"2024-04-16T16:16:43.543881+0000","last_clean":"2024-04-16T16:16:43.543881+0000","last_became_active":"2024-04-16T16:16:42.565289+0000","last_became_peered":"2024-04-16T16:16:42.565289+0000","last_unstale":"2024-04-16T16:16:43.543881+0000","last_undegraded":"2024-04-16T16:16:43.543881+0000","last_fullsized":"2024-04-16T16:16:43.543881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538777+0000","last_change":"2024-04-16T16:16:42.545811+0000","last_active":"2024-04-16T16:16:43.538777+0000","last_peered":"2024-04-16T16:16:43.538777+0000","last_clean":"2024-04-16T16:16:43.538777+0000","last_became_active":"2024-04-16T16:16:42.544185+0000","last_became_peered":"2024-04-16T16:16:42.544185+0000","last_unstale":"2024-04-16T16:16:43.538777+0000","last_undegraded":"2024-04-16T16:16:43.538777+0000","last_fullsized":"2024-04-16T16:16:43.538777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556076+0000","last_change":"2024-04-16T16:16:42.554043+0000","last_active":"2024-04-16T16:16:43.556076+0000","last_peered":"2024-04-16T16:16:43.556076+0000","last_clean":"2024-04-16T16:16:43.556076+0000","last_became_active":"2024-04-16T16:16:42.553829+0000","last_became_peered":"2024-04-16T16:16:42.553829+0000","last_unstale":"2024-04-16T16:16:43.556076+0000","last_undegraded":"2024-04-16T16:16:43.556076+0000","last_fullsized":"2024-04-16T16:16:43.556076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559370+0000","last_change":"2024-04-16T16:16:42.557240+0000","last_active":"2024-04-16T16:16:43.559370+0000","last_peered":"2024-04-16T16:16:43.559370+0000","last_clean":"2024-04-16T16:16:43.559370+0000","last_became_active":"2024-04-16T16:16:42.556898+0000","last_became_peered":"2024-04-16T16:16:42.556898+0000","last_unstale":"2024-04-16T16:16:43.559370+0000","last_undegraded":"2024-04-16T16:16:43.559370+0000","last_fullsized":"2024-04-16T16:16:43.559370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693761+0000","last_change":"2024-04-16T16:16:42.559394+0000","last_active":"2024-04-16T16:16:43.693761+0000","last_peered":"2024-04-16T16:16:43.693761+0000","last_clean":"2024-04-16T16:16:43.693761+0000","last_became_active":"2024-04-16T16:16:42.559074+0000","last_became_peered":"2024-04-16T16:16:42.559074+0000","last_unstale":"2024-04-16T16:16:43.693761+0000","last_undegraded":"2024-04-16T16:16:43.693761+0000","last_fullsized":"2024-04-16T16:16:43.693761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542086+0000","last_change":"2024-04-16T16:16:42.566856+0000","last_active":"2024-04-16T16:16:43.542086+0000","last_peered":"2024-04-16T16:16:43.542086+0000","last_clean":"2024-04-16T16:16:43.542086+0000","last_became_active":"2024-04-16T16:16:42.566592+0000","last_became_peered":"2024-04-16T16:16:42.566592+0000","last_unstale":"2024-04-16T16:16:43.542086+0000","last_undegraded":"2024-04-16T16:16:43.542086+0000","last_fullsized":"2024-04-16T16:16:43.542086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693037+0000","last_change":"2024-04-16T16:16:42.538807+0000","last_active":"2024-04-16T16:16:43.693037+0000","last_peered":"2024-04-16T16:16:43.693037+0000","last_clean":"2024-04-16T16:16:43.693037+0000","last_became_active":"2024-04-16T16:16:42.538490+0000","last_became_peered":"2024-04-16T16:16:42.538490+0000","last_unstale":"2024-04-16T16:16:43.693037+0000","last_undegraded":"2024-04-16T16:16:43.693037+0000","last_fullsized":"2024-04-16T16:16:43.693037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541234+0000","last_change":"2024-04-16T16:16:42.555745+0000","last_active":"2024-04-16T16:16:43.541234+0000","last_peered":"2024-04-16T16:16:43.541234+0000","last_clean":"2024-04-16T16:16:43.541234+0000","last_became_active":"2024-04-16T16:16:42.555171+0000","last_became_peered":"2024-04-16T16:16:42.555171+0000","last_unstale":"2024-04-16T16:16:43.541234+0000","last_undegraded":"2024-04-16T16:16:43.541234+0000","last_fullsized":"2024-04-16T16:16:43.541234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693298+0000","last_change":"2024-04-16T16:16:42.552853+0000","last_active":"2024-04-16T16:16:43.693298+0000","last_peered":"2024-04-16T16:16:43.693298+0000","last_clean":"2024-04-16T16:16:43.693298+0000","last_became_active":"2024-04-16T16:16:42.551283+0000","last_became_peered":"2024-04-16T16:16:42.551283+0000","last_unstale":"2024-04-16T16:16:43.693298+0000","last_undegraded":"2024-04-16T16:16:43.693298+0000","last_fullsized":"2024-04-16T16:16:43.693298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559962+0000","last_change":"2024-04-16T16:16:42.546726+0000","last_active":"2024-04-16T16:16:43.559962+0000","last_peered":"2024-04-16T16:16:43.559962+0000","last_clean":"2024-04-16T16:16:43.559962+0000","last_became_active":"2024-04-16T16:16:42.546286+0000","last_became_peered":"2024-04-16T16:16:42.546286+0000","last_unstale":"2024-04-16T16:16:43.559962+0000","last_undegraded":"2024-04-16T16:16:43.559962+0000","last_fullsized":"2024-04-16T16:16:43.559962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536193+0000","last_change":"2024-04-16T16:16:42.542402+0000","last_active":"2024-04-16T16:16:43.536193+0000","last_peered":"2024-04-16T16:16:43.536193+0000","last_clean":"2024-04-16T16:16:43.536193+0000","last_became_active":"2024-04-16T16:16:42.542076+0000","last_became_peered":"2024-04-16T16:16:42.542076+0000","last_unstale":"2024-04-16T16:16:43.536193+0000","last_undegraded":"2024-04-16T16:16:43.536193+0000","last_fullsized":"2024-04-16T16:16:43.536193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693594+0000","last_change":"2024-04-16T16:16:42.550290+0000","last_active":"2024-04-16T16:16:43.693594+0000","last_peered":"2024-04-16T16:16:43.693594+0000","last_clean":"2024-04-16T16:16:43.693594+0000","last_became_active":"2024-04-16T16:16:42.543751+0000","last_became_peered":"2024-04-16T16:16:42.543751+0000","last_unstale":"2024-04-16T16:16:43.693594+0000","last_undegraded":"2024-04-16T16:16:43.693594+0000","last_fullsized":"2024-04-16T16:16:43.693594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693908+0000","last_change":"2024-04-16T16:16:42.551870+0000","last_active":"2024-04-16T16:16:43.693908+0000","last_peered":"2024-04-16T16:16:43.693908+0000","last_clean":"2024-04-16T16:16:43.693908+0000","last_became_active":"2024-04-16T16:16:42.551579+0000","last_became_peered":"2024-04-16T16:16:42.551579+0000","last_unstale":"2024-04-16T16:16:43.693908+0000","last_undegraded":"2024-04-16T16:16:43.693908+0000","last_fullsized":"2024-04-16T16:16:43.693908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542423+0000","last_change":"2024-04-16T16:16:42.540659+0000","last_active":"2024-04-16T16:16:43.542423+0000","last_peered":"2024-04-16T16:16:43.542423+0000","last_clean":"2024-04-16T16:16:43.542423+0000","last_became_active":"2024-04-16T16:16:42.540216+0000","last_became_peered":"2024-04-16T16:16:42.540216+0000","last_unstale":"2024-04-16T16:16:43.542423+0000","last_undegraded":"2024-04-16T16:16:43.542423+0000","last_fullsized":"2024-04-16T16:16:43.542423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538640+0000","last_change":"2024-04-16T16:16:42.540673+0000","last_active":"2024-04-16T16:16:43.538640+0000","last_peered":"2024-04-16T16:16:43.538640+0000","last_clean":"2024-04-16T16:16:43.538640+0000","last_became_active":"2024-04-16T16:16:42.540278+0000","last_became_peered":"2024-04-16T16:16:42.540278+0000","last_unstale":"2024-04-16T16:16:43.538640+0000","last_undegraded":"2024-04-16T16:16:43.538640+0000","last_fullsized":"2024-04-16T16:16:43.538640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559097+0000","last_change":"2024-04-16T16:16:42.544057+0000","last_active":"2024-04-16T16:16:43.559097+0000","last_peered":"2024-04-16T16:16:43.559097+0000","last_clean":"2024-04-16T16:16:43.559097+0000","last_became_active":"2024-04-16T16:16:42.543472+0000","last_became_peered":"2024-04-16T16:16:42.543472+0000","last_unstale":"2024-04-16T16:16:43.559097+0000","last_undegraded":"2024-04-16T16:16:43.559097+0000","last_fullsized":"2024-04-16T16:16:43.559097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539617+0000","last_change":"2024-04-16T16:16:42.527013+0000","last_active":"2024-04-16T16:16:43.539617+0000","last_peered":"2024-04-16T16:16:43.539617+0000","last_clean":"2024-04-16T16:16:43.539617+0000","last_became_active":"2024-04-16T16:16:42.526649+0000","last_became_peered":"2024-04-16T16:16:42.526649+0000","last_unstale":"2024-04-16T16:16:43.539617+0000","last_undegraded":"2024-04-16T16:16:43.539617+0000","last_fullsized":"2024-04-16T16:16:43.539617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:45.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694817+0000","last_change":"2024-04-16T16:16:41.520565+0000","last_active":"2024-04-16T16:16:43.694817+0000","last_peered":"2024-04-16T16:16:43.694817+0000","last_clean":"2024-04-16T16:16:43.694817+0000","last_became_active":"2024-04-16T16:16:41.517406+0000","last_became_peered":"2024-04-16T16:16:41.517406+0000","last_unstale":"2024-04-16T16:16:43.694817+0000","last_undegraded":"2024-04-16T16:16:43.694817+0000","last_fullsized":"2024-04-16T16:16:43.694817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694052+0000","last_change":"2024-04-16T16:16:42.556599+0000","last_active":"2024-04-16T16:16:43.694052+0000","last_peered":"2024-04-16T16:16:43.694052+0000","last_clean":"2024-04-16T16:16:43.694052+0000","last_became_active":"2024-04-16T16:16:42.555600+0000","last_became_peered":"2024-04-16T16:16:42.555600+0000","last_unstale":"2024-04-16T16:16:43.694052+0000","last_undegraded":"2024-04-16T16:16:43.694052+0000","last_fullsized":"2024-04-16T16:16:43.694052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559476+0000","last_change":"2024-04-16T16:16:41.523017+0000","last_active":"2024-04-16T16:16:43.559476+0000","last_peered":"2024-04-16T16:16:43.559476+0000","last_clean":"2024-04-16T16:16:43.559476+0000","last_became_active":"2024-04-16T16:16:41.519934+0000","last_became_peered":"2024-04-16T16:16:41.519934+0000","last_unstale":"2024-04-16T16:16:43.559476+0000","last_undegraded":"2024-04-16T16:16:43.559476+0000","last_fullsized":"2024-04-16T16:16:43.559476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693115+0000","last_change":"2024-04-16T16:16:41.522651+0000","last_active":"2024-04-16T16:16:43.693115+0000","last_peered":"2024-04-16T16:16:43.693115+0000","last_clean":"2024-04-16T16:16:43.693115+0000","last_became_active":"2024-04-16T16:16:41.522339+0000","last_became_peered":"2024-04-16T16:16:41.522339+0000","last_unstale":"2024-04-16T16:16:43.693115+0000","last_undegraded":"2024-04-16T16:16:43.693115+0000","last_fullsized":"2024-04-16T16:16:43.693115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692933+0000","last_change":"2024-04-16T16:16:42.553919+0000","last_active":"2024-04-16T16:16:43.692933+0000","last_peered":"2024-04-16T16:16:43.692933+0000","last_clean":"2024-04-16T16:16:43.692933+0000","last_became_active":"2024-04-16T16:16:42.553556+0000","last_became_peered":"2024-04-16T16:16:42.553556+0000","last_unstale":"2024-04-16T16:16:43.692933+0000","last_undegraded":"2024-04-16T16:16:43.692933+0000","last_fullsized":"2024-04-16T16:16:43.692933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541425+0000","last_change":"2024-04-16T16:16:41.522408+0000","last_active":"2024-04-16T16:16:43.541425+0000","last_peered":"2024-04-16T16:16:43.541425+0000","last_clean":"2024-04-16T16:16:43.541425+0000","last_became_active":"2024-04-16T16:16:41.520458+0000","last_became_peered":"2024-04-16T16:16:41.520458+0000","last_unstale":"2024-04-16T16:16:43.541425+0000","last_undegraded":"2024-04-16T16:16:43.541425+0000","last_fullsized":"2024-04-16T16:16:43.541425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535473+0000","last_change":"2024-04-16T16:16:42.541508+0000","last_active":"2024-04-16T16:16:43.535473+0000","last_peered":"2024-04-16T16:16:43.535473+0000","last_clean":"2024-04-16T16:16:43.535473+0000","last_became_active":"2024-04-16T16:16:42.541115+0000","last_became_peered":"2024-04-16T16:16:42.541115+0000","last_unstale":"2024-04-16T16:16:43.535473+0000","last_undegraded":"2024-04-16T16:16:43.535473+0000","last_fullsized":"2024-04-16T16:16:43.535473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559608+0000","last_change":"2024-04-16T16:16:41.530254+0000","last_active":"2024-04-16T16:16:43.559608+0000","last_peered":"2024-04-16T16:16:43.559608+0000","last_clean":"2024-04-16T16:16:43.559608+0000","last_became_active":"2024-04-16T16:16:41.529897+0000","last_became_peered":"2024-04-16T16:16:41.529897+0000","last_unstale":"2024-04-16T16:16:43.559608+0000","last_undegraded":"2024-04-16T16:16:43.559608+0000","last_fullsized":"2024-04-16T16:16:43.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543317+0000","last_change":"2024-04-16T16:16:42.554549+0000","last_active":"2024-04-16T16:16:43.543317+0000","last_peered":"2024-04-16T16:16:43.543317+0000","last_clean":"2024-04-16T16:16:43.543317+0000","last_became_active":"2024-04-16T16:16:42.554246+0000","last_became_peered":"2024-04-16T16:16:42.554246+0000","last_unstale":"2024-04-16T16:16:43.543317+0000","last_undegraded":"2024-04-16T16:16:43.543317+0000","last_fullsized":"2024-04-16T16:16:43.543317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543183+0000","last_change":"2024-04-16T16:16:41.531843+0000","last_active":"2024-04-16T16:16:43.543183+0000","last_peered":"2024-04-16T16:16:43.543183+0000","last_clean":"2024-04-16T16:16:43.543183+0000","last_became_active":"2024-04-16T16:16:41.531238+0000","last_became_peered":"2024-04-16T16:16:41.531238+0000","last_unstale":"2024-04-16T16:16:43.543183+0000","last_undegraded":"2024-04-16T16:16:43.543183+0000","last_fullsized":"2024-04-16T16:16:43.543183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694381+0000","last_change":"2024-04-16T16:16:42.556349+0000","last_active":"2024-04-16T16:16:43.694381+0000","last_peered":"2024-04-16T16:16:43.694381+0000","last_clean":"2024-04-16T16:16:43.694381+0000","last_became_active":"2024-04-16T16:16:42.556013+0000","last_became_peered":"2024-04-16T16:16:42.556013+0000","last_unstale":"2024-04-16T16:16:43.694381+0000","last_undegraded":"2024-04-16T16:16:43.694381+0000","last_fullsized":"2024-04-16T16:16:43.694381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535872+0000","last_change":"2024-04-16T16:16:41.524793+0000","last_active":"2024-04-16T16:16:43.535872+0000","last_peered":"2024-04-16T16:16:43.535872+0000","last_clean":"2024-04-16T16:16:43.535872+0000","last_became_active":"2024-04-16T16:16:41.524086+0000","last_became_peered":"2024-04-16T16:16:41.524086+0000","last_unstale":"2024-04-16T16:16:43.535872+0000","last_undegraded":"2024-04-16T16:16:43.535872+0000","last_fullsized":"2024-04-16T16:16:43.535872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541069+0000","last_change":"2024-04-16T16:16:42.551097+0000","last_active":"2024-04-16T16:16:43.541069+0000","last_peered":"2024-04-16T16:16:43.541069+0000","last_clean":"2024-04-16T16:16:43.541069+0000","last_became_active":"2024-04-16T16:16:42.548624+0000","last_became_peered":"2024-04-16T16:16:42.548624+0000","last_unstale":"2024-04-16T16:16:43.541069+0000","last_undegraded":"2024-04-16T16:16:43.541069+0000","last_fullsized":"2024-04-16T16:16:43.541069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559402+0000","last_change":"2024-04-16T16:16:41.523855+0000","last_active":"2024-04-16T16:16:43.559402+0000","last_peered":"2024-04-16T16:16:43.559402+0000","last_clean":"2024-04-16T16:16:43.559402+0000","last_became_active":"2024-04-16T16:16:41.523499+0000","last_became_peered":"2024-04-16T16:16:41.523499+0000","last_unstale":"2024-04-16T16:16:43.559402+0000","last_undegraded":"2024-04-16T16:16:43.559402+0000","last_fullsized":"2024-04-16T16:16:43.559402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555794+0000","last_change":"2024-04-16T16:16:42.557535+0000","last_active":"2024-04-16T16:16:43.555794+0000","last_peered":"2024-04-16T16:16:43.555794+0000","last_clean":"2024-04-16T16:16:43.555794+0000","last_became_active":"2024-04-16T16:16:42.557352+0000","last_became_peered":"2024-04-16T16:16:42.557352+0000","last_unstale":"2024-04-16T16:16:43.555794+0000","last_undegraded":"2024-04-16T16:16:43.555794+0000","last_fullsized":"2024-04-16T16:16:43.555794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694160+0000","last_change":"2024-04-16T16:16:41.509775+0000","last_active":"2024-04-16T16:16:43.694160+0000","last_peered":"2024-04-16T16:16:43.694160+0000","last_clean":"2024-04-16T16:16:43.694160+0000","last_became_active":"2024-04-16T16:16:41.509405+0000","last_became_peered":"2024-04-16T16:16:41.509405+0000","last_unstale":"2024-04-16T16:16:43.694160+0000","last_undegraded":"2024-04-16T16:16:43.694160+0000","last_fullsized":"2024-04-16T16:16:43.694160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:41:24.584086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693565+0000","last_change":"2024-04-16T16:16:42.559637+0000","last_active":"2024-04-16T16:16:43.693565+0000","last_peered":"2024-04-16T16:16:43.693565+0000","last_clean":"2024-04-16T16:16:43.693565+0000","last_became_active":"2024-04-16T16:16:42.559112+0000","last_became_peered":"2024-04-16T16:16:42.559112+0000","last_unstale":"2024-04-16T16:16:43.693565+0000","last_undegraded":"2024-04-16T16:16:43.693565+0000","last_fullsized":"2024-04-16T16:16:43.693565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:58:54.293764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542320+0000","last_change":"2024-04-16T16:16:41.523971+0000","last_active":"2024-04-16T16:16:43.542320+0000","last_peered":"2024-04-16T16:16:43.542320+0000","last_clean":"2024-04-16T16:16:43.542320+0000","last_became_active":"2024-04-16T16:16:41.523700+0000","last_became_peered":"2024-04-16T16:16:41.523700+0000","last_unstale":"2024-04-16T16:16:43.542320+0000","last_undegraded":"2024-04-16T16:16:43.542320+0000","last_fullsized":"2024-04-16T16:16:43.542320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555684+0000","last_change":"2024-04-16T16:16:42.560857+0000","last_active":"2024-04-16T16:16:43.555684+0000","last_peered":"2024-04-16T16:16:43.555684+0000","last_clean":"2024-04-16T16:16:43.555684+0000","last_became_active":"2024-04-16T16:16:42.560540+0000","last_became_peered":"2024-04-16T16:16:42.560540+0000","last_unstale":"2024-04-16T16:16:43.555684+0000","last_undegraded":"2024-04-16T16:16:43.555684+0000","last_fullsized":"2024-04-16T16:16:43.555684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559052+0000","last_change":"2024-04-16T16:16:41.524165+0000","last_active":"2024-04-16T16:16:43.559052+0000","last_peered":"2024-04-16T16:16:43.559052+0000","last_clean":"2024-04-16T16:16:43.559052+0000","last_became_active":"2024-04-16T16:16:41.520052+0000","last_became_peered":"2024-04-16T16:16:41.520052+0000","last_unstale":"2024-04-16T16:16:43.559052+0000","last_undegraded":"2024-04-16T16:16:43.559052+0000","last_fullsized":"2024-04-16T16:16:43.559052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559159+0000","last_change":"2024-04-16T16:16:42.543827+0000","last_active":"2024-04-16T16:16:43.559159+0000","last_peered":"2024-04-16T16:16:43.559159+0000","last_clean":"2024-04-16T16:16:43.559159+0000","last_became_active":"2024-04-16T16:16:42.543057+0000","last_became_peered":"2024-04-16T16:16:42.543057+0000","last_unstale":"2024-04-16T16:16:43.559159+0000","last_undegraded":"2024-04-16T16:16:43.559159+0000","last_fullsized":"2024-04-16T16:16:43.559159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538345+0000","last_change":"2024-04-16T16:16:41.515275+0000","last_active":"2024-04-16T16:16:43.538345+0000","last_peered":"2024-04-16T16:16:43.538345+0000","last_clean":"2024-04-16T16:16:43.538345+0000","last_became_active":"2024-04-16T16:16:41.511512+0000","last_became_peered":"2024-04-16T16:16:41.511512+0000","last_unstale":"2024-04-16T16:16:43.538345+0000","last_undegraded":"2024-04-16T16:16:43.538345+0000","last_fullsized":"2024-04-16T16:16:43.538345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554847+0000","last_change":"2024-04-16T16:16:42.553481+0000","last_active":"2024-04-16T16:16:43.554847+0000","last_peered":"2024-04-16T16:16:43.554847+0000","last_clean":"2024-04-16T16:16:43.554847+0000","last_became_active":"2024-04-16T16:16:42.553097+0000","last_became_peered":"2024-04-16T16:16:42.553097+0000","last_unstale":"2024-04-16T16:16:43.554847+0000","last_undegraded":"2024-04-16T16:16:43.554847+0000","last_fullsized":"2024-04-16T16:16:43.554847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541627+0000","last_change":"2024-04-16T16:16:41.498748+0000","last_active":"2024-04-16T16:16:43.541627+0000","last_peered":"2024-04-16T16:16:43.541627+0000","last_clean":"2024-04-16T16:16:43.541627+0000","last_became_active":"2024-04-16T16:16:41.497561+0000","last_became_peered":"2024-04-16T16:16:41.497561+0000","last_unstale":"2024-04-16T16:16:43.541627+0000","last_undegraded":"2024-04-16T16:16:43.541627+0000","last_fullsized":"2024-04-16T16:16:43.541627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:50.555761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556264+0000","last_change":"2024-04-16T16:16:42.556235+0000","last_active":"2024-04-16T16:16:43.556264+0000","last_peered":"2024-04-16T16:16:43.556264+0000","last_clean":"2024-04-16T16:16:43.556264+0000","last_became_active":"2024-04-16T16:16:42.555772+0000","last_became_peered":"2024-04-16T16:16:42.555772+0000","last_unstale":"2024-04-16T16:16:43.556264+0000","last_undegraded":"2024-04-16T16:16:43.556264+0000","last_fullsized":"2024-04-16T16:16:43.556264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538851+0000","last_change":"2024-04-16T16:16:41.513088+0000","last_active":"2024-04-16T16:16:43.538851+0000","last_peered":"2024-04-16T16:16:43.538851+0000","last_clean":"2024-04-16T16:16:43.538851+0000","last_became_active":"2024-04-16T16:16:41.512316+0000","last_became_peered":"2024-04-16T16:16:41.512316+0000","last_unstale":"2024-04-16T16:16:43.538851+0000","last_undegraded":"2024-04-16T16:16:43.538851+0000","last_fullsized":"2024-04-16T16:16:43.538851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556658+0000","last_change":"2024-04-16T16:16:42.557154+0000","last_active":"2024-04-16T16:16:43.556658+0000","last_peered":"2024-04-16T16:16:43.556658+0000","last_clean":"2024-04-16T16:16:43.556658+0000","last_became_active":"2024-04-16T16:16:42.556853+0000","last_became_peered":"2024-04-16T16:16:42.556853+0000","last_unstale":"2024-04-16T16:16:43.556658+0000","last_undegraded":"2024-04-16T16:16:43.556658+0000","last_fullsized":"2024-04-16T16:16:43.556658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:12:32.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536004+0000","last_change":"2024-04-16T16:16:41.520997+0000","last_active":"2024-04-16T16:16:43.536004+0000","last_peered":"2024-04-16T16:16:43.536004+0000","last_clean":"2024-04-16T16:16:43.536004+0000","last_became_active":"2024-04-16T16:16:41.520502+0000","last_became_peered":"2024-04-16T16:16:41.520502+0000","last_unstale":"2024-04-16T16:16:43.536004+0000","last_undegraded":"2024-04-16T16:16:43.536004+0000","last_fullsized":"2024-04-16T16:16:43.536004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542374+0000","last_change":"2024-04-16T16:16:42.551483+0000","last_active":"2024-04-16T16:16:43.542374+0000","last_peered":"2024-04-16T16:16:43.542374+0000","last_clean":"2024-04-16T16:16:43.542374+0000","last_became_active":"2024-04-16T16:16:42.540166+0000","last_became_peered":"2024-04-16T16:16:42.540166+0000","last_unstale":"2024-04-16T16:16:43.542374+0000","last_undegraded":"2024-04-16T16:16:43.542374+0000","last_fullsized":"2024-04-16T16:16:43.542374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538450+0000","last_change":"2024-04-16T16:16:41.523070+0000","last_active":"2024-04-16T16:16:43.538450+0000","last_peered":"2024-04-16T16:16:43.538450+0000","last_clean":"2024-04-16T16:16:43.538450+0000","last_became_active":"2024-04-16T16:16:41.522786+0000","last_became_peered":"2024-04-16T16:16:41.522786+0000","last_unstale":"2024-04-16T16:16:43.538450+0000","last_undegraded":"2024-04-16T16:16:43.538450+0000","last_fullsized":"2024-04-16T16:16:43.538450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:09.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555935+0000","last_change":"2024-04-16T16:16:42.571326+0000","last_active":"2024-04-16T16:16:43.555935+0000","last_peered":"2024-04-16T16:16:43.555935+0000","last_clean":"2024-04-16T16:16:43.555935+0000","last_became_active":"2024-04-16T16:16:42.570406+0000","last_became_peered":"2024-04-16T16:16:42.570406+0000","last_unstale":"2024-04-16T16:16:43.555935+0000","last_undegraded":"2024-04-16T16:16:43.555935+0000","last_fullsized":"2024-04-16T16:16:43.555935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554754+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:16:43.554754+0000","last_peered":"2024-04-16T16:16:43.554754+0000","last_clean":"2024-04-16T16:16:43.554754+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:16:43.554754+0000","last_undegraded":"2024-04-16T16:16:43.554754+0000","last_fullsized":"2024-04-16T16:16:43.554754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541770+0000","last_change":"2024-04-16T16:16:41.518448+0000","last_active":"2024-04-16T16:16:43.541770+0000","last_peered":"2024-04-16T16:16:43.541770+0000","last_clean":"2024-04-16T16:16:43.541770+0000","last_became_active":"2024-04-16T16:16:41.517938+0000","last_became_peered":"2024-04-16T16:16:41.517938+0000","last_unstale":"2024-04-16T16:16:43.541770+0000","last_undegraded":"2024-04-16T16:16:43.541770+0000","last_fullsized":"2024-04-16T16:16:43.541770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693472+0000","last_change":"2024-04-16T16:16:42.537690+0000","last_active":"2024-04-16T16:16:43.693472+0000","last_peered":"2024-04-16T16:16:43.693472+0000","last_clean":"2024-04-16T16:16:43.693472+0000","last_became_active":"2024-04-16T16:16:42.537268+0000","last_became_peered":"2024-04-16T16:16:42.537268+0000","last_unstale":"2024-04-16T16:16:43.693472+0000","last_undegraded":"2024-04-16T16:16:43.693472+0000","last_fullsized":"2024-04-16T16:16:43.693472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554773+0000","last_change":"2024-04-16T16:16:41.522499+0000","last_active":"2024-04-16T16:16:43.554773+0000","last_peered":"2024-04-16T16:16:43.554773+0000","last_clean":"2024-04-16T16:16:43.554773+0000","last_became_active":"2024-04-16T16:16:41.522124+0000","last_became_peered":"2024-04-16T16:16:41.522124+0000","last_unstale":"2024-04-16T16:16:43.554773+0000","last_undegraded":"2024-04-16T16:16:43.554773+0000","last_fullsized":"2024-04-16T16:16:43.554773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693674+0000","last_change":"2024-04-16T16:16:42.554808+0000","last_active":"2024-04-16T16:16:43.693674+0000","last_peered":"2024-04-16T16:16:43.693674+0000","last_clean":"2024-04-16T16:16:43.693674+0000","last_became_active":"2024-04-16T16:16:42.552890+0000","last_became_peered":"2024-04-16T16:16:42.552890+0000","last_unstale":"2024-04-16T16:16:43.693674+0000","last_undegraded":"2024-04-16T16:16:43.693674+0000","last_fullsized":"2024-04-16T16:16:43.693674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:40.482814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538337+0000","last_change":"2024-04-16T16:16:41.517103+0000","last_active":"2024-04-16T16:16:43.538337+0000","last_peered":"2024-04-16T16:16:43.538337+0000","last_clean":"2024-04-16T16:16:43.538337+0000","last_became_active":"2024-04-16T16:16:41.516829+0000","last_became_peered":"2024-04-16T16:16:41.516829+0000","last_unstale":"2024-04-16T16:16:43.538337+0000","last_undegraded":"2024-04-16T16:16:43.538337+0000","last_fullsized":"2024-04-16T16:16:43.538337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535231+0000","last_change":"2024-04-16T16:16:42.541238+0000","last_active":"2024-04-16T16:16:43.535231+0000","last_peered":"2024-04-16T16:16:43.535231+0000","last_clean":"2024-04-16T16:16:43.535231+0000","last_became_active":"2024-04-16T16:16:42.540924+0000","last_became_peered":"2024-04-16T16:16:42.540924+0000","last_unstale":"2024-04-16T16:16:43.535231+0000","last_undegraded":"2024-04-16T16:16:43.535231+0000","last_fullsized":"2024-04-16T16:16:43.535231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542556+0000","last_change":"2024-04-16T16:16:41.519683+0000","last_active":"2024-04-16T16:16:43.542556+0000","last_peered":"2024-04-16T16:16:43.542556+0000","last_clean":"2024-04-16T16:16:43.542556+0000","last_became_active":"2024-04-16T16:16:41.519343+0000","last_became_peered":"2024-04-16T16:16:41.519343+0000","last_unstale":"2024-04-16T16:16:43.542556+0000","last_undegraded":"2024-04-16T16:16:43.542556+0000","last_fullsized":"2024-04-16T16:16:43.542556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540500+0000","last_change":"2024-04-16T16:16:42.542028+0000","last_active":"2024-04-16T16:16:43.540500+0000","last_peered":"2024-04-16T16:16:43.540500+0000","last_clean":"2024-04-16T16:16:43.540500+0000","last_became_active":"2024-04-16T16:16:42.538888+0000","last_became_peered":"2024-04-16T16:16:42.538888+0000","last_unstale":"2024-04-16T16:16:43.540500+0000","last_undegraded":"2024-04-16T16:16:43.540500+0000","last_fullsized":"2024-04-16T16:16:43.540500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:43.311234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.509361+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.509045+0000","last_became_peered":"2024-04-16T16:16:41.509045+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543027+0000","last_change":"2024-04-16T16:16:42.558916+0000","last_active":"2024-04-16T16:16:43.543027+0000","last_peered":"2024-04-16T16:16:43.543027+0000","last_clean":"2024-04-16T16:16:43.543027+0000","last_became_active":"2024-04-16T16:16:42.545348+0000","last_became_peered":"2024-04-16T16:16:42.545348+0000","last_unstale":"2024-04-16T16:16:43.543027+0000","last_undegraded":"2024-04-16T16:16:43.543027+0000","last_fullsized":"2024-04-16T16:16:43.543027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556231+0000","last_change":"2024-04-16T16:16:41.522662+0000","last_active":"2024-04-16T16:16:43.556231+0000","last_peered":"2024-04-16T16:16:43.556231+0000","last_clean":"2024-04-16T16:16:43.556231+0000","last_became_active":"2024-04-16T16:16:41.522355+0000","last_became_peered":"2024-04-16T16:16:41.522355+0000","last_unstale":"2024-04-16T16:16:43.556231+0000","last_undegraded":"2024-04-16T16:16:43.556231+0000","last_fullsized":"2024-04-16T16:16:43.556231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535843+0000","last_change":"2024-04-16T16:16:42.541278+0000","last_active":"2024-04-16T16:16:43.535843+0000","last_peered":"2024-04-16T16:16:43.535843+0000","last_clean":"2024-04-16T16:16:43.535843+0000","last_became_active":"2024-04-16T16:16:42.540838+0000","last_became_peered":"2024-04-16T16:16:42.540838+0000","last_unstale":"2024-04-16T16:16:43.535843+0000","last_undegraded":"2024-04-16T16:16:43.535843+0000","last_fullsized":"2024-04-16T16:16:43.535843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.558097+0000","last_change":"2024-04-16T16:16:41.527012+0000","last_active":"2024-04-16T16:16:43.558097+0000","last_peered":"2024-04-16T16:16:43.558097+0000","last_clean":"2024-04-16T16:16:43.558097+0000","last_became_active":"2024-04-16T16:16:41.526665+0000","last_became_peered":"2024-04-16T16:16:41.526665+0000","last_unstale":"2024-04-16T16:16:43.558097+0000","last_undegraded":"2024-04-16T16:16:43.558097+0000","last_fullsized":"2024-04-16T16:16:43.558097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693473+0000","last_change":"2024-04-16T16:16:42.549680+0000","last_active":"2024-04-16T16:16:43.693473+0000","last_peered":"2024-04-16T16:16:43.693473+0000","last_clean":"2024-04-16T16:16:43.693473+0000","last_became_active":"2024-04-16T16:16:42.547089+0000","last_became_peered":"2024-04-16T16:16:42.547089+0000","last_unstale":"2024-04-16T16:16:43.693473+0000","last_undegraded":"2024-04-16T16:16:43.693473+0000","last_fullsized":"2024-04-16T16:16:43.693473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559737+0000","last_change":"2024-04-16T16:16:41.528043+0000","last_active":"2024-04-16T16:16:43.559737+0000","last_peered":"2024-04-16T16:16:43.559737+0000","last_clean":"2024-04-16T16:16:43.559737+0000","last_became_active":"2024-04-16T16:16:41.527767+0000","last_became_peered":"2024-04-16T16:16:41.527767+0000","last_unstale":"2024-04-16T16:16:43.559737+0000","last_undegraded":"2024-04-16T16:16:43.559737+0000","last_fullsized":"2024-04-16T16:16:43.559737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694076+0000","last_change":"2024-04-16T16:16:42.540712+0000","last_active":"2024-04-16T16:16:43.694076+0000","last_peered":"2024-04-16T16:16:43.694076+0000","last_clean":"2024-04-16T16:16:43.694076+0000","last_became_active":"2024-04-16T16:16:42.538863+0000","last_became_peered":"2024-04-16T16:16:42.538863+0000","last_unstale":"2024-04-16T16:16:43.694076+0000","last_undegraded":"2024-04-16T16:16:43.694076+0000","last_fullsized":"2024-04-16T16:16:43.694076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554585+0000","last_change":"2024-04-16T16:16:41.518575+0000","last_active":"2024-04-16T16:16:43.554585+0000","last_peered":"2024-04-16T16:16:43.554585+0000","last_clean":"2024-04-16T16:16:43.554585+0000","last_became_active":"2024-04-16T16:16:41.517913+0000","last_became_peered":"2024-04-16T16:16:41.517913+0000","last_unstale":"2024-04-16T16:16:43.554585+0000","last_undegraded":"2024-04-16T16:16:43.554585+0000","last_fullsized":"2024-04-16T16:16:43.554585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539618+0000","last_change":"2024-04-16T16:16:42.539495+0000","last_active":"2024-04-16T16:16:43.539618+0000","last_peered":"2024-04-16T16:16:43.539618+0000","last_clean":"2024-04-16T16:16:43.539618+0000","last_became_active":"2024-04-16T16:16:42.539119+0000","last_became_peered":"2024-04-16T16:16:42.539119+0000","last_unstale":"2024-04-16T16:16:43.539618+0000","last_undegraded":"2024-04-16T16:16:43.539618+0000","last_fullsized":"2024-04-16T16:16:43.539618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:30.369821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535447+0000","last_change":"2024-04-16T16:16:41.524546+0000","last_active":"2024-04-16T16:16:43.535447+0000","last_peered":"2024-04-16T16:16:43.535447+0000","last_clean":"2024-04-16T16:16:43.535447+0000","last_became_active":"2024-04-16T16:16:41.521734+0000","last_became_peered":"2024-04-16T16:16:41.521734+0000","last_unstale":"2024-04-16T16:16:43.535447+0000","last_undegraded":"2024-04-16T16:16:43.535447+0000","last_fullsized":"2024-04-16T16:16:43.535447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693061+0000","last_change":"2024-04-16T16:16:42.549899+0000","last_active":"2024-04-16T16:16:43.693061+0000","last_peered":"2024-04-16T16:16:43.693061+0000","last_clean":"2024-04-16T16:16:43.693061+0000","last_became_active":"2024-04-16T16:16:42.545606+0000","last_became_peered":"2024-04-16T16:16:42.545606+0000","last_unstale":"2024-04-16T16:16:43.693061+0000","last_undegraded":"2024-04-16T16:16:43.693061+0000","last_fullsized":"2024-04-16T16:16:43.693061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.515086+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.514804+0000","last_became_peered":"2024-04-16T16:16:41.514804+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694754+0000","last_change":"2024-04-16T16:16:42.539283+0000","last_active":"2024-04-16T16:16:43.694754+0000","last_peered":"2024-04-16T16:16:43.694754+0000","last_clean":"2024-04-16T16:16:43.694754+0000","last_became_active":"2024-04-16T16:16:42.538992+0000","last_became_peered":"2024-04-16T16:16:42.538992+0000","last_unstale":"2024-04-16T16:16:43.694754+0000","last_undegraded":"2024-04-16T16:16:43.694754+0000","last_fullsized":"2024-04-16T16:16:43.694754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555783+0000","last_change":"2024-04-16T16:16:41.528069+0000","last_active":"2024-04-16T16:16:43.555783+0000","last_peered":"2024-04-16T16:16:43.555783+0000","last_clean":"2024-04-16T16:16:43.555783+0000","last_became_active":"2024-04-16T16:16:41.527661+0000","last_became_peered":"2024-04-16T16:16:41.527661+0000","last_unstale":"2024-04-16T16:16:43.555783+0000","last_undegraded":"2024-04-16T16:16:43.555783+0000","last_fullsized":"2024-04-16T16:16:43.555783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559239+0000","last_change":"2024-04-16T16:16:42.555670+0000","last_active":"2024-04-16T16:16:43.559239+0000","last_peered":"2024-04-16T16:16:43.559239+0000","last_clean":"2024-04-16T16:16:43.559239+0000","last_became_active":"2024-04-16T16:16:42.555257+0000","last_became_peered":"2024-04-16T16:16:42.555257+0000","last_unstale":"2024-04-16T16:16:43.559239+0000","last_undegraded":"2024-04-16T16:16:43.559239+0000","last_fullsized":"2024-04-16T16:16:43.559239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542682+0000","last_change":"2024-04-16T16:16:42.528582+0000","last_active":"2024-04-16T16:16:43.542682+0000","last_peered":"2024-04-16T16:16:43.542682+0000","last_clean":"2024-04-16T16:16:43.542682+0000","last_became_active":"2024-04-16T16:16:42.528086+0000","last_became_peered":"2024-04-16T16:16:42.528086+0000","last_unstale":"2024-04-16T16:16:43.542682+0000","last_undegraded":"2024-04-16T16:16:43.542682+0000","last_fullsized":"2024-04-16T16:16:43.542682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555817+0000","last_change":"2024-04-16T16:16:41.525844+0000","last_active":"2024-04-16T16:16:43.555817+0000","last_peered":"2024-04-16T16:16:43.555817+0000","last_clean":"2024-04-16T16:16:43.555817+0000","last_became_active":"2024-04-16T16:16:41.524506+0000","last_became_peered":"2024-04-16T16:16:41.524506+0000","last_unstale":"2024-04-16T16:16:43.555817+0000","last_undegraded":"2024-04-16T16:16:43.555817+0000","last_fullsized":"2024-04-16T16:16:43.555817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541916+0000","last_change":"2024-04-16T16:16:42.529397+0000","last_active":"2024-04-16T16:16:43.541916+0000","last_peered":"2024-04-16T16:16:43.541916+0000","last_clean":"2024-04-16T16:16:43.541916+0000","last_became_active":"2024-04-16T16:16:42.528776+0000","last_became_peered":"2024-04-16T16:16:42.528776+0000","last_unstale":"2024-04-16T16:16:43.541916+0000","last_undegraded":"2024-04-16T16:16:43.541916+0000","last_fullsized":"2024-04-16T16:16:43.541916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556158+0000","last_change":"2024-04-16T16:16:41.531832+0000","last_active":"2024-04-16T16:16:43.556158+0000","last_peered":"2024-04-16T16:16:43.556158+0000","last_clean":"2024-04-16T16:16:43.556158+0000","last_became_active":"2024-04-16T16:16:41.531327+0000","last_became_peered":"2024-04-16T16:16:41.531327+0000","last_unstale":"2024-04-16T16:16:43.556158+0000","last_undegraded":"2024-04-16T16:16:43.556158+0000","last_fullsized":"2024-04-16T16:16:43.556158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694244+0000","last_change":"2024-04-16T16:16:42.570229+0000","last_active":"2024-04-16T16:16:43.694244+0000","last_peered":"2024-04-16T16:16:43.694244+0000","last_clean":"2024-04-16T16:16:43.694244+0000","last_became_active":"2024-04-16T16:16:42.569878+0000","last_became_peered":"2024-04-16T16:16:42.569878+0000","last_unstale":"2024-04-16T16:16:43.694244+0000","last_undegraded":"2024-04-16T16:16:43.694244+0000","last_fullsized":"2024-04-16T16:16:43.694244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695178+0000","last_change":"2024-04-16T16:16:41.514706+0000","last_active":"2024-04-16T16:16:43.695178+0000","last_peered":"2024-04-16T16:16:43.695178+0000","last_clean":"2024-04-16T16:16:43.695178+0000","last_became_active":"2024-04-16T16:16:41.514337+0000","last_became_peered":"2024-04-16T16:16:41.514337+0000","last_unstale":"2024-04-16T16:16:43.695178+0000","last_undegraded":"2024-04-16T16:16:43.695178+0000","last_fullsized":"2024-04-16T16:16:43.695178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695077+0000","last_change":"2024-04-16T16:16:42.544576+0000","last_active":"2024-04-16T16:16:43.695077+0000","last_peered":"2024-04-16T16:16:43.695077+0000","last_clean":"2024-04-16T16:16:43.695077+0000","last_became_active":"2024-04-16T16:16:42.544221+0000","last_became_peered":"2024-04-16T16:16:42.544221+0000","last_unstale":"2024-04-16T16:16:43.695077+0000","last_undegraded":"2024-04-16T16:16:43.695077+0000","last_fullsized":"2024-04-16T16:16:43.695077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694565+0000","last_change":"2024-04-16T16:16:41.519681+0000","last_active":"2024-04-16T16:16:43.694565+0000","last_peered":"2024-04-16T16:16:43.694565+0000","last_clean":"2024-04-16T16:16:43.694565+0000","last_became_active":"2024-04-16T16:16:41.519259+0000","last_became_peered":"2024-04-16T16:16:41.519259+0000","last_unstale":"2024-04-16T16:16:43.694565+0000","last_undegraded":"2024-04-16T16:16:43.694565+0000","last_fullsized":"2024-04-16T16:16:43.694565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:22.558679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:16:47.048 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:16:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.311+0000 7f2a9ac00640 1 Processor -- start 2024-04-16T16:16:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.312+0000 7f2a9ac00640 1 -- start start 2024-04-16T16:16:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.313+0000 7f2a9ac00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2a940710c0 0x7f2a9415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.313+0000 7f2a9ac00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2a940cf040 0x7f2a940b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.313+0000 7f2a9ac00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a940b7520 con 0x7f2a94156e90 2024-04-16T16:16:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.313+0000 7f2a9ac00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2a94071830 con 0x7f2a940cf040 2024-04-16T16:16:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.313+0000 7f2a9ac00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2a940b7800 con 0x7f2a940710c0 2024-04-16T16:16:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a99800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2a94156e90 0x7f2a940709b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43654/0 (socket says 172.21.15.22:43654) 2024-04-16T16:16:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a99800640 1 -- 172.21.15.22:0/2441269451 learned_addr learned my addr 172.21.15.22:0/2441269451 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a9a200640 1 --2- 172.21.15.22:0/2441269451 >> v2:172.21.15.22:3300/0 conn(0x7f2a940cf040 0x7f2a940b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a98e00640 1 --2- 172.21.15.22:0/2441269451 >> v2:172.21.15.43:3300/0 conn(0x7f2a940710c0 0x7f2a9415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a9a200640 1 -- 172.21.15.22:0/2441269451 >> v2:172.21.15.43:3300/0 conn(0x7f2a940710c0 msgr2=0x7f2a9415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a9a200640 1 --2- 172.21.15.22:0/2441269451 >> v2:172.21.15.43:3300/0 conn(0x7f2a940710c0 0x7f2a9415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a9a200640 1 -- 172.21.15.22:0/2441269451 >> v1:172.21.15.22:6789/0 conn(0x7f2a94156e90 legacy=0x7f2a940709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.314+0000 7f2a9a200640 1 -- 172.21.15.22:0/2441269451 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a940b5880 con 0x7f2a940cf040 2024-04-16T16:16:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.315+0000 7f2a9a200640 1 --2- 172.21.15.22:0/2441269451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940cf040 0x7f2a940b5da0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a940b5440 tx=0x7f2a8c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511d8b5b10db331b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.315+0000 7f2a93e00640 1 -- 172.21.15.22:0/2441269451 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c039070 con 0x7f2a940cf040 2024-04-16T16:16:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a93e00640 1 -- 172.21.15.22:0/2441269451 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8c02cb50 con 0x7f2a940cf040 2024-04-16T16:16:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a93e00640 1 -- 172.21.15.22:0/2441269451 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c034440 con 0x7f2a940cf040 2024-04-16T16:16:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a9ac00640 1 -- 172.21.15.22:0/2441269451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940cf040 msgr2=0x7f2a940b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/2441269451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940cf040 0x7f2a940b5da0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a940b5440 tx=0x7f2a8c02bda0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a9ac00640 1 -- 172.21.15.22:0/2441269451 shutdown_connections 2024-04-16T16:16:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/2441269451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940cf040 0x7f2a940b5da0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/2441269451 >> v2:172.21.15.43:3300/0 conn(0x7f2a940710c0 0x7f2a9415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.316+0000 7f2a9ac00640 1 -- 172.21.15.22:0/2441269451 >> 172.21.15.22:0/2441269451 conn(0x7f2a940b4400 msgr2=0x7f2a940b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.317+0000 7f2a9ac00640 1 -- 172.21.15.22:0/2441269451 shutdown_connections 2024-04-16T16:16:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.317+0000 7f2a9ac00640 1 -- 172.21.15.22:0/2441269451 wait complete. 2024-04-16T16:16:47.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.318+0000 7f2a9ac00640 1 Processor -- start 2024-04-16T16:16:47.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.318+0000 7f2a9ac00640 1 -- start start 2024-04-16T16:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.319+0000 7f2a9ac00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940710c0 0x7f2a941f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.319+0000 7f2a9ac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a940cf040 0x7f2a941456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.319+0000 7f2a9ac00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a94156e90 0x7f2a9415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.319+0000 7f2a9ac00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941573f0 con 0x7f2a940710c0 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.319+0000 7f2a9ac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a94157270 con 0x7f2a940cf040 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.319+0000 7f2a9ac00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2a940b62e0 con 0x7f2a94156e90 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940710c0 0x7f2a941f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940710c0 0x7f2a941f3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58938/0 (socket says 172.21.15.22:58938) 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 -- 172.21.15.22:0/1238102156 learned_addr learned my addr 172.21.15.22:0/1238102156 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a98e00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a940cf040 0x7f2a941456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a9a200640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a94156e90 0x7f2a9415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 -- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a94156e90 msgr2=0x7f2a9415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a94156e90 0x7f2a9415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 -- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a940cf040 msgr2=0x7f2a941456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a940cf040 0x7f2a941456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.320+0000 7f2a99800640 1 -- 172.21.15.22:0/1238102156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a94142ec0 con 0x7f2a940710c0 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.321+0000 7f2a99800640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940710c0 0x7f2a941f3350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800c3c0 tx=0x7f2a8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.321+0000 7f2a91600640 1 -- 172.21.15.22:0/1238102156 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88017070 con 0x7f2a940710c0 2024-04-16T16:16:47.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.321+0000 7f2a91600640 1 -- 172.21.15.22:0/1238102156 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a88005ce0 con 0x7f2a940710c0 2024-04-16T16:16:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.321+0000 7f2a91600640 1 -- 172.21.15.22:0/1238102156 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a880072f0 con 0x7f2a940710c0 2024-04-16T16:16:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.321+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a941431a0 con 0x7f2a940710c0 2024-04-16T16:16:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.321+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a94143760 con 0x7f2a940710c0 2024-04-16T16:16:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.323+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a94075f30 con 0x7f2a940710c0 2024-04-16T16:16:47.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.323+0000 7f2a91600640 1 -- 172.21.15.22:0/1238102156 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a8801a070 con 0x7f2a940710c0 2024-04-16T16:16:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.324+0000 7f2a91600640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a7406c8f0 0x7f2a7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.324+0000 7f2a91600640 1 -- 172.21.15.22:0/1238102156 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2a8808aea0 con 0x7f2a940710c0 2024-04-16T16:16:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.325+0000 7f2a98e00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a7406c8f0 0x7f2a7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.325+0000 7f2a98e00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a7406c8f0 0x7f2a7406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2a9415dac0 tx=0x7f2a80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.329+0000 7f2a91600640 1 -- 172.21.15.22:0/1238102156 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a880592d0 con 0x7f2a940710c0 2024-04-16T16:16:47.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.532+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a9406e260 con 0x7f2a7406c8f0 2024-04-16T16:16:47.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.550+0000 7f2a91600640 1 -- 172.21.15.22:0/1238102156 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f2a9406e260 con 0x7f2a7406c8f0 2024-04-16T16:16:47.552 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:47.553 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:16:47.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a7406c8f0 msgr2=0x7f2a7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a7406c8f0 0x7f2a7406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2a9415dac0 tx=0x7f2a80008040 comp rx=0 tx=0).stop 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940710c0 msgr2=0x7f2a941f3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940710c0 0x7f2a941f3350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800c3c0 tx=0x7f2a8800c880 comp rx=0 tx=0).stop 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 shutdown_connections 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a7406c8f0 0x7f2a7406edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a94156e90 0x7f2a9415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a940cf040 0x7f2a941456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 --2- 172.21.15.22:0/1238102156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a940710c0 0x7f2a941f3350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.555+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 >> 172.21.15.22:0/1238102156 conn(0x7f2a940b4400 msgr2=0x7f2a940709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.556+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 shutdown_connections 2024-04-16T16:16:47.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.556+0000 7f2a9ac00640 1 -- 172.21.15.22:0/1238102156 wait complete. 2024-04-16T16:16:47.575 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-16T16:16:45.705091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252604,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722116,"statfs":{"total":773094113280,"available":772835446784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.230463"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556501+0000","last_change":"2024-04-16T16:16:42.559736+0000","last_active":"2024-04-16T16:16:43.556501+0000","last_peered":"2024-04-16T16:16:43.556501+0000","last_clean":"2024-04-16T16:16:43.556501+0000","last_became_active":"2024-04-16T16:16:42.559419+0000","last_became_peered":"2024-04-16T16:16:42.559419+0000","last_unstale":"2024-04-16T16:16:43.556501+0000","last_undegraded":"2024-04-16T16:16:43.556501+0000","last_fullsized":"2024-04-16T16:16:43.556501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536010+0000","last_change":"2024-04-16T16:16:42.545904+0000","last_active":"2024-04-16T16:16:43.536010+0000","last_peered":"2024-04-16T16:16:43.536010+0000","last_clean":"2024-04-16T16:16:43.536010+0000","last_became_active":"2024-04-16T16:16:42.545527+0000","last_became_peered":"2024-04-16T16:16:42.545527+0000","last_unstale":"2024-04-16T16:16:43.536010+0000","last_undegraded":"2024-04-16T16:16:43.536010+0000","last_fullsized":"2024-04-16T16:16:43.536010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693597+0000","last_change":"2024-04-16T16:16:42.541313+0000","last_active":"2024-04-16T16:16:43.693597+0000","last_peered":"2024-04-16T16:16:43.693597+0000","last_clean":"2024-04-16T16:16:43.693597+0000","last_became_active":"2024-04-16T16:16:42.540978+0000","last_became_peered":"2024-04-16T16:16:42.540978+0000","last_unstale":"2024-04-16T16:16:43.693597+0000","last_undegraded":"2024-04-16T16:16:43.693597+0000","last_fullsized":"2024-04-16T16:16:43.693597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:35.789405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541482+0000","last_change":"2024-04-16T16:16:42.544651+0000","last_active":"2024-04-16T16:16:43.541482+0000","last_peered":"2024-04-16T16:16:43.541482+0000","last_clean":"2024-04-16T16:16:43.541482+0000","last_became_active":"2024-04-16T16:16:42.542011+0000","last_became_peered":"2024-04-16T16:16:42.542011+0000","last_unstale":"2024-04-16T16:16:43.541482+0000","last_undegraded":"2024-04-16T16:16:43.541482+0000","last_fullsized":"2024-04-16T16:16:43.541482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555229+0000","last_change":"2024-04-16T16:16:42.551072+0000","last_active":"2024-04-16T16:16:43.555229+0000","last_peered":"2024-04-16T16:16:43.555229+0000","last_clean":"2024-04-16T16:16:43.555229+0000","last_became_active":"2024-04-16T16:16:42.550775+0000","last_became_peered":"2024-04-16T16:16:42.550775+0000","last_unstale":"2024-04-16T16:16:43.555229+0000","last_undegraded":"2024-04-16T16:16:43.555229+0000","last_fullsized":"2024-04-16T16:16:43.555229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541943+0000","last_change":"2024-04-16T16:16:42.539682+0000","last_active":"2024-04-16T16:16:43.541943+0000","last_peered":"2024-04-16T16:16:43.541943+0000","last_clean":"2024-04-16T16:16:43.541943+0000","last_became_active":"2024-04-16T16:16:42.539350+0000","last_became_peered":"2024-04-16T16:16:42.539350+0000","last_unstale":"2024-04-16T16:16:43.541943+0000","last_undegraded":"2024-04-16T16:16:43.541943+0000","last_fullsized":"2024-04-16T16:16:43.541943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554743+0000","last_change":"2024-04-16T16:16:42.548040+0000","last_active":"2024-04-16T16:16:43.554743+0000","last_peered":"2024-04-16T16:16:43.554743+0000","last_clean":"2024-04-16T16:16:43.554743+0000","last_became_active":"2024-04-16T16:16:42.547751+0000","last_became_peered":"2024-04-16T16:16:42.547751+0000","last_unstale":"2024-04-16T16:16:43.554743+0000","last_undegraded":"2024-04-16T16:16:43.554743+0000","last_fullsized":"2024-04-16T16:16:43.554743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692888+0000","last_change":"2024-04-16T16:16:42.568826+0000","last_active":"2024-04-16T16:16:43.692888+0000","last_peered":"2024-04-16T16:16:43.692888+0000","last_clean":"2024-04-16T16:16:43.692888+0000","last_became_active":"2024-04-16T16:16:42.568499+0000","last_became_peered":"2024-04-16T16:16:42.568499+0000","last_unstale":"2024-04-16T16:16:43.692888+0000","last_undegraded":"2024-04-16T16:16:43.692888+0000","last_fullsized":"2024-04-16T16:16:43.692888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556655+0000","last_change":"2024-04-16T16:16:42.572131+0000","last_active":"2024-04-16T16:16:43.556655+0000","last_peered":"2024-04-16T16:16:43.556655+0000","last_clean":"2024-04-16T16:16:43.556655+0000","last_became_active":"2024-04-16T16:16:42.571817+0000","last_became_peered":"2024-04-16T16:16:42.571817+0000","last_unstale":"2024-04-16T16:16:43.556655+0000","last_undegraded":"2024-04-16T16:16:43.556655+0000","last_fullsized":"2024-04-16T16:16:43.556655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:54.665217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559687+0000","last_change":"2024-04-16T16:16:42.564515+0000","last_active":"2024-04-16T16:16:43.559687+0000","last_peered":"2024-04-16T16:16:43.559687+0000","last_clean":"2024-04-16T16:16:43.559687+0000","last_became_active":"2024-04-16T16:16:42.564233+0000","last_became_peered":"2024-04-16T16:16:42.564233+0000","last_unstale":"2024-04-16T16:16:43.559687+0000","last_undegraded":"2024-04-16T16:16:43.559687+0000","last_fullsized":"2024-04-16T16:16:43.559687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559928+0000","last_change":"2024-04-16T16:16:42.564502+0000","last_active":"2024-04-16T16:16:43.559928+0000","last_peered":"2024-04-16T16:16:43.559928+0000","last_clean":"2024-04-16T16:16:43.559928+0000","last_became_active":"2024-04-16T16:16:42.563916+0000","last_became_peered":"2024-04-16T16:16:42.563916+0000","last_unstale":"2024-04-16T16:16:43.559928+0000","last_undegraded":"2024-04-16T16:16:43.559928+0000","last_fullsized":"2024-04-16T16:16:43.559928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540676+0000","last_change":"2024-04-16T16:16:42.542716+0000","last_active":"2024-04-16T16:16:43.540676+0000","last_peered":"2024-04-16T16:16:43.540676+0000","last_clean":"2024-04-16T16:16:43.540676+0000","last_became_active":"2024-04-16T16:16:42.542395+0000","last_became_peered":"2024-04-16T16:16:42.542395+0000","last_unstale":"2024-04-16T16:16:43.540676+0000","last_undegraded":"2024-04-16T16:16:43.540676+0000","last_fullsized":"2024-04-16T16:16:43.540676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694675+0000","last_change":"2024-04-16T16:16:42.544561+0000","last_active":"2024-04-16T16:16:43.694675+0000","last_peered":"2024-04-16T16:16:43.694675+0000","last_clean":"2024-04-16T16:16:43.694675+0000","last_became_active":"2024-04-16T16:16:42.544242+0000","last_became_peered":"2024-04-16T16:16:42.544242+0000","last_unstale":"2024-04-16T16:16:43.694675+0000","last_undegraded":"2024-04-16T16:16:43.694675+0000","last_fullsized":"2024-04-16T16:16:43.694675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693350+0000","last_change":"2024-04-16T16:16:42.538809+0000","last_active":"2024-04-16T16:16:43.693350+0000","last_peered":"2024-04-16T16:16:43.693350+0000","last_clean":"2024-04-16T16:16:43.693350+0000","last_became_active":"2024-04-16T16:16:42.538530+0000","last_became_peered":"2024-04-16T16:16:42.538530+0000","last_unstale":"2024-04-16T16:16:43.693350+0000","last_undegraded":"2024-04-16T16:16:43.693350+0000","last_fullsized":"2024-04-16T16:16:43.693350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:14:47.747590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535308+0000","last_change":"2024-04-16T16:16:42.530478+0000","last_active":"2024-04-16T16:16:43.535308+0000","last_peered":"2024-04-16T16:16:43.535308+0000","last_clean":"2024-04-16T16:16:43.535308+0000","last_became_active":"2024-04-16T16:16:42.529997+0000","last_became_peered":"2024-04-16T16:16:42.529997+0000","last_unstale":"2024-04-16T16:16:43.535308+0000","last_undegraded":"2024-04-16T16:16:43.535308+0000","last_fullsized":"2024-04-16T16:16:43.535308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540875+0000","last_change":"2024-04-16T16:16:42.555498+0000","last_active":"2024-04-16T16:16:43.540875+0000","last_peered":"2024-04-16T16:16:43.540875+0000","last_clean":"2024-04-16T16:16:43.540875+0000","last_became_active":"2024-04-16T16:16:42.539784+0000","last_became_peered":"2024-04-16T16:16:42.539784+0000","last_unstale":"2024-04-16T16:16:43.540875+0000","last_undegraded":"2024-04-16T16:16:43.540875+0000","last_fullsized":"2024-04-16T16:16:43.540875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543881+0000","last_change":"2024-04-16T16:16:42.565804+0000","last_active":"2024-04-16T16:16:43.543881+0000","last_peered":"2024-04-16T16:16:43.543881+0000","last_clean":"2024-04-16T16:16:43.543881+0000","last_became_active":"2024-04-16T16:16:42.565289+0000","last_became_peered":"2024-04-16T16:16:42.565289+0000","last_unstale":"2024-04-16T16:16:43.543881+0000","last_undegraded":"2024-04-16T16:16:43.543881+0000","last_fullsized":"2024-04-16T16:16:43.543881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538777+0000","last_change":"2024-04-16T16:16:42.545811+0000","last_active":"2024-04-16T16:16:43.538777+0000","last_peered":"2024-04-16T16:16:43.538777+0000","last_clean":"2024-04-16T16:16:43.538777+0000","last_became_active":"2024-04-16T16:16:42.544185+0000","last_became_peered":"2024-04-16T16:16:42.544185+0000","last_unstale":"2024-04-16T16:16:43.538777+0000","last_undegraded":"2024-04-16T16:16:43.538777+0000","last_fullsized":"2024-04-16T16:16:43.538777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556076+0000","last_change":"2024-04-16T16:16:42.554043+0000","last_active":"2024-04-16T16:16:43.556076+0000","last_peered":"2024-04-16T16:16:43.556076+0000","last_clean":"2024-04-16T16:16:43.556076+0000","last_became_active":"2024-04-16T16:16:42.553829+0000","last_became_peered":"2024-04-16T16:16:42.553829+0000","last_unstale":"2024-04-16T16:16:43.556076+0000","last_undegraded":"2024-04-16T16:16:43.556076+0000","last_fullsized":"2024-04-16T16:16:43.556076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559370+0000","last_change":"2024-04-16T16:16:42.557240+0000","last_active":"2024-04-16T16:16:43.559370+0000","last_peered":"2024-04-16T16:16:43.559370+0000","last_clean":"2024-04-16T16:16:43.559370+0000","last_became_active":"2024-04-16T16:16:42.556898+0000","last_became_peered":"2024-04-16T16:16:42.556898+0000","last_unstale":"2024-04-16T16:16:43.559370+0000","last_undegraded":"2024-04-16T16:16:43.559370+0000","last_fullsized":"2024-04-16T16:16:43.559370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693761+0000","last_change":"2024-04-16T16:16:42.559394+0000","last_active":"2024-04-16T16:16:43.693761+0000","last_peered":"2024-04-16T16:16:43.693761+0000","last_clean":"2024-04-16T16:16:43.693761+0000","last_became_active":"2024-04-16T16:16:42.559074+0000","last_became_peered":"2024-04-16T16:16:42.559074+0000","last_unstale":"2024-04-16T16:16:43.693761+0000","last_undegraded":"2024-04-16T16:16:43.693761+0000","last_fullsized":"2024-04-16T16:16:43.693761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542086+0000","last_change":"2024-04-16T16:16:42.566856+0000","last_active":"2024-04-16T16:16:43.542086+0000","last_peered":"2024-04-16T16:16:43.542086+0000","last_clean":"2024-04-16T16:16:43.542086+0000","last_became_active":"2024-04-16T16:16:42.566592+0000","last_became_peered":"2024-04-16T16:16:42.566592+0000","last_unstale":"2024-04-16T16:16:43.542086+0000","last_undegraded":"2024-04-16T16:16:43.542086+0000","last_fullsized":"2024-04-16T16:16:43.542086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693037+0000","last_change":"2024-04-16T16:16:42.538807+0000","last_active":"2024-04-16T16:16:43.693037+0000","last_peered":"2024-04-16T16:16:43.693037+0000","last_clean":"2024-04-16T16:16:43.693037+0000","last_became_active":"2024-04-16T16:16:42.538490+0000","last_became_peered":"2024-04-16T16:16:42.538490+0000","last_unstale":"2024-04-16T16:16:43.693037+0000","last_undegraded":"2024-04-16T16:16:43.693037+0000","last_fullsized":"2024-04-16T16:16:43.693037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541234+0000","last_change":"2024-04-16T16:16:42.555745+0000","last_active":"2024-04-16T16:16:43.541234+0000","last_peered":"2024-04-16T16:16:43.541234+0000","last_clean":"2024-04-16T16:16:43.541234+0000","last_became_active":"2024-04-16T16:16:42.555171+0000","last_became_peered":"2024-04-16T16:16:42.555171+0000","last_unstale":"2024-04-16T16:16:43.541234+0000","last_undegraded":"2024-04-16T16:16:43.541234+0000","last_fullsized":"2024-04-16T16:16:43.541234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693298+0000","last_change":"2024-04-16T16:16:42.552853+0000","last_active":"2024-04-16T16:16:43.693298+0000","last_peered":"2024-04-16T16:16:43.693298+0000","last_clean":"2024-04-16T16:16:43.693298+0000","last_became_active":"2024-04-16T16:16:42.551283+0000","last_became_peered":"2024-04-16T16:16:42.551283+0000","last_unstale":"2024-04-16T16:16:43.693298+0000","last_undegraded":"2024-04-16T16:16:43.693298+0000","last_fullsized":"2024-04-16T16:16:43.693298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559962+0000","last_change":"2024-04-16T16:16:42.546726+0000","last_active":"2024-04-16T16:16:43.559962+0000","last_peered":"2024-04-16T16:16:43.559962+0000","last_clean":"2024-04-16T16:16:43.559962+0000","last_became_active":"2024-04-16T16:16:42.546286+0000","last_became_peered":"2024-04-16T16:16:42.546286+0000","last_unstale":"2024-04-16T16:16:43.559962+0000","last_undegraded":"2024-04-16T16:16:43.559962+0000","last_fullsized":"2024-04-16T16:16:43.559962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536193+0000","last_change":"2024-04-16T16:16:42.542402+0000","last_active":"2024-04-16T16:16:43.536193+0000","last_peered":"2024-04-16T16:16:43.536193+0000","last_clean":"2024-04-16T16:16:43.536193+0000","last_became_active":"2024-04-16T16:16:42.542076+0000","last_became_peered":"2024-04-16T16:16:42.542076+0000","last_unstale":"2024-04-16T16:16:43.536193+0000","last_undegraded":"2024-04-16T16:16:43.536193+0000","last_fullsized":"2024-04-16T16:16:43.536193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693594+0000","last_change":"2024-04-16T16:16:42.550290+0000","last_active":"2024-04-16T16:16:43.693594+0000","last_peered":"2024-04-16T16:16:43.693594+0000","last_clean":"2024-04-16T16:16:43.693594+0000","last_became_active":"2024-04-16T16:16:42.543751+0000","last_became_peered":"2024-04-16T16:16:42.543751+0000","last_unstale":"2024-04-16T16:16:43.693594+0000","last_undegraded":"2024-04-16T16:16:43.693594+0000","last_fullsized":"2024-04-16T16:16:43.693594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693908+0000","last_change":"2024-04-16T16:16:42.551870+0000","last_active":"2024-04-16T16:16:43.693908+0000","last_peered":"2024-04-16T16:16:43.693908+0000","last_clean":"2024-04-16T16:16:43.693908+0000","last_became_active":"2024-04-16T16:16:42.551579+0000","last_became_peered":"2024-04-16T16:16:42.551579+0000","last_unstale":"2024-04-16T16:16:43.693908+0000","last_undegraded":"2024-04-16T16:16:43.693908+0000","last_fullsized":"2024-04-16T16:16:43.693908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542423+0000","last_change":"2024-04-16T16:16:42.540659+0000","last_active":"2024-04-16T16:16:43.542423+0000","last_peered":"2024-04-16T16:16:43.542423+0000","last_clean":"2024-04-16T16:16:43.542423+0000","last_became_active":"2024-04-16T16:16:42.540216+0000","last_became_peered":"2024-04-16T16:16:42.540216+0000","last_unstale":"2024-04-16T16:16:43.542423+0000","last_undegraded":"2024-04-16T16:16:43.542423+0000","last_fullsized":"2024-04-16T16:16:43.542423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538640+0000","last_change":"2024-04-16T16:16:42.540673+0000","last_active":"2024-04-16T16:16:43.538640+0000","last_peered":"2024-04-16T16:16:43.538640+0000","last_clean":"2024-04-16T16:16:43.538640+0000","last_became_active":"2024-04-16T16:16:42.540278+0000","last_became_peered":"2024-04-16T16:16:42.540278+0000","last_unstale":"2024-04-16T16:16:43.538640+0000","last_undegraded":"2024-04-16T16:16:43.538640+0000","last_fullsized":"2024-04-16T16:16:43.538640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559097+0000","last_change":"2024-04-16T16:16:42.544057+0000","last_active":"2024-04-16T16:16:43.559097+0000","last_peered":"2024-04-16T16:16:43.559097+0000","last_clean":"2024-04-16T16:16:43.559097+0000","last_became_active":"2024-04-16T16:16:42.543472+0000","last_became_peered":"2024-04-16T16:16:42.543472+0000","last_unstale":"2024-04-16T16:16:43.559097+0000","last_undegraded":"2024-04-16T16:16:43.559097+0000","last_fullsized":"2024-04-16T16:16:43.559097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539617+0000","last_change":"2024-04-16T16:16:42.527013+0000","last_active":"2024-04-16T16:16:43.539617+0000","last_peered":"2024-04-16T16:16:43.539617+0000","last_clean":"2024-04-16T16:16:43.539617+0000","last_became_active":"2024-04-16T16:16:42.526649+0000","last_became_peered":"2024-04-16T16:16:42.526649+0000","last_unstale":"2024-04-16T16:16:43.539617+0000","last_undegraded":"2024-04-16T16:16:43.539617+0000","last_fullsized":"2024-04-16T16:16:43.539617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:45.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694817+0000","last_change":"2024-04-16T16:16:41.520565+0000","last_active":"2024-04-16T16:16:43.694817+0000","last_peered":"2024-04-16T16:16:43.694817+0000","last_clean":"2024-04-16T16:16:43.694817+0000","last_became_active":"2024-04-16T16:16:41.517406+0000","last_became_peered":"2024-04-16T16:16:41.517406+0000","last_unstale":"2024-04-16T16:16:43.694817+0000","last_undegraded":"2024-04-16T16:16:43.694817+0000","last_fullsized":"2024-04-16T16:16:43.694817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694052+0000","last_change":"2024-04-16T16:16:42.556599+0000","last_active":"2024-04-16T16:16:43.694052+0000","last_peered":"2024-04-16T16:16:43.694052+0000","last_clean":"2024-04-16T16:16:43.694052+0000","last_became_active":"2024-04-16T16:16:42.555600+0000","last_became_peered":"2024-04-16T16:16:42.555600+0000","last_unstale":"2024-04-16T16:16:43.694052+0000","last_undegraded":"2024-04-16T16:16:43.694052+0000","last_fullsized":"2024-04-16T16:16:43.694052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559476+0000","last_change":"2024-04-16T16:16:41.523017+0000","last_active":"2024-04-16T16:16:43.559476+0000","last_peered":"2024-04-16T16:16:43.559476+0000","last_clean":"2024-04-16T16:16:43.559476+0000","last_became_active":"2024-04-16T16:16:41.519934+0000","last_became_peered":"2024-04-16T16:16:41.519934+0000","last_unstale":"2024-04-16T16:16:43.559476+0000","last_undegraded":"2024-04-16T16:16:43.559476+0000","last_fullsized":"2024-04-16T16:16:43.559476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693115+0000","last_change":"2024-04-16T16:16:41.522651+0000","last_active":"2024-04-16T16:16:43.693115+0000","last_peered":"2024-04-16T16:16:43.693115+0000","last_clean":"2024-04-16T16:16:43.693115+0000","last_became_active":"2024-04-16T16:16:41.522339+0000","last_became_peered":"2024-04-16T16:16:41.522339+0000","last_unstale":"2024-04-16T16:16:43.693115+0000","last_undegraded":"2024-04-16T16:16:43.693115+0000","last_fullsized":"2024-04-16T16:16:43.693115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692933+0000","last_change":"2024-04-16T16:16:42.553919+0000","last_active":"2024-04-16T16:16:43.692933+0000","last_peered":"2024-04-16T16:16:43.692933+0000","last_clean":"2024-04-16T16:16:43.692933+0000","last_became_active":"2024-04-16T16:16:42.553556+0000","last_became_peered":"2024-04-16T16:16:42.553556+0000","last_unstale":"2024-04-16T16:16:43.692933+0000","last_undegraded":"2024-04-16T16:16:43.692933+0000","last_fullsized":"2024-04-16T16:16:43.692933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541425+0000","last_change":"2024-04-16T16:16:41.522408+0000","last_active":"2024-04-16T16:16:43.541425+0000","last_peered":"2024-04-16T16:16:43.541425+0000","last_clean":"2024-04-16T16:16:43.541425+0000","last_became_active":"2024-04-16T16:16:41.520458+0000","last_became_peered":"2024-04-16T16:16:41.520458+0000","last_unstale":"2024-04-16T16:16:43.541425+0000","last_undegraded":"2024-04-16T16:16:43.541425+0000","last_fullsized":"2024-04-16T16:16:43.541425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535473+0000","last_change":"2024-04-16T16:16:42.541508+0000","last_active":"2024-04-16T16:16:43.535473+0000","last_peered":"2024-04-16T16:16:43.535473+0000","last_clean":"2024-04-16T16:16:43.535473+0000","last_became_active":"2024-04-16T16:16:42.541115+0000","last_became_peered":"2024-04-16T16:16:42.541115+0000","last_unstale":"2024-04-16T16:16:43.535473+0000","last_undegraded":"2024-04-16T16:16:43.535473+0000","last_fullsized":"2024-04-16T16:16:43.535473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559608+0000","last_change":"2024-04-16T16:16:41.530254+0000","last_active":"2024-04-16T16:16:43.559608+0000","last_peered":"2024-04-16T16:16:43.559608+0000","last_clean":"2024-04-16T16:16:43.559608+0000","last_became_active":"2024-04-16T16:16:41.529897+0000","last_became_peered":"2024-04-16T16:16:41.529897+0000","last_unstale":"2024-04-16T16:16:43.559608+0000","last_undegraded":"2024-04-16T16:16:43.559608+0000","last_fullsized":"2024-04-16T16:16:43.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543317+0000","last_change":"2024-04-16T16:16:42.554549+0000","last_active":"2024-04-16T16:16:43.543317+0000","last_peered":"2024-04-16T16:16:43.543317+0000","last_clean":"2024-04-16T16:16:43.543317+0000","last_became_active":"2024-04-16T16:16:42.554246+0000","last_became_peered":"2024-04-16T16:16:42.554246+0000","last_unstale":"2024-04-16T16:16:43.543317+0000","last_undegraded":"2024-04-16T16:16:43.543317+0000","last_fullsized":"2024-04-16T16:16:43.543317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543183+0000","last_change":"2024-04-16T16:16:41.531843+0000","last_active":"2024-04-16T16:16:43.543183+0000","last_peered":"2024-04-16T16:16:43.543183+0000","last_clean":"2024-04-16T16:16:43.543183+0000","last_became_active":"2024-04-16T16:16:41.531238+0000","last_became_peered":"2024-04-16T16:16:41.531238+0000","last_unstale":"2024-04-16T16:16:43.543183+0000","last_undegraded":"2024-04-16T16:16:43.543183+0000","last_fullsized":"2024-04-16T16:16:43.543183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694381+0000","last_change":"2024-04-16T16:16:42.556349+0000","last_active":"2024-04-16T16:16:43.694381+0000","last_peered":"2024-04-16T16:16:43.694381+0000","last_clean":"2024-04-16T16:16:43.694381+0000","last_became_active":"2024-04-16T16:16:42.556013+0000","last_became_peered":"2024-04-16T16:16:42.556013+0000","last_unstale":"2024-04-16T16:16:43.694381+0000","last_undegraded":"2024-04-16T16:16:43.694381+0000","last_fullsized":"2024-04-16T16:16:43.694381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535872+0000","last_change":"2024-04-16T16:16:41.524793+0000","last_active":"2024-04-16T16:16:43.535872+0000","last_peered":"2024-04-16T16:16:43.535872+0000","last_clean":"2024-04-16T16:16:43.535872+0000","last_became_active":"2024-04-16T16:16:41.524086+0000","last_became_peered":"2024-04-16T16:16:41.524086+0000","last_unstale":"2024-04-16T16:16:43.535872+0000","last_undegraded":"2024-04-16T16:16:43.535872+0000","last_fullsized":"2024-04-16T16:16:43.535872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541069+0000","last_change":"2024-04-16T16:16:42.551097+0000","last_active":"2024-04-16T16:16:43.541069+0000","last_peered":"2024-04-16T16:16:43.541069+0000","last_clean":"2024-04-16T16:16:43.541069+0000","last_became_active":"2024-04-16T16:16:42.548624+0000","last_became_peered":"2024-04-16T16:16:42.548624+0000","last_unstale":"2024-04-16T16:16:43.541069+0000","last_undegraded":"2024-04-16T16:16:43.541069+0000","last_fullsized":"2024-04-16T16:16:43.541069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559402+0000","last_change":"2024-04-16T16:16:41.523855+0000","last_active":"2024-04-16T16:16:43.559402+0000","last_peered":"2024-04-16T16:16:43.559402+0000","last_clean":"2024-04-16T16:16:43.559402+0000","last_became_active":"2024-04-16T16:16:41.523499+0000","last_became_peered":"2024-04-16T16:16:41.523499+0000","last_unstale":"2024-04-16T16:16:43.559402+0000","last_undegraded":"2024-04-16T16:16:43.559402+0000","last_fullsized":"2024-04-16T16:16:43.559402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555794+0000","last_change":"2024-04-16T16:16:42.557535+0000","last_active":"2024-04-16T16:16:43.555794+0000","last_peered":"2024-04-16T16:16:43.555794+0000","last_clean":"2024-04-16T16:16:43.555794+0000","last_became_active":"2024-04-16T16:16:42.557352+0000","last_became_peered":"2024-04-16T16:16:42.557352+0000","last_unstale":"2024-04-16T16:16:43.555794+0000","last_undegraded":"2024-04-16T16:16:43.555794+0000","last_fullsized":"2024-04-16T16:16:43.555794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694160+0000","last_change":"2024-04-16T16:16:41.509775+0000","last_active":"2024-04-16T16:16:43.694160+0000","last_peered":"2024-04-16T16:16:43.694160+0000","last_clean":"2024-04-16T16:16:43.694160+0000","last_became_active":"2024-04-16T16:16:41.509405+0000","last_became_peered":"2024-04-16T16:16:41.509405+0000","last_unstale":"2024-04-16T16:16:43.694160+0000","last_undegraded":"2024-04-16T16:16:43.694160+0000","last_fullsized":"2024-04-16T16:16:43.694160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:41:24.584086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693565+0000","last_change":"2024-04-16T16:16:42.559637+0000","last_active":"2024-04-16T16:16:43.693565+0000","last_peered":"2024-04-16T16:16:43.693565+0000","last_clean":"2024-04-16T16:16:43.693565+0000","last_became_active":"2024-04-16T16:16:42.559112+0000","last_became_peered":"2024-04-16T16:16:42.559112+0000","last_unstale":"2024-04-16T16:16:43.693565+0000","last_undegraded":"2024-04-16T16:16:43.693565+0000","last_fullsized":"2024-04-16T16:16:43.693565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:58:54.293764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542320+0000","last_change":"2024-04-16T16:16:41.523971+0000","last_active":"2024-04-16T16:16:43.542320+0000","last_peered":"2024-04-16T16:16:43.542320+0000","last_clean":"2024-04-16T16:16:43.542320+0000","last_became_active":"2024-04-16T16:16:41.523700+0000","last_became_peered":"2024-04-16T16:16:41.523700+0000","last_unstale":"2024-04-16T16:16:43.542320+0000","last_undegraded":"2024-04-16T16:16:43.542320+0000","last_fullsized":"2024-04-16T16:16:43.542320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555684+0000","last_change":"2024-04-16T16:16:42.560857+0000","last_active":"2024-04-16T16:16:43.555684+0000","last_peered":"2024-04-16T16:16:43.555684+0000","last_clean":"2024-04-16T16:16:43.555684+0000","last_became_active":"2024-04-16T16:16:42.560540+0000","last_became_peered":"2024-04-16T16:16:42.560540+0000","last_unstale":"2024-04-16T16:16:43.555684+0000","last_undegraded":"2024-04-16T16:16:43.555684+0000","last_fullsized":"2024-04-16T16:16:43.555684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559052+0000","last_change":"2024-04-16T16:16:41.524165+0000","last_active":"2024-04-16T16:16:43.559052+0000","last_peered":"2024-04-16T16:16:43.559052+0000","last_clean":"2024-04-16T16:16:43.559052+0000","last_became_active":"2024-04-16T16:16:41.520052+0000","last_became_peered":"2024-04-16T16:16:41.520052+0000","last_unstale":"2024-04-16T16:16:43.559052+0000","last_undegraded":"2024-04-16T16:16:43.559052+0000","last_fullsized":"2024-04-16T16:16:43.559052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559159+0000","last_change":"2024-04-16T16:16:42.543827+0000","last_active":"2024-04-16T16:16:43.559159+0000","last_peered":"2024-04-16T16:16:43.559159+0000","last_clean":"2024-04-16T16:16:43.559159+0000","last_became_active":"2024-04-16T16:16:42.543057+0000","last_became_peered":"2024-04-16T16:16:42.543057+0000","last_unstale":"2024-04-16T16:16:43.559159+0000","last_undegraded":"2024-04-16T16:16:43.559159+0000","last_fullsized":"2024-04-16T16:16:43.559159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538345+0000","last_change":"2024-04-16T16:16:41.515275+0000","last_active":"2024-04-16T16:16:43.538345+0000","last_peered":"2024-04-16T16:16:43.538345+0000","last_clean":"2024-04-16T16:16:43.538345+0000","last_became_active":"2024-04-16T16:16:41.511512+0000","last_became_peered":"2024-04-16T16:16:41.511512+0000","last_unstale":"2024-04-16T16:16:43.538345+0000","last_undegraded":"2024-04-16T16:16:43.538345+0000","last_fullsized":"2024-04-16T16:16:43.538345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554847+0000","last_change":"2024-04-16T16:16:42.553481+0000","last_active":"2024-04-16T16:16:43.554847+0000","last_peered":"2024-04-16T16:16:43.554847+0000","last_clean":"2024-04-16T16:16:43.554847+0000","last_became_active":"2024-04-16T16:16:42.553097+0000","last_became_peered":"2024-04-16T16:16:42.553097+0000","last_unstale":"2024-04-16T16:16:43.554847+0000","last_undegraded":"2024-04-16T16:16:43.554847+0000","last_fullsized":"2024-04-16T16:16:43.554847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541627+0000","last_change":"2024-04-16T16:16:41.498748+0000","last_active":"2024-04-16T16:16:43.541627+0000","last_peered":"2024-04-16T16:16:43.541627+0000","last_clean":"2024-04-16T16:16:43.541627+0000","last_became_active":"2024-04-16T16:16:41.497561+0000","last_became_peered":"2024-04-16T16:16:41.497561+0000","last_unstale":"2024-04-16T16:16:43.541627+0000","last_undegraded":"2024-04-16T16:16:43.541627+0000","last_fullsized":"2024-04-16T16:16:43.541627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:50.555761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556264+0000","last_change":"2024-04-16T16:16:42.556235+0000","last_active":"2024-04-16T16:16:43.556264+0000","last_peered":"2024-04-16T16:16:43.556264+0000","last_clean":"2024-04-16T16:16:43.556264+0000","last_became_active":"2024-04-16T16:16:42.555772+0000","last_became_peered":"2024-04-16T16:16:42.555772+0000","last_unstale":"2024-04-16T16:16:43.556264+0000","last_undegraded":"2024-04-16T16:16:43.556264+0000","last_fullsized":"2024-04-16T16:16:43.556264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538851+0000","last_change":"2024-04-16T16:16:41.513088+0000","last_active":"2024-04-16T16:16:43.538851+0000","last_peered":"2024-04-16T16:16:43.538851+0000","last_clean":"2024-04-16T16:16:43.538851+0000","last_became_active":"2024-04-16T16:16:41.512316+0000","last_became_peered":"2024-04-16T16:16:41.512316+0000","last_unstale":"2024-04-16T16:16:43.538851+0000","last_undegraded":"2024-04-16T16:16:43.538851+0000","last_fullsized":"2024-04-16T16:16:43.538851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556658+0000","last_change":"2024-04-16T16:16:42.557154+0000","last_active":"2024-04-16T16:16:43.556658+0000","last_peered":"2024-04-16T16:16:43.556658+0000","last_clean":"2024-04-16T16:16:43.556658+0000","last_became_active":"2024-04-16T16:16:42.556853+0000","last_became_peered":"2024-04-16T16:16:42.556853+0000","last_unstale":"2024-04-16T16:16:43.556658+0000","last_undegraded":"2024-04-16T16:16:43.556658+0000","last_fullsized":"2024-04-16T16:16:43.556658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:12:32.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536004+0000","last_change":"2024-04-16T16:16:41.520997+0000","last_active":"2024-04-16T16:16:43.536004+0000","last_peered":"2024-04-16T16:16:43.536004+0000","last_clean":"2024-04-16T16:16:43.536004+0000","last_became_active":"2024-04-16T16:16:41.520502+0000","last_became_peered":"2024-04-16T16:16:41.520502+0000","last_unstale":"2024-04-16T16:16:43.536004+0000","last_undegraded":"2024-04-16T16:16:43.536004+0000","last_fullsized":"2024-04-16T16:16:43.536004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542374+0000","last_change":"2024-04-16T16:16:42.551483+0000","last_active":"2024-04-16T16:16:43.542374+0000","last_peered":"2024-04-16T16:16:43.542374+0000","last_clean":"2024-04-16T16:16:43.542374+0000","last_became_active":"2024-04-16T16:16:42.540166+0000","last_became_peered":"2024-04-16T16:16:42.540166+0000","last_unstale":"2024-04-16T16:16:43.542374+0000","last_undegraded":"2024-04-16T16:16:43.542374+0000","last_fullsized":"2024-04-16T16:16:43.542374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538450+0000","last_change":"2024-04-16T16:16:41.523070+0000","last_active":"2024-04-16T16:16:43.538450+0000","last_peered":"2024-04-16T16:16:43.538450+0000","last_clean":"2024-04-16T16:16:43.538450+0000","last_became_active":"2024-04-16T16:16:41.522786+0000","last_became_peered":"2024-04-16T16:16:41.522786+0000","last_unstale":"2024-04-16T16:16:43.538450+0000","last_undegraded":"2024-04-16T16:16:43.538450+0000","last_fullsized":"2024-04-16T16:16:43.538450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:09.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555935+0000","last_change":"2024-04-16T16:16:42.571326+0000","last_active":"2024-04-16T16:16:43.555935+0000","last_peered":"2024-04-16T16:16:43.555935+0000","last_clean":"2024-04-16T16:16:43.555935+0000","last_became_active":"2024-04-16T16:16:42.570406+0000","last_became_peered":"2024-04-16T16:16:42.570406+0000","last_unstale":"2024-04-16T16:16:43.555935+0000","last_undegraded":"2024-04-16T16:16:43.555935+0000","last_fullsized":"2024-04-16T16:16:43.555935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554754+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:16:43.554754+0000","last_peered":"2024-04-16T16:16:43.554754+0000","last_clean":"2024-04-16T16:16:43.554754+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:16:43.554754+0000","last_undegraded":"2024-04-16T16:16:43.554754+0000","last_fullsized":"2024-04-16T16:16:43.554754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541770+0000","last_change":"2024-04-16T16:16:41.518448+0000","last_active":"2024-04-16T16:16:43.541770+0000","last_peered":"2024-04-16T16:16:43.541770+0000","last_clean":"2024-04-16T16:16:43.541770+0000","last_became_active":"2024-04-16T16:16:41.517938+0000","last_became_peered":"2024-04-16T16:16:41.517938+0000","last_unstale":"2024-04-16T16:16:43.541770+0000","last_undegraded":"2024-04-16T16:16:43.541770+0000","last_fullsized":"2024-04-16T16:16:43.541770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693472+0000","last_change":"2024-04-16T16:16:42.537690+0000","last_active":"2024-04-16T16:16:43.693472+0000","last_peered":"2024-04-16T16:16:43.693472+0000","last_clean":"2024-04-16T16:16:43.693472+0000","last_became_active":"2024-04-16T16:16:42.537268+0000","last_became_peered":"2024-04-16T16:16:42.537268+0000","last_unstale":"2024-04-16T16:16:43.693472+0000","last_undegraded":"2024-04-16T16:16:43.693472+0000","last_fullsized":"2024-04-16T16:16:43.693472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554773+0000","last_change":"2024-04-16T16:16:41.522499+0000","last_active":"2024-04-16T16:16:43.554773+0000","last_peered":"2024-04-16T16:16:43.554773+0000","last_clean":"2024-04-16T16:16:43.554773+0000","last_became_active":"2024-04-16T16:16:41.522124+0000","last_became_peered":"2024-04-16T16:16:41.522124+0000","last_unstale":"2024-04-16T16:16:43.554773+0000","last_undegraded":"2024-04-16T16:16:43.554773+0000","last_fullsized":"2024-04-16T16:16:43.554773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693674+0000","last_change":"2024-04-16T16:16:42.554808+0000","last_active":"2024-04-16T16:16:43.693674+0000","last_peered":"2024-04-16T16:16:43.693674+0000","last_clean":"2024-04-16T16:16:43.693674+0000","last_became_active":"2024-04-16T16:16:42.552890+0000","last_became_peered":"2024-04-16T16:16:42.552890+0000","last_unstale":"2024-04-16T16:16:43.693674+0000","last_undegraded":"2024-04-16T16:16:43.693674+0000","last_fullsized":"2024-04-16T16:16:43.693674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:40.482814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538337+0000","last_change":"2024-04-16T16:16:41.517103+0000","last_active":"2024-04-16T16:16:43.538337+0000","last_peered":"2024-04-16T16:16:43.538337+0000","last_clean":"2024-04-16T16:16:43.538337+0000","last_became_active":"2024-04-16T16:16:41.516829+0000","last_became_peered":"2024-04-16T16:16:41.516829+0000","last_unstale":"2024-04-16T16:16:43.538337+0000","last_undegraded":"2024-04-16T16:16:43.538337+0000","last_fullsized":"2024-04-16T16:16:43.538337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535231+0000","last_change":"2024-04-16T16:16:42.541238+0000","last_active":"2024-04-16T16:16:43.535231+0000","last_peered":"2024-04-16T16:16:43.535231+0000","last_clean":"2024-04-16T16:16:43.535231+0000","last_became_active":"2024-04-16T16:16:42.540924+0000","last_became_peered":"2024-04-16T16:16:42.540924+0000","last_unstale":"2024-04-16T16:16:43.535231+0000","last_undegraded":"2024-04-16T16:16:43.535231+0000","last_fullsized":"2024-04-16T16:16:43.535231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542556+0000","last_change":"2024-04-16T16:16:41.519683+0000","last_active":"2024-04-16T16:16:43.542556+0000","last_peered":"2024-04-16T16:16:43.542556+0000","last_clean":"2024-04-16T16:16:43.542556+0000","last_became_active":"2024-04-16T16:16:41.519343+0000","last_became_peered":"2024-04-16T16:16:41.519343+0000","last_unstale":"2024-04-16T16:16:43.542556+0000","last_undegraded":"2024-04-16T16:16:43.542556+0000","last_fullsized":"2024-04-16T16:16:43.542556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540500+0000","last_change":"2024-04-16T16:16:42.542028+0000","last_active":"2024-04-16T16:16:43.540500+0000","last_peered":"2024-04-16T16:16:43.540500+0000","last_clean":"2024-04-16T16:16:43.540500+0000","last_became_active":"2024-04-16T16:16:42.538888+0000","last_became_peered":"2024-04-16T16:16:42.538888+0000","last_unstale":"2024-04-16T16:16:43.540500+0000","last_undegraded":"2024-04-16T16:16:43.540500+0000","last_fullsized":"2024-04-16T16:16:43.540500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:43.311234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.509361+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.509045+0000","last_became_peered":"2024-04-16T16:16:41.509045+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543027+0000","last_change":"2024-04-16T16:16:42.558916+0000","last_active":"2024-04-16T16:16:43.543027+0000","last_peered":"2024-04-16T16:16:43.543027+0000","last_clean":"2024-04-16T16:16:43.543027+0000","last_became_active":"2024-04-16T16:16:42.545348+0000","last_became_peered":"2024-04-16T16:16:42.545348+0000","last_unstale":"2024-04-16T16:16:43.543027+0000","last_undegraded":"2024-04-16T16:16:43.543027+0000","last_fullsized":"2024-04-16T16:16:43.543027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556231+0000","last_change":"2024-04-16T16:16:41.522662+0000","last_active":"2024-04-16T16:16:43.556231+0000","last_peered":"2024-04-16T16:16:43.556231+0000","last_clean":"2024-04-16T16:16:43.556231+0000","last_became_active":"2024-04-16T16:16:41.522355+0000","last_became_peered":"2024-04-16T16:16:41.522355+0000","last_unstale":"2024-04-16T16:16:43.556231+0000","last_undegraded":"2024-04-16T16:16:43.556231+0000","last_fullsized":"2024-04-16T16:16:43.556231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535843+0000","last_change":"2024-04-16T16:16:42.541278+0000","last_active":"2024-04-16T16:16:43.535843+0000","last_peered":"2024-04-16T16:16:43.535843+0000","last_clean":"2024-04-16T16:16:43.535843+0000","last_became_active":"2024-04-16T16:16:42.540838+0000","last_became_peered":"2024-04-16T16:16:42.540838+0000","last_unstale":"2024-04-16T16:16:43.535843+0000","last_undegraded":"2024-04-16T16:16:43.535843+0000","last_fullsized":"2024-04-16T16:16:43.535843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.558097+0000","last_change":"2024-04-16T16:16:41.527012+0000","last_active":"2024-04-16T16:16:43.558097+0000","last_peered":"2024-04-16T16:16:43.558097+0000","last_clean":"2024-04-16T16:16:43.558097+0000","last_became_active":"2024-04-16T16:16:41.526665+0000","last_became_peered":"2024-04-16T16:16:41.526665+0000","last_unstale":"2024-04-16T16:16:43.558097+0000","last_undegraded":"2024-04-16T16:16:43.558097+0000","last_fullsized":"2024-04-16T16:16:43.558097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693473+0000","last_change":"2024-04-16T16:16:42.549680+0000","last_active":"2024-04-16T16:16:43.693473+0000","last_peered":"2024-04-16T16:16:43.693473+0000","last_clean":"2024-04-16T16:16:43.693473+0000","last_became_active":"2024-04-16T16:16:42.547089+0000","last_became_peered":"2024-04-16T16:16:42.547089+0000","last_unstale":"2024-04-16T16:16:43.693473+0000","last_undegraded":"2024-04-16T16:16:43.693473+0000","last_fullsized":"2024-04-16T16:16:43.693473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559737+0000","last_change":"2024-04-16T16:16:41.528043+0000","last_active":"2024-04-16T16:16:43.559737+0000","last_peered":"2024-04-16T16:16:43.559737+0000","last_clean":"2024-04-16T16:16:43.559737+0000","last_became_active":"2024-04-16T16:16:41.527767+0000","last_became_peered":"2024-04-16T16:16:41.527767+0000","last_unstale":"2024-04-16T16:16:43.559737+0000","last_undegraded":"2024-04-16T16:16:43.559737+0000","last_fullsized":"2024-04-16T16:16:43.559737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694076+0000","last_change":"2024-04-16T16:16:42.540712+0000","last_active":"2024-04-16T16:16:43.694076+0000","last_peered":"2024-04-16T16:16:43.694076+0000","last_clean":"2024-04-16T16:16:43.694076+0000","last_became_active":"2024-04-16T16:16:42.538863+0000","last_became_peered":"2024-04-16T16:16:42.538863+0000","last_unstale":"2024-04-16T16:16:43.694076+0000","last_undegraded":"2024-04-16T16:16:43.694076+0000","last_fullsized":"2024-04-16T16:16:43.694076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554585+0000","last_change":"2024-04-16T16:16:41.518575+0000","last_active":"2024-04-16T16:16:43.554585+0000","last_peered":"2024-04-16T16:16:43.554585+0000","last_clean":"2024-04-16T16:16:43.554585+0000","last_became_active":"2024-04-16T16:16:41.517913+0000","last_became_peered":"2024-04-16T16:16:41.517913+0000","last_unstale":"2024-04-16T16:16:43.554585+0000","last_undegraded":"2024-04-16T16:16:43.554585+0000","last_fullsized":"2024-04-16T16:16:43.554585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539618+0000","last_change":"2024-04-16T16:16:42.539495+0000","last_active":"2024-04-16T16:16:43.539618+0000","last_peered":"2024-04-16T16:16:43.539618+0000","last_clean":"2024-04-16T16:16:43.539618+0000","last_became_active":"2024-04-16T16:16:42.539119+0000","last_became_peered":"2024-04-16T16:16:42.539119+0000","last_unstale":"2024-04-16T16:16:43.539618+0000","last_undegraded":"2024-04-16T16:16:43.539618+0000","last_fullsized":"2024-04-16T16:16:43.539618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:30.369821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535447+0000","last_change":"2024-04-16T16:16:41.524546+0000","last_active":"2024-04-16T16:16:43.535447+0000","last_peered":"2024-04-16T16:16:43.535447+0000","last_clean":"2024-04-16T16:16:43.535447+0000","last_became_active":"2024-04-16T16:16:41.521734+0000","last_became_peered":"2024-04-16T16:16:41.521734+0000","last_unstale":"2024-04-16T16:16:43.535447+0000","last_undegraded":"2024-04-16T16:16:43.535447+0000","last_fullsized":"2024-04-16T16:16:43.535447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693061+0000","last_change":"2024-04-16T16:16:42.549899+0000","last_active":"2024-04-16T16:16:43.693061+0000","last_peered":"2024-04-16T16:16:43.693061+0000","last_clean":"2024-04-16T16:16:43.693061+0000","last_became_active":"2024-04-16T16:16:42.545606+0000","last_became_peered":"2024-04-16T16:16:42.545606+0000","last_unstale":"2024-04-16T16:16:43.693061+0000","last_undegraded":"2024-04-16T16:16:43.693061+0000","last_fullsized":"2024-04-16T16:16:43.693061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.515086+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.514804+0000","last_became_peered":"2024-04-16T16:16:41.514804+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694754+0000","last_change":"2024-04-16T16:16:42.539283+0000","last_active":"2024-04-16T16:16:43.694754+0000","last_peered":"2024-04-16T16:16:43.694754+0000","last_clean":"2024-04-16T16:16:43.694754+0000","last_became_active":"2024-04-16T16:16:42.538992+0000","last_became_peered":"2024-04-16T16:16:42.538992+0000","last_unstale":"2024-04-16T16:16:43.694754+0000","last_undegraded":"2024-04-16T16:16:43.694754+0000","last_fullsized":"2024-04-16T16:16:43.694754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555783+0000","last_change":"2024-04-16T16:16:41.528069+0000","last_active":"2024-04-16T16:16:43.555783+0000","last_peered":"2024-04-16T16:16:43.555783+0000","last_clean":"2024-04-16T16:16:43.555783+0000","last_became_active":"2024-04-16T16:16:41.527661+0000","last_became_peered":"2024-04-16T16:16:41.527661+0000","last_unstale":"2024-04-16T16:16:43.555783+0000","last_undegraded":"2024-04-16T16:16:43.555783+0000","last_fullsized":"2024-04-16T16:16:43.555783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559239+0000","last_change":"2024-04-16T16:16:42.555670+0000","last_active":"2024-04-16T16:16:43.559239+0000","last_peered":"2024-04-16T16:16:43.559239+0000","last_clean":"2024-04-16T16:16:43.559239+0000","last_became_active":"2024-04-16T16:16:42.555257+0000","last_became_peered":"2024-04-16T16:16:42.555257+0000","last_unstale":"2024-04-16T16:16:43.559239+0000","last_undegraded":"2024-04-16T16:16:43.559239+0000","last_fullsized":"2024-04-16T16:16:43.559239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542682+0000","last_change":"2024-04-16T16:16:42.528582+0000","last_active":"2024-04-16T16:16:43.542682+0000","last_peered":"2024-04-16T16:16:43.542682+0000","last_clean":"2024-04-16T16:16:43.542682+0000","last_became_active":"2024-04-16T16:16:42.528086+0000","last_became_peered":"2024-04-16T16:16:42.528086+0000","last_unstale":"2024-04-16T16:16:43.542682+0000","last_undegraded":"2024-04-16T16:16:43.542682+0000","last_fullsized":"2024-04-16T16:16:43.542682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555817+0000","last_change":"2024-04-16T16:16:41.525844+0000","last_active":"2024-04-16T16:16:43.555817+0000","last_peered":"2024-04-16T16:16:43.555817+0000","last_clean":"2024-04-16T16:16:43.555817+0000","last_became_active":"2024-04-16T16:16:41.524506+0000","last_became_peered":"2024-04-16T16:16:41.524506+0000","last_unstale":"2024-04-16T16:16:43.555817+0000","last_undegraded":"2024-04-16T16:16:43.555817+0000","last_fullsized":"2024-04-16T16:16:43.555817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541916+0000","last_change":"2024-04-16T16:16:42.529397+0000","last_active":"2024-04-16T16:16:43.541916+0000","last_peered":"2024-04-16T16:16:43.541916+0000","last_clean":"2024-04-16T16:16:43.541916+0000","last_became_active":"2024-04-16T16:16:42.528776+0000","last_became_peered":"2024-04-16T16:16:42.528776+0000","last_unstale":"2024-04-16T16:16:43.541916+0000","last_undegraded":"2024-04-16T16:16:43.541916+0000","last_fullsized":"2024-04-16T16:16:43.541916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556158+0000","last_change":"2024-04-16T16:16:41.531832+0000","last_active":"2024-04-16T16:16:43.556158+0000","last_peered":"2024-04-16T16:16:43.556158+0000","last_clean":"2024-04-16T16:16:43.556158+0000","last_became_active":"2024-04-16T16:16:41.531327+0000","last_became_peered":"2024-04-16T16:16:41.531327+0000","last_unstale":"2024-04-16T16:16:43.556158+0000","last_undegraded":"2024-04-16T16:16:43.556158+0000","last_fullsized":"2024-04-16T16:16:43.556158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694244+0000","last_change":"2024-04-16T16:16:42.570229+0000","last_active":"2024-04-16T16:16:43.694244+0000","last_peered":"2024-04-16T16:16:43.694244+0000","last_clean":"2024-04-16T16:16:43.694244+0000","last_became_active":"2024-04-16T16:16:42.569878+0000","last_became_peered":"2024-04-16T16:16:42.569878+0000","last_unstale":"2024-04-16T16:16:43.694244+0000","last_undegraded":"2024-04-16T16:16:43.694244+0000","last_fullsized":"2024-04-16T16:16:43.694244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695178+0000","last_change":"2024-04-16T16:16:41.514706+0000","last_active":"2024-04-16T16:16:43.695178+0000","last_peered":"2024-04-16T16:16:43.695178+0000","last_clean":"2024-04-16T16:16:43.695178+0000","last_became_active":"2024-04-16T16:16:41.514337+0000","last_became_peered":"2024-04-16T16:16:41.514337+0000","last_unstale":"2024-04-16T16:16:43.695178+0000","last_undegraded":"2024-04-16T16:16:43.695178+0000","last_fullsized":"2024-04-16T16:16:43.695178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695077+0000","last_change":"2024-04-16T16:16:42.544576+0000","last_active":"2024-04-16T16:16:43.695077+0000","last_peered":"2024-04-16T16:16:43.695077+0000","last_clean":"2024-04-16T16:16:43.695077+0000","last_became_active":"2024-04-16T16:16:42.544221+0000","last_became_peered":"2024-04-16T16:16:42.544221+0000","last_unstale":"2024-04-16T16:16:43.695077+0000","last_undegraded":"2024-04-16T16:16:43.695077+0000","last_fullsized":"2024-04-16T16:16:43.695077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694565+0000","last_change":"2024-04-16T16:16:41.519681+0000","last_active":"2024-04-16T16:16:43.694565+0000","last_peered":"2024-04-16T16:16:43.694565+0000","last_clean":"2024-04-16T16:16:43.694565+0000","last_became_active":"2024-04-16T16:16:41.519259+0000","last_became_peered":"2024-04-16T16:16:41.519259+0000","last_unstale":"2024-04-16T16:16:43.694565+0000","last_undegraded":"2024-04-16T16:16:43.694565+0000","last_fullsized":"2024-04-16T16:16:43.694565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:22.558679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:16:47.579 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T16:16:47.579 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-16T16:16:47.579 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-16T16:16:47.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-16T16:16:47.579 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T16:16:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.850+0000 7f789aa00640 1 Processor -- start 2024-04-16T16:16:47.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.850+0000 7f789aa00640 1 -- start start 2024-04-16T16:16:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.851+0000 7f789aa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f789415cc70 0x7f78940d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.851+0000 7f789aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 0x7f78940d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.851+0000 7f789aa00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78940ce360 con 0x7f78940d13f0 2024-04-16T16:16:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.851+0000 7f789aa00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f789406f400 con 0x7f789415cc70 2024-04-16T16:16:47.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.851+0000 7f789aa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f789406f9c0 con 0x7f789415d050 2024-04-16T16:16:47.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.852+0000 7f7898a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f78940d13f0 0x7f78940cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43664/0 (socket says 172.21.15.22:43664) 2024-04-16T16:16:47.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.852+0000 7f7898a00640 1 -- 172.21.15.22:0/2358776353 learned_addr learned my addr 172.21.15.22:0/2358776353 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.852+0000 7f7893e00640 1 --2- 172.21.15.22:0/2358776353 >> v2:172.21.15.43:3300/0 conn(0x7f789415cc70 0x7f78940d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.852+0000 7f7893400640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 0x7f78940d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.852+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802495339 0 0) 0x7f78940ce360 con 0x7f78940d13f0 2024-04-16T16:16:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.852+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7878003520 con 0x7f78940d13f0 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1428575832 0 0) 0x7f7878003520 con 0x7f78940d13f0 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 msgr2=0x7f78940d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 0x7f78940d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 >> v2:172.21.15.43:3300/0 conn(0x7f789415cc70 msgr2=0x7f78940d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 --2- 172.21.15.22:0/2358776353 >> v2:172.21.15.43:3300/0 conn(0x7f789415cc70 0x7f78940d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78940ce640 con 0x7f78940d13f0 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f788c001670 con 0x7f78940d13f0 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 >> v1:172.21.15.22:6789/0 conn(0x7f78940d13f0 legacy=0x7f78940cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78780039b0 0x7f7878003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 0x7f7878004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7878004d40 0x7f78780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f789406f400 con 0x7f7878004d40 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f789406f9c0 con 0x7f78780039b0 2024-04-16T16:16:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f787800b9f0 con 0x7f789415d050 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7898a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7878004d40 0x7f78780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7893e00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78780039b0 0x7f7878003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.853+0000 7f7893400640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 0x7f7878004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.854+0000 7f7898a00640 1 -- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 msgr2=0x7f7878004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.854+0000 7f7898a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f789415d050 0x7f7878004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.854+0000 7f7898a00640 1 -- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78780039b0 msgr2=0x7f7878003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.854+0000 7f7898a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78780039b0 0x7f7878003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.854+0000 7f7898a00640 1 -- 172.21.15.22:0/2358776353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7878003520 con 0x7f7878004d40 2024-04-16T16:16:47.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.855+0000 7f7898a00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7878004d40 0x7f78780051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c190 tx=0x7f7878005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad588031653121cf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:47.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.855+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c007c80 con 0x7f7878004d40 2024-04-16T16:16:47.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.855+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c030070 con 0x7f7878004d40 2024-04-16T16:16:47.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.855+0000 7f7892a00640 1 -- 172.21.15.22:0/2358776353 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c005d30 con 0x7f7878004d40 2024-04-16T16:16:47.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.856+0000 7f789aa00640 1 -- 172.21.15.22:0/2358776353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7878004d40 msgr2=0x7f78780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.856+0000 7f789aa00640 1 --2- 172.21.15.22:0/2358776353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7878004d40 0x7f78780051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c190 tx=0x7f7878005830 comp rx=0 tx=0).stop 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.856+0000 7f7898a00640 1 -- 172.21.15.22:0/2358776353 reap_dead start 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.856+0000 7f789aa00640 1 -- 172.21.15.22:0/2358776353 shutdown_connections 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.856+0000 7f789aa00640 1 -- 172.21.15.22:0/2358776353 >> 172.21.15.22:0/2358776353 conn(0x7f78940d28d0 msgr2=0x7f78940d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.856+0000 7f789aa00640 1 -- 172.21.15.22:0/2358776353 shutdown_connections 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.856+0000 7f789aa00640 1 -- 172.21.15.22:0/2358776353 wait complete. 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.858+0000 7f789aa00640 1 Processor -- start 2024-04-16T16:16:47.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.858+0000 7f789aa00640 1 -- start start 2024-04-16T16:16:47.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f789aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7878004d40 0x7f78940b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f789aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78941f4e60 0x7f78941f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f789aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f789415f0d0 0x7f78940cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f789aa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78940d0890 con 0x7f789415f0d0 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f789aa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f78940d1820 con 0x7f78941f4e60 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f789aa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f78940d0a10 con 0x7f7878004d40 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f7898a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f789415f0d0 0x7f78940cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f7898a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f789415f0d0 0x7f78940cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58960/0 (socket says 172.21.15.22:58960) 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f7898a00640 1 -- 172.21.15.22:0/1467546926 learned_addr learned my addr 172.21.15.22:0/1467546926 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f7893400640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78941f4e60 0x7f78941f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.859+0000 7f7893e00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7878004d40 0x7f78940b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f7898a00640 1 -- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7878004d40 msgr2=0x7f78940b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f7898a00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7878004d40 0x7f78940b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f7898a00640 1 -- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78941f4e60 msgr2=0x7f78941f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f7898a00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78941f4e60 0x7f78941f3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f7898a00640 1 -- 172.21.15.22:0/1467546926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78940b66c0 con 0x7f789415f0d0 2024-04-16T16:16:47.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f7898a00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f789415f0d0 0x7f78940cb960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c2b0 tx=0x7f788c0019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:47.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f788be00640 1 -- 172.21.15.22:0/1467546926 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c001bc0 con 0x7f789415f0d0 2024-04-16T16:16:47.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f788be00640 1 -- 172.21.15.22:0/1467546926 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c0049e0 con 0x7f789415f0d0 2024-04-16T16:16:47.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78940b6980 con 0x7f789415f0d0 2024-04-16T16:16:47.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f788be00640 1 -- 172.21.15.22:0/1467546926 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c004d90 con 0x7f789415f0d0 2024-04-16T16:16:47.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.860+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f789415f550 con 0x7f789415f0d0 2024-04-16T16:16:47.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.861+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f789404fd90 con 0x7f789415f0d0 2024-04-16T16:16:47.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.863+0000 7f788be00640 1 -- 172.21.15.22:0/1467546926 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f788c007070 con 0x7f789415f0d0 2024-04-16T16:16:47.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.863+0000 7f788be00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f787006c8f0 0x7f787006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:47.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.864+0000 7f788be00640 1 -- 172.21.15.22:0/1467546926 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f788c0ad1a0 con 0x7f789415f0d0 2024-04-16T16:16:47.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.864+0000 7f7893e00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f787006c8f0 0x7f787006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:47.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.864+0000 7f7893e00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f787006c8f0 0x7f787006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7884009fd0 tx=0x7f788400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:47.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:47.869+0000 7f788be00640 1 -- 172.21.15.22:0/1467546926 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f788c047060 con 0x7f789415f0d0 2024-04-16T16:16:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.127+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f789406e380 con 0x7f789415f0d0 2024-04-16T16:16:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.137+0000 7f788be00640 1 -- 172.21.15.22:0/1467546926 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174137 (secure 0 0 0) 0x7f788c07b010 con 0x7f789415f0d0 2024-04-16T16:16:48.139 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f787006c8f0 msgr2=0x7f787006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f787006c8f0 0x7f787006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7884009fd0 tx=0x7f788400b040 comp rx=0 tx=0).stop 2024-04-16T16:16:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f789415f0d0 msgr2=0x7f78940cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f789415f0d0 0x7f78940cb960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c2b0 tx=0x7f788c0019e0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 shutdown_connections 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f787006c8f0 0x7f787006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f789415f0d0 0x7f78940cb960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78941f4e60 0x7f78941f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 --2- 172.21.15.22:0/1467546926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7878004d40 0x7f78940b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.141+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 >> 172.21.15.22:0/1467546926 conn(0x7f78940d28d0 msgr2=0x7f7894070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.142+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 shutdown_connections 2024-04-16T16:16:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.142+0000 7f789aa00640 1 -- 172.21.15.22:0/1467546926 wait complete. 2024-04-16T16:16:48.162 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1860401634},{"type":"v1","addr":"172.21.15.22:6833","nonce":1860401634}]},"active_addr":"172.21.15.22:6833/1860401634","active_change":"2024-04-16T16:16:27.684404+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2193819351}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1588497854}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":3286356621}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":4210116215}]}]} 2024-04-16T16:16:48.165 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-16T16:16:48.165 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-16T16:16:48.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:48.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.389+0000 7fd5f3200640 1 Processor -- start 2024-04-16T16:16:48.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.389+0000 7fd5f3200640 1 -- start start 2024-04-16T16:16:48.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f3200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5f40af7c0 0x7fd5f415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f3200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f415bba0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f3200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f4071ba0 con 0x7fd5f40d0810 2024-04-16T16:16:48.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f3200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f4071e80 con 0x7fd5f40af7c0 2024-04-16T16:16:48.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f1e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd5f415b7c0 0x7fd5f40d0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43666/0 (socket says 172.21.15.22:43666) 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f1e00640 1 -- 172.21.15.22:0/69498142 learned_addr learned my addr 172.21.15.22:0/69498142 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f2800640 1 --2- 172.21.15.22:0/69498142 >> v2:172.21.15.22:3300/0 conn(0x7fd5f40af7c0 0x7fd5f415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.391+0000 7fd5f1400640 1 -- 172.21.15.22:0/69498142 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110703465 0 0) 0x7fd5f415bba0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.392+0000 7fd5f1400640 1 -- 172.21.15.22:0/69498142 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d8003520 con 0x7fd5f415b7c0 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.392+0000 7fd5f2800640 1 -- 172.21.15.22:0/69498142 >> v1:172.21.15.43:6789/0 conn(0x7fd5f40d0810 legacy=0x7fd5f406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.392+0000 7fd5f2800640 1 -- 172.21.15.22:0/69498142 >> v1:172.21.15.22:6789/0 conn(0x7fd5f415b7c0 legacy=0x7fd5f40d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.392+0000 7fd5f2800640 1 -- 172.21.15.22:0/69498142 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f4072160 con 0x7fd5f40af7c0 2024-04-16T16:16:48.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.393+0000 7fd5f2800640 1 --2- 172.21.15.22:0/69498142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f40af7c0 0x7fd5f415fd50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0097a0 tx=0x7fd5ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91807660cbec4a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.393+0000 7fd5f1400640 1 -- 172.21.15.22:0/69498142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec035020 con 0x7fd5f40af7c0 2024-04-16T16:16:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.393+0000 7fd5f1400640 1 -- 172.21.15.22:0/69498142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec031830 con 0x7fd5f40af7c0 2024-04-16T16:16:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.393+0000 7fd5f1400640 1 -- 172.21.15.22:0/69498142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec031be0 con 0x7fd5f40af7c0 2024-04-16T16:16:48.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.393+0000 7fd5f3200640 1 -- 172.21.15.22:0/69498142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f40af7c0 msgr2=0x7fd5f415fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.394+0000 7fd5f3200640 1 --2- 172.21.15.22:0/69498142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f40af7c0 0x7fd5f415fd50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0097a0 tx=0x7fd5ec02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.394+0000 7fd5f3200640 1 -- 172.21.15.22:0/69498142 shutdown_connections 2024-04-16T16:16:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.394+0000 7fd5f3200640 1 --2- 172.21.15.22:0/69498142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f40af7c0 0x7fd5f415fd50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.394+0000 7fd5f3200640 1 -- 172.21.15.22:0/69498142 >> 172.21.15.22:0/69498142 conn(0x7fd5f4062440 msgr2=0x7fd5f4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.394+0000 7fd5f3200640 1 -- 172.21.15.22:0/69498142 shutdown_connections 2024-04-16T16:16:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.394+0000 7fd5f3200640 1 -- 172.21.15.22:0/69498142 wait complete. 2024-04-16T16:16:48.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.395+0000 7fd5f3200640 1 Processor -- start 2024-04-16T16:16:48.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.396+0000 7fd5f3200640 1 -- start start 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.396+0000 7fd5f3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f40af7c0 0x7fd5f4144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.396+0000 7fd5f3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f40d0810 0x7fd5f414e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f415b7c0 0x7fd5f414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f4072ae0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f4072960 con 0x7fd5f40af7c0 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f406d650 con 0x7fd5f40d0810 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f415b7c0 0x7fd5f414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f415b7c0 0x7fd5f414ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58970/0 (socket says 172.21.15.22:58970) 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 -- 172.21.15.22:0/1002135115 learned_addr learned my addr 172.21.15.22:0/1002135115 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5e9400640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f40d0810 0x7fd5f414e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 -- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f40d0810 msgr2=0x7fd5f414e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f1e00640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f40af7c0 0x7fd5f4144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f40d0810 0x7fd5f414e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 -- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f40af7c0 msgr2=0x7fd5f4144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f40af7c0 0x7fd5f4144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f2800640 1 -- 172.21.15.22:0/1002135115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f4157ba0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5e9400640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f40d0810 0x7fd5f414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.397+0000 7fd5f1e00640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f40af7c0 0x7fd5f4144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.398+0000 7fd5f2800640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f415b7c0 0x7fd5f414ee20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec02b910 tx=0x7fd5ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.398+0000 7fd5eaa00640 1 -- 172.21.15.22:0/1002135115 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec041070 con 0x7fd5f415b7c0 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.398+0000 7fd5eaa00640 1 -- 172.21.15.22:0/1002135115 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec03b840 con 0x7fd5f415b7c0 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.398+0000 7fd5eaa00640 1 -- 172.21.15.22:0/1002135115 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec035040 con 0x7fd5f415b7c0 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.398+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f41517e0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.398+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f4151da0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.399+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f4075f30 con 0x7fd5f415b7c0 2024-04-16T16:16:48.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.400+0000 7fd5eaa00640 1 -- 172.21.15.22:0/1002135115 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5ec038020 con 0x7fd5f415b7c0 2024-04-16T16:16:48.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.401+0000 7fd5eaa00640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d006c8f0 0x7fd5d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.401+0000 7fd5eaa00640 1 -- 172.21.15.22:0/1002135115 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5ec0ad4f0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.401+0000 7fd5f1e00640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d006c8f0 0x7fd5d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.402+0000 7fd5f1e00640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d006c8f0 0x7fd5d006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4005c00 tx=0x7fd5e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:48.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.409+0000 7fd5eaa00640 1 -- 172.21.15.22:0/1002135115 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5ec031800 con 0x7fd5f415b7c0 2024-04-16T16:16:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.617+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5f40714c0 con 0x7fd5f415b7c0 2024-04-16T16:16:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.618+0000 7fd5eaa00640 1 -- 172.21.15.22:0/1002135115 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7fd5ec07b880 con 0x7fd5f415b7c0 2024-04-16T16:16:48.619 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:48.619 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:48.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.621+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d006c8f0 msgr2=0x7fd5d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.621+0000 7fd5f3200640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d006c8f0 0x7fd5d006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4005c00 tx=0x7fd5e4009040 comp rx=0 tx=0).stop 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.621+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f415b7c0 msgr2=0x7fd5f414ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.621+0000 7fd5f3200640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f415b7c0 0x7fd5f414ee20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec02b910 tx=0x7fd5ec0046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 shutdown_connections 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d006c8f0 0x7fd5d006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f415b7c0 0x7fd5f414ee20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f40d0810 0x7fd5f414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 --2- 172.21.15.22:0/1002135115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f40af7c0 0x7fd5f4144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 >> 172.21.15.22:0/1002135115 conn(0x7fd5f4062440 msgr2=0x7fd5f40b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 shutdown_connections 2024-04-16T16:16:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.622+0000 7fd5f3200640 1 -- 172.21.15.22:0/1002135115 wait complete. 2024-04-16T16:16:48.641 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-16T16:16:48.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:48.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.859+0000 7fbe5b000640 1 Processor -- start 2024-04-16T16:16:48.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.859+0000 7fbe5b000640 1 -- start start 2024-04-16T16:16:48.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe5b000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbe5415ed60 0x7fbe540d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe5b000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540d3420 0x7fbe540cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe5b000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe540d39a0 con 0x7fbe540cfdd0 2024-04-16T16:16:48.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe5b000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbe540d3c80 con 0x7fbe5415ed60 2024-04-16T16:16:48.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe5b000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbe540d3f60 con 0x7fbe540d3420 2024-04-16T16:16:48.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe53e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbe5415ed60 0x7fbe540d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe59000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbe540cfdd0 0x7fbe540b6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43676/0 (socket says 172.21.15.22:43676) 2024-04-16T16:16:48.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.861+0000 7fbe59000640 1 -- 172.21.15.22:0/2374806487 learned_addr learned my addr 172.21.15.22:0/2374806487 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:48.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.862+0000 7fbe53400640 1 --2- 172.21.15.22:0/2374806487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540d3420 0x7fbe540cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.862+0000 7fbe53e00640 1 -- 172.21.15.22:0/2374806487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540d3420 msgr2=0x7fbe540cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:48.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.862+0000 7fbe53e00640 1 --2- 172.21.15.22:0/2374806487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540d3420 0x7fbe540cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.862+0000 7fbe53e00640 1 -- 172.21.15.22:0/2374806487 >> v1:172.21.15.22:6789/0 conn(0x7fbe540cfdd0 legacy=0x7fbe540b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.862+0000 7fbe53e00640 1 -- 172.21.15.22:0/2374806487 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe540d4240 con 0x7fbe5415ed60 2024-04-16T16:16:48.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.863+0000 7fbe53e00640 1 --2- 172.21.15.22:0/2374806487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe540d2ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6798dee72c6dace server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:48.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.863+0000 7fbe52a00640 1 -- 172.21.15.22:0/2374806487 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44034070 con 0x7fbe5415ed60 2024-04-16T16:16:48.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.863+0000 7fbe52a00640 1 -- 172.21.15.22:0/2374806487 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe44030800 con 0x7fbe5415ed60 2024-04-16T16:16:48.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.863+0000 7fbe52a00640 1 -- 172.21.15.22:0/2374806487 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44030bd0 con 0x7fbe5415ed60 2024-04-16T16:16:48.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 -- 172.21.15.22:0/2374806487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 msgr2=0x7fbe540d2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2374806487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe540d2ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402b940 comp rx=0 tx=0).stop 2024-04-16T16:16:48.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 -- 172.21.15.22:0/2374806487 shutdown_connections 2024-04-16T16:16:48.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2374806487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540d3420 0x7fbe540cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2374806487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe540d2ee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 -- 172.21.15.22:0/2374806487 >> 172.21.15.22:0/2374806487 conn(0x7fbe54062620 msgr2=0x7fbe54062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 -- 172.21.15.22:0/2374806487 shutdown_connections 2024-04-16T16:16:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.864+0000 7fbe5b000640 1 -- 172.21.15.22:0/2374806487 wait complete. 2024-04-16T16:16:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.866+0000 7fbe5b000640 1 Processor -- start 2024-04-16T16:16:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.866+0000 7fbe5b000640 1 -- start start 2024-04-16T16:16:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe5b000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540cfdd0 0x7fbe540ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe5b000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe540d3420 0x7fbe54153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe5b000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe54153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe5b000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe540ba970 con 0x7fbe5415ed60 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe5b000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5415f140 con 0x7fbe540d3420 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe5b000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbe540b8c70 con 0x7fbe540cfdd0 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe59000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe54153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe59000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe54153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58990/0 (socket says 172.21.15.22:58990) 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.867+0000 7fbe59000640 1 -- 172.21.15.22:0/2682806966 learned_addr learned my addr 172.21.15.22:0/2682806966 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe53e00640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540cfdd0 0x7fbe540ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe53400640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe540d3420 0x7fbe54153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe59000640 1 -- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540cfdd0 msgr2=0x7fbe540ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe59000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540cfdd0 0x7fbe540ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe59000640 1 -- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe540d3420 msgr2=0x7fbe54153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe59000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe540d3420 0x7fbe54153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:48.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe59000640 1 -- 172.21.15.22:0/2682806966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe541543a0 con 0x7fbe5415ed60 2024-04-16T16:16:48.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe59000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe54153e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00cbc0 tx=0x7fbe4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe4be00640 1 -- 172.21.15.22:0/2682806966 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c017070 con 0x7fbe5415ed60 2024-04-16T16:16:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe4be00640 1 -- 172.21.15.22:0/2682806966 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00ad40 con 0x7fbe5415ed60 2024-04-16T16:16:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe4be00640 1 -- 172.21.15.22:0/2682806966 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c012600 con 0x7fbe5415ed60 2024-04-16T16:16:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.868+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe540b4770 con 0x7fbe5415ed60 2024-04-16T16:16:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.869+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe540b4fb0 con 0x7fbe5415ed60 2024-04-16T16:16:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.870+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5404fd90 con 0x7fbe5415ed60 2024-04-16T16:16:48.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.871+0000 7fbe4be00640 1 -- 172.21.15.22:0/2682806966 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe4c01a070 con 0x7fbe5415ed60 2024-04-16T16:16:48.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.872+0000 7fbe4be00640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbe3006c8f0 0x7fbe3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:48.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.872+0000 7fbe4be00640 1 -- 172.21.15.22:0/2682806966 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbe4c08b7e0 con 0x7fbe5415ed60 2024-04-16T16:16:48.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.872+0000 7fbe53e00640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbe3006c8f0 0x7fbe3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:48.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.873+0000 7fbe53e00640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbe3006c8f0 0x7fbe3006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe44036000 tx=0x7fbe44008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:48.876+0000 7fbe4be00640 1 -- 172.21.15.22:0/2682806966 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe540b4770 con 0x7fbe5415ed60 2024-04-16T16:16:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.080+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe540d0d40 con 0x7fbe5415ed60 2024-04-16T16:16:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.081+0000 7fbe4be00640 1 -- 172.21.15.22:0/2682806966 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7fbe4c0595c0 con 0x7fbe5415ed60 2024-04-16T16:16:49.081 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:49.082 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbe3006c8f0 msgr2=0x7fbe3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbe3006c8f0 0x7fbe3006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe44036000 tx=0x7fbe44008030 comp rx=0 tx=0).stop 2024-04-16T16:16:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 msgr2=0x7fbe54153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe54153e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00cbc0 tx=0x7fbe4c00a430 comp rx=0 tx=0).stop 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 shutdown_connections 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbe3006c8f0 0x7fbe3006edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe5415ed60 0x7fbe54153e60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe540d3420 0x7fbe54153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 --2- 172.21.15.22:0/2682806966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe540cfdd0 0x7fbe540ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.084+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 >> 172.21.15.22:0/2682806966 conn(0x7fbe54062620 msgr2=0x7fbe540c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.085+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 shutdown_connections 2024-04-16T16:16:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.085+0000 7fbe5b000640 1 -- 172.21.15.22:0/2682806966 wait complete. 2024-04-16T16:16:49.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-16T16:16:49.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-16T16:16:49.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-16T16:16:49.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-16T16:16:49.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-16T16:16:49.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-16T16:16:49.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-16T16:16:49.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-16T16:16:49.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.411+0000 7f095ce00640 1 Processor -- start 2024-04-16T16:16:49.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.412+0000 7f095ce00640 1 -- start start 2024-04-16T16:16:49.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.412+0000 7f4763200640 1 Processor -- start 2024-04-16T16:16:49.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.412+0000 7f0739200640 1 Processor -- start 2024-04-16T16:16:49.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.412+0000 7f0739200640 1 -- start start 2024-04-16T16:16:49.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.413+0000 7f4763200640 1 -- start start 2024-04-16T16:16:49.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.414+0000 7f095ce00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f095815afe0 0x7f09580ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.414+0000 7f0739200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f073406ef20 0x7f07340ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.414+0000 7f0739200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073406df70 con 0x7f073415f2e0 2024-04-16T16:16:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.415+0000 7f0739200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073406e250 con 0x7f07340d0a40 2024-04-16T16:16:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.415+0000 7f0739200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f073406e530 con 0x7f073406ef20 2024-04-16T16:16:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.415+0000 7f095ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f09580b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.415+0000 7f095ce00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0958071d80 con 0x7f09580b5c70 2024-04-16T16:16:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f095ce00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0958072060 con 0x7f095815afe0 2024-04-16T16:16:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f095ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0958072340 con 0x7f095806eac0 2024-04-16T16:16:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f0732a00640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f07340d0a40 0x7f07340b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:41918/0 (socket says 172.21.15.22:41918) 2024-04-16T16:16:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f0732a00640 1 -- 172.21.15.22:0/1156903030 learned_addr learned my addr 172.21.15.22:0/1156903030 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f0733e00640 1 --2- 172.21.15.22:0/1156903030 >> v2:172.21.15.22:3300/0 conn(0x7f073406ef20 0x7f07340ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f4763200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 0x7f475c038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f4763200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f475c0544c0 con 0x7f475c053c70 2024-04-16T16:16:49.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f4761e00640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f475c0df220 0x7f475c04fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:41938/0 (socket says 172.21.15.22:41938) 2024-04-16T16:16:49.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f4761e00640 1 -- 172.21.15.22:0/374018465 learned_addr learned my addr 172.21.15.22:0/374018465 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.416+0000 7f0956800640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f09580b5c70 0x7f0958072e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:41926/0 (socket says 172.21.15.22:41926) 2024-04-16T16:16:49.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f0956800640 1 -- 172.21.15.22:0/1133369883 learned_addr learned my addr 172.21.15.22:0/1133369883 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627117302 0 0) 0x7f073406e250 con 0x7f07340d0a40 2024-04-16T16:16:49.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f4763200640 1 -- 172.21.15.22:0/374018465 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f475c0541e0 con 0x7f475c0df220 2024-04-16T16:16:49.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f4763200640 1 -- 172.21.15.22:0/374018465 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f475c005f80 con 0x7f475c0501a0 2024-04-16T16:16:49.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f0955e00640 1 --2- 172.21.15.22:0/1133369883 >> v2:172.21.15.22:3300/0 conn(0x7f095815afe0 0x7f09580ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0718003520 con 0x7f07340d0a40 2024-04-16T16:16:49.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f4761400640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 0x7f475c038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063211155 0 0) 0x7f073406df70 con 0x7f073415f2e0 2024-04-16T16:16:49.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.417+0000 7f0955400640 1 --2- 172.21.15.22:0/1133369883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f09580b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0954a00640 1 -- 172.21.15.22:0/1133369883 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064660218 0 0) 0x7f0958071d80 con 0x7f09580b5c70 2024-04-16T16:16:49.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0954a00640 1 -- 172.21.15.22:0/1133369883 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f093c007930 con 0x7f09580b5c70 2024-04-16T16:16:49.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f073406e250 con 0x7f073415f2e0 2024-04-16T16:16:49.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677624309 0 0) 0x7f475c0541e0 con 0x7f475c0df220 2024-04-16T16:16:49.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4748003520 con 0x7f475c0df220 2024-04-16T16:16:49.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0955e00640 1 -- 172.21.15.22:0/1133369883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 msgr2=0x7f09580b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0955e00640 1 --2- 172.21.15.22:0/1133369883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f09580b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0955e00640 1 -- 172.21.15.22:0/1133369883 >> v1:172.21.15.43:6789/0 conn(0x7f09580b5c70 legacy=0x7f0958072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.418+0000 7f0955e00640 1 -- 172.21.15.22:0/1133369883 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0958072620 con 0x7f095815afe0 2024-04-16T16:16:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 <== mon.1 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 142476845 0 0) 0x7f0718003520 con 0x7f07340d0a40 2024-04-16T16:16:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 >> v2:172.21.15.22:3300/0 conn(0x7f073406ef20 msgr2=0x7f07340ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2842958345 0 0) 0x7f475c0544c0 con 0x7f475c053c70 2024-04-16T16:16:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f475c0541e0 con 0x7f475c053c70 2024-04-16T16:16:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 --2- 172.21.15.22:0/1156903030 >> v2:172.21.15.22:3300/0 conn(0x7f073406ef20 0x7f07340ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 >> v1:172.21.15.22:6789/0 conn(0x7f073415f2e0 legacy=0x7f07340d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07340b4490 con 0x7f07340d0a40 2024-04-16T16:16:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 <== mon.1 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f0724001670 con 0x7f07340d0a40 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 <== mon.1 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 169545674 0 0) 0x7f4748003520 con 0x7f475c0df220 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 msgr2=0x7f475c038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 0x7f475c038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 >> v1:172.21.15.22:6789/0 conn(0x7f475c053c70 legacy=0x7f475c006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c006260 con 0x7f475c0df220 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 <== mon.1 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f4754001670 con 0x7f475c0df220 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 >> v1:172.21.15.43:6789/0 conn(0x7f475c0df220 legacy=0x7f475c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4748003b40 0x7f4748003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4748004800 0x7f4748004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 0x7f47480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f475c005f80 con 0x7f4748003b40 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4748007ba0 con 0x7f4748004800 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4748007da0 con 0x7f475c0501a0 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 >> v1:172.21.15.43:6789/0 conn(0x7f07340d0a40 legacy=0x7f07340b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0718004c10 0x7f0718005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07180037a0 0x7f0718003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0718004160 0x7f071800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f073406e530 con 0x7f0718004160 2024-04-16T16:16:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f071800c0f0 con 0x7f07180037a0 2024-04-16T16:16:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.419+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f071800c2f0 con 0x7f0718004c10 2024-04-16T16:16:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f0733e00640 1 --2- 172.21.15.22:0/1156903030 >> v2:172.21.15.22:3300/0 conn(0x7f073406ef20 0x7f07340ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f0732a00640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07180037a0 0x7f0718003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f5c9fe00640 1 Processor -- start 2024-04-16T16:16:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.420+0000 7f5c9fe00640 1 -- start start 2024-04-16T16:16:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0733400640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0718004c10 0x7f0718005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f4761400640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4748004800 0x7f4748004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f4761e00640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4748003b40 0x7f4748003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0733e00640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0718004160 0x7f071800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0732a00640 1 -- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0718004c10 msgr2=0x7f0718005010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0732a00640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0718004c10 0x7f0718005010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0732a00640 1 -- 172.21.15.22:0/1156903030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0718004160 msgr2=0x7f071800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0732a00640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0718004160 0x7f071800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0732a00640 1 -- 172.21.15.22:0/1156903030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07340b4490 con 0x7f07180037a0 2024-04-16T16:16:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f0733e00640 1 -- 172.21.15.22:0/1156903030 reap_dead start 2024-04-16T16:16:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f5c9fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5ca015eb30 0x7f5ca00d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f5c9fe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ca00d1770 0x7f5ca00d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f5c9fe00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca00d4650 con 0x7f5ca00d2de0 2024-04-16T16:16:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f5c9fe00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca015ef10 con 0x7f5ca015eb30 2024-04-16T16:16:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f5c9fe00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca00d35b0 con 0x7f5ca00d1770 2024-04-16T16:16:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f0955e00640 1 --2- 172.21.15.22:0/1133369883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 0x7f09580ade00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f094800c860 tx=0x7f094802c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692c6ecaa38b5a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.423+0000 7f0954a00640 1 -- 172.21.15.22:0/1133369883 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948032070 con 0x7f095815afe0 2024-04-16T16:16:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.421+0000 7f4762800640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 0x7f47480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f4761400640 1 -- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 msgr2=0x7f47480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f4761400640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f475c0501a0 0x7f47480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f4761400640 1 -- 172.21.15.22:0/374018465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4748003b40 msgr2=0x7f4748003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f4761400640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4748003b40 0x7f4748003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.422+0000 7f4761400640 1 -- 172.21.15.22:0/374018465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c0544c0 con 0x7f4748004800 2024-04-16T16:16:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.423+0000 7f5c9ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5ca015eb30 0x7f5ca00d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.423+0000 7f0954a00640 1 -- 172.21.15.22:0/1133369883 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094802ce30 con 0x7f095815afe0 2024-04-16T16:16:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f0954a00640 1 -- 172.21.15.22:0/1133369883 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948036600 con 0x7f095815afe0 2024-04-16T16:16:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f0732a00640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07180037a0 0x7f0718003c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0724012a50 tx=0x7f0718005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36668c9c33c6d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f4761400640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4748004800 0x7f4748004c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f475000aab0 tx=0x7f4748005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01893b5fab49d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f24e3800640 1 Processor -- start 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f095ce00640 1 -- 172.21.15.22:0/1133369883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 msgr2=0x7f09580ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f095ce00640 1 --2- 172.21.15.22:0/1133369883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 0x7f09580ade00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f094800c860 tx=0x7f094802c080 comp rx=0 tx=0).stop 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f5c9ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5ca015eb30 0x7f5ca00d1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59042/0 (socket says 172.21.15.22:59042) 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f5c9ea00640 1 -- 172.21.15.22:0/184719127 learned_addr learned my addr 172.21.15.22:0/184719127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f5c9ea00640 1 -- 172.21.15.22:0/184719127 >> v2:172.21.15.43:3300/0 conn(0x7f5ca00d1770 msgr2=0x7f5ca00d28a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f5c9ea00640 1 --2- 172.21.15.22:0/184719127 >> v2:172.21.15.43:3300/0 conn(0x7f5ca00d1770 0x7f5ca00d28a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f5c9ea00640 1 -- 172.21.15.22:0/184719127 >> v1:172.21.15.22:6789/0 conn(0x7f5ca00d2de0 legacy=0x7f5ca00b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f5c9ea00640 1 -- 172.21.15.22:0/184719127 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca00d1be0 con 0x7f5ca015eb30 2024-04-16T16:16:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f095ce00640 1 -- 172.21.15.22:0/1133369883 shutdown_connections 2024-04-16T16:16:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f095ce00640 1 --2- 172.21.15.22:0/1133369883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f09580b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f095ce00640 1 --2- 172.21.15.22:0/1133369883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 0x7f09580ade00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f095ce00640 1 -- 172.21.15.22:0/1133369883 >> 172.21.15.22:0/1133369883 conn(0x7f09580b2b20 msgr2=0x7f09580b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724007e00 con 0x7f07180037a0 2024-04-16T16:16:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0724038030 con 0x7f07180037a0 2024-04-16T16:16:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.424+0000 7f0732000640 1 -- 172.21.15.22:0/1156903030 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724005d70 con 0x7f07180037a0 2024-04-16T16:16:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750034070 con 0x7f4748004800 2024-04-16T16:16:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f4760a00640 1 -- 172.21.15.22:0/374018465 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4750030660 con 0x7f4748004800 2024-04-16T16:16:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f0739200640 1 -- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07180037a0 msgr2=0x7f0718003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f0739200640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07180037a0 0x7f0718003c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0724012a50 tx=0x7f0718005830 comp rx=0 tx=0).stop 2024-04-16T16:16:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f095ce00640 1 -- 172.21.15.22:0/1133369883 shutdown_connections 2024-04-16T16:16:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f095ce00640 1 -- 172.21.15.22:0/1133369883 wait complete. 2024-04-16T16:16:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f4763200640 1 -- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4748004800 msgr2=0x7f4748004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f4763200640 1 --2- 172.21.15.22:0/374018465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4748004800 0x7f4748004c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f475000aab0 tx=0x7f4748005830 comp rx=0 tx=0).stop 2024-04-16T16:16:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f5c9ea00640 1 --2- 172.21.15.22:0/184719127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca015eb30 0x7f5ca00d1230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00d0e70 tx=0x7f5c900343a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b225ecdce72e52cf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f0739200640 1 -- 172.21.15.22:0/1156903030 shutdown_connections 2024-04-16T16:16:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f0739200640 1 --2- 172.21.15.22:0/1156903030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07180037a0 0x7f0718003c20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f0739200640 1 -- 172.21.15.22:0/1156903030 >> 172.21.15.22:0/1156903030 conn(0x7f0734062440 msgr2=0x7f0734062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f0739200640 1 -- 172.21.15.22:0/1156903030 shutdown_connections 2024-04-16T16:16:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f4762800640 1 -- 172.21.15.22:0/374018465 reap_dead start 2024-04-16T16:16:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.425+0000 7f24e3800640 1 -- start start 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f0739200640 1 -- 172.21.15.22:0/1156903030 wait complete. 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f24e3800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc15f010 0x7f24dc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f24e3800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24dc0d13f0 0x7f24dc0d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f24e3800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24dc0d2d40 con 0x7f24dc15ec30 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f24e3800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f24dc0cf960 con 0x7f24dc0d13f0 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7f24e3800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc0cfc40 con 0x7f24dc15f010 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.427+0000 7f5c9d600640 1 -- 172.21.15.22:0/184719127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90040070 con 0x7f5ca015eb30 2024-04-16T16:16:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.427+0000 7f5c9d600640 1 -- 172.21.15.22:0/184719127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9003b600 con 0x7f5ca015eb30 2024-04-16T16:16:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.427+0000 7f5c9d600640 1 -- 172.21.15.22:0/184719127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9003b9d0 con 0x7f5ca015eb30 2024-04-16T16:16:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7fb572800640 1 Processor -- start 2024-04-16T16:16:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.426+0000 7fb572800640 1 -- start start 2024-04-16T16:16:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.427+0000 7f24e1800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24dc0d13f0 0x7f24dc0d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.427+0000 7f24e1800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24dc0d13f0 0x7f24dc0d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59052/0 (socket says 172.21.15.22:59052) 2024-04-16T16:16:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.427+0000 7f24e0e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f24dc15ec30 0x7f24dc163380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43718/0 (socket says 172.21.15.22:43718) 2024-04-16T16:16:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.427+0000 7f24e0e00640 1 -- 172.21.15.22:0/1149303423 learned_addr learned my addr 172.21.15.22:0/1149303423 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f5c9fe00640 1 -- 172.21.15.22:0/184719127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca015eb30 msgr2=0x7f5ca00d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f5c9fe00640 1 --2- 172.21.15.22:0/184719127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca015eb30 0x7f5ca00d1230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00d0e70 tx=0x7f5c900343a0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f24dbe00640 1 --2- 172.21.15.22:0/1149303423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc15f010 0x7f24dc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7fb572800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb56404a320 0x7fb564039b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f5c9fe00640 1 -- 172.21.15.22:0/184719127 shutdown_connections 2024-04-16T16:16:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f5c9fe00640 1 --2- 172.21.15.22:0/184719127 >> v2:172.21.15.43:3300/0 conn(0x7f5ca00d1770 0x7f5ca00d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f5c9fe00640 1 --2- 172.21.15.22:0/184719127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca015eb30 0x7f5ca00d1230 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f5c9fe00640 1 -- 172.21.15.22:0/184719127 >> 172.21.15.22:0/184719127 conn(0x7f5ca0072670 msgr2=0x7f5ca0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f24db400640 1 -- 172.21.15.22:0/1149303423 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767830889 0 0) 0x7f24dc0d2d40 con 0x7f24dc15ec30 2024-04-16T16:16:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f4763200640 1 -- 172.21.15.22:0/374018465 shutdown_connections 2024-04-16T16:16:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7f4763200640 1 -- 172.21.15.22:0/374018465 >> 172.21.15.22:0/374018465 conn(0x7f475c009fb0 msgr2=0x7f475c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7fb572800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56403b340 con 0x7fb5640529f0 2024-04-16T16:16:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7fb572800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56403b5e0 con 0x7fb5640361b0 2024-04-16T16:16:49.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.428+0000 7fb572800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb56403b8c0 con 0x7fb56404a320 2024-04-16T16:16:49.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7f0739200640 1 Processor -- start 2024-04-16T16:16:49.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7f24db400640 1 -- 172.21.15.22:0/1149303423 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c4003520 con 0x7f24dc15ec30 2024-04-16T16:16:49.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7fb571e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb5640529f0 0x7fb564054870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43734/0 (socket says 172.21.15.22:43734) 2024-04-16T16:16:49.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7fb571e00640 1 -- 172.21.15.22:0/1673280749 learned_addr learned my addr 172.21.15.22:0/1673280749 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7f0739200640 1 -- start start 2024-04-16T16:16:49.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7f5c9fe00640 1 -- 172.21.15.22:0/184719127 shutdown_connections 2024-04-16T16:16:49.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7f5c9fe00640 1 -- 172.21.15.22:0/184719127 wait complete. 2024-04-16T16:16:49.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7f24db400640 1 -- 172.21.15.22:0/1149303423 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3081306089 0 0) 0x7f24c4003520 con 0x7f24dc15ec30 2024-04-16T16:16:49.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.430+0000 7f24e1800640 1 -- 172.21.15.22:0/1149303423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc15f010 msgr2=0x7f24dc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.430+0000 7f24e1800640 1 --2- 172.21.15.22:0/1149303423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc15f010 0x7f24dc0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.430+0000 7f24e1800640 1 -- 172.21.15.22:0/1149303423 >> v1:172.21.15.22:6789/0 conn(0x7f24dc15ec30 legacy=0x7f24dc163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.429+0000 7fb571400640 1 --2- 172.21.15.22:0/1673280749 >> v2:172.21.15.22:3300/0 conn(0x7fb56404a320 0x7fb564039b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.430+0000 7f24e1800640 1 -- 172.21.15.22:0/1149303423 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc0cff20 con 0x7f24dc0d13f0 2024-04-16T16:16:49.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f095ce00640 1 Processor -- start 2024-04-16T16:16:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f4763200640 1 -- 172.21.15.22:0/374018465 shutdown_connections 2024-04-16T16:16:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f0739200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07180037a0 0x7f0734150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f095ce00640 1 -- start start 2024-04-16T16:16:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f0739200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f073415c1c0 0x7f0734151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f0739200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07341520d0 0x7f0734151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f0739200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07340ceb70 con 0x7f073415c1c0 2024-04-16T16:16:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f0739200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07340ce9f0 con 0x7f07341520d0 2024-04-16T16:16:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f0739200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f07340cecf0 con 0x7f07180037a0 2024-04-16T16:16:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f4763200640 1 -- 172.21.15.22:0/374018465 wait complete. 2024-04-16T16:16:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f5c9fe00640 1 Processor -- start 2024-04-16T16:16:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7f24e1800640 1 --2- 172.21.15.22:0/1149303423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0d13f0 0x7f24dc0d18a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f24d40097a0 tx=0x7f24d402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d4f580e930a465 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7fb571400640 1 -- 172.21.15.22:0/1673280749 >> v1:172.21.15.43:6789/0 conn(0x7fb5640361b0 legacy=0x7fb56403c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7fb571400640 1 -- 172.21.15.22:0/1673280749 >> v1:172.21.15.22:6789/0 conn(0x7fb5640529f0 legacy=0x7fb564054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7fb56be00640 1 -- 172.21.15.22:0/1673280749 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612630330 0 0) 0x7fb56403b340 con 0x7fb5640529f0 2024-04-16T16:16:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.431+0000 7fb571400640 1 -- 172.21.15.22:0/1673280749 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56403bba0 con 0x7fb56404a320 2024-04-16T16:16:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f5c9fe00640 1 -- start start 2024-04-16T16:16:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f0733400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07180037a0 0x7f0734150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f0733400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07180037a0 0x7f0734150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:35214/0 (socket says 172.21.15.22:35214) 2024-04-16T16:16:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f0733400640 1 -- 172.21.15.22:0/2572531359 learned_addr learned my addr 172.21.15.22:0/2572531359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f0732a00640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f073415c1c0 0x7f0734151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f0733400640 1 -- 172.21.15.22:0/2572531359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07341520d0 msgr2=0x7f0734151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f0733400640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07341520d0 0x7f0734151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f0733400640 1 -- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f073415c1c0 msgr2=0x7f0734151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7fb571400640 1 --2- 172.21.15.22:0/1673280749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56404a320 0x7fb564039b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb5600097a0 tx=0x7fb56002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641db042a1c8a9a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7fb56be00640 1 -- 172.21.15.22:0/1673280749 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560035020 con 0x7fb56404a320 2024-04-16T16:16:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7fb56be00640 1 -- 172.21.15.22:0/1673280749 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb560031640 con 0x7fb56404a320 2024-04-16T16:16:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7fb56be00640 1 -- 172.21.15.22:0/1673280749 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56002d040 con 0x7fb56404a320 2024-04-16T16:16:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f24db400640 1 -- 172.21.15.22:0/1149303423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4037070 con 0x7f24dc0d13f0 2024-04-16T16:16:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f24db400640 1 -- 172.21.15.22:0/1149303423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d4030510 con 0x7f24dc0d13f0 2024-04-16T16:16:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.432+0000 7f24db400640 1 -- 172.21.15.22:0/1149303423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d00019f0 con 0x7f24dc0d13f0 2024-04-16T16:16:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f5c9fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ca00d1770 0x7f5ca015f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f5c9fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca00d2de0 0x7f5ca0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f24e3800640 1 -- 172.21.15.22:0/1149303423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0d13f0 msgr2=0x7f24dc0d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f24e3800640 1 --2- 172.21.15.22:0/1149303423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0d13f0 0x7f24dc0d18a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f24d40097a0 tx=0x7f24d402b790 comp rx=0 tx=0).stop 2024-04-16T16:16:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f5c9fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ca015eb30 0x7f5ca00cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9fe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca00d3e50 con 0x7f5ca00d2de0 2024-04-16T16:16:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca00d3b70 con 0x7f5ca015eb30 2024-04-16T16:16:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca00d4130 con 0x7f5ca00d1770 2024-04-16T16:16:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f095ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f095809e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f095ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09580b5c70 0x7f09581506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f095ce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 0x7f095809ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f095ce00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f095815b3c0 con 0x7f095815afe0 2024-04-16T16:16:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f095ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0958071a10 con 0x7f09580b5c70 2024-04-16T16:16:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f095ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f095815b540 con 0x7f095806eac0 2024-04-16T16:16:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ca00d1770 0x7f5ca015f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7fb572800640 1 -- 172.21.15.22:0/1673280749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56404a320 msgr2=0x7fb564039b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7fb572800640 1 --2- 172.21.15.22:0/1673280749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56404a320 0x7fb564039b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb5600097a0 tx=0x7fb56002b8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f4763200640 1 Processor -- start 2024-04-16T16:16:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ca00d1770 0x7f5ca015f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:35226/0 (socket says 172.21.15.22:35226) 2024-04-16T16:16:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9ea00640 1 -- 172.21.15.22:0/1443049664 learned_addr learned my addr 172.21.15.22:0/1443049664 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.433+0000 7f0733400640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f073415c1c0 0x7f0734151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f0733400640 1 -- 172.21.15.22:0/2572531359 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073415ad20 con 0x7f07180037a0 2024-04-16T16:16:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f0732a00640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f073415c1c0 0x7f0734151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f0733400640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07180037a0 0x7f0734150340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f072c00fb40 tx=0x7f072c0021c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f24e3800640 1 -- 172.21.15.22:0/1149303423 shutdown_connections 2024-04-16T16:16:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f24e3800640 1 --2- 172.21.15.22:0/1149303423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc0d13f0 0x7f24dc0d18a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f24e3800640 1 --2- 172.21.15.22:0/1149303423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc15f010 0x7f24dc0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f24e3800640 1 -- 172.21.15.22:0/1149303423 >> 172.21.15.22:0/1149303423 conn(0x7f24dc062440 msgr2=0x7f24dc062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7fb572800640 1 -- 172.21.15.22:0/1673280749 shutdown_connections 2024-04-16T16:16:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7fb572800640 1 --2- 172.21.15.22:0/1673280749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56404a320 0x7fb564039b80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7fb572800640 1 -- 172.21.15.22:0/1673280749 >> 172.21.15.22:0/1673280749 conn(0x7fb5640537b0 msgr2=0x7fb564053b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f5a46600640 1 Processor -- start 2024-04-16T16:16:49.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9f400640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ca015eb30 0x7f5ca00cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.434+0000 7f5c9e000640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca00d2de0 0x7f5ca0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f24e3800640 1 -- 172.21.15.22:0/1149303423 shutdown_connections 2024-04-16T16:16:49.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f24e3800640 1 -- 172.21.15.22:0/1149303423 wait complete. 2024-04-16T16:16:49.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f0955e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f095809e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f0955e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f095809e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:35230/0 (socket says 172.21.15.22:35230) 2024-04-16T16:16:49.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f0955e00640 1 -- 172.21.15.22:0/689610383 learned_addr learned my addr 172.21.15.22:0/689610383 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f0955400640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09580b5c70 0x7f09581506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f0956800640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 0x7f095809ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f5a46600640 1 -- start start 2024-04-16T16:16:49.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f4763200640 1 -- start start 2024-04-16T16:16:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7fb572800640 1 -- 172.21.15.22:0/1673280749 shutdown_connections 2024-04-16T16:16:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.435+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c003b80 con 0x7f07180037a0 2024-04-16T16:16:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7fb572800640 1 -- 172.21.15.22:0/1673280749 wait complete. 2024-04-16T16:16:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0734150ab0 con 0x7f07180037a0 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f073414d0c0 con 0x7f07180037a0 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c018070 con 0x7f07180037a0 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c003b80 con 0x7f07180037a0 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f5c9f400640 1 -- 172.21.15.22:0/1443049664 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ca00d1770 msgr2=0x7f5ca015f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f5c9f400640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ca00d1770 0x7f5ca015f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f5c9f400640 1 -- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca00d2de0 msgr2=0x7f5ca0154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f5c9f400640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca00d2de0 0x7f5ca0154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f5c9f400640 1 -- 172.21.15.22:0/1443049664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca00cc580 con 0x7f5ca015eb30 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.437+0000 7f24e3800640 1 Processor -- start 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.437+0000 7f24e3800640 1 -- start start 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e3800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d13f0 0x7f24dc0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e3800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc15ec30 0x7f24dc15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e3800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc15f010 0x7f24dc15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e3800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc0d3380 con 0x7f24dc15f010 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e3800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc0d3200 con 0x7f24dc15ec30 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e3800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc0d3500 con 0x7f24dc0d13f0 2024-04-16T16:16:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f5c9f400640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ca015eb30 0x7f5ca00cc040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c780 tx=0x7f5c9800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.437+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0734075f30 con 0x7f07180037a0 2024-04-16T16:16:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.436+0000 7f0956800640 1 -- 172.21.15.22:0/689610383 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 msgr2=0x7f095809e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.437+0000 7f0956800640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f095806eac0 0x7f095809e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.437+0000 7f0956800640 1 -- 172.21.15.22:0/689610383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09580b5c70 msgr2=0x7f09581506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.437+0000 7f0956800640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09580b5c70 0x7f09581506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.437+0000 7f0956800640 1 -- 172.21.15.22:0/689610383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095809d350 con 0x7f095815afe0 2024-04-16T16:16:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f0955400640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09580b5c70 0x7f09581506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:49.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f0956800640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 0x7f095809ce10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f095000ca70 tx=0x7f095000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7fb572800640 1 Processor -- start 2024-04-16T16:16:49.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7fb572800640 1 -- start start 2024-04-16T16:16:49.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f5a46600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a401635f0 0x7f5a400d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f5a3f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a401635f0 0x7f5a400d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f5a46600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5a401639d0 0x7f5a40163e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f5a46600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a400d1070 con 0x7f5a400b3620 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f5a46600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5a400b3b50 con 0x7f5a401635f0 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f5a46600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5a400d0050 con 0x7f5a401639d0 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f5a3f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a401635f0 0x7f5a400d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59104/0 (socket says 172.21.15.22:59104) 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f5a3f400640 1 -- 172.21.15.22:0/848408463 learned_addr learned my addr 172.21.15.22:0/848408463 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f4763200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4748004800 0x7f475c0c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7fb4d2800640 1 Processor -- start 2024-04-16T16:16:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f4763200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f475c02b6e0 0x7f475c178400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e1800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc15f010 0x7f24dc15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e1800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc15f010 0x7f24dc15bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59096/0 (socket says 172.21.15.22:59096) 2024-04-16T16:16:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.438+0000 7f24e1800640 1 -- 172.21.15.22:0/4131996952 learned_addr learned my addr 172.21.15.22:0/4131996952 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f4763200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c02bb60 0x7f475c178940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f4763200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f475c037a90 con 0x7f475c02bb60 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f4763200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f475c037910 con 0x7f475c02b6e0 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f4763200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f475c0df600 con 0x7f4748004800 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7fb4d2800640 1 -- start start 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f4761e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4748004800 0x7f475c0c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f4761e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4748004800 0x7f475c0c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:35258/0 (socket says 172.21.15.22:35258) 2024-04-16T16:16:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f4761400640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f475c02b6e0 0x7f475c178400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98017070 con 0x7f5ca015eb30 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c98003b90 con 0x7f5ca015eb30 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98005070 con 0x7f5ca015eb30 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f24e0e00640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d13f0 0x7f24dc0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f24e1800640 1 -- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d13f0 msgr2=0x7f24dc0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f24e1800640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24dc0d13f0 0x7f24dc0b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f24e1800640 1 -- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc15ec30 msgr2=0x7f24dc15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f24e1800640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24dc15ec30 0x7f24dc15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f24e1800640 1 -- 172.21.15.22:0/4131996952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc0b4340 con 0x7f24dc15f010 2024-04-16T16:16:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.439+0000 7f5a3fe00640 1 --2- 172.21.15.22:0/848408463 >> v2:172.21.15.43:3300/0 conn(0x7f5a401639d0 0x7f5a40163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f4761e00640 1 -- 172.21.15.22:0/2142354251 learned_addr learned my addr 172.21.15.22:0/2142354251 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950017070 con 0x7f095815afe0 2024-04-16T16:16:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095000ab70 con 0x7f095815afe0 2024-04-16T16:16:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950012400 con 0x7f095815afe0 2024-04-16T16:16:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f5a3e000640 1 -- 172.21.15.22:0/848408463 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298047417 0 0) 0x7f5a2c001110 con 0x7f5a400b3620 2024-04-16T16:16:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5a3e000640 1 -- 172.21.15.22:0/848408463 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a24003520 con 0x7f5a400b3620 2024-04-16T16:16:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.440+0000 7f4762800640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c02bb60 0x7f475c178940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7fb572800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5640361b0 0x7fb5641807a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7fb572800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb56404a320 0x7fb5640d9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7fb572800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5640529f0 0x7fb5640d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7fb572800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640eb4d0 con 0x7fb5640361b0 2024-04-16T16:16:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7fb572800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640eb350 con 0x7fb5640529f0 2024-04-16T16:16:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7fb572800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb564054f80 con 0x7fb56404a320 2024-04-16T16:16:49.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5a3e000640 1 -- 172.21.15.22:0/848408463 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3973462138 0 0) 0x7f5a24003520 con 0x7f5a400b3620 2024-04-16T16:16:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5a3fe00640 1 -- 172.21.15.22:0/848408463 >> v2:172.21.15.22:3300/0 conn(0x7f5a401635f0 msgr2=0x7f5a400d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5a3fe00640 1 --2- 172.21.15.22:0/848408463 >> v2:172.21.15.22:3300/0 conn(0x7f5a401635f0 0x7f5a400d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5a3fe00640 1 -- 172.21.15.22:0/848408463 >> v1:172.21.15.22:6789/0 conn(0x7f5a400b3620 legacy=0x7f5a40071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5a3fe00640 1 -- 172.21.15.22:0/848408463 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a400d0330 con 0x7f5a401639d0 2024-04-16T16:16:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca015f720 con 0x7f5ca015eb30 2024-04-16T16:16:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca015fce0 con 0x7f5ca015eb30 2024-04-16T16:16:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.441+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f072c00d800 con 0x7f07180037a0 2024-04-16T16:16:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb571e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5640529f0 0x7fb5640d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb571e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5640529f0 0x7fb5640d5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:52156/0 (socket says 172.21.15.22:52156) 2024-04-16T16:16:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb571e00640 1 -- 172.21.15.22:0/1439766726 learned_addr learned my addr 172.21.15.22:0/1439766726 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb4d2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc15c990 0x7fb4cc0728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7f24e1800640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc15f010 0x7f24dc15bc30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098c0 tx=0x7f24d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb4d2800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc161540 con 0x7fb4cc072df0 2024-04-16T16:16:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb4d2800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc0afd80 con 0x7fb4cc0d0bc0 2024-04-16T16:16:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb4d2800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc073250 con 0x7fb4cc15c990 2024-04-16T16:16:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7f095ce00640 1 -- 172.21.15.22:0/689610383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095809d5d0 con 0x7f095815afe0 2024-04-16T16:16:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb4caa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb4cc072df0 0x7fb4cc0d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43752/0 (socket says 172.21.15.22:43752) 2024-04-16T16:16:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb4caa00640 1 -- 172.21.15.22:0/4201609930 learned_addr learned my addr 172.21.15.22:0/4201609930 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ca0075f30 con 0x7f5ca015eb30 2024-04-16T16:16:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f095ce00640 1 -- 172.21.15.22:0/689610383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095809db90 con 0x7f095815afe0 2024-04-16T16:16:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f4761e00640 1 -- 172.21.15.22:0/2142354251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f475c02b6e0 msgr2=0x7f475c178400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f4761e00640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f475c02b6e0 0x7f475c178400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f4761e00640 1 -- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c02bb60 msgr2=0x7f475c178940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f4761e00640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c02bb60 0x7f475c178940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f4761e00640 1 -- 172.21.15.22:0/2142354251 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c179050 con 0x7f4748004800 2024-04-16T16:16:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f072b400640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f071006cb20 0x7f071006efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7fb4cb400640 1 --2- 172.21.15.22:0/4201609930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc15c990 0x7fb4cc0728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f072c08c310 con 0x7f07180037a0 2024-04-16T16:16:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.442+0000 7fb571400640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5640361b0 0x7fb5641807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7fb570a00640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb56404a320 0x7fb5640d9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7fb571400640 1 -- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb56404a320 msgr2=0x7fb5640d9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7fb571400640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb56404a320 0x7fb5640d9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7fb571400640 1 -- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5640529f0 msgr2=0x7fb5640d5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7fb571400640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5640529f0 0x7fb5640d5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f072b400640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7f0710074d40 0x7f0710077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4042070 con 0x7f24dc15f010 2024-04-16T16:16:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d403d850 con 0x7f24dc15f010 2024-04-16T16:16:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4037040 con 0x7f24dc15f010 2024-04-16T16:16:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.443+0000 7fb571400640 1 -- 172.21.15.22:0/1439766726 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56404c400 con 0x7fb5640361b0 2024-04-16T16:16:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24dc0b4620 con 0x7f24dc15f010 2024-04-16T16:16:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24dc0b57c0 con 0x7f24dc15f010 2024-04-16T16:16:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 --> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f072c028ea0 con 0x7f0710074d40 2024-04-16T16:16:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f072c08c700 con 0x7f07180037a0 2024-04-16T16:16:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f0732a00640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f071006cb20 0x7f071006efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7f0733e00640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7f0710074d40 0x7f0710077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7fb4cb400640 1 -- 172.21.15.22:0/4201609930 >> v1:172.21.15.43:6789/0 conn(0x7fb4cc0d0bc0 legacy=0x7fb4cc0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7fb4cb400640 1 -- 172.21.15.22:0/4201609930 >> v1:172.21.15.22:6789/0 conn(0x7fb4cc072df0 legacy=0x7fb4cc0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7fb4cb400640 1 -- 172.21.15.22:0/4201609930 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc160780 con 0x7fb4cc15c990 2024-04-16T16:16:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7f4761e00640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4748004800 0x7f475c0c8c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4754000f60 tx=0x7f47540077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.444+0000 7fb571400640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5640361b0 0x7fb5641807a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb560033000 tx=0x7fb5600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7f5a3fe00640 1 --2- 172.21.15.22:0/848408463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401639d0 0x7f5a40163e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a400cfce0 tx=0x7f5a3802bc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4f31bb295761614 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7f095ce00640 1 -- 172.21.15.22:0/689610383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0958150c30 con 0x7f095815afe0 2024-04-16T16:16:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24dc1607e0 con 0x7f24dc15f010 2024-04-16T16:16:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475400f990 con 0x7f4748004800 2024-04-16T16:16:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4754018070 con 0x7f4748004800 2024-04-16T16:16:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475400fd90 con 0x7f4748004800 2024-04-16T16:16:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c0e0d70 con 0x7f4748004800 2024-04-16T16:16:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.445+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560006e10 con 0x7fb5640361b0 2024-04-16T16:16:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7f5a3e000640 1 -- 172.21.15.22:0/848408463 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38039070 con 0x7f5a401639d0 2024-04-16T16:16:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7f5a3e000640 1 -- 172.21.15.22:0/848408463 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a3802c7a0 con 0x7f5a401639d0 2024-04-16T16:16:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7f5a3e000640 1 -- 172.21.15.22:0/848408463 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c001820 con 0x7f5a401639d0 2024-04-16T16:16:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c0e1330 con 0x7f4748004800 2024-04-16T16:16:49.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7f0733e00640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7f0710074d40 0x7f0710077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f0732a00640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f071006cb20 0x7f071006efe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f072403b000 tx=0x7f0724012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56003ade0 con 0x7fb5640361b0 2024-04-16T16:16:49.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560044630 con 0x7fb5640361b0 2024-04-16T16:16:49.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7fb4cb400640 1 --2- 172.21.15.22:0/4201609930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc15c990 0x7fb4cc0728b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009df0 tx=0x7fb4bc02be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c8b7193fba586 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f475c179330 con 0x7f4748004800 2024-04-16T16:16:49.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7fb4ca000640 1 -- 172.21.15.22:0/4201609930 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc039070 con 0x7fb4cc15c990 2024-04-16T16:16:49.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7fb4ca000640 1 -- 172.21.15.22:0/4201609930 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc02cc20 con 0x7fb4cc15c990 2024-04-16T16:16:49.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7fb4ca000640 1 -- 172.21.15.22:0/4201609930 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc034440 con 0x7fb4cc15c990 2024-04-16T16:16:49.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5640d9540 con 0x7fb5640361b0 2024-04-16T16:16:49.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.446+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb564180d80 con 0x7fb5640361b0 2024-04-16T16:16:49.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.448+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb548001030 con 0x7fb5640361b0 2024-04-16T16:16:49.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.448+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c9801a070 con 0x7f5ca015eb30 2024-04-16T16:16:49.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.448+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== osd.3 v2:172.21.15.22:6816/552031347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f072c028ea0 con 0x7f0710074d40 2024-04-16T16:16:49.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.449+0000 7fb4d2800640 1 -- 172.21.15.22:0/4201609930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc15c990 msgr2=0x7fb4cc0728b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.449+0000 7fb4d2800640 1 --2- 172.21.15.22:0/4201609930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc15c990 0x7fb4cc0728b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009df0 tx=0x7fb4bc02be70 comp rx=0 tx=0).stop 2024-04-16T16:16:49.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.449+0000 7fb4d2800640 1 -- 172.21.15.22:0/4201609930 shutdown_connections 2024-04-16T16:16:49.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.449+0000 7fb4d2800640 1 --2- 172.21.15.22:0/4201609930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc15c990 0x7fb4cc0728b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.449+0000 7fb4d2800640 1 -- 172.21.15.22:0/4201609930 >> 172.21.15.22:0/4201609930 conn(0x7fb4cc062440 msgr2=0x7fb4cc062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.449+0000 7f5c96a00640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c8006c940 0x7f5c8006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.449+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c9808b740 con 0x7f5ca015eb30 2024-04-16T16:16:49.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb56004b060 con 0x7fb5640361b0 2024-04-16T16:16:49.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7f5c96a00640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7f5c80074b60 0x7f5c80076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 --> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c80077630 con 0x7f5c80074b60 2024-04-16T16:16:49.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5c9808bc20 con 0x7f5ca015eb30 2024-04-16T16:16:49.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7fb4d2800640 1 -- 172.21.15.22:0/4201609930 shutdown_connections 2024-04-16T16:16:49.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7fb4d2800640 1 -- 172.21.15.22:0/4201609930 wait complete. 2024-04-16T16:16:49.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7f5c9ea00640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c8006c940 0x7f5c8006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.450+0000 7fb569600640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f095001a070 con 0x7f095815afe0 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb5600ae140 con 0x7fb5640361b0 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f5a46600640 1 -- 172.21.15.22:0/848408463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401639d0 msgr2=0x7f5a40163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f5a46600640 1 --2- 172.21.15.22:0/848408463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401639d0 0x7f5a40163e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a400cfce0 tx=0x7f5a3802bc70 comp rx=0 tx=0).stop 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f5a46600640 1 -- 172.21.15.22:0/848408463 shutdown_connections 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f5a46600640 1 --2- 172.21.15.22:0/848408463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401639d0 0x7f5a40163e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f5a46600640 1 --2- 172.21.15.22:0/848408463 >> v2:172.21.15.22:3300/0 conn(0x7f5a401635f0 0x7f5a400d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.447+0000 7f5a46600640 1 -- 172.21.15.22:0/848408463 >> 172.21.15.22:0/848408463 conn(0x7f5a40062440 msgr2=0x7f5a40062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.448+0000 7f5a46600640 1 -- 172.21.15.22:0/848408463 shutdown_connections 2024-04-16T16:16:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.448+0000 7f5a46600640 1 -- 172.21.15.22:0/848408463 wait complete. 2024-04-16T16:16:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7fb569600640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fb54c074a90 0x7fb54c076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 --> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb560048e80 con 0x7fb54c074a90 2024-04-16T16:16:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb5600ae4f0 con 0x7fb5640361b0 2024-04-16T16:16:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7f5a46600640 1 Processor -- start 2024-04-16T16:16:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7f5a46600640 1 -- start start 2024-04-16T16:16:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.451+0000 7f5c9e000640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7f5c80074b60 0x7f5c80076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7fb571e00640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fb54c074a90 0x7fb54c076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7fb4d2800640 1 Processor -- start 2024-04-16T16:16:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7fb4d2800640 1 -- start start 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7f094e000640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f093806c9c0 0x7f093806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f095008b7a0 con 0x7f095815afe0 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7f094e000640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7f0938074be0 0x7f0938077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 --> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f095001dec0 con 0x7f0938074be0 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0950092050 con 0x7f095815afe0 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7f5c9e000640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7f5c80074b60 0x7f5c80076f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.453+0000 7f5c9ea00640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c8006c940 0x7f5c8006ee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c9003e040 tx=0x7f5c90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.453+0000 7f0955400640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7f0938074be0 0x7f0938077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7fb571e00640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fb54c074a90 0x7fb54c076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.453+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24d4045070 con 0x7f24dc15f010 2024-04-16T16:16:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.452+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4754027430 con 0x7f4748004800 2024-04-16T16:16:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.453+0000 7f0955e00640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f093806c9c0 0x7f093806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.453+0000 7f5a46600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a400b3620 0x7f5a400aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f475a000640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f474406c8f0 0x7f474406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f475408c550 con 0x7f4748004800 2024-04-16T16:16:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f5a46600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401635f0 0x7f5a4015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f5a46600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a401639d0 0x7f5a4015e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f475a000640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7f4744074b10 0x7f4744076f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 --> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47440775e0 con 0x7f4744074b10 2024-04-16T16:16:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f475408c940 con 0x7f4748004800 2024-04-16T16:16:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f5a46600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5a40164740 con 0x7f5a401639d0 2024-04-16T16:16:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f5a46600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a401643a0 con 0x7f5a401635f0 2024-04-16T16:16:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f5a46600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a401648c0 con 0x7f5a400b3620 2024-04-16T16:16:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f24d8c00640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24bc06c9f0 0x7f24bc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f24d40adab0 con 0x7f24dc15f010 2024-04-16T16:16:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7fb4d2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc072df0 0x7fb4cc148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f5a3fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a401639d0 0x7f5a4015e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.453+0000 7fb570a00640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f0955400640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7f0938074be0 0x7f0938077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== osd.2 v2:172.21.15.22:6800/154267311 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c80077630 con 0x7f5c80074b60 2024-04-16T16:16:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f24d8c00640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7f24bc074c10 0x7f24bc077030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 --> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24bc0776e0 con 0x7f24bc074c10 2024-04-16T16:16:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f24d40adea0 con 0x7f24dc15f010 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7f24dbe00640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7f24bc074c10 0x7f24bc077030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== osd.5 v2:172.21.15.43:6800/3649609022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb560048e80 con 0x7fb54c074a90 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.454+0000 7f5a3fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a401639d0 0x7f5a4015e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59132/0 (socket says 172.21.15.22:59132) 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3fe00640 1 -- 172.21.15.22:0/3707521819 learned_addr learned my addr 172.21.15.22:0/3707521819 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3ea00640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401635f0 0x7f5a4015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3f400640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a400b3620 0x7f5a400aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3fe00640 1 -- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a400b3620 msgr2=0x7f5a400aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3fe00640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a400b3620 0x7f5a400aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3fe00640 1 -- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401635f0 msgr2=0x7f5a4015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3fe00640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a401635f0 0x7f5a4015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f5a3fe00640 1 -- 172.21.15.22:0/3707521819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a400aaa70 con 0x7f5a401639d0 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4d2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4cc0d0bc0 0x7fb4cc15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4d2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc15c990 0x7fb4cc15f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4d2800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc161020 con 0x7fb4cc0d0bc0 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4d2800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc160d40 con 0x7fb4cc15c990 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4caa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4cc0d0bc0 0x7fb4cc15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4d2800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc15cd70 con 0x7fb4cc072df0 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4cb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc072df0 0x7fb4cc148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4cb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc072df0 0x7fb4cc148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:35300/0 (socket says 172.21.15.22:35300) 2024-04-16T16:16:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7fb4cb400640 1 -- 172.21.15.22:0/1730476369 learned_addr learned my addr 172.21.15.22:0/1730476369 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7fb4cbe00640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc15c990 0x7fb4cc15f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f4762800640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7f4744074b10 0x7f4744076f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.455+0000 7f4761400640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f474406c8f0 0x7f474406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7fb570a00640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb54c06c8f0 0x7fb54c06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb564037bd0 tx=0x7fb558009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7f24e0e00640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24bc06c9f0 0x7f24bc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.457+0000 7f5a3fe00640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a401639d0 0x7f5a4015e590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5a38037040 tx=0x7f5a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7fb4cb400640 1 -- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc15c990 msgr2=0x7fb4cc15f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7fb4cb400640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc15c990 0x7fb4cc15f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7fb4cb400640 1 -- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4cc0d0bc0 msgr2=0x7fb4cc15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7fb4cb400640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4cc0d0bc0 0x7fb4cc15f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.456+0000 7fb4cb400640 1 -- 172.21.15.22:0/1730476369 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc148e40 con 0x7fb4cc072df0 2024-04-16T16:16:49.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.457+0000 7fb4caa00640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4cc0d0bc0 0x7fb4cc15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:49.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.457+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38039050 con 0x7f5a401639d0 2024-04-16T16:16:49.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.457+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a38045070 con 0x7f5a401639d0 2024-04-16T16:16:49.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.457+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38034e20 con 0x7f5a401639d0 2024-04-16T16:16:49.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.458+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== osd.1 v2:172.21.15.22:6808/454707647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f095001dec0 con 0x7f0938074be0 2024-04-16T16:16:49.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.458+0000 7f4762800640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7f4744074b10 0x7f4744076f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.457+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a401498b0 con 0x7f5a401639d0 2024-04-16T16:16:49.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.458+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a40149e70 con 0x7f5a401639d0 2024-04-16T16:16:49.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.459+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a4004fd90 con 0x7f5a401639d0 2024-04-16T16:16:49.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.460+0000 7f24e0e00640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24bc06c9f0 0x7f24bc06eeb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24d0001b60 tx=0x7f24d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.460+0000 7f0955e00640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f093806c9c0 0x7f093806ee80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f095815db60 tx=0x7f0948032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.458+0000 7fb4cb400640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc072df0 0x7fb4cc148900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009f10 tx=0x7fb4bc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.460+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc044020 con 0x7fb4cc072df0 2024-04-16T16:16:49.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.460+0000 7f4761400640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f474406c8f0 0x7f474406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f475000aa80 tx=0x7f475003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.460+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc149530 con 0x7fb4cc072df0 2024-04-16T16:16:49.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.461+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== osd.0 v2:172.21.15.22:6817/62943544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47440775e0 con 0x7f4744074b10 2024-04-16T16:16:49.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.462+0000 7f24dbe00640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7f24bc074c10 0x7f24bc077030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.462+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a3804a460 con 0x7f5a401639d0 2024-04-16T16:16:49.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.460+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc149af0 con 0x7fb4cc072df0 2024-04-16T16:16:49.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.462+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4cc04fd90 con 0x7fb4cc072df0 2024-04-16T16:16:49.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.463+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc03a040 con 0x7fb4cc072df0 2024-04-16T16:16:49.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.463+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc044020 con 0x7fb4cc072df0 2024-04-16T16:16:49.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.464+0000 7f5a37400640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5a2006c9c0 0x7f5a2006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.464+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5a380aec50 con 0x7f5a401639d0 2024-04-16T16:16:49.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.464+0000 7f5a3f400640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5a2006c9c0 0x7f5a2006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.464+0000 7f5a37400640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7f5a20074be0 0x7f5a20077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.464+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 --> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a380091a0 con 0x7f5a20074be0 2024-04-16T16:16:49.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.464+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5a380af040 con 0x7f5a401639d0 2024-04-16T16:16:49.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.465+0000 7f5a3ea00640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7f5a20074be0 0x7f5a20077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.465+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== osd.4 v2:172.21.15.43:6808/2374877108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24bc0776e0 con 0x7f24bc074c10 2024-04-16T16:16:49.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.467+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4bc047020 con 0x7fb4cc072df0 2024-04-16T16:16:49.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.466+0000 7f5a3ea00640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7f5a20074be0 0x7f5a20077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.469+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== osd.6 v2:172.21.15.43:6816/748765916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a380091a0 con 0x7f5a20074be0 2024-04-16T16:16:49.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.469+0000 7f5a3f400640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5a2006c9c0 0x7f5a2006ee80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009b60 tx=0x7f5a30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.469+0000 7fb4c3400640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4ac06caf0 0x7fb4ac06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.469+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb4bc0ae730 con 0x7fb4cc072df0 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.469+0000 7fb4c3400640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7fb4ac074d10 0x7fb4ac077130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.469+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 --> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4ac0777e0 con 0x7fb4ac074d10 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.469+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb4bc0aeb20 con 0x7fb4cc072df0 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.470+0000 7fb4caa00640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4ac06caf0 0x7fb4ac06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.471+0000 7fb4caa00640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4ac06caf0 0x7fb4ac06efb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc1600c0 tx=0x7fb4b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.473+0000 7fb4cbe00640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7fb4ac074d10 0x7fb4ac077130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.474+0000 7fb4cbe00640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7fb4ac074d10 0x7fb4ac077130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.476+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== osd.7 v2:172.21.15.43:6821/355389441 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb4ac0777e0 con 0x7fb4ac074d10 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.478+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 --> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0734151eb0 con 0x7f0710074d40 2024-04-16T16:16:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.480+0000 7f072b400640 1 -- 172.21.15.22:0/2572531359 <== osd.3 v2:172.21.15.22:6816/552031347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0734151eb0 con 0x7f0710074d40 2024-04-16T16:16:49.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.480+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7f0710074d40 msgr2=0x7f0710077160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.480+0000 7f0739200640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7f0710074d40 0x7f0710077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.482+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 --> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ca015a800 con 0x7f5c80074b60 2024-04-16T16:16:49.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.482+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f071006cb20 msgr2=0x7f071006efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.482+0000 7f0739200640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f071006cb20 0x7f071006efe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f072403b000 tx=0x7f0724012000 comp rx=0 tx=0).stop 2024-04-16T16:16:49.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.482+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07180037a0 msgr2=0x7f0734150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.482+0000 7f0739200640 1 --2- 172.21.15.22:0/2572531359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07180037a0 0x7f0734150340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f072c00fb40 tx=0x7f072c0021c0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.482+0000 7f0733e00640 1 -- 172.21.15.22:0/2572531359 reap_dead start 2024-04-16T16:16:49.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.483+0000 7f5c96a00640 1 -- 172.21.15.22:0/1443049664 <== osd.2 v2:172.21.15.22:6800/154267311 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ca015a800 con 0x7f5c80074b60 2024-04-16T16:16:49.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.483+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 shutdown_connections 2024-04-16T16:16:49.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.483+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 >> 172.21.15.22:0/2572531359 conn(0x7f0734062440 msgr2=0x7f073406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.483+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 shutdown_connections 2024-04-16T16:16:49.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.483+0000 7f0739200640 1 -- 172.21.15.22:0/2572531359 wait complete. 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.484+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7f5c80074b60 msgr2=0x7f5c80076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.484+0000 7f5c9fe00640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7f5c80074b60 0x7f5c80076f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.487+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c8006c940 msgr2=0x7f5c8006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.487+0000 7f5c9fe00640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c8006c940 0x7f5c8006ee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c9003e040 tx=0x7f5c90008030 comp rx=0 tx=0).stop 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.487+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ca015eb30 msgr2=0x7f5ca00cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.487+0000 7f5c9fe00640 1 --2- 172.21.15.22:0/1443049664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ca015eb30 0x7f5ca00cc040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c780 tx=0x7f5c9800cc40 comp rx=0 tx=0).stop 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.487+0000 7f5c9f400640 1 -- 172.21.15.22:0/1443049664 reap_dead start 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.488+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 shutdown_connections 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.488+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 >> 172.21.15.22:0/1443049664 conn(0x7f5ca0072670 msgr2=0x7f5ca00c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.488+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 shutdown_connections 2024-04-16T16:16:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.488+0000 7f5c9fe00640 1 -- 172.21.15.22:0/1443049664 wait complete. 2024-04-16T16:16:49.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.489+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 --> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb548002dd0 con 0x7fb54c074a90 2024-04-16T16:16:49.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.491+0000 7fb569600640 1 -- 172.21.15.22:0/1439766726 <== osd.5 v2:172.21.15.43:6800/3649609022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb548002dd0 con 0x7fb54c074a90 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.492+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fb54c074a90 msgr2=0x7fb54c076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.492+0000 7fb572800640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fb54c074a90 0x7fb54c076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.493+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb54c06c8f0 msgr2=0x7fb54c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.493+0000 7fb572800640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb54c06c8f0 0x7fb54c06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb564037bd0 tx=0x7fb558009040 comp rx=0 tx=0).stop 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.493+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5640361b0 msgr2=0x7fb5641807a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.493+0000 7fb572800640 1 --2- 172.21.15.22:0/1439766726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5640361b0 0x7fb5641807a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb560033000 tx=0x7fb5600046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.493+0000 7fb571e00640 1 -- 172.21.15.22:0/1439766726 reap_dead start 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.493+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 shutdown_connections 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.493+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 >> 172.21.15.22:0/1439766726 conn(0x7fb5640537b0 msgr2=0x7fb5640e7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.494+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 shutdown_connections 2024-04-16T16:16:49.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.494+0000 7fb572800640 1 -- 172.21.15.22:0/1439766726 wait complete. 2024-04-16T16:16:49.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.495+0000 7f095ce00640 1 -- 172.21.15.22:0/689610383 --> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f095814d850 con 0x7f0938074be0 2024-04-16T16:16:49.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.497+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 --> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f475c0052c0 con 0x7f4744074b10 2024-04-16T16:16:49.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.497+0000 7f094e000640 1 -- 172.21.15.22:0/689610383 <== osd.1 v2:172.21.15.22:6808/454707647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f095814d850 con 0x7f0938074be0 2024-04-16T16:16:49.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.497+0000 7f0943400640 1 -- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7f0938074be0 msgr2=0x7f0938077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.497+0000 7f0943400640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7f0938074be0 0x7f0938077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f0943400640 1 -- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f093806c9c0 msgr2=0x7f093806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f0943400640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f093806c9c0 0x7f093806ee80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f095815db60 tx=0x7f0948032000 comp rx=0 tx=0).stop 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f0943400640 1 -- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 msgr2=0x7f095809ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f0943400640 1 --2- 172.21.15.22:0/689610383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095815afe0 0x7f095809ce10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f095000ca70 tx=0x7f095000cf30 comp rx=0 tx=0).stop 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f0956800640 1 -- 172.21.15.22:0/689610383 reap_dead start 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f0943400640 1 -- 172.21.15.22:0/689610383 shutdown_connections 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f0943400640 1 -- 172.21.15.22:0/689610383 >> 172.21.15.22:0/689610383 conn(0x7f09580b2b20 msgr2=0x7f09580b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.498+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 --> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a40073200 con 0x7f5a20074be0 2024-04-16T16:16:49.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.499+0000 7f5a37400640 1 -- 172.21.15.22:0/3707521819 <== osd.6 v2:172.21.15.43:6816/748765916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5a40073200 con 0x7f5a20074be0 2024-04-16T16:16:49.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.500+0000 7f475a000640 1 -- 172.21.15.22:0/2142354251 <== osd.0 v2:172.21.15.22:6817/62943544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f475c0052c0 con 0x7f4744074b10 2024-04-16T16:16:49.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.500+0000 7f0943400640 1 -- 172.21.15.22:0/689610383 shutdown_connections 2024-04-16T16:16:49.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.500+0000 7f0943400640 1 -- 172.21.15.22:0/689610383 wait complete. 2024-04-16T16:16:49.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.500+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7f5a20074be0 msgr2=0x7f5a20077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.500+0000 7f5a46600640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7f5a20074be0 0x7f5a20077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.500+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7f4744074b10 msgr2=0x7f4744076f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.500+0000 7f4763200640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7f4744074b10 0x7f4744076f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 --> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f24dc04fd90 con 0x7f24bc074c10 2024-04-16T16:16:49.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f474406c8f0 msgr2=0x7f474406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f4763200640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f474406c8f0 0x7f474406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f475000aa80 tx=0x7f475003b040 comp rx=0 tx=0).stop 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4748004800 msgr2=0x7f475c0c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f4763200640 1 --2- 172.21.15.22:0/2142354251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4748004800 0x7f475c0c8c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4754000f60 tx=0x7f47540077a0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f4762800640 1 -- 172.21.15.22:0/2142354251 reap_dead start 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5a2006c9c0 msgr2=0x7f5a2006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f5a46600640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5a2006c9c0 0x7f5a2006ee80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009b60 tx=0x7f5a30008040 comp rx=0 tx=0).stop 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a401639d0 msgr2=0x7f5a4015e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f5a46600640 1 --2- 172.21.15.22:0/3707521819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a401639d0 0x7f5a4015e590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5a38037040 tx=0x7f5a38004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:49.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f5a3fe00640 1 -- 172.21.15.22:0/3707521819 reap_dead start 2024-04-16T16:16:49.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 shutdown_connections 2024-04-16T16:16:49.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 >> 172.21.15.22:0/2142354251 conn(0x7f475c009fb0 msgr2=0x7f475c0056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 shutdown_connections 2024-04-16T16:16:49.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.501+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 >> 172.21.15.22:0/3707521819 conn(0x7f5a40062440 msgr2=0x7f5a40162800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.502+0000 7f24d8c00640 1 -- 172.21.15.22:0/4131996952 <== osd.4 v2:172.21.15.43:6808/2374877108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f24dc04fd90 con 0x7f24bc074c10 2024-04-16T16:16:49.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.502+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 shutdown_connections 2024-04-16T16:16:49.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.502+0000 7f4763200640 1 -- 172.21.15.22:0/2142354251 wait complete. 2024-04-16T16:16:49.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.502+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7f24bc074c10 msgr2=0x7f24bc077030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.502+0000 7f24e3800640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7f24bc074c10 0x7f24bc077030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.503+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 shutdown_connections 2024-04-16T16:16:49.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.503+0000 7f5a46600640 1 -- 172.21.15.22:0/3707521819 wait complete. 2024-04-16T16:16:49.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.504+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24bc06c9f0 msgr2=0x7f24bc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.504+0000 7f24e3800640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f24bc06c9f0 0x7f24bc06eeb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24d0001b60 tx=0x7f24d0009040 comp rx=0 tx=0).stop 2024-04-16T16:16:49.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.504+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc15f010 msgr2=0x7f24dc15bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.504+0000 7f24e3800640 1 --2- 172.21.15.22:0/4131996952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24dc15f010 0x7f24dc15bc30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098c0 tx=0x7f24d40046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.504+0000 7f24e1800640 1 -- 172.21.15.22:0/4131996952 reap_dead start 2024-04-16T16:16:49.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.505+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 shutdown_connections 2024-04-16T16:16:49.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.505+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 >> 172.21.15.22:0/4131996952 conn(0x7f24dc062440 msgr2=0x7f24dc15c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.506+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 --> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4cc149f40 con 0x7fb4ac074d10 2024-04-16T16:16:49.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.507+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 shutdown_connections 2024-04-16T16:16:49.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.507+0000 7fb4c3400640 1 -- 172.21.15.22:0/1730476369 <== osd.7 v2:172.21.15.43:6821/355389441 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4cc149f40 con 0x7fb4ac074d10 2024-04-16T16:16:49.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.507+0000 7f24e3800640 1 -- 172.21.15.22:0/4131996952 wait complete. 2024-04-16T16:16:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.510+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7fb4ac074d10 msgr2=0x7fb4ac077130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.510+0000 7fb4d2800640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7fb4ac074d10 0x7fb4ac077130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.511+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4ac06caf0 msgr2=0x7fb4ac06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.511+0000 7fb4d2800640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4ac06caf0 0x7fb4ac06efb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc1600c0 tx=0x7fb4b8009040 comp rx=0 tx=0).stop 2024-04-16T16:16:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.511+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc072df0 msgr2=0x7fb4cc148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.511+0000 7fb4d2800640 1 --2- 172.21.15.22:0/1730476369 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4cc072df0 0x7fb4cc148900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009f10 tx=0x7fb4bc004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.512+0000 7fb4cbe00640 1 -- 172.21.15.22:0/1730476369 reap_dead start 2024-04-16T16:16:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.512+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 shutdown_connections 2024-04-16T16:16:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.512+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 >> 172.21.15.22:0/1730476369 conn(0x7fb4cc062440 msgr2=0x7fb4cc0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.512+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 shutdown_connections 2024-04-16T16:16:49.527 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2024-04-16T16:16:49.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T16:16:49.528 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2024-04-16T16:16:49.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T16:16:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.512+0000 7fb4d2800640 1 -- 172.21.15.22:0/1730476369 wait complete. 2024-04-16T16:16:49.530 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2024-04-16T16:16:49.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T16:16:49.531 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2024-04-16T16:16:49.531 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T16:16:49.532 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2024-04-16T16:16:49.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T16:16:49.536 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2024-04-16T16:16:49.536 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:49.537 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T16:16:49.537 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2024-04-16T16:16:49.537 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T16:16:49.538 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T16:16:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.822+0000 7f53f3e00640 1 Processor -- start 2024-04-16T16:16:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.822+0000 7fc254c00640 1 Processor -- start 2024-04-16T16:16:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.822+0000 7f53f3e00640 1 -- start start 2024-04-16T16:16:49.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.822+0000 7fc254c00640 1 -- start start 2024-04-16T16:16:49.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.825+0000 7fc254c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2500b5510 0x7fc25015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.825+0000 7fc254c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2501633a0 con 0x7fc25006ce50 2024-04-16T16:16:49.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.825+0000 7fc254c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc250163680 con 0x7fc2500d0a90 2024-04-16T16:16:49.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.825+0000 7fc254c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc250163960 con 0x7fc2500b5510 2024-04-16T16:16:49.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.825+0000 7f53f3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53f40729a0 0x7f53f40b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7f53ea000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f53f415f0e0 0x7f53f406d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43776/0 (socket says 172.21.15.22:43776) 2024-04-16T16:16:49.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7fc24de00640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc2500d0a90 0x7fc25006eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:41970/0 (socket says 172.21.15.22:41970) 2024-04-16T16:16:49.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7f53ea000640 1 -- 172.21.15.22:0/137258142 learned_addr learned my addr 172.21.15.22:0/137258142 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f4070f10 con 0x7f53f415f0e0 2024-04-16T16:16:49.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7fc24e800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2500b5510 0x7fc25015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f40711f0 con 0x7f53f415e520 2024-04-16T16:16:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f53f406cc90 con 0x7f53f40729a0 2024-04-16T16:16:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7fc24e800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2500b5510 0x7fc25015fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:52196/0 (socket says 172.21.15.22:52196) 2024-04-16T16:16:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.826+0000 7fc24e800640 1 -- 172.21.15.22:0/1587570849 learned_addr learned my addr 172.21.15.22:0/1587570849 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.827+0000 7fc24ca00640 1 -- 172.21.15.22:0/1587570849 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942333387 0 0) 0x7fc250163680 con 0x7fc2500d0a90 2024-04-16T16:16:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.827+0000 7fc24ca00640 1 -- 172.21.15.22:0/1587570849 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc234003520 con 0x7fc2500d0a90 2024-04-16T16:16:49.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.827+0000 7f53f3400640 1 --2- 172.21.15.22:0/137258142 >> v2:172.21.15.22:3300/0 conn(0x7f53f40729a0 0x7f53f40b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.828+0000 7f53f2000640 1 -- 172.21.15.22:0/137258142 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847295979 0 0) 0x7f53f4070f10 con 0x7f53f415f0e0 2024-04-16T16:16:49.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.828+0000 7f53f2000640 1 -- 172.21.15.22:0/137258142 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d8003520 con 0x7f53f415f0e0 2024-04-16T16:16:49.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.828+0000 7fc24e800640 1 -- 172.21.15.22:0/1587570849 >> v1:172.21.15.43:6789/0 conn(0x7fc2500d0a90 legacy=0x7fc25006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.828+0000 7fc24e800640 1 -- 172.21.15.22:0/1587570849 >> v1:172.21.15.22:6789/0 conn(0x7fc25006ce50 legacy=0x7fc2500b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.828+0000 7fc24e800640 1 -- 172.21.15.22:0/1587570849 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc250163c40 con 0x7fc2500b5510 2024-04-16T16:16:49.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.829+0000 7f53f2000640 1 -- 172.21.15.22:0/137258142 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109143154 0 0) 0x7f53f40711f0 con 0x7f53f415e520 2024-04-16T16:16:49.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.829+0000 7f53f2000640 1 -- 172.21.15.22:0/137258142 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53f4070f10 con 0x7f53f415e520 2024-04-16T16:16:49.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.830+0000 7fc24e800640 1 --2- 172.21.15.22:0/1587570849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500b5510 0x7fc25015fed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc248009e50 tx=0x7fc24802c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180f7b3d608a729c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.830+0000 7f53f3400640 1 -- 172.21.15.22:0/137258142 >> v1:172.21.15.43:6789/0 conn(0x7f53f415e520 legacy=0x7f53f415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.830+0000 7f53f3400640 1 -- 172.21.15.22:0/137258142 >> v1:172.21.15.22:6789/0 conn(0x7f53f415f0e0 legacy=0x7f53f406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.830+0000 7f53f3400640 1 -- 172.21.15.22:0/137258142 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f406cf70 con 0x7f53f40729a0 2024-04-16T16:16:49.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.831+0000 7fc24ca00640 1 -- 172.21.15.22:0/1587570849 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24802cbe0 con 0x7fc2500b5510 2024-04-16T16:16:49.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.831+0000 7fc24ca00640 1 -- 172.21.15.22:0/1587570849 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24802cd80 con 0x7fc2500b5510 2024-04-16T16:16:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.831+0000 7fc24ca00640 1 -- 172.21.15.22:0/1587570849 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480345f0 con 0x7fc2500b5510 2024-04-16T16:16:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.831+0000 7f1a77200640 1 Processor -- start 2024-04-16T16:16:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.831+0000 7f1a77200640 1 -- start start 2024-04-16T16:16:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.832+0000 7fc254c00640 1 -- 172.21.15.22:0/1587570849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500b5510 msgr2=0x7fc25015fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.832+0000 7fc254c00640 1 --2- 172.21.15.22:0/1587570849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500b5510 0x7fc25015fed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc248009e50 tx=0x7fc24802c040 comp rx=0 tx=0).stop 2024-04-16T16:16:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.832+0000 7f53f3400640 1 --2- 172.21.15.22:0/137258142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f40729a0 0x7f53f40b3410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0097a0 tx=0x7f53ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22ae194d1d6e5f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.832+0000 7fc254c00640 1 -- 172.21.15.22:0/1587570849 shutdown_connections 2024-04-16T16:16:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7fc254c00640 1 --2- 172.21.15.22:0/1587570849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500b5510 0x7fc25015fed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7fc254c00640 1 -- 172.21.15.22:0/1587570849 >> 172.21.15.22:0/1587570849 conn(0x7fc250075070 msgr2=0x7fc250062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.832+0000 7f1a77200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a7015eb30 0x7f1a700d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7f1a77200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a700d2fb0 0x7f1a700b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7f1a77200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a700d4650 con 0x7f1a700d1770 2024-04-16T16:16:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7f1a77200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7015ef10 con 0x7f1a700d2fb0 2024-04-16T16:16:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7f1a77200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1a700d1bb0 con 0x7f1a7015eb30 2024-04-16T16:16:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.832+0000 7f53f2000640 1 -- 172.21.15.22:0/137258142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0315a0 con 0x7f53f40729a0 2024-04-16T16:16:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7f1a75400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1a700d1770 0x7f1a700d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35070/0 (socket says 172.21.15.22:35070) 2024-04-16T16:16:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7f1a75400640 1 -- 172.21.15.22:0/2861944429 learned_addr learned my addr 172.21.15.22:0/2861944429 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.834+0000 7f1a76800640 1 --2- 172.21.15.22:0/2861944429 >> v2:172.21.15.43:3300/0 conn(0x7f1a700d2fb0 0x7f1a700b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7f53f2000640 1 -- 172.21.15.22:0/137258142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec037070 con 0x7f53f40729a0 2024-04-16T16:16:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7fc254c00640 1 -- 172.21.15.22:0/1587570849 shutdown_connections 2024-04-16T16:16:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.833+0000 7fc254c00640 1 -- 172.21.15.22:0/1587570849 wait complete. 2024-04-16T16:16:49.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.834+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f40729a0 msgr2=0x7f53f40b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.834+0000 7f53f3e00640 1 --2- 172.21.15.22:0/137258142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f40729a0 0x7f53f40b3410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0097a0 tx=0x7f53ec02b840 comp rx=0 tx=0).stop 2024-04-16T16:16:49.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.834+0000 7f1a75e00640 1 --2- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a7015eb30 0x7f1a700d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.835+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 shutdown_connections 2024-04-16T16:16:49.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.835+0000 7f53f3e00640 1 --2- 172.21.15.22:0/137258142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f40729a0 0x7f53f40b3410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.835+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 >> 172.21.15.22:0/137258142 conn(0x7f53f4062440 msgr2=0x7f53f4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.834+0000 7f1a74a00640 1 -- 172.21.15.22:0/2861944429 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059568603 0 0) 0x7f1a700d4650 con 0x7f1a700d1770 2024-04-16T16:16:49.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.835+0000 7f1a76800640 1 -- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a7015eb30 msgr2=0x7f1a700d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.835+0000 7f1a76800640 1 --2- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a7015eb30 0x7f1a700d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.835+0000 7f1a76800640 1 -- 172.21.15.22:0/2861944429 >> v1:172.21.15.22:6789/0 conn(0x7f1a700d1770 legacy=0x7f1a700d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.835+0000 7f1a76800640 1 -- 172.21.15.22:0/2861944429 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a700d35b0 con 0x7f1a700d2fb0 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.836+0000 7f1a75e00640 1 --2- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a7015eb30 0x7f1a700d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.836+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 shutdown_connections 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.836+0000 7f53f3e00640 1 -- 172.21.15.22:0/137258142 wait complete. 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.837+0000 7fc254c00640 1 Processor -- start 2024-04-16T16:16:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.837+0000 7fc254c00640 1 -- start start 2024-04-16T16:16:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.837+0000 7f1a76800640 1 --2- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a700d2fb0 0x7f1a700b7950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a680097a0 tx=0x7f1a6802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b4303fbacb875 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.838+0000 7f1a74a00640 1 -- 172.21.15.22:0/2861944429 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68035020 con 0x7f1a700d2fb0 2024-04-16T16:16:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.838+0000 7f1a74a00640 1 -- 172.21.15.22:0/2861944429 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68031830 con 0x7f1a700d2fb0 2024-04-16T16:16:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.838+0000 7f1a74a00640 1 -- 172.21.15.22:0/2861944429 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68031c40 con 0x7f1a700d2fb0 2024-04-16T16:16:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.838+0000 7fc254c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc25006ce50 0x7fc2501607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.838+0000 7fc254c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2500b5510 0x7fc2500ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.838+0000 7fc254c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500d0a90 0x7fc2500ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.839+0000 7f7067200640 1 Processor -- start 2024-04-16T16:16:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.839+0000 7f7067200640 1 -- start start 2024-04-16T16:16:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.839+0000 7f1a77200640 1 -- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a700d2fb0 msgr2=0x7f1a700b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.839+0000 7f1a77200640 1 --2- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a700d2fb0 0x7f1a700b7950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a680097a0 tx=0x7f1a6802b8d0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7f1a77200640 1 -- 172.21.15.22:0/2861944429 shutdown_connections 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7f1a77200640 1 --2- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a700d2fb0 0x7f1a700b7950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7f1a77200640 1 --2- 172.21.15.22:0/2861944429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a7015eb30 0x7f1a700d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7f1a77200640 1 -- 172.21.15.22:0/2861944429 >> 172.21.15.22:0/2861944429 conn(0x7f1a70072670 msgr2=0x7f1a70062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc24d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2500b5510 0x7fc2500ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc24d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2500b5510 0x7fc2500ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58084/0 (socket says 172.21.15.22:58084) 2024-04-16T16:16:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7f53f3e00640 1 Processor -- start 2024-04-16T16:16:49.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc24d400640 1 -- 172.21.15.22:0/189109209 learned_addr learned my addr 172.21.15.22:0/189109209 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc24e800640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500d0a90 0x7fc2500ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc24de00640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc25006ce50 0x7fc2501607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc254c00640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc250072730 con 0x7fc2500b5510 2024-04-16T16:16:49.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7f53f3e00640 1 -- start start 2024-04-16T16:16:49.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc254c00640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2500725b0 con 0x7fc2500d0a90 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.840+0000 7fc254c00640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc2500728b0 con 0x7fc25006ce50 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7f7067200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f70601633f0 0x7f70600d37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7f7067200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70600cfaf0 con 0x7f70601679d0 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7f7067200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70600d29e0 con 0x7f7060163010 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7f7067200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f70600d3ce0 con 0x7f70601633f0 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7fc24e800640 1 -- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc25006ce50 msgr2=0x7fc2501607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7fc24e800640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc25006ce50 0x7fc2501607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7fc24e800640 1 -- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2500b5510 msgr2=0x7fc2500ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7f705f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f70601633f0 0x7f70600d37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7f705f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f70601633f0 0x7f70600d37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58090/0 (socket says 172.21.15.22:58090) 2024-04-16T16:16:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.841+0000 7f705f400640 1 -- 172.21.15.22:0/3379050352 learned_addr learned my addr 172.21.15.22:0/3379050352 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.842+0000 7fc24e800640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2500b5510 0x7fc2500ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.842+0000 7fc24e800640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2500af2a0 con 0x7fc2500d0a90 2024-04-16T16:16:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.842+0000 7fc24de00640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc25006ce50 0x7fc2501607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.842+0000 7fc24d400640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2500b5510 0x7fc2500ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.842+0000 7f53f3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53f40729a0 0x7f53f4144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f53f3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f415e520 0x7f53f414b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f705f400640 1 -- 172.21.15.22:0/3379050352 >> v1:172.21.15.43:6789/0 conn(0x7f7060163010 legacy=0x7f70600cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f705f400640 1 -- 172.21.15.22:0/3379050352 >> v1:172.21.15.22:6789/0 conn(0x7f70601679d0 legacy=0x7f70600d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f53f3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53f415f0e0 0x7f53f4149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f53f3e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4155360 con 0x7f53f415e520 2024-04-16T16:16:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f53f3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41551e0 con 0x7f53f40729a0 2024-04-16T16:16:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7fc24e800640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500d0a90 0x7fc2500ab150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc248032000 tx=0x7fc248004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f705f400640 1 -- 172.21.15.22:0/3379050352 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70600d2cc0 con 0x7f70601633f0 2024-04-16T16:16:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.842+0000 7f1a77200640 1 -- 172.21.15.22:0/2861944429 shutdown_connections 2024-04-16T16:16:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.843+0000 7f53f3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f53f4072dd0 con 0x7f53f415f0e0 2024-04-16T16:16:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7f53f2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53f40729a0 0x7f53f4144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7f53f3400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53f415f0e0 0x7f53f4149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7f53ea000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f415e520 0x7f53f414b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7f53f3400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53f415f0e0 0x7f53f4149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:57736/0 (socket says 172.21.15.22:57736) 2024-04-16T16:16:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7f53f3400640 1 -- 172.21.15.22:0/3139258275 learned_addr learned my addr 172.21.15.22:0/3139258275 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7fc246000640 1 -- 172.21.15.22:0/189109209 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248042020 con 0x7fc2500d0a90 2024-04-16T16:16:49.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7fc254c00640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2500af580 con 0x7fc2500d0a90 2024-04-16T16:16:49.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.845+0000 7fc254c00640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2500aac30 con 0x7fc2500d0a90 2024-04-16T16:16:49.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.845+0000 7fc246000640 1 -- 172.21.15.22:0/189109209 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2480094d0 con 0x7fc2500d0a90 2024-04-16T16:16:49.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.845+0000 7fc246000640 1 -- 172.21.15.22:0/189109209 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248042020 con 0x7fc2500d0a90 2024-04-16T16:16:49.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.846+0000 7f53ea000640 1 -- 172.21.15.22:0/3139258275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53f415f0e0 msgr2=0x7f53f4149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.846+0000 7f53ea000640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53f415f0e0 0x7f53f4149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.845+0000 7ff7eae00640 1 Processor -- start 2024-04-16T16:16:49.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.845+0000 7ff7eae00640 1 -- start start 2024-04-16T16:16:49.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.844+0000 7f1a77200640 1 -- 172.21.15.22:0/2861944429 wait complete. 2024-04-16T16:16:49.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.846+0000 7f1a77200640 1 Processor -- start 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.846+0000 7f53ea000640 1 -- 172.21.15.22:0/3139258275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53f40729a0 msgr2=0x7f53f4144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.846+0000 7f53ea000640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53f40729a0 0x7f53f4144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.846+0000 7f53ea000640 1 -- 172.21.15.22:0/3139258275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f414a540 con 0x7f53f415e520 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7f53ea000640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f415e520 0x7f53f414b5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53e400ce40 tx=0x7f53e400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7f1a77200640 1 -- start start 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a77200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a700d1770 0x7f1a700ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a77200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a700d2fb0 0x7f1a7015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7f53eb400640 1 -- 172.21.15.22:0/3139258275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4017070 con 0x7f53f415e520 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7f53eb400640 1 -- 172.21.15.22:0/3139258275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e400ad40 con 0x7f53f415e520 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7f53eb400640 1 -- 172.21.15.22:0/3139258275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4012600 con 0x7f53f415e520 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f414a820 con 0x7f53f415e520 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.848+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f414ade0 con 0x7f53f415e520 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc224005290 con 0x7fc2500d0a90 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7ff7eae00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7dc009da0 0x7ff7dc0e2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7ff7eae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc051690 0x7ff7dc00a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.847+0000 7ff7eae00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7dc0e4cf0 0x7ff7dc0e5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.848+0000 7ff7eae00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff7dc00a6c0 con 0x7ff7dc0e4cf0 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.848+0000 7ff7eae00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff7dc051e80 con 0x7ff7dc009da0 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.848+0000 7ff7eae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff7dc052160 con 0x7ff7dc051690 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.848+0000 7ff7e9a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7dc009da0 0x7ff7dc0e2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.848+0000 7ff7e9000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc051690 0x7ff7dc00a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7dc009da0 0x7ff7dc0e2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:58474/0 (socket says 172.21.15.22:58474) 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9a00640 1 -- 172.21.15.22:0/276500874 learned_addr learned my addr 172.21.15.22:0/276500874 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc051690 0x7ff7dc00a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:57750/0 (socket says 172.21.15.22:57750) 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7ea400640 1 --2- 172.21.15.22:0/276500874 >> v2:172.21.15.22:3300/0 conn(0x7ff7dc0e4cf0 0x7ff7dc0e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f25a9400640 1 Processor -- start 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9a00640 1 -- 172.21.15.22:0/276500874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc051690 msgr2=0x7ff7dc00a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9a00640 1 --2- 172.21.15.22:0/276500874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc051690 0x7ff7dc00a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9a00640 1 -- 172.21.15.22:0/276500874 >> v2:172.21.15.22:3300/0 conn(0x7ff7dc0e4cf0 msgr2=0x7ff7dc0e5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9a00640 1 --2- 172.21.15.22:0/276500874 >> v2:172.21.15.22:3300/0 conn(0x7ff7dc0e4cf0 0x7ff7dc0e5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7ff7e9a00640 1 -- 172.21.15.22:0/276500874 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc0e2c90 con 0x7ff7dc009da0 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a77200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7015eb30 0x7f1a70200390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a77200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1a700d3e50 con 0x7f1a700d1770 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a77200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a700d3b70 con 0x7f1a7015eb30 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a77200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1a700d4130 con 0x7f1a700d2fb0 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a75e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a700d1770 0x7f1a700ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a75e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a700d1770 0x7f1a700ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58128/0 (socket says 172.21.15.22:58128) 2024-04-16T16:16:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f1a75e00640 1 -- 172.21.15.22:0/240538432 learned_addr learned my addr 172.21.15.22:0/240538432 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.850+0000 7f1a75400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a700d2fb0 0x7f1a7015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.849+0000 7f705f400640 1 --2- 172.21.15.22:0/3379050352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70601633f0 0x7f70600d37a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7050009870 tx=0x7f705002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89f65484ee9d8f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.850+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53cc005290 con 0x7f53f415e520 2024-04-16T16:16:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.850+0000 7f25a9400640 1 -- start start 2024-04-16T16:16:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f1a76800640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7015eb30 0x7f1a70200390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.850+0000 7f705ea00640 1 -- 172.21.15.22:0/3379050352 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050034070 con 0x7f70601633f0 2024-04-16T16:16:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f1a75e00640 1 -- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a700d2fb0 msgr2=0x7f1a7015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f1a75e00640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a700d2fb0 0x7f1a7015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f1a75e00640 1 -- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7015eb30 msgr2=0x7f1a70200390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f1a75e00640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7015eb30 0x7f1a70200390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f1a75e00640 1 -- 172.21.15.22:0/240538432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a70204830 con 0x7f1a700d1770 2024-04-16T16:16:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f705ea00640 1 -- 172.21.15.22:0/3379050352 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7050030860 con 0x7f70601633f0 2024-04-16T16:16:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f705ea00640 1 -- 172.21.15.22:0/3379050352 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050030c30 con 0x7f70601633f0 2024-04-16T16:16:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7fc246000640 1 -- 172.21.15.22:0/189109209 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc248045020 con 0x7fc2500d0a90 2024-04-16T16:16:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.851+0000 7f1a75e00640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a700d1770 0x7f1a700ce440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00cf60 tx=0x7f1a6c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f1a66000640 1 -- 172.21.15.22:0/240538432 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c01a070 con 0x7f1a700d1770 2024-04-16T16:16:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f1a77200640 1 -- 172.21.15.22:0/240538432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a70204b10 con 0x7f1a700d1770 2024-04-16T16:16:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f1a77200640 1 -- 172.21.15.22:0/240538432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a702050d0 con 0x7f1a700d1770 2024-04-16T16:16:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f1a66000640 1 -- 172.21.15.22:0/240538432 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00d840 con 0x7f1a700d1770 2024-04-16T16:16:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f25a9400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25a41635f0 0x7f25a40d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f25a9400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f25a40b3620 0x7f25a4071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7ff7e9a00640 1 --2- 172.21.15.22:0/276500874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc009da0 0x7ff7dc0e2200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc039830 tx=0x7ff7d802fd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9805d4b4edc6c63 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f7067200640 1 -- 172.21.15.22:0/3379050352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70601633f0 msgr2=0x7f70600d37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f7067200640 1 --2- 172.21.15.22:0/3379050352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70601633f0 0x7f70600d37a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7050009870 tx=0x7f705002b9a0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f7067200640 1 -- 172.21.15.22:0/3379050352 shutdown_connections 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f7067200640 1 --2- 172.21.15.22:0/3379050352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70601633f0 0x7f70600d37a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.852+0000 7f7067200640 1 -- 172.21.15.22:0/3379050352 >> 172.21.15.22:0/3379050352 conn(0x7f7060072490 msgr2=0x7f70600728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7f7067200640 1 -- 172.21.15.22:0/3379050352 shutdown_connections 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7f7067200640 1 -- 172.21.15.22:0/3379050352 wait complete. 2024-04-16T16:16:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7fc246000640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc23006caf0 0x7fc23006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7f25a2800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25a41635f0 0x7f25a40d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7f25a9400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a40d1070 con 0x7f25a41639d0 2024-04-16T16:16:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7f25a2800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25a41635f0 0x7f25a40d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:58490/0 (socket says 172.21.15.22:58490) 2024-04-16T16:16:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7f25a2800640 1 -- 172.21.15.22:0/3483482426 learned_addr learned my addr 172.21.15.22:0/3483482426 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7f25a9400640 1 -- 172.21.15.22:0/3483482426 --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f25a40b3b50 con 0x7f25a40b3620 2024-04-16T16:16:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.854+0000 7f25a9400640 1 -- 172.21.15.22:0/3483482426 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f25a40d0050 con 0x7f25a41635f0 2024-04-16T16:16:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.854+0000 7f1a66000640 1 -- 172.21.15.22:0/240538432 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00dbf0 con 0x7f1a700d1770 2024-04-16T16:16:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.854+0000 7fa88da00640 1 Processor -- start 2024-04-16T16:16:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.853+0000 7fc246000640 1 -- 172.21.15.22:0/189109209 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc2480adef0 con 0x7fc2500d0a90 2024-04-16T16:16:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.854+0000 7fa88da00640 1 -- start start 2024-04-16T16:16:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.854+0000 7fc24de00640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc23006caf0 0x7fc23006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.854+0000 7f53eb400640 1 -- 172.21.15.22:0/3139258275 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53e401a070 con 0x7f53f415e520 2024-04-16T16:16:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.855+0000 7f25a2800640 1 -- 172.21.15.22:0/3483482426 >> v2:172.21.15.22:3300/0 conn(0x7f25a40b3620 msgr2=0x7f25a4071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.855+0000 7f25a2800640 1 --2- 172.21.15.22:0/3483482426 >> v2:172.21.15.22:3300/0 conn(0x7f25a40b3620 0x7f25a4071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.855+0000 7f25a2800640 1 -- 172.21.15.22:0/3483482426 >> v1:172.21.15.43:6789/0 conn(0x7f25a41639d0 legacy=0x7f25a4163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.855+0000 7f25a2800640 1 -- 172.21.15.22:0/3483482426 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a40d0330 con 0x7f25a41635f0 2024-04-16T16:16:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.855+0000 7f1a77200640 1 -- 172.21.15.22:0/240538432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a50005290 con 0x7f1a700d1770 2024-04-16T16:16:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7f7067200640 1 Processor -- start 2024-04-16T16:16:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa88da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa8880b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa88da00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8880d3fa0 0x7fa8880cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa88da00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa8880cfb50 0x7fa8880d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa88da00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa8880ba150 con 0x7fa8880d3fa0 2024-04-16T16:16:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa88da00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa8880ba430 con 0x7fa8880cfb50 2024-04-16T16:16:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa88da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa8880ba710 con 0x7fa88815e940 2024-04-16T16:16:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fc24de00640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc23006caf0 0x7fc23006efb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2400011e0 tx=0x7fc240007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa887400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8880d3fa0 0x7fa8880cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa887400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8880d3fa0 0x7fa8880cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58148/0 (socket says 172.21.15.22:58148) 2024-04-16T16:16:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7fa887400640 1 -- 172.21.15.22:0/1959105348 learned_addr learned my addr 172.21.15.22:0/1959105348 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7f53eb400640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f53d006c9c0 0x7f53d006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7f25a2800640 1 --2- 172.21.15.22:0/3483482426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41635f0 0x7f25a40d0b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25a41645d0 tx=0x7f259c02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15317d2cf35c8d66 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7f53eb400640 1 -- 172.21.15.22:0/3139258275 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f53e408c0d0 con 0x7f53f415e520 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa88d000640 1 --2- 172.21.15.22:0/1959105348 >> v2:172.21.15.43:3300/0 conn(0x7fa8880cfb50 0x7fa8880d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa887400640 1 -- 172.21.15.22:0/1959105348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 msgr2=0x7fa8880b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa887e00640 1 --2- 172.21.15.22:0/1959105348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa8880b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa887400640 1 --2- 172.21.15.22:0/1959105348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa8880b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa887400640 1 -- 172.21.15.22:0/1959105348 >> v2:172.21.15.43:3300/0 conn(0x7fa8880cfb50 msgr2=0x7fa8880d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa887400640 1 --2- 172.21.15.22:0/1959105348 >> v2:172.21.15.43:3300/0 conn(0x7fa8880cfb50 0x7fa8880d2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa887400640 1 -- 172.21.15.22:0/1959105348 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8880cee10 con 0x7fa8880d3fa0 2024-04-16T16:16:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7fa887e00640 1 --2- 172.21.15.22:0/1959105348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa8880b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.857+0000 7f53f2a00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f53d006c9c0 0x7f53d006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.856+0000 7f7067200640 1 -- start start 2024-04-16T16:16:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.858+0000 7f53f2a00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f53d006c9c0 0x7f53d006ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001010 tx=0x7f53dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.858+0000 7f7067200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060163010 0x7f70600ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.858+0000 7f7067200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70601633f0 0x7f7060161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.858+0000 7f7067200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70601679d0 0x7f7060153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.858+0000 7f705fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060163010 0x7f70600ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.858+0000 7f705fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060163010 0x7f70600ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58156/0 (socket says 172.21.15.22:58156) 2024-04-16T16:16:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.858+0000 7fa887400640 1 --2- 172.21.15.22:0/1959105348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa8880cf610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa8880ba640 tx=0x7fa87802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee20200945e8c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f705fe00640 1 -- 172.21.15.22:0/3536826520 learned_addr learned my addr 172.21.15.22:0/3536826520 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70600d2360 con 0x7f7060163010 2024-04-16T16:16:49.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f70600d21e0 con 0x7f70601633f0 2024-04-16T16:16:49.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f2047200640 1 Processor -- start 2024-04-16T16:16:49.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f705f400640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70601633f0 0x7f7060161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f70600b7a10 con 0x7f70601679d0 2024-04-16T16:16:49.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f2047200640 1 -- start start 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.859+0000 7f7065200640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70601679d0 0x7f7060153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f705fe00640 1 -- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70601679d0 msgr2=0x7f7060153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f705fe00640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70601679d0 0x7f7060153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f705fe00640 1 -- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70601633f0 msgr2=0x7f7060161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f705fe00640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70601633f0 0x7f7060161bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f705fe00640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706006ede0 con 0x7f7060163010 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f705f400640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70601633f0 0x7f7060161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f705fe00640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060163010 0x7f70600ce6d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f705800c870 tx=0x7f705800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.860+0000 7f2047200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f20400d1940 0x7f20400d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.861+0000 7f2047200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20400d4650 con 0x7f204015eb30 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.861+0000 7f2047200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f204015ef10 con 0x7f20400d2de0 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.861+0000 7f2047200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f20400d35b0 con 0x7f20400d1940 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.861+0000 7f2045e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f204015eb30 0x7f20400d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35082/0 (socket says 172.21.15.22:35082) 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.861+0000 7f2045e00640 1 -- 172.21.15.22:0/1917582187 learned_addr learned my addr 172.21.15.22:0/1917582187 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.861+0000 7f2045400640 1 --2- 172.21.15.22:0/1917582187 >> v2:172.21.15.43:3300/0 conn(0x7f20400d1940 0x7f20400d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7f2045400640 1 -- 172.21.15.22:0/1917582187 >> v1:172.21.15.43:6789/0 conn(0x7f20400d2de0 legacy=0x7f20400b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7f2045400640 1 -- 172.21.15.22:0/1917582187 >> v1:172.21.15.22:6789/0 conn(0x7f204015eb30 legacy=0x7f20400d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7f2045400640 1 -- 172.21.15.22:0/1917582187 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20400d3890 con 0x7f20400d1940 2024-04-16T16:16:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7f53eb400640 1 -- 172.21.15.22:0/3139258275 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53e4059e90 con 0x7f53f415e520 2024-04-16T16:16:49.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7f7057e00640 1 -- 172.21.15.22:0/3536826520 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058003b70 con 0x7f7060163010 2024-04-16T16:16:49.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7fa886a00640 1 -- 172.21.15.22:0/1959105348 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878034070 con 0x7fa8880d3fa0 2024-04-16T16:16:49.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7fa886a00640 1 -- 172.21.15.22:0/1959105348 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa878030860 con 0x7fa8880d3fa0 2024-04-16T16:16:49.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7fa886a00640 1 -- 172.21.15.22:0/1959105348 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878030c30 con 0x7fa8880d3fa0 2024-04-16T16:16:49.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.863+0000 7f2045400640 1 --2- 172.21.15.22:0/1917582187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20400d1940 0x7f20400d28a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20300097a0 tx=0x7f203002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=418362b4ab7e2f79 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7f7057e00640 1 -- 172.21.15.22:0/3536826520 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058003d10 con 0x7f7060163010 2024-04-16T16:16:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.862+0000 7f7057e00640 1 -- 172.21.15.22:0/3536826520 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058003b70 con 0x7f7060163010 2024-04-16T16:16:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.863+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706006f0c0 con 0x7f7060163010 2024-04-16T16:16:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.863+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70600cc010 con 0x7f7060163010 2024-04-16T16:16:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.863+0000 7fa88da00640 1 -- 172.21.15.22:0/1959105348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 msgr2=0x7fa8880cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.863+0000 7fa88da00640 1 --2- 172.21.15.22:0/1959105348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa8880cf610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa8880ba640 tx=0x7fa87802b9a0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7fa88da00640 1 -- 172.21.15.22:0/1959105348 shutdown_connections 2024-04-16T16:16:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7fa88da00640 1 --2- 172.21.15.22:0/1959105348 >> v2:172.21.15.43:3300/0 conn(0x7fa8880cfb50 0x7fa8880d2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7fa88da00640 1 --2- 172.21.15.22:0/1959105348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa8880cf610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7fa88da00640 1 --2- 172.21.15.22:0/1959105348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa8880b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7fa88da00640 1 -- 172.21.15.22:0/1959105348 >> 172.21.15.22:0/1959105348 conn(0x7fa888072670 msgr2=0x7fa888062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7f1a66000640 1 -- 172.21.15.22:0/240538432 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a6c01d070 con 0x7f1a700d1770 2024-04-16T16:16:49.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7fa88da00640 1 -- 172.21.15.22:0/1959105348 shutdown_connections 2024-04-16T16:16:49.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7fa88da00640 1 -- 172.21.15.22:0/1959105348 wait complete. 2024-04-16T16:16:49.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.864+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706004fd90 con 0x7f7060163010 2024-04-16T16:16:49.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.865+0000 7f1a66000640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1a5406caf0 0x7f1a5406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.865+0000 7f1a66000640 1 -- 172.21.15.22:0/240538432 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a6c00d9f0 con 0x7f1a700d1770 2024-04-16T16:16:49.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.866+0000 7f1a75400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1a5406caf0 0x7f1a5406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.867+0000 7f1a75400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1a5406caf0 0x7f1a5406efb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a700b9110 tx=0x7f1a60007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.867+0000 7fa88da00640 1 Processor -- start 2024-04-16T16:16:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.867+0000 7fa88da00640 1 -- start start 2024-04-16T16:16:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7fa88da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8880cfb50 0x7fa8881530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7ff7e3e00640 1 -- 172.21.15.22:0/276500874 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d803d070 con 0x7ff7dc009da0 2024-04-16T16:16:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7fa88da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa888157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7fa88da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa88815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7fa88da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa88815eea0 con 0x7fa8880d3fa0 2024-04-16T16:16:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7ff7e3e00640 1 -- 172.21.15.22:0/276500874 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d8030ae0 con 0x7ff7dc009da0 2024-04-16T16:16:49.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7ff7e3e00640 1 -- 172.21.15.22:0/276500874 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8038440 con 0x7ff7dc009da0 2024-04-16T16:16:49.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7fa88da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa88815ed20 con 0x7fa8880cfb50 2024-04-16T16:16:49.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7fa88da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa8880d4400 con 0x7fa88815e940 2024-04-16T16:16:49.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7f25a1400640 1 -- 172.21.15.22:0/3483482426 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c02c9f0 con 0x7f25a41635f0 2024-04-16T16:16:49.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7f25a1400640 1 -- 172.21.15.22:0/3483482426 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c02cb90 con 0x7f25a41635f0 2024-04-16T16:16:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7f25a1400640 1 -- 172.21.15.22:0/3483482426 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c0343f0 con 0x7f25a41635f0 2024-04-16T16:16:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.869+0000 7fa887400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa888157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7f2044a00640 1 -- 172.21.15.22:0/1917582187 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030034070 con 0x7f20400d1940 2024-04-16T16:16:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7f2044a00640 1 -- 172.21.15.22:0/1917582187 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2030030610 con 0x7f20400d1940 2024-04-16T16:16:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7f2044a00640 1 -- 172.21.15.22:0/1917582187 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20300309e0 con 0x7f20400d1940 2024-04-16T16:16:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7fa887400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa888157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58172/0 (socket says 172.21.15.22:58172) 2024-04-16T16:16:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7fa887400640 1 -- 172.21.15.22:0/238538592 learned_addr learned my addr 172.21.15.22:0/238538592 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7fa88d000640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa88815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7fa887e00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8880cfb50 0x7fa8881530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7fc246000640 1 -- 172.21.15.22:0/189109209 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc24804c030 con 0x7fc2500d0a90 2024-04-16T16:16:49.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7ff7eae00640 1 -- 172.21.15.22:0/276500874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc009da0 msgr2=0x7ff7dc0e2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7ff7eae00640 1 --2- 172.21.15.22:0/276500874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc009da0 0x7ff7dc0e2200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc039830 tx=0x7ff7d802fd30 comp rx=0 tx=0).stop 2024-04-16T16:16:49.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7f2047200640 1 -- 172.21.15.22:0/1917582187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20400d1940 msgr2=0x7f20400d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7f2047200640 1 --2- 172.21.15.22:0/1917582187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20400d1940 0x7f20400d28a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20300097a0 tx=0x7f203002b960 comp rx=0 tx=0).stop 2024-04-16T16:16:49.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7ff7eae00640 1 -- 172.21.15.22:0/276500874 shutdown_connections 2024-04-16T16:16:49.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7ff7eae00640 1 --2- 172.21.15.22:0/276500874 >> v2:172.21.15.22:3300/0 conn(0x7ff7dc0e4cf0 0x7ff7dc0e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7ff7eae00640 1 --2- 172.21.15.22:0/276500874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc051690 0x7ff7dc00a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7ff7eae00640 1 --2- 172.21.15.22:0/276500874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc009da0 0x7ff7dc0e2200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7ff7eae00640 1 -- 172.21.15.22:0/276500874 >> 172.21.15.22:0/276500874 conn(0x7ff7dc0537b0 msgr2=0x7ff7dc053b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7fa887400640 1 -- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 msgr2=0x7fa88815a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7ff7eae00640 1 -- 172.21.15.22:0/276500874 shutdown_connections 2024-04-16T16:16:49.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7ff7eae00640 1 -- 172.21.15.22:0/276500874 wait complete. 2024-04-16T16:16:49.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.870+0000 7fa887400640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa88815a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7fa887400640 1 -- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8880cfb50 msgr2=0x7fa8881530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7fa887400640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8880cfb50 0x7fa8881530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7fa887400640 1 -- 172.21.15.22:0/238538592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa888158a10 con 0x7fa8880d3fa0 2024-04-16T16:16:49.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7fa887400640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa888157800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa878009930 tx=0x7fa8780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7f25a9400640 1 -- 172.21.15.22:0/3483482426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41635f0 msgr2=0x7f25a40d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7f25a9400640 1 --2- 172.21.15.22:0/3483482426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41635f0 0x7f25a40d0b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25a41645d0 tx=0x7f259c02be50 comp rx=0 tx=0).stop 2024-04-16T16:16:49.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.872+0000 7f2047200640 1 -- 172.21.15.22:0/1917582187 shutdown_connections 2024-04-16T16:16:49.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.871+0000 7f1a66000640 1 -- 172.21.15.22:0/240538432 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a6c05a770 con 0x7f1a700d1770 2024-04-16T16:16:49.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.872+0000 7f2047200640 1 --2- 172.21.15.22:0/1917582187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20400d1940 0x7f20400d28a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.872+0000 7f2047200640 1 -- 172.21.15.22:0/1917582187 >> 172.21.15.22:0/1917582187 conn(0x7f2040072670 msgr2=0x7f2040062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.872+0000 7f2047200640 1 -- 172.21.15.22:0/1917582187 shutdown_connections 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.872+0000 7f2047200640 1 -- 172.21.15.22:0/1917582187 wait complete. 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7f25a9400640 1 -- 172.21.15.22:0/3483482426 shutdown_connections 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7f25a9400640 1 --2- 172.21.15.22:0/3483482426 >> v2:172.21.15.22:3300/0 conn(0x7f25a40b3620 0x7f25a4071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7f25a9400640 1 --2- 172.21.15.22:0/3483482426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41635f0 0x7f25a40d0b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7f25a9400640 1 -- 172.21.15.22:0/3483482426 >> 172.21.15.22:0/3483482426 conn(0x7f25a4062440 msgr2=0x7f25a4062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7f25a9400640 1 -- 172.21.15.22:0/3483482426 shutdown_connections 2024-04-16T16:16:49.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.873+0000 7f2047200640 1 Processor -- start 2024-04-16T16:16:49.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7f25a9400640 1 -- 172.21.15.22:0/3483482426 wait complete. 2024-04-16T16:16:49.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7f2047200640 1 -- start start 2024-04-16T16:16:49.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7ff7eae00640 1 Processor -- start 2024-04-16T16:16:49.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.874+0000 7ff7eae00640 1 -- start start 2024-04-16T16:16:49.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.875+0000 7f2047200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20400d1940 0x7f204014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.875+0000 7f2047200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20400d2de0 0x7f204014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2047200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015eb30 0x7f20400b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2047200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f20400d4130 con 0x7f20400d2de0 2024-04-16T16:16:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2047200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f20400d3e50 con 0x7f204015eb30 2024-04-16T16:16:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2045400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20400d2de0 0x7f204014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2047200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f20400d3230 con 0x7f20400d1940 2024-04-16T16:16:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2045400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20400d2de0 0x7f204014dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58180/0 (socket says 172.21.15.22:58180) 2024-04-16T16:16:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2045400640 1 -- 172.21.15.22:0/1476477129 learned_addr learned my addr 172.21.15.22:0/1476477129 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f25a9400640 1 Processor -- start 2024-04-16T16:16:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.876+0000 7f2046800640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015eb30 0x7f20400b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7f25a9400640 1 -- start start 2024-04-16T16:16:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7ff7eae00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7dc009da0 0x7ff7dc175e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7f2045400640 1 -- 172.21.15.22:0/1476477129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20400d1940 msgr2=0x7f204014e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7f2045400640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20400d1940 0x7f204014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7f2045400640 1 -- 172.21.15.22:0/1476477129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015eb30 msgr2=0x7f20400b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7f2045400640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015eb30 0x7f20400b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7f2045400640 1 -- 172.21.15.22:0/1476477129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20400b5d10 con 0x7f20400d2de0 2024-04-16T16:16:49.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7ff7eae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc051690 0x7ff7dc0d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7ff7eae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc0e4cf0 0x7ff7dc0dc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7ff7eae00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc0e56a0 con 0x7ff7dc009da0 2024-04-16T16:16:49.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.877+0000 7f2045400640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20400d2de0 0x7f204014dbc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f203002bf70 tx=0x7f20300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7ff7eae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc0e1520 con 0x7ff7dc051690 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7f25a9400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a40b3620 0x7f25a415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7f25a9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a41635f0 0x7f25a4159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7f25a9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41639d0 0x7f25a41498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7f25a9400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25a4164740 con 0x7f25a41635f0 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7f25a9400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25a40b3e30 con 0x7f25a41639d0 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7f25a9400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f25a41648c0 con 0x7f25a40b3620 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7ff7e9a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7dc009da0 0x7ff7dc175e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7ff7e9a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7dc009da0 0x7ff7dc175e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58194/0 (socket says 172.21.15.22:58194) 2024-04-16T16:16:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7ff7e9a00640 1 -- 172.21.15.22:0/1019555756 learned_addr learned my addr 172.21.15.22:0/1019555756 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff7dc0e5820 con 0x7ff7dc0e4cf0 2024-04-16T16:16:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7ff7ea400640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc0e4cf0 0x7ff7dc0dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.878+0000 7ff7e9000640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc051690 0x7ff7dc0d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7f25a2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a40b3620 0x7f25a415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7f25a2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a40b3620 0x7f25a415eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:57832/0 (socket says 172.21.15.22:57832) 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7f25a3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41639d0 0x7f25a41498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7f25a2800640 1 -- 172.21.15.22:0/3894726631 learned_addr learned my addr 172.21.15.22:0/3894726631 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7f25a1e00640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a41635f0 0x7f25a4159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7ff7e9a00640 1 -- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc0e4cf0 msgr2=0x7ff7dc0dc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7ff7e9a00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc0e4cf0 0x7ff7dc0dc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7ff7e9a00640 1 -- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc051690 msgr2=0x7ff7dc0d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7ff7e9a00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc051690 0x7ff7dc0d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7ff7e9a00640 1 -- 172.21.15.22:0/1019555756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc0e07e0 con 0x7ff7dc009da0 2024-04-16T16:16:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.879+0000 7f25a1e00640 1 -- 172.21.15.22:0/3894726631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a40b3620 msgr2=0x7f25a415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.880+0000 7f25a1e00640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a40b3620 0x7f25a415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.880+0000 7f25a1e00640 1 -- 172.21.15.22:0/3894726631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41639d0 msgr2=0x7f25a41498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.880+0000 7f25a1e00640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41639d0 0x7f25a41498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.880+0000 7f25a1e00640 1 -- 172.21.15.22:0/3894726631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a415a550 con 0x7f25a41635f0 2024-04-16T16:16:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.880+0000 7f25a2800640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a40b3620 0x7f25a415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.880+0000 7ff7e9a00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7dc009da0 0x7ff7dc175e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff7d802fd70 tx=0x7ff7d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.880+0000 7f25a1e00640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a41635f0 0x7f25a4159de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f259400b3f0 tx=0x7f259400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f259aa00640 1 -- 172.21.15.22:0/3894726631 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594015020 con 0x7f25a41635f0 2024-04-16T16:16:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7fa87fe00640 1 -- 172.21.15.22:0/238538592 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878034040 con 0x7fa8880d3fa0 2024-04-16T16:16:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f203a000640 1 -- 172.21.15.22:0/1476477129 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030034040 con 0x7f20400d2de0 2024-04-16T16:16:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f259aa00640 1 -- 172.21.15.22:0/3894726631 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594011830 con 0x7f25a41635f0 2024-04-16T16:16:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f259aa00640 1 -- 172.21.15.22:0/3894726631 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594011c20 con 0x7f25a41635f0 2024-04-16T16:16:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7fa87fe00640 1 -- 172.21.15.22:0/238538592 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87802f5c0 con 0x7fa8880d3fa0 2024-04-16T16:16:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a415a830 con 0x7f25a41635f0 2024-04-16T16:16:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7fa87fe00640 1 -- 172.21.15.22:0/238538592 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87802f990 con 0x7fa8880d3fa0 2024-04-16T16:16:49.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a415adf0 con 0x7f25a41635f0 2024-04-16T16:16:49.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7ff7e1600640 1 -- 172.21.15.22:0/1019555756 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d803d040 con 0x7ff7dc009da0 2024-04-16T16:16:49.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7ff7e1600640 1 -- 172.21.15.22:0/1019555756 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d8048070 con 0x7ff7dc009da0 2024-04-16T16:16:49.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7ff7e1600640 1 -- 172.21.15.22:0/1019555756 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8043660 con 0x7ff7dc009da0 2024-04-16T16:16:49.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.881+0000 7f7057e00640 1 -- 172.21.15.22:0/3536826520 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f705800a850 con 0x7f7060163010 2024-04-16T16:16:49.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f7057e00640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f704006caf0 0x7f704006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.883+0000 7f7057e00640 1 -- 172.21.15.22:0/3536826520 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f705808c120 con 0x7f7060163010 2024-04-16T16:16:49.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f203a000640 1 -- 172.21.15.22:0/1476477129 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2030039c90 con 0x7f20400d2de0 2024-04-16T16:16:49.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f203a000640 1 -- 172.21.15.22:0/1476477129 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030042610 con 0x7f20400d2de0 2024-04-16T16:16:49.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.883+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a404fd90 con 0x7f25a41635f0 2024-04-16T16:16:49.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.882+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20400cc750 con 0x7f20400d2de0 2024-04-16T16:16:49.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.883+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20400b5fb0 con 0x7f20400d2de0 2024-04-16T16:16:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.883+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa888158cb0 con 0x7fa8880d3fa0 2024-04-16T16:16:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.884+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa888153630 con 0x7fa8880d3fa0 2024-04-16T16:16:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.883+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7dc0e0ac0 con 0x7ff7dc009da0 2024-04-16T16:16:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.883+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7dc0da470 con 0x7ff7dc009da0 2024-04-16T16:16:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.885+0000 7f705f400640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f704006caf0 0x7f704006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.885+0000 7f7057e00640 1 -- 172.21.15.22:0/3536826520 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f705805a5c0 con 0x7f7060163010 2024-04-16T16:16:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.886+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c0005290 con 0x7ff7dc009da0 2024-04-16T16:16:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.887+0000 7f705f400640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f704006caf0 0x7f704006efb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7050036000 tx=0x7f705003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.887+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c005290 con 0x7f20400d2de0 2024-04-16T16:16:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.887+0000 7ff7e1600640 1 -- 172.21.15.22:0/1019555756 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7d8043800 con 0x7ff7dc009da0 2024-04-16T16:16:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.888+0000 7f259aa00640 1 -- 172.21.15.22:0/3894726631 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2594018020 con 0x7f25a41635f0 2024-04-16T16:16:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.889+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa888075f30 con 0x7fa8880d3fa0 2024-04-16T16:16:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.889+0000 7f259aa00640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f258406c9c0 0x7f258406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.889+0000 7ff7e1600640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff7c406c9c0 0x7ff7c406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.889+0000 7f259aa00640 1 -- 172.21.15.22:0/3894726631 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f259408bfc0 con 0x7f25a41635f0 2024-04-16T16:16:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.889+0000 7ff7e1600640 1 -- 172.21.15.22:0/1019555756 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff7d80b2070 con 0x7ff7dc009da0 2024-04-16T16:16:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.890+0000 7ff7e9000640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff7c406c9c0 0x7ff7c406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.890+0000 7f25a2800640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f258406c9c0 0x7f258406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.891+0000 7ff7e9000640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff7c406c9c0 0x7ff7c406ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc1798e0 tx=0x7ff7d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.891+0000 7f25a2800640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f258406c9c0 0x7f258406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f259c02be90 tx=0x7f259c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.894+0000 7f259aa00640 1 -- 172.21.15.22:0/3894726631 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f259401f020 con 0x7f25a41635f0 2024-04-16T16:16:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.897+0000 7f203a000640 1 -- 172.21.15.22:0/1476477129 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2030037070 con 0x7f20400d2de0 2024-04-16T16:16:49.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.897+0000 7fa87fe00640 1 -- 172.21.15.22:0/238538592 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa878037070 con 0x7fa8880d3fa0 2024-04-16T16:16:49.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.898+0000 7fa87fe00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa86406c970 0x7fa86406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.898+0000 7f203a000640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f202406c940 0x7f202406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:49.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.899+0000 7fa887e00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa86406c970 0x7fa86406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.899+0000 7f2045e00640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f202406c940 0x7f202406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:49.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.900+0000 7f2045e00640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f202406c940 0x7f202406ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2034001550 tx=0x7f2034007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.900+0000 7fa887e00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa86406c970 0x7fa86406ee30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa87000a990 tx=0x7fa870008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:49.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.905+0000 7fa87fe00640 1 -- 172.21.15.22:0/238538592 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa87807a410 con 0x7fa8880d3fa0 2024-04-16T16:16:49.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.905+0000 7f203a000640 1 -- 172.21.15.22:0/1476477129 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f203007a6a0 con 0x7f20400d2de0 2024-04-16T16:16:49.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.906+0000 7ff7e1600640 1 -- 172.21.15.22:0/1019555756 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7d8080510 con 0x7ff7dc009da0 2024-04-16T16:16:49.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.915+0000 7fa87fe00640 1 -- 172.21.15.22:0/238538592 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa87803e070 con 0x7fa8880d3fa0 2024-04-16T16:16:49.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:49.925+0000 7f203a000640 1 -- 172.21.15.22:0/1476477129 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f203007cd00 con 0x7f20400d2de0 2024-04-16T16:16:50.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.305+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f53cc005850 con 0x7f53f415e520 2024-04-16T16:16:50.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.306+0000 7f53eb400640 1 -- 172.21.15.22:0/3139258275 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53e405e190 con 0x7f53f415e520 2024-04-16T16:16:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2024-04-16T16:16:50.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.308+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc224005580 con 0x7fc2500d0a90 2024-04-16T16:16:50.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.309+0000 7fc246000640 1 -- 172.21.15.22:0/189109209 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc24807c280 con 0x7fc2500d0a90 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.309+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f53d006c9c0 msgr2=0x7f53d006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.309+0000 7f53f3e00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f53d006c9c0 0x7f53d006ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001010 tx=0x7f53dc009040 comp rx=0 tx=0).stop 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.310+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f415e520 msgr2=0x7f53f414b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.310+0000 7f53f3e00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f415e520 0x7f53f414b5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53e400ce40 tx=0x7f53e400a430 comp rx=0 tx=0).stop 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.310+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 shutdown_connections 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.310+0000 7f53f3e00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f53d006c9c0 0x7f53d006ee80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.310+0000 7f53f3e00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53f415f0e0 0x7f53f4149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.310+0000 7f53f3e00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f415e520 0x7f53f414b5e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.310+0000 7f53f3e00640 1 --2- 172.21.15.22:0/3139258275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53f40729a0 0x7f53f4144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.311+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 >> 172.21.15.22:0/3139258275 conn(0x7f53f4062440 msgr2=0x7f53f40716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.311+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 shutdown_connections 2024-04-16T16:16:50.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.311+0000 7f53f3e00640 1 -- 172.21.15.22:0/3139258275 wait complete. 2024-04-16T16:16:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2024-04-16T16:16:50.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.312+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc23006caf0 msgr2=0x7fc23006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.312+0000 7fc23b400640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc23006caf0 0x7fc23006efb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2400011e0 tx=0x7fc240007c10 comp rx=0 tx=0).stop 2024-04-16T16:16:50.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500d0a90 msgr2=0x7fc2500ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500d0a90 0x7fc2500ab150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc248032000 tx=0x7fc248004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 shutdown_connections 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc23006caf0 0x7fc23006efb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2500d0a90 0x7fc2500ab150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2500b5510 0x7fc2500ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 --2- 172.21.15.22:0/189109209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc25006ce50 0x7fc2501607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.313+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 >> 172.21.15.22:0/189109209 conn(0x7fc250075070 msgr2=0x7fc250062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.314+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 shutdown_connections 2024-04-16T16:16:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.314+0000 7fc23b400640 1 -- 172.21.15.22:0/189109209 wait complete. 2024-04-16T16:16:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2024-04-16T16:16:50.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.326+0000 7f1a77200640 1 -- 172.21.15.22:0/240538432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1a50005850 con 0x7f1a700d1770 2024-04-16T16:16:50.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.326+0000 7f1a66000640 1 -- 172.21.15.22:0/240538432 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a6c05ea70 con 0x7f1a700d1770 2024-04-16T16:16:50.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.330+0000 7f1a5b400640 1 -- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1a5406caf0 msgr2=0x7f1a5406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.330+0000 7f1a5b400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1a5406caf0 0x7f1a5406efb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a700b9110 tx=0x7f1a60007e40 comp rx=0 tx=0).stop 2024-04-16T16:16:50.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 -- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a700d1770 msgr2=0x7f1a700ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a700d1770 0x7f1a700ce440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00cf60 tx=0x7f1a6c00cf90 comp rx=0 tx=0).stop 2024-04-16T16:16:50.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 -- 172.21.15.22:0/240538432 shutdown_connections 2024-04-16T16:16:50.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1a5406caf0 0x7f1a5406efb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7015eb30 0x7f1a70200390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1a700d2fb0 0x7f1a7015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 --2- 172.21.15.22:0/240538432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a700d1770 0x7f1a700ce440 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.331+0000 7f1a5b400640 1 -- 172.21.15.22:0/240538432 >> 172.21.15.22:0/240538432 conn(0x7f1a70072670 msgr2=0x7f1a700b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.332+0000 7f1a5b400640 1 -- 172.21.15.22:0/240538432 shutdown_connections 2024-04-16T16:16:50.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.332+0000 7f1a5b400640 1 -- 172.21.15.22:0/240538432 wait complete. 2024-04-16T16:16:50.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.333+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f25a40d0e50 con 0x7f25a41635f0 2024-04-16T16:16:50.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.334+0000 7f259aa00640 1 -- 172.21.15.22:0/3894726631 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2594059d80 con 0x7f25a41635f0 2024-04-16T16:16:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:50.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.337+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f258406c9c0 msgr2=0x7f258406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.337+0000 7f25a9400640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f258406c9c0 0x7f258406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f259c02be90 tx=0x7f259c030000 comp rx=0 tx=0).stop 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.337+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a41635f0 msgr2=0x7f25a4159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.337+0000 7f25a9400640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a41635f0 0x7f25a4159de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f259400b3f0 tx=0x7f259400b8b0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 shutdown_connections 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f258406c9c0 0x7f258406ee80 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f259c02be90 tx=0x7f259c030000 comp rx=0 tx=0).stop 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a41639d0 0x7f25a41498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a41635f0 0x7f25a4159de0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 --2- 172.21.15.22:0/3894726631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a40b3620 0x7f25a415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 >> 172.21.15.22:0/3894726631 conn(0x7f25a4062440 msgr2=0x7f25a406d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 shutdown_connections 2024-04-16T16:16:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.338+0000 7f25a9400640 1 -- 172.21.15.22:0/3894726631 wait complete. 2024-04-16T16:16:50.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-04-16T16:16:50.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.342+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f70600b7170 con 0x7f7060163010 2024-04-16T16:16:50.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.343+0000 7f7057e00640 1 -- 172.21.15.22:0/3536826520 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7058059ec0 con 0x7f7060163010 2024-04-16T16:16:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:50.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.344+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff7c0005580 con 0x7ff7dc009da0 2024-04-16T16:16:50.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-04-16T16:16:50.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.345+0000 7ff7e1600640 1 -- 172.21.15.22:0/1019555756 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7d807fe10 con 0x7ff7dc009da0 2024-04-16T16:16:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2024-04-16T16:16:50.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f704006caf0 msgr2=0x7f704006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f704006caf0 0x7f704006efb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7050036000 tx=0x7f705003b040 comp rx=0 tx=0).stop 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060163010 msgr2=0x7f70600ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060163010 0x7f70600ce6d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f705800c870 tx=0x7f705800cd30 comp rx=0 tx=0).stop 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 shutdown_connections 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f704006caf0 0x7f704006efb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70601679d0 0x7f7060153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70601633f0 0x7f7060161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 --2- 172.21.15.22:0/3536826520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060163010 0x7f70600ce6d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 >> 172.21.15.22:0/3536826520 conn(0x7f7060072490 msgr2=0x7f7060164140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff7c406c9c0 msgr2=0x7ff7c406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7ff7eae00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff7c406c9c0 0x7ff7c406ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc1798e0 tx=0x7ff7d0008040 comp rx=0 tx=0).stop 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7dc009da0 msgr2=0x7ff7dc175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.347+0000 7ff7eae00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7dc009da0 0x7ff7dc175e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff7d802fd70 tx=0x7ff7d80046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 shutdown_connections 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff7c406c9c0 0x7ff7c406ee80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7dc0e4cf0 0x7ff7dc0dc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7dc051690 0x7ff7dc0d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 --2- 172.21.15.22:0/1019555756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7dc009da0 0x7ff7dc175e40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 >> 172.21.15.22:0/1019555756 conn(0x7ff7dc0537b0 msgr2=0x7ff7dc0d7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 shutdown_connections 2024-04-16T16:16:50.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7f7067200640 1 -- 172.21.15.22:0/3536826520 wait complete. 2024-04-16T16:16:50.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 shutdown_connections 2024-04-16T16:16:50.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.348+0000 7ff7eae00640 1 -- 172.21.15.22:0/1019555756 wait complete. 2024-04-16T16:16:50.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-04-16T16:16:50.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-16T16:16:50.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-04-16T16:16:50.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-16T16:16:50.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.370+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa8880d5040 con 0x7fa8880d3fa0 2024-04-16T16:16:50.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.371+0000 7fa87fe00640 1 -- 172.21.15.22:0/238538592 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa87807c370 con 0x7fa8880d3fa0 2024-04-16T16:16:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2024-04-16T16:16:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.373+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa86406c970 msgr2=0x7fa86406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.373+0000 7fa88da00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa86406c970 0x7fa86406ee30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa87000a990 tx=0x7fa870008040 comp rx=0 tx=0).stop 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 msgr2=0x7fa888157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa888157800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa878009930 tx=0x7fa8780046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 shutdown_connections 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa86406c970 0x7fa86406ee30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa88815e940 0x7fa88815a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8880d3fa0 0x7fa888157800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 --2- 172.21.15.22:0/238538592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8880cfb50 0x7fa8881530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 >> 172.21.15.22:0/238538592 conn(0x7fa888072670 msgr2=0x7fa8880b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 shutdown_connections 2024-04-16T16:16:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.374+0000 7fa88da00640 1 -- 172.21.15.22:0/238538592 wait complete. 2024-04-16T16:16:50.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.377+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f201c005850 con 0x7f20400d2de0 2024-04-16T16:16:50.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.377+0000 7f203a000640 1 -- 172.21.15.22:0/1476477129 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f203007c600 con 0x7f20400d2de0 2024-04-16T16:16:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2024-04-16T16:16:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f202406c940 msgr2=0x7f202406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f202406c940 0x7f202406ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2034001550 tx=0x7f2034007a40 comp rx=0 tx=0).stop 2024-04-16T16:16:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20400d2de0 msgr2=0x7f204014dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20400d2de0 0x7f204014dbc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f203002bf70 tx=0x7f20300046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 shutdown_connections 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f202406c940 0x7f202406ee00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015eb30 0x7f20400b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20400d2de0 0x7f204014dbc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 --2- 172.21.15.22:0/1476477129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20400d1940 0x7f204014e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 >> 172.21.15.22:0/1476477129 conn(0x7f2040072670 msgr2=0x7f20400cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 shutdown_connections 2024-04-16T16:16:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:50.379+0000 7f2047200640 1 -- 172.21.15.22:0/1476477129 wait complete. 2024-04-16T16:16:50.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-04-16T16:16:50.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2024-04-16T16:16:51.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T16:16:51.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T16:16:51.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T16:16:51.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T16:16:51.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T16:16:51.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T16:16:51.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T16:16:51.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T16:16:51.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.636+0000 7f3685800640 1 Processor -- start 2024-04-16T16:16:51.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.636+0000 7f3685800640 1 -- start start 2024-04-16T16:16:51.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.638+0000 7f3685800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3678034e50 0x7f3678004740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.638+0000 7f3685800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678049250 0x7f3678004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.638+0000 7f3685800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3678048c90 0x7f36780eb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.638+0000 7f3685800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3678035230 con 0x7f3678034e50 2024-04-16T16:16:51.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.638+0000 7f3685800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f36780088b0 con 0x7f3678048c90 2024-04-16T16:16:51.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.638+0000 7f3685800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3678051be0 con 0x7f3678049250 2024-04-16T16:16:51.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.640+0000 7f367ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3678034e50 0x7f3678004740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.640+0000 7f367ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3678034e50 0x7f3678004740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58210/0 (socket says 172.21.15.22:58210) 2024-04-16T16:16:51.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.640+0000 7f367ea00640 1 -- 172.21.15.22:0/1255363562 learned_addr learned my addr 172.21.15.22:0/1255363562 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.640+0000 7f367e000640 1 --2- 172.21.15.22:0/1255363562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678049250 0x7f3678004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.640+0000 7f367f400640 1 --2- 172.21.15.22:0/1255363562 >> v2:172.21.15.43:3300/0 conn(0x7f3678048c90 0x7f36780eb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.641+0000 7f367ea00640 1 -- 172.21.15.22:0/1255363562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678049250 msgr2=0x7f3678004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.641+0000 7f367ea00640 1 --2- 172.21.15.22:0/1255363562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678049250 0x7f3678004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.641+0000 7f367ea00640 1 -- 172.21.15.22:0/1255363562 >> v2:172.21.15.43:3300/0 conn(0x7f3678048c90 msgr2=0x7f36780eb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.641+0000 7f367ea00640 1 --2- 172.21.15.22:0/1255363562 >> v2:172.21.15.43:3300/0 conn(0x7f3678048c90 0x7f36780eb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.641+0000 7f367ea00640 1 -- 172.21.15.22:0/1255363562 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3678051ec0 con 0x7f3678034e50 2024-04-16T16:16:51.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.644+0000 7f367ea00640 1 --2- 172.21.15.22:0/1255363562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678004740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f367800e630 tx=0x7f366c02bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04bd6ed24ea191f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.645+0000 7f367d600640 1 -- 172.21.15.22:0/1255363562 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c02d6d0 con 0x7f3678034e50 2024-04-16T16:16:51.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.645+0000 7f367d600640 1 -- 172.21.15.22:0/1255363562 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c02d870 con 0x7f3678034e50 2024-04-16T16:16:51.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.645+0000 7f367d600640 1 -- 172.21.15.22:0/1255363562 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c02d6d0 con 0x7f3678034e50 2024-04-16T16:16:51.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.646+0000 7f3685800640 1 -- 172.21.15.22:0/1255363562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 msgr2=0x7f3678004740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.646+0000 7f3685800640 1 --2- 172.21.15.22:0/1255363562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678004740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f367800e630 tx=0x7f366c02bb20 comp rx=0 tx=0).stop 2024-04-16T16:16:51.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.647+0000 7f3685800640 1 -- 172.21.15.22:0/1255363562 shutdown_connections 2024-04-16T16:16:51.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.647+0000 7f3685800640 1 --2- 172.21.15.22:0/1255363562 >> v2:172.21.15.43:3300/0 conn(0x7f3678048c90 0x7f36780eb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.648+0000 7f3685800640 1 --2- 172.21.15.22:0/1255363562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678049250 0x7f3678004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.648+0000 7f3685800640 1 --2- 172.21.15.22:0/1255363562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678004740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.648+0000 7f3685800640 1 -- 172.21.15.22:0/1255363562 >> 172.21.15.22:0/1255363562 conn(0x7f3678055bd0 msgr2=0x7f3678055fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.648+0000 7f3685800640 1 -- 172.21.15.22:0/1255363562 shutdown_connections 2024-04-16T16:16:51.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.648+0000 7f3685800640 1 -- 172.21.15.22:0/1255363562 wait complete. 2024-04-16T16:16:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.652+0000 7f3685800640 1 Processor -- start 2024-04-16T16:16:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.653+0000 7f3685800640 1 -- start start 2024-04-16T16:16:51.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.655+0000 7f3685800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678181e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.656+0000 7f3685800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678048c90 0x7f367817d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.656+0000 7f367ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678181e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.656+0000 7f367ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678181e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58218/0 (socket says 172.21.15.22:58218) 2024-04-16T16:16:51.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.656+0000 7f367ea00640 1 -- 172.21.15.22:0/961379716 learned_addr learned my addr 172.21.15.22:0/961379716 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.657+0000 7f3685800640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3678049250 0x7f36780e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.657+0000 7f367e000640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678048c90 0x7f367817d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.657+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f36780084d0 con 0x7f3678034e50 2024-04-16T16:16:51.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.658+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3678051870 con 0x7f3678049250 2024-04-16T16:16:51.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.658+0000 7f367f400640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3678049250 0x7f36780e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.658+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3678008650 con 0x7f3678048c90 2024-04-16T16:16:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.660+0000 7f367e000640 1 -- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3678049250 msgr2=0x7f36780e4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.660+0000 7f367e000640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3678049250 0x7f36780e4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.660+0000 7f367e000640 1 -- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 msgr2=0x7f3678181e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.660+0000 7f367e000640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678181e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.660+0000 7f367e000640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36781823a0 con 0x7f3678048c90 2024-04-16T16:16:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.660+0000 7f367ea00640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678181e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.661+0000 7f367f400640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3678049250 0x7f36780e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:51.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.662+0000 7f367e000640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678048c90 0x7f367817d760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f367000e870 tx=0x7f367000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.662+0000 7f3676a00640 1 -- 172.21.15.22:0/961379716 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670017070 con 0x7f3678048c90 2024-04-16T16:16:51.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.663+0000 7f3676a00640 1 -- 172.21.15.22:0/961379716 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367000ee60 con 0x7f3678048c90 2024-04-16T16:16:51.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.663+0000 7f3676a00640 1 -- 172.21.15.22:0/961379716 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367000cb60 con 0x7f3678048c90 2024-04-16T16:16:51.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.663+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36780e0bb0 con 0x7f3678048c90 2024-04-16T16:16:51.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.663+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36780e1170 con 0x7f3678048c90 2024-04-16T16:16:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.666+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3678009ae0 con 0x7f3678048c90 2024-04-16T16:16:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.668+0000 7f3676a00640 1 -- 172.21.15.22:0/961379716 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f367001a070 con 0x7f3678048c90 2024-04-16T16:16:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.670+0000 7f3676a00640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f366006c8f0 0x7f366006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.670+0000 7f3676a00640 1 -- 172.21.15.22:0/961379716 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f367008b8d0 con 0x7f3678048c90 2024-04-16T16:16:51.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.671+0000 7f367ea00640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f366006c8f0 0x7f366006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.673+0000 7f367ea00640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f366006c8f0 0x7f366006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f366c009280 tx=0x7f366c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.685+0000 7f1689800640 1 Processor -- start 2024-04-16T16:16:51.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.685+0000 7f1689800640 1 -- start start 2024-04-16T16:16:51.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.686+0000 7f3676a00640 1 -- 172.21.15.22:0/961379716 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36781823a0 con 0x7f3678048c90 2024-04-16T16:16:51.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.686+0000 7fd924e00640 1 Processor -- start 2024-04-16T16:16:51.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.687+0000 7fd924e00640 1 -- start start 2024-04-16T16:16:51.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.688+0000 7f1689800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f168415eb30 0x7f16840d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.688+0000 7f1689800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16840d1770 0x7f16840d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.688+0000 7f1689800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.688+0000 7f1689800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f16840d4650 con 0x7f16840d1770 2024-04-16T16:16:51.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.688+0000 7f1689800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f16840d1be0 con 0x7f168415eb30 2024-04-16T16:16:51.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.688+0000 7f1689800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f168415ef10 con 0x7f16840d2de0 2024-04-16T16:16:51.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7fd924e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd92015ef70 0x7fd9200cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.689+0000 7f1688e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.689+0000 7f1688e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:57864/0 (socket says 172.21.15.22:57864) 2024-04-16T16:16:51.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.689+0000 7f1688e00640 1 -- 172.21.15.22:0/2766579375 learned_addr learned my addr 172.21.15.22:0/2766579375 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.689+0000 7f1683e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f168415eb30 0x7f16840d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.689+0000 7f1683400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f16840d1770 0x7f16840d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7fd924e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9200d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7fd924e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd920162c40 con 0x7fd92015eb90 2024-04-16T16:16:51.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7fd924e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd9200d0150 con 0x7fd92015ef70 2024-04-16T16:16:51.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7fd924e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd920162f20 con 0x7fd9200cfd00 2024-04-16T16:16:51.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7f1683e00640 1 -- 172.21.15.22:0/2766579375 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 msgr2=0x7f16840b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7f1683e00640 1 --2- 172.21.15.22:0/2766579375 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7f1683e00640 1 -- 172.21.15.22:0/2766579375 >> v2:172.21.15.22:3300/0 conn(0x7f16840d1770 msgr2=0x7f16840d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7fd91de00640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd92015eb90 0x7fd9200ba3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:51536/0 (socket says 172.21.15.22:51536) 2024-04-16T16:16:51.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.690+0000 7fd91de00640 1 -- 172.21.15.22:0/2659769116 learned_addr learned my addr 172.21.15.22:0/2659769116 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:51.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.691+0000 7f1683e00640 1 --2- 172.21.15.22:0/2766579375 >> v2:172.21.15.22:3300/0 conn(0x7f16840d1770 0x7f16840d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.691+0000 7f1683e00640 1 -- 172.21.15.22:0/2766579375 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16840d35b0 con 0x7f168415eb30 2024-04-16T16:16:51.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.691+0000 7fd91d400640 1 --2- 172.21.15.22:0/2659769116 >> v2:172.21.15.22:3300/0 conn(0x7fd92015ef70 0x7fd9200cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.691+0000 7f1683400640 1 --2- 172.21.15.22:0/2766579375 >> v2:172.21.15.22:3300/0 conn(0x7f16840d1770 0x7f16840d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:51.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.692+0000 7f07c6a00640 1 Processor -- start 2024-04-16T16:16:51.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.692+0000 7fd91ca00640 1 -- 172.21.15.22:0/2659769116 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 853371134 0 0) 0x7fd920162c40 con 0x7fd92015eb90 2024-04-16T16:16:51.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.693+0000 7f1683e00640 1 --2- 172.21.15.22:0/2766579375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168415eb30 0x7f16840d1230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16840d1200 tx=0x7f167402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8630498dff9b423c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.692+0000 7fd91ca00640 1 -- 172.21.15.22:0/2659769116 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd904003520 con 0x7fd92015eb90 2024-04-16T16:16:51.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.692+0000 7f07c6a00640 1 -- start start 2024-04-16T16:16:51.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.693+0000 7f1682a00640 1 -- 172.21.15.22:0/2766579375 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16740315a0 con 0x7f168415eb30 2024-04-16T16:16:51.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.694+0000 7f1682a00640 1 -- 172.21.15.22:0/2766579375 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1674037070 con 0x7f168415eb30 2024-04-16T16:16:51.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.694+0000 7f1682a00640 1 -- 172.21.15.22:0/2766579375 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674031960 con 0x7f168415eb30 2024-04-16T16:16:51.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.694+0000 7f07c6a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07c015ec30 0x7f07c00cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.694+0000 7f07c6a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f07c015f010 0x7f07c0163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.694+0000 7f07c6a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c01638c0 con 0x7f07c00d13f0 2024-04-16T16:16:51.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.693+0000 7fd91d400640 1 -- 172.21.15.22:0/2659769116 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 msgr2=0x7fd9200d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.693+0000 7fd91d400640 1 --2- 172.21.15.22:0/2659769116 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9200d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.693+0000 7fd91d400640 1 -- 172.21.15.22:0/2659769116 >> v1:172.21.15.43:6789/0 conn(0x7fd92015eb90 legacy=0x7fd9200ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.693+0000 7fd91d400640 1 -- 172.21.15.22:0/2659769116 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd920163200 con 0x7fd92015ef70 2024-04-16T16:16:51.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.694+0000 7f07c6a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f07c00d2d40 con 0x7f07c015f010 2024-04-16T16:16:51.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.694+0000 7f07c6a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f07c00cf960 con 0x7f07c015ec30 2024-04-16T16:16:51.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.695+0000 7f1689800640 1 -- 172.21.15.22:0/2766579375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168415eb30 msgr2=0x7f16840d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.695+0000 7f1689800640 1 --2- 172.21.15.22:0/2766579375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168415eb30 0x7f16840d1230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16840d1200 tx=0x7f167402b840 comp rx=0 tx=0).stop 2024-04-16T16:16:51.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f1689800640 1 -- 172.21.15.22:0/2766579375 shutdown_connections 2024-04-16T16:16:51.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f1689800640 1 --2- 172.21.15.22:0/2766579375 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.695+0000 7fd91d400640 1 --2- 172.21.15.22:0/2659769116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9200cf7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41825bed24ba234d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.695+0000 7f07c4a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f07c00d13f0 0x7f07c00b6550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35088/0 (socket says 172.21.15.22:35088) 2024-04-16T16:16:51.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.695+0000 7f07c4a00640 1 -- 172.21.15.22:0/1185322686 learned_addr learned my addr 172.21.15.22:0/1185322686 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:51.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f1689800640 1 --2- 172.21.15.22:0/2766579375 >> v2:172.21.15.22:3300/0 conn(0x7f16840d1770 0x7f16840d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f1689800640 1 --2- 172.21.15.22:0/2766579375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168415eb30 0x7f16840d1230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f1689800640 1 -- 172.21.15.22:0/2766579375 >> 172.21.15.22:0/2766579375 conn(0x7f1684072670 msgr2=0x7f1684062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f1689800640 1 -- 172.21.15.22:0/2766579375 shutdown_connections 2024-04-16T16:16:51.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f07bf400640 1 --2- 172.21.15.22:0/1185322686 >> v2:172.21.15.22:3300/0 conn(0x7f07c015f010 0x7f07c0163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f07bfe00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07c015ec30 0x7f07c00cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384231554 0 0) 0x7f07ac001110 con 0x7f07c00d13f0 2024-04-16T16:16:51.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07a4003520 con 0x7f07c00d13f0 2024-04-16T16:16:51.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7fd91ca00640 1 -- 172.21.15.22:0/2659769116 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908035020 con 0x7fd92015ef70 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1569747232 0 0) 0x7f07a4003520 con 0x7f07c00d13f0 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07c015ec30 msgr2=0x7f07c00cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07c015ec30 0x7f07c00cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 >> v2:172.21.15.22:3300/0 conn(0x7f07c015f010 msgr2=0x7f07c0163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 --2- 172.21.15.22:0/1185322686 >> v2:172.21.15.22:3300/0 conn(0x7f07c015f010 0x7f07c0163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c00cfc40 con 0x7f07c00d13f0 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f07ac001840 con 0x7f07c00d13f0 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 >> v1:172.21.15.22:6789/0 conn(0x7f07c00d13f0 legacy=0x7f07c00b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a40039b0 0x7f07a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07a40043a0 0x7f07a4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a4004fa0 0x7f07a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07c00d2d40 con 0x7f07a40039b0 2024-04-16T16:16:51.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07c00cf960 con 0x7f07a40043a0 2024-04-16T16:16:51.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.697+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f07a400bf00 con 0x7f07a4004fa0 2024-04-16T16:16:51.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.696+0000 7f1689800640 1 -- 172.21.15.22:0/2766579375 wait complete. 2024-04-16T16:16:51.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.698+0000 7fd91ca00640 1 -- 172.21.15.22:0/2659769116 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908031830 con 0x7fd92015ef70 2024-04-16T16:16:51.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.698+0000 7fd91ca00640 1 -- 172.21.15.22:0/2659769116 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908031c40 con 0x7fd92015ef70 2024-04-16T16:16:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.698+0000 7f07bf400640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07a40043a0 0x7f07a4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07c4a00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a4004fa0 0x7f07a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7fd924e00640 1 -- 172.21.15.22:0/2659769116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 msgr2=0x7fd9200cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7fd924e00640 1 --2- 172.21.15.22:0/2659769116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9200cf7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802b8d0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07bfe00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a40039b0 0x7f07a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07bf400640 1 -- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a4004fa0 msgr2=0x7f07a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07bf400640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a4004fa0 0x7f07a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07bf400640 1 -- 172.21.15.22:0/1185322686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a40039b0 msgr2=0x7f07a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07bf400640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a40039b0 0x7f07a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07bf400640 1 -- 172.21.15.22:0/1185322686 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c00cfc40 con 0x7f07a40043a0 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.699+0000 7f07c4a00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a4004fa0 0x7f07a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.700+0000 7fd924e00640 1 -- 172.21.15.22:0/2659769116 shutdown_connections 2024-04-16T16:16:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.700+0000 7fd924e00640 1 --2- 172.21.15.22:0/2659769116 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9200d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.700+0000 7fd924e00640 1 --2- 172.21.15.22:0/2659769116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9200cf7c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.700+0000 7fd924e00640 1 -- 172.21.15.22:0/2659769116 >> 172.21.15.22:0/2659769116 conn(0x7fd920062440 msgr2=0x7fd920062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.701+0000 7f1689800640 1 Processor -- start 2024-04-16T16:16:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.700+0000 7fd924e00640 1 -- 172.21.15.22:0/2659769116 shutdown_connections 2024-04-16T16:16:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.700+0000 7fd924e00640 1 -- 172.21.15.22:0/2659769116 wait complete. 2024-04-16T16:16:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.701+0000 7f39f8400640 1 Processor -- start 2024-04-16T16:16:51.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.702+0000 7fd924e00640 1 Processor -- start 2024-04-16T16:16:51.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.702+0000 7fd924e00640 1 -- start start 2024-04-16T16:16:51.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f07bf400640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07a40043a0 0x7f07a4004880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009fc0 tx=0x7f07a4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91faeb0a18d0702c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f39f8400640 1 -- start start 2024-04-16T16:16:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd924e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9201f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd924e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd92015eb90 0x7fd9201e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd924e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9201e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd924e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd920162a00 con 0x7fd92015ef70 2024-04-16T16:16:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd924e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd920162880 con 0x7fd92015eb90 2024-04-16T16:16:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd924e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd9200d3470 con 0x7fd9200cfd00 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8039070 con 0x7f07a40043a0 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b802cc60 con 0x7f07a40043a0 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd91de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9201f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.701+0000 7f1689800640 1 -- start start 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f1689800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16840d1770 0x7f16840c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f1689800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f1689800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f168415eb30 0x7f16840cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f1689800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f16840d3e50 con 0x7f168415eb30 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f1689800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16840d3b70 con 0x7f16840d1770 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.703+0000 7f1689800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f16840d4130 con 0x7f16840d2de0 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7f1683e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16840d1770 0x7f16840c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7f1683e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16840d1770 0x7f16840c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:58588/0 (socket says 172.21.15.22:58588) 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7f1683e00640 1 -- 172.21.15.22:0/2153039986 learned_addr learned my addr 172.21.15.22:0/2153039986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7f1683400640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7f1683e00640 1 -- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 msgr2=0x7f16840c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7f1683e00640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7f1683e00640 1 -- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f168415eb30 msgr2=0x7f16840cb8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T16:16:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd91e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9201e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd91de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9201f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:57912/0 (socket says 172.21.15.22:57912) 2024-04-16T16:16:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7fd91de00640 1 -- 172.21.15.22:0/3945265526 learned_addr learned my addr 172.21.15.22:0/3945265526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7fd91d400640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd92015eb90 0x7fd9201e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7f07c6a00640 1 -- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07a40043a0 msgr2=0x7f07a4004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7f07c6a00640 1 --2- 172.21.15.22:0/1185322686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07a40043a0 0x7f07a4004880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009fc0 tx=0x7f07a4005830 comp rx=0 tx=0).stop 2024-04-16T16:16:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.706+0000 7f07c4a00640 1 -- 172.21.15.22:0/1185322686 reap_dead start 2024-04-16T16:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7fd91e800640 1 -- 172.21.15.22:0/3945265526 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 msgr2=0x7fd9201f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7fd91e800640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9201f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7fd91e800640 1 -- 172.21.15.22:0/3945265526 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd92015eb90 msgr2=0x7fd9201e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7fd91e800640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd92015eb90 0x7fd9201e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7fd91e800640 1 -- 172.21.15.22:0/3945265526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9200b70c0 con 0x7fd92015ef70 2024-04-16T16:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.704+0000 7f07bea00640 1 -- 172.21.15.22:0/1185322686 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7f07b8009c10 con 0x7f07a40043a0 2024-04-16T16:16:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.705+0000 7f1683e00640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f168415eb30 0x7f16840cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.706+0000 7fd91e800640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9201e8aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd91800be50 tx=0x7fd91800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.706+0000 7f1683e00640 1 -- 172.21.15.22:0/2153039986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16840c78b0 con 0x7f16840d1770 2024-04-16T16:16:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.706+0000 7f1683e00640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16840d1770 0x7f16840c7ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f167402be50 tx=0x7f16740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f39f8400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f39f015ec30 0x7f39f00cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f39f8400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f00d2d40 con 0x7f39f015f010 2024-04-16T16:16:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f39f8400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f00cf960 con 0x7f39f00d13f0 2024-04-16T16:16:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f39f8400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f39f00cfc40 con 0x7f39f015ec30 2024-04-16T16:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f07c6a00640 1 -- 172.21.15.22:0/1185322686 shutdown_connections 2024-04-16T16:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f07c6a00640 1 -- 172.21.15.22:0/1185322686 >> 172.21.15.22:0/1185322686 conn(0x7f07c0062440 msgr2=0x7f07c0062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f167be00640 1 -- 172.21.15.22:0/2153039986 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674032630 con 0x7f16840d1770 2024-04-16T16:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f167be00640 1 -- 172.21.15.22:0/2153039986 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16740327d0 con 0x7f16840d1770 2024-04-16T16:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f167be00640 1 -- 172.21.15.22:0/2153039986 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674032bc0 con 0x7f16840d1770 2024-04-16T16:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16840c8280 con 0x7f16840d1770 2024-04-16T16:16:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f07c6a00640 1 -- 172.21.15.22:0/1185322686 shutdown_connections 2024-04-16T16:16:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f39f5000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f39f015f010 0x7f39f0163380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35104/0 (socket says 172.21.15.22:35104) 2024-04-16T16:16:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f39f5000640 1 -- 172.21.15.22:0/1955276653 learned_addr learned my addr 172.21.15.22:0/1955276653 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7fc3fb400640 1 Processor -- start 2024-04-16T16:16:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.708+0000 7f07c6a00640 1 -- 172.21.15.22:0/1185322686 wait complete. 2024-04-16T16:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.708+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16840c8840 con 0x7f16840d1770 2024-04-16T16:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.708+0000 7fd916000640 1 -- 172.21.15.22:0/3945265526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918019070 con 0x7fd92015ef70 2024-04-16T16:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.708+0000 7fd916000640 1 -- 172.21.15.22:0/3945265526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd918014440 con 0x7fd92015ef70 2024-04-16T16:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.708+0000 7fd916000640 1 -- 172.21.15.22:0/3945265526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918014830 con 0x7fd92015ef70 2024-04-16T16:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.708+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd920143bd0 con 0x7fd92015ef70 2024-04-16T16:16:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.709+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c005290 con 0x7f16840d1770 2024-04-16T16:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.708+0000 7fc3fb400640 1 -- start start 2024-04-16T16:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.709+0000 7fc3fb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40ba770 0x7fc3f40cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.710+0000 7fc3fb400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f4163070 con 0x7fc3f40cfcb0 2024-04-16T16:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.710+0000 7fc3fb400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f4163350 con 0x7fc3f415ec20 2024-04-16T16:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.710+0000 7fc3fb400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f4163630 con 0x7fc3f40ba770 2024-04-16T16:16:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.707+0000 7f39f5a00640 1 --2- 172.21.15.22:0/1955276653 >> v2:172.21.15.43:3300/0 conn(0x7f39f015ec30 0x7f39f00cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7fc3f3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40ba770 0x7fc3f40cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7f07c6a00640 1 Processor -- start 2024-04-16T16:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.710+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd920144190 con 0x7fd92015ef70 2024-04-16T16:16:51.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7f39efe00640 1 -- 172.21.15.22:0/1955276653 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290993609 0 0) 0x7f39f00d2d40 con 0x7f39f015f010 2024-04-16T16:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7fc3f9400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc3f40cfcb0 0x7fc3f40d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35112/0 (socket says 172.21.15.22:35112) 2024-04-16T16:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7fc3f9400640 1 -- 172.21.15.22:0/3569285454 learned_addr learned my addr 172.21.15.22:0/3569285454 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7fc3f3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40ba770 0x7fc3f40cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:57926/0 (socket says 172.21.15.22:57926) 2024-04-16T16:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7f07c6a00640 1 -- start start 2024-04-16T16:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7f39efe00640 1 -- 172.21.15.22:0/1955276653 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39d8003520 con 0x7f39f015f010 2024-04-16T16:16:51.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7f39f5a00640 1 -- 172.21.15.22:0/1955276653 >> v1:172.21.15.43:6789/0 conn(0x7f39f00d13f0 legacy=0x7f39f00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.711+0000 7f39f5a00640 1 -- 172.21.15.22:0/1955276653 >> v1:172.21.15.22:6789/0 conn(0x7f39f015f010 legacy=0x7f39f0163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.712+0000 7f39f5a00640 1 -- 172.21.15.22:0/1955276653 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f00cff20 con 0x7f39f015ec30 2024-04-16T16:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.712+0000 7fc3f3400640 1 -- 172.21.15.22:0/3569285454 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967744813 0 0) 0x7fc3f4163070 con 0x7fc3f40cfcb0 2024-04-16T16:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.712+0000 7fc3f3e00640 1 -- 172.21.15.22:0/3569285454 >> v1:172.21.15.43:6789/0 conn(0x7fc3f415ec20 legacy=0x7fc3f4162770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.712+0000 7fc3f3e00640 1 -- 172.21.15.22:0/3569285454 >> v1:172.21.15.22:6789/0 conn(0x7fc3f40cfcb0 legacy=0x7fc3f40d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.712+0000 7fc3f3e00640 1 -- 172.21.15.22:0/3569285454 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f40d2c10 con 0x7fc3f40ba770 2024-04-16T16:16:51.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.713+0000 7fb3c5000640 1 Processor -- start 2024-04-16T16:16:51.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.713+0000 7f39f5a00640 1 --2- 172.21.15.22:0/1955276653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 0x7f39f00cf330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009d90 tx=0x7f39e802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4160455d2990f5e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7fb3c5000640 1 -- start start 2024-04-16T16:16:51.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.713+0000 7f167be00640 1 -- 172.21.15.22:0/2153039986 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f167404e440 con 0x7f16840d1770 2024-04-16T16:16:51.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.713+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9200b3650 con 0x7fd92015ef70 2024-04-16T16:16:51.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f07c6a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a40043a0 0x7f07c0071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f07c6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c00b6dc0 0x7f07c006e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f07c6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c00b9420 0x7f07c00b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f07c6a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07c00d0380 con 0x7f07c00b9420 2024-04-16T16:16:51.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f07c6a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07c00d0200 con 0x7f07c00b6dc0 2024-04-16T16:16:51.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f07c6a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f07c00d4210 con 0x7f07a40043a0 2024-04-16T16:16:51.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f167be00640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f166406c940 0x7f166406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7fc3f3e00640 1 --2- 172.21.15.22:0/3569285454 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40ba770 0x7fc3f40cf770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80097d0 tx=0x7fc3e802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60c80afa57a5cde server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.714+0000 7f167be00640 1 -- 172.21.15.22:0/2153039986 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f167402f020 con 0x7f16840d1770 2024-04-16T16:16:51.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7f07bfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a40043a0 0x7f07c0071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7f07bfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a40043a0 0x7f07c0071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:57928/0 (socket says 172.21.15.22:57928) 2024-04-16T16:16:51.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7f07bfe00640 1 -- 172.21.15.22:0/3326240778 learned_addr learned my addr 172.21.15.22:0/3326240778 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fb3c5000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb3c00b3620 0x7fb3c0071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7f07c4a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c00b9420 0x7f07c00b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fb3c5000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c00b3b50 con 0x7fb3c01639d0 2024-04-16T16:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fb3c5000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c00d0050 con 0x7fb3c01635f0 2024-04-16T16:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fb3c5000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c00d0330 con 0x7fb3c00b3620 2024-04-16T16:16:51.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7f07bf400640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c00b6dc0 0x7f07c006e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fc3f3400640 1 -- 172.21.15.22:0/3569285454 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8034070 con 0x7fc3f40ba770 2024-04-16T16:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fc3f3400640 1 -- 172.21.15.22:0/3569285454 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e8030800 con 0x7fc3f40ba770 2024-04-16T16:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fd916000640 1 -- 172.21.15.22:0/3945265526 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd91801c070 con 0x7fd92015ef70 2024-04-16T16:16:51.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fc3f3400640 1 -- 172.21.15.22:0/3569285454 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8030bd0 con 0x7fc3f40ba770 2024-04-16T16:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fb3be800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb3c01639d0 0x7fb3c0163e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35122/0 (socket says 172.21.15.22:35122) 2024-04-16T16:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.715+0000 7fb3be800640 1 -- 172.21.15.22:0/768627454 learned_addr learned my addr 172.21.15.22:0/768627454 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.716+0000 7f07c4a00640 1 -- 172.21.15.22:0/3326240778 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a40043a0 msgr2=0x7f07c0071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.716+0000 7f1683400640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f166406c940 0x7f166406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.716+0000 7f07c4a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a40043a0 0x7f07c0071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.716+0000 7f07c4a00640 1 -- 172.21.15.22:0/3326240778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c00b6dc0 msgr2=0x7f07c006e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.716+0000 7f07c4a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c00b6dc0 0x7f07c006e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.716+0000 7f07c4a00640 1 -- 172.21.15.22:0/3326240778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c00b7240 con 0x7f07c00b9420 2024-04-16T16:16:51.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fc3fb400640 1 -- 172.21.15.22:0/3569285454 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40ba770 msgr2=0x7fc3f40cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fc3fb400640 1 --2- 172.21.15.22:0/3569285454 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40ba770 0x7fc3f40cf770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80097d0 tx=0x7fc3e802b940 comp rx=0 tx=0).stop 2024-04-16T16:16:51.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fb3bd400640 1 --2- 172.21.15.22:0/768627454 >> v2:172.21.15.43:3300/0 conn(0x7fb3c00b3620 0x7fb3c0071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fd916000640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8fc06c940 0x7fd8fc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fc3fb400640 1 -- 172.21.15.22:0/3569285454 shutdown_connections 2024-04-16T16:16:51.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fc3fb400640 1 --2- 172.21.15.22:0/3569285454 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40ba770 0x7fc3f40cf770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fc3fb400640 1 -- 172.21.15.22:0/3569285454 >> 172.21.15.22:0/3569285454 conn(0x7fc3f4062620 msgr2=0x7fc3f4062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fd916000640 1 -- 172.21.15.22:0/3945265526 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd9180576a0 con 0x7fd92015ef70 2024-04-16T16:16:51.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fc3fb400640 1 -- 172.21.15.22:0/3569285454 shutdown_connections 2024-04-16T16:16:51.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fc3fb400640 1 -- 172.21.15.22:0/3569285454 wait complete. 2024-04-16T16:16:51.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.717+0000 7fd91de00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8fc06c940 0x7fd8fc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.718+0000 7f07c4a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c00b9420 0x7f07c00b98a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07c00b7660 tx=0x7f07ac007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.718+0000 7f1683400640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f166406c940 0x7f166406ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1670009560 tx=0x7f1670009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.718+0000 7fd91de00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8fc06c940 0x7fd8fc06ee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd910001200 tx=0x7fd910009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.719+0000 7fb3bd400640 1 -- 172.21.15.22:0/768627454 >> v1:172.21.15.43:6789/0 conn(0x7fb3c01635f0 legacy=0x7fb3c00d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.719+0000 7fb3bd400640 1 -- 172.21.15.22:0/768627454 >> v1:172.21.15.22:6789/0 conn(0x7fb3c01639d0 legacy=0x7fb3c0163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.719+0000 7fb3bd400640 1 -- 172.21.15.22:0/768627454 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c0072040 con 0x7fb3c00b3620 2024-04-16T16:16:51.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.719+0000 7fc3fb400640 1 Processor -- start 2024-04-16T16:16:51.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.720+0000 7fb3bd400640 1 --2- 172.21.15.22:0/768627454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c00b3620 0x7fb3c0071b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00097a0 tx=0x7fb3b002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9c525a6b5447515 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.719+0000 7fc3fb400640 1 -- start start 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.720+0000 7fc3fb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3f40ba770 0x7fc3f40ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.720+0000 7fc3fb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40cfcb0 0x7fc3f40b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.720+0000 7fc3fb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f415ec20 0x7fc3f415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.720+0000 7fc3fb400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f40d3b20 con 0x7fc3f40ba770 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.720+0000 7fc3fb400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f415f000 con 0x7fc3f415ec20 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.720+0000 7fc3fb400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f40d3ca0 con 0x7fc3f40cfcb0 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3f40ba770 0x7fc3f40ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3f40ba770 0x7fc3f40ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58314/0 (socket says 172.21.15.22:58314) 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 -- 172.21.15.22:0/2434493858 learned_addr learned my addr 172.21.15.22:0/2434493858 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 -- 172.21.15.22:0/2434493858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40cfcb0 msgr2=0x7fc3f40b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40cfcb0 0x7fc3f40b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 -- 172.21.15.22:0/2434493858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f415ec20 msgr2=0x7fc3f415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f415ec20 0x7fc3f415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 -- 172.21.15.22:0/2434493858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f40b5f00 con 0x7fc3f40ba770 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.721+0000 7fc3f8a00640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3f40ba770 0x7fc3f40ce120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c400 tx=0x7fc3e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7fc3f0c00640 1 -- 172.21.15.22:0/2434493858 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0017070 con 0x7fc3f40ba770 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7fc3f0c00640 1 -- 172.21.15.22:0/2434493858 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e00052d0 con 0x7fc3f40ba770 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7fc3f0c00640 1 -- 172.21.15.22:0/2434493858 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0003830 con 0x7fc3f40ba770 2024-04-16T16:16:51.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7f07b7e00640 1 -- 172.21.15.22:0/3326240778 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac01a070 con 0x7f07c00b9420 2024-04-16T16:16:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7fd916000640 1 -- 172.21.15.22:0/3945265526 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd9200b3650 con 0x7fd92015ef70 2024-04-16T16:16:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7f07b7e00640 1 -- 172.21.15.22:0/3326240778 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac00c980 con 0x7f07c00b9420 2024-04-16T16:16:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7f07b7e00640 1 -- 172.21.15.22:0/3326240778 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00c100 con 0x7f07c00b9420 2024-04-16T16:16:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.722+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c006ee90 con 0x7f07c00b9420 2024-04-16T16:16:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.723+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f415c680 con 0x7fc3f40ba770 2024-04-16T16:16:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.723+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f40b6480 con 0x7fc3f40ba770 2024-04-16T16:16:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.723+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c006f450 con 0x7f07c00b9420 2024-04-16T16:16:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.724+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f404fd90 con 0x7fc3f40ba770 2024-04-16T16:16:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.725+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c004fd90 con 0x7f07c00b9420 2024-04-16T16:16:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.725+0000 7f07b7e00640 1 -- 172.21.15.22:0/3326240778 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f07ac01d070 con 0x7f07c00b9420 2024-04-16T16:16:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.727+0000 7f07b7e00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f07a006c940 0x7f07a006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.727+0000 7fc3f0c00640 1 -- 172.21.15.22:0/2434493858 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3e001a070 con 0x7fc3f40ba770 2024-04-16T16:16:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.727+0000 7f07bfe00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f07a006c940 0x7f07a006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7f07b7e00640 1 -- 172.21.15.22:0/3326240778 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f07ac089830 con 0x7f07c00b9420 2024-04-16T16:16:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7fc3f0c00640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc3d406c9c0 0x7fc3d406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7f39efe00640 1 -- 172.21.15.22:0/1955276653 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8039070 con 0x7f39f015ec30 2024-04-16T16:16:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7f39efe00640 1 -- 172.21.15.22:0/1955276653 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e802cc60 con 0x7f39f015ec30 2024-04-16T16:16:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7f39efe00640 1 -- 172.21.15.22:0/1955276653 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8034660 con 0x7f39f015ec30 2024-04-16T16:16:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7fc3f0c00640 1 -- 172.21.15.22:0/2434493858 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3e008af80 con 0x7fc3f40ba770 2024-04-16T16:16:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7fb3bca00640 1 -- 172.21.15.22:0/768627454 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00317c0 con 0x7fb3c00b3620 2024-04-16T16:16:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7fb3bca00640 1 -- 172.21.15.22:0/768627454 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0037070 con 0x7fb3c00b3620 2024-04-16T16:16:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.728+0000 7fb3bca00640 1 -- 172.21.15.22:0/768627454 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0031bc0 con 0x7fb3c00b3620 2024-04-16T16:16:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.729+0000 7f167be00640 1 -- 172.21.15.22:0/2153039986 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f16840c78b0 con 0x7f16840d1770 2024-04-16T16:16:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.729+0000 7f07bfe00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f07a006c940 0x7f07a006ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b9c0 tx=0x7f07b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.729+0000 7fb3c5000640 1 -- 172.21.15.22:0/768627454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c00b3620 msgr2=0x7fb3c0071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.729+0000 7fb3c5000640 1 --2- 172.21.15.22:0/768627454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c00b3620 0x7fb3c0071b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00097a0 tx=0x7fb3b002b860 comp rx=0 tx=0).stop 2024-04-16T16:16:51.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.730+0000 7fb3c5000640 1 -- 172.21.15.22:0/768627454 shutdown_connections 2024-04-16T16:16:51.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.730+0000 7fb3c5000640 1 --2- 172.21.15.22:0/768627454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c00b3620 0x7fb3c0071b00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.730+0000 7fb3c5000640 1 -- 172.21.15.22:0/768627454 >> 172.21.15.22:0/768627454 conn(0x7fb3c0062440 msgr2=0x7fb3c0062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.730+0000 7f39f8400640 1 -- 172.21.15.22:0/1955276653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 msgr2=0x7f39f00cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.730+0000 7f39f8400640 1 --2- 172.21.15.22:0/1955276653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 0x7f39f00cf330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009d90 tx=0x7f39e802beb0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.731+0000 7fb3c5000640 1 -- 172.21.15.22:0/768627454 shutdown_connections 2024-04-16T16:16:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.731+0000 7fc3f3e00640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc3d406c9c0 0x7fc3d406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.731+0000 7fb3c5000640 1 -- 172.21.15.22:0/768627454 wait complete. 2024-04-16T16:16:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.731+0000 7f39f8400640 1 -- 172.21.15.22:0/1955276653 shutdown_connections 2024-04-16T16:16:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.731+0000 7f39f8400640 1 --2- 172.21.15.22:0/1955276653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 0x7f39f00cf330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.731+0000 7f39f8400640 1 -- 172.21.15.22:0/1955276653 >> 172.21.15.22:0/1955276653 conn(0x7f39f0062440 msgr2=0x7f39f0062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.732+0000 7fc3f3e00640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc3d406c9c0 0x7fc3d406ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8036000 tx=0x7fc3e8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.733+0000 7fb3c5000640 1 Processor -- start 2024-04-16T16:16:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.734+0000 7f07b7e00640 1 -- 172.21.15.22:0/3326240778 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f07c00b7240 con 0x7f07c00b9420 2024-04-16T16:16:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.734+0000 7fb3c5000640 1 -- start start 2024-04-16T16:16:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.735+0000 7fb3c5000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3c00b3620 0x7fb3c0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.735+0000 7fb3c5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c01635f0 0x7fb3c015df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7fb3c5000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3c01639d0 0x7fb3c015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7fb3c5000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c01648c0 con 0x7fb3c00b3620 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7fb3c5000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0164740 con 0x7fb3c01635f0 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7fb3c5000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c0164a40 con 0x7fb3c01639d0 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7fb3bde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3c00b3620 0x7fb3c0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7fb3bde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3c00b3620 0x7fb3c0150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58330/0 (socket says 172.21.15.22:58330) 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7fb3bde00640 1 -- 172.21.15.22:0/964528486 learned_addr learned my addr 172.21.15.22:0/964528486 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.734+0000 7f39f8400640 1 -- 172.21.15.22:0/1955276653 shutdown_connections 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.734+0000 7f39f8400640 1 -- 172.21.15.22:0/1955276653 wait complete. 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.736+0000 7f39f8400640 1 Processor -- start 2024-04-16T16:16:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.737+0000 7f39f8400640 1 -- start start 2024-04-16T16:16:51.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.737+0000 7fb3bd400640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c01635f0 0x7fb3c015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.737+0000 7fb3bde00640 1 -- 172.21.15.22:0/964528486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3c01639d0 msgr2=0x7fb3c015e460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.737+0000 7fb3bde00640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3c01639d0 0x7fb3c015e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.737+0000 7fb3bde00640 1 -- 172.21.15.22:0/964528486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c01635f0 msgr2=0x7fb3c015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.737+0000 7fb3bde00640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c01635f0 0x7fb3c015df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.737+0000 7fb3bde00640 1 -- 172.21.15.22:0/964528486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c00ad6b0 con 0x7fb3c00b3620 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.738+0000 7fb3bde00640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3c00b3620 0x7fb3c0150910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c430 tx=0x7fb3ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.739+0000 7fb3b6000640 1 -- 172.21.15.22:0/964528486 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac017070 con 0x7fb3c00b3620 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.739+0000 7fb3b6000640 1 -- 172.21.15.22:0/964528486 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac0052d0 con 0x7fb3c00b3620 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.739+0000 7fb3b6000640 1 -- 172.21.15.22:0/964528486 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac003830 con 0x7fb3c00b3620 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.739+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c00acbe0 con 0x7fb3c00b3620 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.739+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c00ad950 con 0x7fb3c00b3620 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.740+0000 7f39f8400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f00d13f0 0x7f39f0204660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.740+0000 7f39f8400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 0x7f39f015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.740+0000 7f39f8400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39f015f010 0x7f39f00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.740+0000 7fc3f0c00640 1 -- 172.21.15.22:0/2434493858 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3e0059390 con 0x7fc3f40ba770 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f00d13f0 0x7f39f0204660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f8400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39f00d4390 con 0x7f39f00d13f0 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f00d13f0 0x7f39f0204660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58346/0 (socket says 172.21.15.22:58346) 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f5a00640 1 -- 172.21.15.22:0/2225676425 learned_addr learned my addr 172.21.15.22:0/2225676425 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f8400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f39f00d4210 con 0x7f39f015ec30 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f39f00d4510 con 0x7f39f015f010 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f5000640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 0x7f39f015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7f39f6400640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39f015f010 0x7f39f00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.742+0000 7f39f5a00640 1 -- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39f015f010 msgr2=0x7f39f00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.742+0000 7f39f5a00640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39f015f010 0x7f39f00cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.742+0000 7f39f5a00640 1 -- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 msgr2=0x7f39f015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.742+0000 7f39f5a00640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 0x7f39f015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.742+0000 7f39f5a00640 1 -- 172.21.15.22:0/2225676425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f01606f0 con 0x7f39f00d13f0 2024-04-16T16:16:51.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.741+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb398005290 con 0x7fb3c00b3620 2024-04-16T16:16:51.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.743+0000 7f39f5a00640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f00d13f0 0x7f39f0204660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39e8037040 tx=0x7f39e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.746+0000 7fb3b6000640 1 -- 172.21.15.22:0/964528486 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3ac01a070 con 0x7fb3c00b3620 2024-04-16T16:16:51.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.746+0000 7f39ed600640 1 -- 172.21.15.22:0/2225676425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8039050 con 0x7f39f00d13f0 2024-04-16T16:16:51.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.746+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f00b5cf0 con 0x7f39f00d13f0 2024-04-16T16:16:51.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.746+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f015bb70 con 0x7f39f00d13f0 2024-04-16T16:16:51.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.747+0000 7fb3b6000640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb3a006c920 0x7fb3a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.747+0000 7fb3b6000640 1 -- 172.21.15.22:0/964528486 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb3ac08ae20 con 0x7fb3c00b3620 2024-04-16T16:16:51.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.750+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f004fd90 con 0x7f39f00d13f0 2024-04-16T16:16:51.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.750+0000 7fb3bd400640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb3a006c920 0x7fb3a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.751+0000 7fb3bd400640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb3a006c920 0x7fb3a006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0036000 tx=0x7fb3b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.759+0000 7fb3b6000640 1 -- 172.21.15.22:0/964528486 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb3ac058bf0 con 0x7fb3c00b3620 2024-04-16T16:16:51.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.759+0000 7f39ed600640 1 -- 172.21.15.22:0/2225676425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e8045070 con 0x7f39f00d13f0 2024-04-16T16:16:51.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.759+0000 7f39ed600640 1 -- 172.21.15.22:0/2225676425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e803e810 con 0x7f39f00d13f0 2024-04-16T16:16:51.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.759+0000 7f39ed600640 1 -- 172.21.15.22:0/2225676425 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39e803ea70 con 0x7f39f00d13f0 2024-04-16T16:16:51.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.760+0000 7f39ed600640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39d006c920 0x7f39d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.760+0000 7f39ed600640 1 -- 172.21.15.22:0/2225676425 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f39e80af320 con 0x7f39f00d13f0 2024-04-16T16:16:51.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.763+0000 7f39f5000640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39d006c920 0x7f39d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.763+0000 7fad22000640 1 Processor -- start 2024-04-16T16:16:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.764+0000 7f39f5000640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39d006c920 0x7f39d006ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39f015d9f0 tx=0x7f39dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.763+0000 7fad22000640 1 -- start start 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.766+0000 7fad22000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fad1c0b3620 0x7fad1c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.766+0000 7fad22000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c163e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.766+0000 7fad22000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c0b3b50 con 0x7fad1c1635f0 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.766+0000 7fad22000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c0d0050 con 0x7fad1c0b3620 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.766+0000 7fad22000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0d0330 con 0x7fad1c1639d0 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.767+0000 7fad1aa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fad1c0b3620 0x7fad1c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.767+0000 7fad1aa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fad1c0b3620 0x7fad1c071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:58658/0 (socket says 172.21.15.22:58658) 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.767+0000 7fad1aa00640 1 -- 172.21.15.22:0/2243445887 learned_addr learned my addr 172.21.15.22:0/2243445887 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.767+0000 7fad1be00640 1 --2- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.768+0000 7fad1aa00640 1 -- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 msgr2=0x7fad1c163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.768+0000 7fad1aa00640 1 --2- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c163e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.768+0000 7fad1aa00640 1 -- 172.21.15.22:0/2243445887 >> v1:172.21.15.22:6789/0 conn(0x7fad1c1635f0 legacy=0x7fad1c0d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:51.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.768+0000 7fad1aa00640 1 -- 172.21.15.22:0/2243445887 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c072040 con 0x7fad1c0b3620 2024-04-16T16:16:51.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.769+0000 7f39ed600640 1 -- 172.21.15.22:0/2225676425 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39e807d170 con 0x7f39f00d13f0 2024-04-16T16:16:51.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.770+0000 7fad1aa00640 1 --2- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c0b3620 0x7fad1c071b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad08009870 tx=0x7fad0802b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c44537cc2798831 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.773+0000 7fad1a000640 1 -- 172.21.15.22:0/2243445887 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08038070 con 0x7fad1c0b3620 2024-04-16T16:16:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.774+0000 7fad1a000640 1 -- 172.21.15.22:0/2243445887 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08033620 con 0x7fad1c0b3620 2024-04-16T16:16:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.774+0000 7fad1a000640 1 -- 172.21.15.22:0/2243445887 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad080339f0 con 0x7fad1c0b3620 2024-04-16T16:16:51.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.775+0000 7fad22000640 1 -- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c0b3620 msgr2=0x7fad1c071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.775+0000 7fad22000640 1 --2- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c0b3620 0x7fad1c071b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad08009870 tx=0x7fad0802b7d0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.775+0000 7fad22000640 1 -- 172.21.15.22:0/2243445887 shutdown_connections 2024-04-16T16:16:51.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.775+0000 7fad22000640 1 --2- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c163e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.775+0000 7fad22000640 1 --2- 172.21.15.22:0/2243445887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c0b3620 0x7fad1c071b00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.775+0000 7fad22000640 1 -- 172.21.15.22:0/2243445887 >> 172.21.15.22:0/2243445887 conn(0x7fad1c062440 msgr2=0x7fad1c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:51.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.776+0000 7fad22000640 1 -- 172.21.15.22:0/2243445887 shutdown_connections 2024-04-16T16:16:51.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.776+0000 7fad22000640 1 -- 172.21.15.22:0/2243445887 wait complete. 2024-04-16T16:16:51.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.779+0000 7fad22000640 1 Processor -- start 2024-04-16T16:16:51.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.780+0000 7fad22000640 1 -- start start 2024-04-16T16:16:51.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.781+0000 7fad22000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad1c0b3620 0x7fad1c15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.781+0000 7fad22000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c1635f0 0x7fad1c0aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.781+0000 7fad22000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c1f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.781+0000 7fad22000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c164740 con 0x7fad1c0b3620 2024-04-16T16:16:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.781+0000 7fad22000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1643a0 con 0x7fad1c1635f0 2024-04-16T16:16:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.781+0000 7fad22000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c1648c0 con 0x7fad1c1639d0 2024-04-16T16:16:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.782+0000 7fad1b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad1c0b3620 0x7fad1c15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.782+0000 7fad1b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad1c0b3620 0x7fad1c15c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58358/0 (socket says 172.21.15.22:58358) 2024-04-16T16:16:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.782+0000 7fad1b400640 1 -- 172.21.15.22:0/3640591656 learned_addr learned my addr 172.21.15.22:0/3640591656 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:51.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.782+0000 7fad1be00640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c1f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.783+0000 7fad1aa00640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c1635f0 0x7fad1c0aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.783+0000 7fad1b400640 1 -- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 msgr2=0x7fad1c1f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.783+0000 7fad1b400640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c1f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.783+0000 7fad1b400640 1 -- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c1635f0 msgr2=0x7fad1c0aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:51.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.783+0000 7fad1b400640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c1635f0 0x7fad1c0aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:51.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.783+0000 7fad1b400640 1 -- 172.21.15.22:0/3640591656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c149d50 con 0x7fad1c0b3620 2024-04-16T16:16:51.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.784+0000 7fad1b400640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad1c0b3620 0x7fad1c15c820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c410 tx=0x7fad0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.784+0000 7fad13400640 1 -- 172.21.15.22:0/3640591656 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c017070 con 0x7fad1c0b3620 2024-04-16T16:16:51.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.784+0000 7fad13400640 1 -- 172.21.15.22:0/3640591656 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c0035f0 con 0x7fad1c0b3620 2024-04-16T16:16:51.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.784+0000 7fad13400640 1 -- 172.21.15.22:0/3640591656 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c003a20 con 0x7fad1c0b3620 2024-04-16T16:16:51.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.785+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c14a030 con 0x7fad1c0b3620 2024-04-16T16:16:51.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.786+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c14a5f0 con 0x7fad1c0b3620 2024-04-16T16:16:51.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.789+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c04fd90 con 0x7fad1c0b3620 2024-04-16T16:16:51.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.789+0000 7fad13400640 1 -- 172.21.15.22:0/3640591656 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad0c003bc0 con 0x7fad1c0b3620 2024-04-16T16:16:51.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.791+0000 7fad13400640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7facfc06c8f0 0x7facfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:51.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.791+0000 7fad13400640 1 -- 172.21.15.22:0/3640591656 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad0c08af20 con 0x7fad1c0b3620 2024-04-16T16:16:51.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.797+0000 7fad1aa00640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7facfc06c8f0 0x7facfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:51.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.799+0000 7fad1aa00640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7facfc06c8f0 0x7facfc06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad08035000 tx=0x7fad08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:51.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:51.800+0000 7fad13400640 1 -- 172.21.15.22:0/3640591656 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad0c0010c0 con 0x7fad1c0b3620 2024-04-16T16:16:52.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.131+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3678050190 con 0x7f3678048c90 2024-04-16T16:16:52.137 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:52.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.132+0000 7f3676a00640 1 -- 172.21.15.22:0/961379716 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3670059610 con 0x7f3678048c90 2024-04-16T16:16:52.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.135+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f366006c8f0 msgr2=0x7f366006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.135+0000 7f3685800640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f366006c8f0 0x7f366006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f366c009280 tx=0x7f366c008030 comp rx=0 tx=0).stop 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.135+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678048c90 msgr2=0x7f367817d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.135+0000 7f3685800640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678048c90 0x7f367817d760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f367000e870 tx=0x7f367000ed30 comp rx=0 tx=0).stop 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 shutdown_connections 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f366006c8f0 0x7f366006edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3678049250 0x7f36780e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3678048c90 0x7f367817d760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 --2- 172.21.15.22:0/961379716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3678034e50 0x7f3678181e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 >> 172.21.15.22:0/961379716 conn(0x7f3678055bd0 msgr2=0x7f367804af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 shutdown_connections 2024-04-16T16:16:52.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.136+0000 7f3685800640 1 -- 172.21.15.22:0/961379716 wait complete. 2024-04-16T16:16:52.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.2 2024-04-16T16:16:52.163 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.177+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd920075fa0 con 0x7fd92015ef70 2024-04-16T16:16:52.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.177+0000 7fd916000640 1 -- 172.21.15.22:0/3945265526 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd918059600 con 0x7fd92015ef70 2024-04-16T16:16:52.178 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:52.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.180+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f165c005850 con 0x7f16840d1770 2024-04-16T16:16:52.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8fc06c940 msgr2=0x7fd8fc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7f167be00640 1 -- 172.21.15.22:0/2153039986 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1674040070 con 0x7f16840d1770 2024-04-16T16:16:52.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f07c00d2850 con 0x7f07c00b9420 2024-04-16T16:16:52.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8fc06c940 0x7fd8fc06ee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd910001200 tx=0x7fd910009040 comp rx=0 tx=0).stop 2024-04-16T16:16:52.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 msgr2=0x7fd9201e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.182 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9201e8aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd91800be50 tx=0x7fd91800bf40 comp rx=0 tx=0).stop 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 shutdown_connections 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8fc06c940 0x7fd8fc06ee00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd92015ef70 0x7fd9201e8aa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd92015eb90 0x7fd9201e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 --2- 172.21.15.22:0/3945265526 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9200cfd00 0x7fd9201f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 >> 172.21.15.22:0/3945265526 conn(0x7fd920062440 msgr2=0x7fd920160f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 shutdown_connections 2024-04-16T16:16:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.181+0000 7fd924e00640 1 -- 172.21.15.22:0/3945265526 wait complete. 2024-04-16T16:16:52.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.183+0000 7f07b7e00640 1 -- 172.21.15.22:0/3326240778 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f07c01638c0 con 0x7f07c00b9420 2024-04-16T16:16:52.184 INFO:teuthology.orchestra.run.smithi022.stdout:55834574855 2024-04-16T16:16:52.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.185+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f166406c940 msgr2=0x7f166406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.185+0000 7f1689800640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f166406c940 0x7f166406ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1670009560 tx=0x7f1670009190 comp rx=0 tx=0).stop 2024-04-16T16:16:52.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.185+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16840d1770 msgr2=0x7f16840c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.185+0000 7f1689800640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16840d1770 0x7f16840c7ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f167402be50 tx=0x7f16740046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 shutdown_connections 2024-04-16T16:16:52.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f166406c940 0x7f166406ee00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f168415eb30 0x7f16840cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16840d2de0 0x7f16840c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 --2- 172.21.15.22:0/2153039986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16840d1770 0x7f16840c7ca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 >> 172.21.15.22:0/2153039986 conn(0x7f1684072670 msgr2=0x7f1684160a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f07a006c940 msgr2=0x7f07a006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f07c6a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f07a006c940 0x7f07a006ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b9c0 tx=0x7f07b0008040 comp rx=0 tx=0).stop 2024-04-16T16:16:52.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c00b9420 msgr2=0x7f07c00b98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f07c6a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c00b9420 0x7f07c00b98a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07c00b7660 tx=0x7f07ac007720 comp rx=0 tx=0).stop 2024-04-16T16:16:52.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 shutdown_connections 2024-04-16T16:16:52.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.186+0000 7f1689800640 1 -- 172.21.15.22:0/2153039986 wait complete. 2024-04-16T16:16:52.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 shutdown_connections 2024-04-16T16:16:52.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f07a006c940 0x7f07a006ee00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c00b9420 0x7f07c00b98a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c00b6dc0 0x7f07c006e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb398005580 con 0x7fb3c00b3620 2024-04-16T16:16:52.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 --2- 172.21.15.22:0/3326240778 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07a40043a0 0x7f07c0071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 >> 172.21.15.22:0/3326240778 conn(0x7f07c0062440 msgr2=0x7f07c015cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7fb3b6000640 1 -- 172.21.15.22:0/964528486 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3ac05cef0 con 0x7fb3c00b3620 2024-04-16T16:16:52.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 shutdown_connections 2024-04-16T16:16:52.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.187+0000 7f07c6a00640 1 -- 172.21.15.22:0/3326240778 wait complete. 2024-04-16T16:16:52.189 INFO:teuthology.orchestra.run.smithi022.stdout:55834574855 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb3a006c920 msgr2=0x7fb3a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb3a006c920 0x7fb3a006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0036000 tx=0x7fb3b0008030 comp rx=0 tx=0).stop 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3c00b3620 msgr2=0x7fb3c0150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3c00b3620 0x7fb3c0150910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c430 tx=0x7fb3ac00c8f0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 shutdown_connections 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb3a006c920 0x7fb3a006ede0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3c01639d0 0x7fb3c015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3c01635f0 0x7fb3c015df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 --2- 172.21.15.22:0/964528486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3c00b3620 0x7fb3c0150910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 >> 172.21.15.22:0/964528486 conn(0x7fb3c0062440 msgr2=0x7fb3c006e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 shutdown_connections 2024-04-16T16:16:52.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.190+0000 7fb3c5000640 1 -- 172.21.15.22:0/964528486 wait complete. 2024-04-16T16:16:52.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.196+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc3f40d2720 con 0x7fc3f40ba770 2024-04-16T16:16:52.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.196+0000 7fc3f0c00640 1 -- 172.21.15.22:0/2434493858 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3e0058c90 con 0x7fc3f40ba770 2024-04-16T16:16:52.196 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2024-04-16T16:16:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc3d406c9c0 msgr2=0x7fc3d406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc3d406c9c0 0x7fc3d406ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8036000 tx=0x7fc3e8030000 comp rx=0 tx=0).stop 2024-04-16T16:16:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3f40ba770 msgr2=0x7fc3f40ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3f40ba770 0x7fc3f40ce120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c400 tx=0x7fc3e000c8c0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 shutdown_connections 2024-04-16T16:16:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc3d406c9c0 0x7fc3d406ee80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f415ec20 0x7fc3f415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3f40cfcb0 0x7fc3f40b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 --2- 172.21.15.22:0/2434493858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3f40ba770 0x7fc3f40ce120 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 >> 172.21.15.22:0/2434493858 conn(0x7fc3f4062620 msgr2=0x7fc3f40cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.199+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 shutdown_connections 2024-04-16T16:16:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.200+0000 7fc3fb400640 1 -- 172.21.15.22:0/2434493858 wait complete. 2024-04-16T16:16:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.211+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f39f00d2850 con 0x7f39f00d13f0 2024-04-16T16:16:52.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2024-04-16T16:16:52.211 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.212+0000 7f39ed600640 1 -- 172.21.15.22:0/2225676425 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39e8081470 con 0x7f39f00d13f0 2024-04-16T16:16:52.214 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39d006c920 msgr2=0x7f39d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39d006c920 0x7f39d006ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39f015d9f0 tx=0x7f39dc009040 comp rx=0 tx=0).stop 2024-04-16T16:16:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f00d13f0 msgr2=0x7f39f0204660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f00d13f0 0x7f39f0204660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39e8037040 tx=0x7f39e8004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 shutdown_connections 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39d006c920 0x7f39d006ede0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39f015f010 0x7f39f00cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39f015ec30 0x7f39f015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 --2- 172.21.15.22:0/2225676425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f00d13f0 0x7f39f0204660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.216+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 >> 172.21.15.22:0/2225676425 conn(0x7f39f0062440 msgr2=0x7f39f0161550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.217+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 shutdown_connections 2024-04-16T16:16:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.217+0000 7f39f8400640 1 -- 172.21.15.22:0/2225676425 wait complete. 2024-04-16T16:16:52.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2024-04-16T16:16:52.218 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2024-04-16T16:16:52.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2024-04-16T16:16:52.219 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.220 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2024-04-16T16:16:52.220 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.225+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fad1c1f5670 con 0x7fad1c0b3620 2024-04-16T16:16:52.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.226+0000 7fad13400640 1 -- 172.21.15.22:0/3640591656 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad0c058c60 con 0x7fad1c0b3620 2024-04-16T16:16:52.225 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7facfc06c8f0 msgr2=0x7facfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7facfc06c8f0 0x7facfc06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad08035000 tx=0x7fad08008030 comp rx=0 tx=0).stop 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad1c0b3620 msgr2=0x7fad1c15c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad1c0b3620 0x7fad1c15c820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c410 tx=0x7fad0c00c8d0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 shutdown_connections 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7facfc06c8f0 0x7facfc06edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c1639d0 0x7fad1c1f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad1c1635f0 0x7fad1c0aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 --2- 172.21.15.22:0/3640591656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad1c0b3620 0x7fad1c15c820 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 >> 172.21.15.22:0/3640591656 conn(0x7fad1c062440 msgr2=0x7fad1c06e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 shutdown_connections 2024-04-16T16:16:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.228+0000 7fad22000640 1 -- 172.21.15.22:0/3640591656 wait complete. 2024-04-16T16:16:52.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2024-04-16T16:16:52.236 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.7 2024-04-16T16:16:52.245 DEBUG:teuthology.parallel:result is None 2024-04-16T16:16:52.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T16:16:52.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:16:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.502+0000 7f2a16200640 1 Processor -- start 2024-04-16T16:16:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.502+0000 7f2a16200640 1 -- start start 2024-04-16T16:16:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a16200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2a1015b790 0x7f2a1015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a16200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 0x7f2a1006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a16200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a10071b00 con 0x7f2a100728c0 2024-04-16T16:16:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a16200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2a10072430 con 0x7f2a1015b790 2024-04-16T16:16:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a16200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2a10071de0 con 0x7f2a100d0b80 2024-04-16T16:16:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a07e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2a100728c0 0x7f2a100d0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35136/0 (socket says 172.21.15.22:35136) 2024-04-16T16:16:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a07e00640 1 -- 172.21.15.22:0/2407279513 learned_addr learned my addr 172.21.15.22:0/2407279513 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a14e00640 1 --2- 172.21.15.22:0/2407279513 >> v2:172.21.15.43:3300/0 conn(0x7f2a1015b790 0x7f2a1015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a15800640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 0x7f2a1006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.504+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266404161 0 0) 0x7f2a10071b00 con 0x7f2a100728c0 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29f4005730 con 0x7f2a100728c0 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1682899036 0 0) 0x7f29f4005730 con 0x7f2a100728c0 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 msgr2=0x7f2a1006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 0x7f2a1006cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 >> v2:172.21.15.43:3300/0 conn(0x7f2a1015b790 msgr2=0x7f2a1015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 --2- 172.21.15.22:0/2407279513 >> v2:172.21.15.43:3300/0 conn(0x7f2a1015b790 0x7f2a1015fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a100720c0 con 0x7f2a100728c0 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f29f8001670 con 0x7f2a100728c0 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 >> v1:172.21.15.22:6789/0 conn(0x7f2a100728c0 legacy=0x7f2a100d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4005bc0 0x7f29f4005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29f4006a10 0x7f29f4006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 0x7f29f40073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10072430 con 0x7f29f4006a10 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10071de0 con 0x7f29f4005bc0 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f29f400dbd0 con 0x7f2a100d0b80 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.505+0000 7f2a07e00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29f4006a10 0x7f29f4006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.506+0000 7f2a14e00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4005bc0 0x7f29f4005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.506+0000 7f2a15800640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 0x7f29f40073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.506+0000 7f2a07e00640 1 -- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 msgr2=0x7f29f40073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.506+0000 7f2a07e00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a100d0b80 0x7f29f40073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.506+0000 7f2a07e00640 1 -- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4005bc0 msgr2=0x7f29f4005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.506+0000 7f2a07e00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4005bc0 0x7f29f4005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.506+0000 7f2a07e00640 1 -- 172.21.15.22:0/2407279513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f4005730 con 0x7f29f4006a10 2024-04-16T16:16:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.507+0000 7f2a07e00640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29f4006a10 0x7f29f4006e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c1c0 tx=0x7f29f4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684da8316385a60b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.507+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8007c80 con 0x7f29f4006a10 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.507+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f8030070 con 0x7f29f4006a10 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.507+0000 7f2a0fe00640 1 -- 172.21.15.22:0/2407279513 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8005db0 con 0x7f29f4006a10 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.508+0000 7f2a16200640 1 -- 172.21.15.22:0/2407279513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29f4006a10 msgr2=0x7f29f4006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.508+0000 7f2a16200640 1 --2- 172.21.15.22:0/2407279513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29f4006a10 0x7f29f4006e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c1c0 tx=0x7f29f4007a40 comp rx=0 tx=0).stop 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.508+0000 7f2a15800640 1 -- 172.21.15.22:0/2407279513 reap_dead start 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.508+0000 7f2a16200640 1 -- 172.21.15.22:0/2407279513 shutdown_connections 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.508+0000 7f2a16200640 1 -- 172.21.15.22:0/2407279513 >> 172.21.15.22:0/2407279513 conn(0x7f2a10062440 msgr2=0x7f2a10062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.508+0000 7f2a16200640 1 -- 172.21.15.22:0/2407279513 shutdown_connections 2024-04-16T16:16:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.508+0000 7f2a16200640 1 -- 172.21.15.22:0/2407279513 wait complete. 2024-04-16T16:16:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.510+0000 7f2a16200640 1 Processor -- start 2024-04-16T16:16:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.510+0000 7f2a16200640 1 -- start start 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a16200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4006a10 0x7f2a10150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a16200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a10153f70 0x7f2a101f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a16200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a100b0120 0x7f2a100b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a16200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a100cc7c0 con 0x7f2a100b0120 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a16200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a100afde0 con 0x7f29f4006a10 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a16200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2a100cc940 con 0x7f2a10153f70 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a15800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a100b0120 0x7f2a100b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a15800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a100b0120 0x7f2a100b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58376/0 (socket says 172.21.15.22:58376) 2024-04-16T16:16:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a15800640 1 -- 172.21.15.22:0/1550932312 learned_addr learned my addr 172.21.15.22:0/1550932312 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:52.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a14e00640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4006a10 0x7f2a10150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a15800640 1 -- 172.21.15.22:0/1550932312 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a10153f70 msgr2=0x7f2a101f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a15800640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a10153f70 0x7f2a101f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.511+0000 7f2a15800640 1 -- 172.21.15.22:0/1550932312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4006a10 msgr2=0x7f2a10150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a15800640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4006a10 0x7f2a10150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a15800640 1 -- 172.21.15.22:0/1550932312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1015cdd0 con 0x7f2a100b0120 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a15800640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a100b0120 0x7f2a100b05a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a1006ee00 tx=0x7f2a0800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a0d600640 1 -- 172.21.15.22:0/1550932312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0801c070 con 0x7f2a100b0120 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a0d600640 1 -- 172.21.15.22:0/1550932312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08017400 con 0x7f2a100b0120 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a0d600640 1 -- 172.21.15.22:0/1550932312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a080177f0 con 0x7f2a100b0120 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a101f5150 con 0x7f2a100b0120 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.512+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a101f5710 con 0x7f2a100b0120 2024-04-16T16:16:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.513+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a10075f30 con 0x7f2a100b0120 2024-04-16T16:16:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.515+0000 7f2a0d600640 1 -- 172.21.15.22:0/1550932312 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a08005d10 con 0x7f2a100b0120 2024-04-16T16:16:52.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.515+0000 7f2a0d600640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f29ec06c920 0x7f29ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:52.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.516+0000 7f2a0d600640 1 -- 172.21.15.22:0/1550932312 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2a0808bfc0 con 0x7f2a100b0120 2024-04-16T16:16:52.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.516+0000 7f2a14e00640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f29ec06c920 0x7f29ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:52.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.516+0000 7f2a14e00640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f29ec06c920 0x7f29ec06ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009930 tx=0x7f2a00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:52.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.520+0000 7f2a0d600640 1 -- 172.21.15.22:0/1550932312 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a08012070 con 0x7f2a100b0120 2024-04-16T16:16:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.712+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a10071530 con 0x7f29ec06c920 2024-04-16T16:16:52.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.729+0000 7f2a0d600640 1 -- 172.21.15.22:0/1550932312 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f2a10071530 con 0x7f29ec06c920 2024-04-16T16:16:52.731 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:52.734 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:16:52.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f29ec06c920 msgr2=0x7f29ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f29ec06c920 0x7f29ec06ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009930 tx=0x7f2a00008040 comp rx=0 tx=0).stop 2024-04-16T16:16:52.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a100b0120 msgr2=0x7f2a100b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:52.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a100b0120 0x7f2a100b05a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a1006ee00 tx=0x7f2a0800f4a0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 shutdown_connections 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f29ec06c920 0x7f29ec06ede0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a100b0120 0x7f2a100b05a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a10153f70 0x7f2a101f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 --2- 172.21.15.22:0/1550932312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f4006a10 0x7f2a10150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.736+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 >> 172.21.15.22:0/1550932312 conn(0x7f2a10062440 msgr2=0x7f2a100cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.737+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 shutdown_connections 2024-04-16T16:16:52.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:52.737+0000 7f2a16200640 1 -- 172.21.15.22:0/1550932312 wait complete. 2024-04-16T16:16:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-16T16:16:51.707926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252604,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722116,"statfs":{"total":773094113280,"available":772835446784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.201966"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556501+0000","last_change":"2024-04-16T16:16:42.559736+0000","last_active":"2024-04-16T16:16:43.556501+0000","last_peered":"2024-04-16T16:16:43.556501+0000","last_clean":"2024-04-16T16:16:43.556501+0000","last_became_active":"2024-04-16T16:16:42.559419+0000","last_became_peered":"2024-04-16T16:16:42.559419+0000","last_unstale":"2024-04-16T16:16:43.556501+0000","last_undegraded":"2024-04-16T16:16:43.556501+0000","last_fullsized":"2024-04-16T16:16:43.556501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536010+0000","last_change":"2024-04-16T16:16:42.545904+0000","last_active":"2024-04-16T16:16:43.536010+0000","last_peered":"2024-04-16T16:16:43.536010+0000","last_clean":"2024-04-16T16:16:43.536010+0000","last_became_active":"2024-04-16T16:16:42.545527+0000","last_became_peered":"2024-04-16T16:16:42.545527+0000","last_unstale":"2024-04-16T16:16:43.536010+0000","last_undegraded":"2024-04-16T16:16:43.536010+0000","last_fullsized":"2024-04-16T16:16:43.536010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693597+0000","last_change":"2024-04-16T16:16:42.541313+0000","last_active":"2024-04-16T16:16:43.693597+0000","last_peered":"2024-04-16T16:16:43.693597+0000","last_clean":"2024-04-16T16:16:43.693597+0000","last_became_active":"2024-04-16T16:16:42.540978+0000","last_became_peered":"2024-04-16T16:16:42.540978+0000","last_unstale":"2024-04-16T16:16:43.693597+0000","last_undegraded":"2024-04-16T16:16:43.693597+0000","last_fullsized":"2024-04-16T16:16:43.693597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:35.789405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541482+0000","last_change":"2024-04-16T16:16:42.544651+0000","last_active":"2024-04-16T16:16:43.541482+0000","last_peered":"2024-04-16T16:16:43.541482+0000","last_clean":"2024-04-16T16:16:43.541482+0000","last_became_active":"2024-04-16T16:16:42.542011+0000","last_became_peered":"2024-04-16T16:16:42.542011+0000","last_unstale":"2024-04-16T16:16:43.541482+0000","last_undegraded":"2024-04-16T16:16:43.541482+0000","last_fullsized":"2024-04-16T16:16:43.541482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555229+0000","last_change":"2024-04-16T16:16:42.551072+0000","last_active":"2024-04-16T16:16:43.555229+0000","last_peered":"2024-04-16T16:16:43.555229+0000","last_clean":"2024-04-16T16:16:43.555229+0000","last_became_active":"2024-04-16T16:16:42.550775+0000","last_became_peered":"2024-04-16T16:16:42.550775+0000","last_unstale":"2024-04-16T16:16:43.555229+0000","last_undegraded":"2024-04-16T16:16:43.555229+0000","last_fullsized":"2024-04-16T16:16:43.555229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541943+0000","last_change":"2024-04-16T16:16:42.539682+0000","last_active":"2024-04-16T16:16:43.541943+0000","last_peered":"2024-04-16T16:16:43.541943+0000","last_clean":"2024-04-16T16:16:43.541943+0000","last_became_active":"2024-04-16T16:16:42.539350+0000","last_became_peered":"2024-04-16T16:16:42.539350+0000","last_unstale":"2024-04-16T16:16:43.541943+0000","last_undegraded":"2024-04-16T16:16:43.541943+0000","last_fullsized":"2024-04-16T16:16:43.541943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554743+0000","last_change":"2024-04-16T16:16:42.548040+0000","last_active":"2024-04-16T16:16:43.554743+0000","last_peered":"2024-04-16T16:16:43.554743+0000","last_clean":"2024-04-16T16:16:43.554743+0000","last_became_active":"2024-04-16T16:16:42.547751+0000","last_became_peered":"2024-04-16T16:16:42.547751+0000","last_unstale":"2024-04-16T16:16:43.554743+0000","last_undegraded":"2024-04-16T16:16:43.554743+0000","last_fullsized":"2024-04-16T16:16:43.554743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692888+0000","last_change":"2024-04-16T16:16:42.568826+0000","last_active":"2024-04-16T16:16:43.692888+0000","last_peered":"2024-04-16T16:16:43.692888+0000","last_clean":"2024-04-16T16:16:43.692888+0000","last_became_active":"2024-04-16T16:16:42.568499+0000","last_became_peered":"2024-04-16T16:16:42.568499+0000","last_unstale":"2024-04-16T16:16:43.692888+0000","last_undegraded":"2024-04-16T16:16:43.692888+0000","last_fullsized":"2024-04-16T16:16:43.692888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556655+0000","last_change":"2024-04-16T16:16:42.572131+0000","last_active":"2024-04-16T16:16:43.556655+0000","last_peered":"2024-04-16T16:16:43.556655+0000","last_clean":"2024-04-16T16:16:43.556655+0000","last_became_active":"2024-04-16T16:16:42.571817+0000","last_became_peered":"2024-04-16T16:16:42.571817+0000","last_unstale":"2024-04-16T16:16:43.556655+0000","last_undegraded":"2024-04-16T16:16:43.556655+0000","last_fullsized":"2024-04-16T16:16:43.556655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:54.665217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559687+0000","last_change":"2024-04-16T16:16:42.564515+0000","last_active":"2024-04-16T16:16:43.559687+0000","last_peered":"2024-04-16T16:16:43.559687+0000","last_clean":"2024-04-16T16:16:43.559687+0000","last_became_active":"2024-04-16T16:16:42.564233+0000","last_became_peered":"2024-04-16T16:16:42.564233+0000","last_unstale":"2024-04-16T16:16:43.559687+0000","last_undegraded":"2024-04-16T16:16:43.559687+0000","last_fullsized":"2024-04-16T16:16:43.559687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559928+0000","last_change":"2024-04-16T16:16:42.564502+0000","last_active":"2024-04-16T16:16:43.559928+0000","last_peered":"2024-04-16T16:16:43.559928+0000","last_clean":"2024-04-16T16:16:43.559928+0000","last_became_active":"2024-04-16T16:16:42.563916+0000","last_became_peered":"2024-04-16T16:16:42.563916+0000","last_unstale":"2024-04-16T16:16:43.559928+0000","last_undegraded":"2024-04-16T16:16:43.559928+0000","last_fullsized":"2024-04-16T16:16:43.559928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540676+0000","last_change":"2024-04-16T16:16:42.542716+0000","last_active":"2024-04-16T16:16:43.540676+0000","last_peered":"2024-04-16T16:16:43.540676+0000","last_clean":"2024-04-16T16:16:43.540676+0000","last_became_active":"2024-04-16T16:16:42.542395+0000","last_became_peered":"2024-04-16T16:16:42.542395+0000","last_unstale":"2024-04-16T16:16:43.540676+0000","last_undegraded":"2024-04-16T16:16:43.540676+0000","last_fullsized":"2024-04-16T16:16:43.540676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694675+0000","last_change":"2024-04-16T16:16:42.544561+0000","last_active":"2024-04-16T16:16:43.694675+0000","last_peered":"2024-04-16T16:16:43.694675+0000","last_clean":"2024-04-16T16:16:43.694675+0000","last_became_active":"2024-04-16T16:16:42.544242+0000","last_became_peered":"2024-04-16T16:16:42.544242+0000","last_unstale":"2024-04-16T16:16:43.694675+0000","last_undegraded":"2024-04-16T16:16:43.694675+0000","last_fullsized":"2024-04-16T16:16:43.694675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693350+0000","last_change":"2024-04-16T16:16:42.538809+0000","last_active":"2024-04-16T16:16:43.693350+0000","last_peered":"2024-04-16T16:16:43.693350+0000","last_clean":"2024-04-16T16:16:43.693350+0000","last_became_active":"2024-04-16T16:16:42.538530+0000","last_became_peered":"2024-04-16T16:16:42.538530+0000","last_unstale":"2024-04-16T16:16:43.693350+0000","last_undegraded":"2024-04-16T16:16:43.693350+0000","last_fullsized":"2024-04-16T16:16:43.693350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:14:47.747590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535308+0000","last_change":"2024-04-16T16:16:42.530478+0000","last_active":"2024-04-16T16:16:43.535308+0000","last_peered":"2024-04-16T16:16:43.535308+0000","last_clean":"2024-04-16T16:16:43.535308+0000","last_became_active":"2024-04-16T16:16:42.529997+0000","last_became_peered":"2024-04-16T16:16:42.529997+0000","last_unstale":"2024-04-16T16:16:43.535308+0000","last_undegraded":"2024-04-16T16:16:43.535308+0000","last_fullsized":"2024-04-16T16:16:43.535308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540875+0000","last_change":"2024-04-16T16:16:42.555498+0000","last_active":"2024-04-16T16:16:43.540875+0000","last_peered":"2024-04-16T16:16:43.540875+0000","last_clean":"2024-04-16T16:16:43.540875+0000","last_became_active":"2024-04-16T16:16:42.539784+0000","last_became_peered":"2024-04-16T16:16:42.539784+0000","last_unstale":"2024-04-16T16:16:43.540875+0000","last_undegraded":"2024-04-16T16:16:43.540875+0000","last_fullsized":"2024-04-16T16:16:43.540875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543881+0000","last_change":"2024-04-16T16:16:42.565804+0000","last_active":"2024-04-16T16:16:43.543881+0000","last_peered":"2024-04-16T16:16:43.543881+0000","last_clean":"2024-04-16T16:16:43.543881+0000","last_became_active":"2024-04-16T16:16:42.565289+0000","last_became_peered":"2024-04-16T16:16:42.565289+0000","last_unstale":"2024-04-16T16:16:43.543881+0000","last_undegraded":"2024-04-16T16:16:43.543881+0000","last_fullsized":"2024-04-16T16:16:43.543881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538777+0000","last_change":"2024-04-16T16:16:42.545811+0000","last_active":"2024-04-16T16:16:43.538777+0000","last_peered":"2024-04-16T16:16:43.538777+0000","last_clean":"2024-04-16T16:16:43.538777+0000","last_became_active":"2024-04-16T16:16:42.544185+0000","last_became_peered":"2024-04-16T16:16:42.544185+0000","last_unstale":"2024-04-16T16:16:43.538777+0000","last_undegraded":"2024-04-16T16:16:43.538777+0000","last_fullsized":"2024-04-16T16:16:43.538777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556076+0000","last_change":"2024-04-16T16:16:42.554043+0000","last_active":"2024-04-16T16:16:43.556076+0000","last_peered":"2024-04-16T16:16:43.556076+0000","last_clean":"2024-04-16T16:16:43.556076+0000","last_became_active":"2024-04-16T16:16:42.553829+0000","last_became_peered":"2024-04-16T16:16:42.553829+0000","last_unstale":"2024-04-16T16:16:43.556076+0000","last_undegraded":"2024-04-16T16:16:43.556076+0000","last_fullsized":"2024-04-16T16:16:43.556076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559370+0000","last_change":"2024-04-16T16:16:42.557240+0000","last_active":"2024-04-16T16:16:43.559370+0000","last_peered":"2024-04-16T16:16:43.559370+0000","last_clean":"2024-04-16T16:16:43.559370+0000","last_became_active":"2024-04-16T16:16:42.556898+0000","last_became_peered":"2024-04-16T16:16:42.556898+0000","last_unstale":"2024-04-16T16:16:43.559370+0000","last_undegraded":"2024-04-16T16:16:43.559370+0000","last_fullsized":"2024-04-16T16:16:43.559370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693761+0000","last_change":"2024-04-16T16:16:42.559394+0000","last_active":"2024-04-16T16:16:43.693761+0000","last_peered":"2024-04-16T16:16:43.693761+0000","last_clean":"2024-04-16T16:16:43.693761+0000","last_became_active":"2024-04-16T16:16:42.559074+0000","last_became_peered":"2024-04-16T16:16:42.559074+0000","last_unstale":"2024-04-16T16:16:43.693761+0000","last_undegraded":"2024-04-16T16:16:43.693761+0000","last_fullsized":"2024-04-16T16:16:43.693761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542086+0000","last_change":"2024-04-16T16:16:42.566856+0000","last_active":"2024-04-16T16:16:43.542086+0000","last_peered":"2024-04-16T16:16:43.542086+0000","last_clean":"2024-04-16T16:16:43.542086+0000","last_became_active":"2024-04-16T16:16:42.566592+0000","last_became_peered":"2024-04-16T16:16:42.566592+0000","last_unstale":"2024-04-16T16:16:43.542086+0000","last_undegraded":"2024-04-16T16:16:43.542086+0000","last_fullsized":"2024-04-16T16:16:43.542086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693037+0000","last_change":"2024-04-16T16:16:42.538807+0000","last_active":"2024-04-16T16:16:43.693037+0000","last_peered":"2024-04-16T16:16:43.693037+0000","last_clean":"2024-04-16T16:16:43.693037+0000","last_became_active":"2024-04-16T16:16:42.538490+0000","last_became_peered":"2024-04-16T16:16:42.538490+0000","last_unstale":"2024-04-16T16:16:43.693037+0000","last_undegraded":"2024-04-16T16:16:43.693037+0000","last_fullsized":"2024-04-16T16:16:43.693037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541234+0000","last_change":"2024-04-16T16:16:42.555745+0000","last_active":"2024-04-16T16:16:43.541234+0000","last_peered":"2024-04-16T16:16:43.541234+0000","last_clean":"2024-04-16T16:16:43.541234+0000","last_became_active":"2024-04-16T16:16:42.555171+0000","last_became_peered":"2024-04-16T16:16:42.555171+0000","last_unstale":"2024-04-16T16:16:43.541234+0000","last_undegraded":"2024-04-16T16:16:43.541234+0000","last_fullsized":"2024-04-16T16:16:43.541234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693298+0000","last_change":"2024-04-16T16:16:42.552853+0000","last_active":"2024-04-16T16:16:43.693298+0000","last_peered":"2024-04-16T16:16:43.693298+0000","last_clean":"2024-04-16T16:16:43.693298+0000","last_became_active":"2024-04-16T16:16:42.551283+0000","last_became_peered":"2024-04-16T16:16:42.551283+0000","last_unstale":"2024-04-16T16:16:43.693298+0000","last_undegraded":"2024-04-16T16:16:43.693298+0000","last_fullsized":"2024-04-16T16:16:43.693298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559962+0000","last_change":"2024-04-16T16:16:42.546726+0000","last_active":"2024-04-16T16:16:43.559962+0000","last_peered":"2024-04-16T16:16:43.559962+0000","last_clean":"2024-04-16T16:16:43.559962+0000","last_became_active":"2024-04-16T16:16:42.546286+0000","last_became_peered":"2024-04-16T16:16:42.546286+0000","last_unstale":"2024-04-16T16:16:43.559962+0000","last_undegraded":"2024-04-16T16:16:43.559962+0000","last_fullsized":"2024-04-16T16:16:43.559962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536193+0000","last_change":"2024-04-16T16:16:42.542402+0000","last_active":"2024-04-16T16:16:43.536193+0000","last_peered":"2024-04-16T16:16:43.536193+0000","last_clean":"2024-04-16T16:16:43.536193+0000","last_became_active":"2024-04-16T16:16:42.542076+0000","last_became_peered":"2024-04-16T16:16:42.542076+0000","last_unstale":"2024-04-16T16:16:43.536193+0000","last_undegraded":"2024-04-16T16:16:43.536193+0000","last_fullsized":"2024-04-16T16:16:43.536193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693594+0000","last_change":"2024-04-16T16:16:42.550290+0000","last_active":"2024-04-16T16:16:43.693594+0000","last_peered":"2024-04-16T16:16:43.693594+0000","last_clean":"2024-04-16T16:16:43.693594+0000","last_became_active":"2024-04-16T16:16:42.543751+0000","last_became_peered":"2024-04-16T16:16:42.543751+0000","last_unstale":"2024-04-16T16:16:43.693594+0000","last_undegraded":"2024-04-16T16:16:43.693594+0000","last_fullsized":"2024-04-16T16:16:43.693594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693908+0000","last_change":"2024-04-16T16:16:42.551870+0000","last_active":"2024-04-16T16:16:43.693908+0000","last_peered":"2024-04-16T16:16:43.693908+0000","last_clean":"2024-04-16T16:16:43.693908+0000","last_became_active":"2024-04-16T16:16:42.551579+0000","last_became_peered":"2024-04-16T16:16:42.551579+0000","last_unstale":"2024-04-16T16:16:43.693908+0000","last_undegraded":"2024-04-16T16:16:43.693908+0000","last_fullsized":"2024-04-16T16:16:43.693908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542423+0000","last_change":"2024-04-16T16:16:42.540659+0000","last_active":"2024-04-16T16:16:43.542423+0000","last_peered":"2024-04-16T16:16:43.542423+0000","last_clean":"2024-04-16T16:16:43.542423+0000","last_became_active":"2024-04-16T16:16:42.540216+0000","last_became_peered":"2024-04-16T16:16:42.540216+0000","last_unstale":"2024-04-16T16:16:43.542423+0000","last_undegraded":"2024-04-16T16:16:43.542423+0000","last_fullsized":"2024-04-16T16:16:43.542423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538640+0000","last_change":"2024-04-16T16:16:42.540673+0000","last_active":"2024-04-16T16:16:43.538640+0000","last_peered":"2024-04-16T16:16:43.538640+0000","last_clean":"2024-04-16T16:16:43.538640+0000","last_became_active":"2024-04-16T16:16:42.540278+0000","last_became_peered":"2024-04-16T16:16:42.540278+0000","last_unstale":"2024-04-16T16:16:43.538640+0000","last_undegraded":"2024-04-16T16:16:43.538640+0000","last_fullsized":"2024-04-16T16:16:43.538640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559097+0000","last_change":"2024-04-16T16:16:42.544057+0000","last_active":"2024-04-16T16:16:43.559097+0000","last_peered":"2024-04-16T16:16:43.559097+0000","last_clean":"2024-04-16T16:16:43.559097+0000","last_became_active":"2024-04-16T16:16:42.543472+0000","last_became_peered":"2024-04-16T16:16:42.543472+0000","last_unstale":"2024-04-16T16:16:43.559097+0000","last_undegraded":"2024-04-16T16:16:43.559097+0000","last_fullsized":"2024-04-16T16:16:43.559097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539617+0000","last_change":"2024-04-16T16:16:42.527013+0000","last_active":"2024-04-16T16:16:43.539617+0000","last_peered":"2024-04-16T16:16:43.539617+0000","last_clean":"2024-04-16T16:16:43.539617+0000","last_became_active":"2024-04-16T16:16:42.526649+0000","last_became_peered":"2024-04-16T16:16:42.526649+0000","last_unstale":"2024-04-16T16:16:43.539617+0000","last_undegraded":"2024-04-16T16:16:43.539617+0000","last_fullsized":"2024-04-16T16:16:43.539617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:45.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694817+0000","last_change":"2024-04-16T16:16:41.520565+0000","last_active":"2024-04-16T16:16:43.694817+0000","last_peered":"2024-04-16T16:16:43.694817+0000","last_clean":"2024-04-16T16:16:43.694817+0000","last_became_active":"2024-04-16T16:16:41.517406+0000","last_became_peered":"2024-04-16T16:16:41.517406+0000","last_unstale":"2024-04-16T16:16:43.694817+0000","last_undegraded":"2024-04-16T16:16:43.694817+0000","last_fullsized":"2024-04-16T16:16:43.694817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694052+0000","last_change":"2024-04-16T16:16:42.556599+0000","last_active":"2024-04-16T16:16:43.694052+0000","last_peered":"2024-04-16T16:16:43.694052+0000","last_clean":"2024-04-16T16:16:43.694052+0000","last_became_active":"2024-04-16T16:16:42.555600+0000","last_became_peered":"2024-04-16T16:16:42.555600+0000","last_unstale":"2024-04-16T16:16:43.694052+0000","last_undegraded":"2024-04-16T16:16:43.694052+0000","last_fullsized":"2024-04-16T16:16:43.694052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559476+0000","last_change":"2024-04-16T16:16:41.523017+0000","last_active":"2024-04-16T16:16:43.559476+0000","last_peered":"2024-04-16T16:16:43.559476+0000","last_clean":"2024-04-16T16:16:43.559476+0000","last_became_active":"2024-04-16T16:16:41.519934+0000","last_became_peered":"2024-04-16T16:16:41.519934+0000","last_unstale":"2024-04-16T16:16:43.559476+0000","last_undegraded":"2024-04-16T16:16:43.559476+0000","last_fullsized":"2024-04-16T16:16:43.559476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693115+0000","last_change":"2024-04-16T16:16:41.522651+0000","last_active":"2024-04-16T16:16:43.693115+0000","last_peered":"2024-04-16T16:16:43.693115+0000","last_clean":"2024-04-16T16:16:43.693115+0000","last_became_active":"2024-04-16T16:16:41.522339+0000","last_became_peered":"2024-04-16T16:16:41.522339+0000","last_unstale":"2024-04-16T16:16:43.693115+0000","last_undegraded":"2024-04-16T16:16:43.693115+0000","last_fullsized":"2024-04-16T16:16:43.693115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692933+0000","last_change":"2024-04-16T16:16:42.553919+0000","last_active":"2024-04-16T16:16:43.692933+0000","last_peered":"2024-04-16T16:16:43.692933+0000","last_clean":"2024-04-16T16:16:43.692933+0000","last_became_active":"2024-04-16T16:16:42.553556+0000","last_became_peered":"2024-04-16T16:16:42.553556+0000","last_unstale":"2024-04-16T16:16:43.692933+0000","last_undegraded":"2024-04-16T16:16:43.692933+0000","last_fullsized":"2024-04-16T16:16:43.692933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541425+0000","last_change":"2024-04-16T16:16:41.522408+0000","last_active":"2024-04-16T16:16:43.541425+0000","last_peered":"2024-04-16T16:16:43.541425+0000","last_clean":"2024-04-16T16:16:43.541425+0000","last_became_active":"2024-04-16T16:16:41.520458+0000","last_became_peered":"2024-04-16T16:16:41.520458+0000","last_unstale":"2024-04-16T16:16:43.541425+0000","last_undegraded":"2024-04-16T16:16:43.541425+0000","last_fullsized":"2024-04-16T16:16:43.541425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535473+0000","last_change":"2024-04-16T16:16:42.541508+0000","last_active":"2024-04-16T16:16:43.535473+0000","last_peered":"2024-04-16T16:16:43.535473+0000","last_clean":"2024-04-16T16:16:43.535473+0000","last_became_active":"2024-04-16T16:16:42.541115+0000","last_became_peered":"2024-04-16T16:16:42.541115+0000","last_unstale":"2024-04-16T16:16:43.535473+0000","last_undegraded":"2024-04-16T16:16:43.535473+0000","last_fullsized":"2024-04-16T16:16:43.535473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559608+0000","last_change":"2024-04-16T16:16:41.530254+0000","last_active":"2024-04-16T16:16:43.559608+0000","last_peered":"2024-04-16T16:16:43.559608+0000","last_clean":"2024-04-16T16:16:43.559608+0000","last_became_active":"2024-04-16T16:16:41.529897+0000","last_became_peered":"2024-04-16T16:16:41.529897+0000","last_unstale":"2024-04-16T16:16:43.559608+0000","last_undegraded":"2024-04-16T16:16:43.559608+0000","last_fullsized":"2024-04-16T16:16:43.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543317+0000","last_change":"2024-04-16T16:16:42.554549+0000","last_active":"2024-04-16T16:16:43.543317+0000","last_peered":"2024-04-16T16:16:43.543317+0000","last_clean":"2024-04-16T16:16:43.543317+0000","last_became_active":"2024-04-16T16:16:42.554246+0000","last_became_peered":"2024-04-16T16:16:42.554246+0000","last_unstale":"2024-04-16T16:16:43.543317+0000","last_undegraded":"2024-04-16T16:16:43.543317+0000","last_fullsized":"2024-04-16T16:16:43.543317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543183+0000","last_change":"2024-04-16T16:16:41.531843+0000","last_active":"2024-04-16T16:16:43.543183+0000","last_peered":"2024-04-16T16:16:43.543183+0000","last_clean":"2024-04-16T16:16:43.543183+0000","last_became_active":"2024-04-16T16:16:41.531238+0000","last_became_peered":"2024-04-16T16:16:41.531238+0000","last_unstale":"2024-04-16T16:16:43.543183+0000","last_undegraded":"2024-04-16T16:16:43.543183+0000","last_fullsized":"2024-04-16T16:16:43.543183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694381+0000","last_change":"2024-04-16T16:16:42.556349+0000","last_active":"2024-04-16T16:16:43.694381+0000","last_peered":"2024-04-16T16:16:43.694381+0000","last_clean":"2024-04-16T16:16:43.694381+0000","last_became_active":"2024-04-16T16:16:42.556013+0000","last_became_peered":"2024-04-16T16:16:42.556013+0000","last_unstale":"2024-04-16T16:16:43.694381+0000","last_undegraded":"2024-04-16T16:16:43.694381+0000","last_fullsized":"2024-04-16T16:16:43.694381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535872+0000","last_change":"2024-04-16T16:16:41.524793+0000","last_active":"2024-04-16T16:16:43.535872+0000","last_peered":"2024-04-16T16:16:43.535872+0000","last_clean":"2024-04-16T16:16:43.535872+0000","last_became_active":"2024-04-16T16:16:41.524086+0000","last_became_peered":"2024-04-16T16:16:41.524086+0000","last_unstale":"2024-04-16T16:16:43.535872+0000","last_undegraded":"2024-04-16T16:16:43.535872+0000","last_fullsized":"2024-04-16T16:16:43.535872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541069+0000","last_change":"2024-04-16T16:16:42.551097+0000","last_active":"2024-04-16T16:16:43.541069+0000","last_peered":"2024-04-16T16:16:43.541069+0000","last_clean":"2024-04-16T16:16:43.541069+0000","last_became_active":"2024-04-16T16:16:42.548624+0000","last_became_peered":"2024-04-16T16:16:42.548624+0000","last_unstale":"2024-04-16T16:16:43.541069+0000","last_undegraded":"2024-04-16T16:16:43.541069+0000","last_fullsized":"2024-04-16T16:16:43.541069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559402+0000","last_change":"2024-04-16T16:16:41.523855+0000","last_active":"2024-04-16T16:16:43.559402+0000","last_peered":"2024-04-16T16:16:43.559402+0000","last_clean":"2024-04-16T16:16:43.559402+0000","last_became_active":"2024-04-16T16:16:41.523499+0000","last_became_peered":"2024-04-16T16:16:41.523499+0000","last_unstale":"2024-04-16T16:16:43.559402+0000","last_undegraded":"2024-04-16T16:16:43.559402+0000","last_fullsized":"2024-04-16T16:16:43.559402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555794+0000","last_change":"2024-04-16T16:16:42.557535+0000","last_active":"2024-04-16T16:16:43.555794+0000","last_peered":"2024-04-16T16:16:43.555794+0000","last_clean":"2024-04-16T16:16:43.555794+0000","last_became_active":"2024-04-16T16:16:42.557352+0000","last_became_peered":"2024-04-16T16:16:42.557352+0000","last_unstale":"2024-04-16T16:16:43.555794+0000","last_undegraded":"2024-04-16T16:16:43.555794+0000","last_fullsized":"2024-04-16T16:16:43.555794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694160+0000","last_change":"2024-04-16T16:16:41.509775+0000","last_active":"2024-04-16T16:16:43.694160+0000","last_peered":"2024-04-16T16:16:43.694160+0000","last_clean":"2024-04-16T16:16:43.694160+0000","last_became_active":"2024-04-16T16:16:41.509405+0000","last_became_peered":"2024-04-16T16:16:41.509405+0000","last_unstale":"2024-04-16T16:16:43.694160+0000","last_undegraded":"2024-04-16T16:16:43.694160+0000","last_fullsized":"2024-04-16T16:16:43.694160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:41:24.584086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693565+0000","last_change":"2024-04-16T16:16:42.559637+0000","last_active":"2024-04-16T16:16:43.693565+0000","last_peered":"2024-04-16T16:16:43.693565+0000","last_clean":"2024-04-16T16:16:43.693565+0000","last_became_active":"2024-04-16T16:16:42.559112+0000","last_became_peered":"2024-04-16T16:16:42.559112+0000","last_unstale":"2024-04-16T16:16:43.693565+0000","last_undegraded":"2024-04-16T16:16:43.693565+0000","last_fullsized":"2024-04-16T16:16:43.693565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:58:54.293764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542320+0000","last_change":"2024-04-16T16:16:41.523971+0000","last_active":"2024-04-16T16:16:43.542320+0000","last_peered":"2024-04-16T16:16:43.542320+0000","last_clean":"2024-04-16T16:16:43.542320+0000","last_became_active":"2024-04-16T16:16:41.523700+0000","last_became_peered":"2024-04-16T16:16:41.523700+0000","last_unstale":"2024-04-16T16:16:43.542320+0000","last_undegraded":"2024-04-16T16:16:43.542320+0000","last_fullsized":"2024-04-16T16:16:43.542320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555684+0000","last_change":"2024-04-16T16:16:42.560857+0000","last_active":"2024-04-16T16:16:43.555684+0000","last_peered":"2024-04-16T16:16:43.555684+0000","last_clean":"2024-04-16T16:16:43.555684+0000","last_became_active":"2024-04-16T16:16:42.560540+0000","last_became_peered":"2024-04-16T16:16:42.560540+0000","last_unstale":"2024-04-16T16:16:43.555684+0000","last_undegraded":"2024-04-16T16:16:43.555684+0000","last_fullsized":"2024-04-16T16:16:43.555684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559052+0000","last_change":"2024-04-16T16:16:41.524165+0000","last_active":"2024-04-16T16:16:43.559052+0000","last_peered":"2024-04-16T16:16:43.559052+0000","last_clean":"2024-04-16T16:16:43.559052+0000","last_became_active":"2024-04-16T16:16:41.520052+0000","last_became_peered":"2024-04-16T16:16:41.520052+0000","last_unstale":"2024-04-16T16:16:43.559052+0000","last_undegraded":"2024-04-16T16:16:43.559052+0000","last_fullsized":"2024-04-16T16:16:43.559052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559159+0000","last_change":"2024-04-16T16:16:42.543827+0000","last_active":"2024-04-16T16:16:43.559159+0000","last_peered":"2024-04-16T16:16:43.559159+0000","last_clean":"2024-04-16T16:16:43.559159+0000","last_became_active":"2024-04-16T16:16:42.543057+0000","last_became_peered":"2024-04-16T16:16:42.543057+0000","last_unstale":"2024-04-16T16:16:43.559159+0000","last_undegraded":"2024-04-16T16:16:43.559159+0000","last_fullsized":"2024-04-16T16:16:43.559159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538345+0000","last_change":"2024-04-16T16:16:41.515275+0000","last_active":"2024-04-16T16:16:43.538345+0000","last_peered":"2024-04-16T16:16:43.538345+0000","last_clean":"2024-04-16T16:16:43.538345+0000","last_became_active":"2024-04-16T16:16:41.511512+0000","last_became_peered":"2024-04-16T16:16:41.511512+0000","last_unstale":"2024-04-16T16:16:43.538345+0000","last_undegraded":"2024-04-16T16:16:43.538345+0000","last_fullsized":"2024-04-16T16:16:43.538345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554847+0000","last_change":"2024-04-16T16:16:42.553481+0000","last_active":"2024-04-16T16:16:43.554847+0000","last_peered":"2024-04-16T16:16:43.554847+0000","last_clean":"2024-04-16T16:16:43.554847+0000","last_became_active":"2024-04-16T16:16:42.553097+0000","last_became_peered":"2024-04-16T16:16:42.553097+0000","last_unstale":"2024-04-16T16:16:43.554847+0000","last_undegraded":"2024-04-16T16:16:43.554847+0000","last_fullsized":"2024-04-16T16:16:43.554847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541627+0000","last_change":"2024-04-16T16:16:41.498748+0000","last_active":"2024-04-16T16:16:43.541627+0000","last_peered":"2024-04-16T16:16:43.541627+0000","last_clean":"2024-04-16T16:16:43.541627+0000","last_became_active":"2024-04-16T16:16:41.497561+0000","last_became_peered":"2024-04-16T16:16:41.497561+0000","last_unstale":"2024-04-16T16:16:43.541627+0000","last_undegraded":"2024-04-16T16:16:43.541627+0000","last_fullsized":"2024-04-16T16:16:43.541627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:50.555761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556264+0000","last_change":"2024-04-16T16:16:42.556235+0000","last_active":"2024-04-16T16:16:43.556264+0000","last_peered":"2024-04-16T16:16:43.556264+0000","last_clean":"2024-04-16T16:16:43.556264+0000","last_became_active":"2024-04-16T16:16:42.555772+0000","last_became_peered":"2024-04-16T16:16:42.555772+0000","last_unstale":"2024-04-16T16:16:43.556264+0000","last_undegraded":"2024-04-16T16:16:43.556264+0000","last_fullsized":"2024-04-16T16:16:43.556264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538851+0000","last_change":"2024-04-16T16:16:41.513088+0000","last_active":"2024-04-16T16:16:43.538851+0000","last_peered":"2024-04-16T16:16:43.538851+0000","last_clean":"2024-04-16T16:16:43.538851+0000","last_became_active":"2024-04-16T16:16:41.512316+0000","last_became_peered":"2024-04-16T16:16:41.512316+0000","last_unstale":"2024-04-16T16:16:43.538851+0000","last_undegraded":"2024-04-16T16:16:43.538851+0000","last_fullsized":"2024-04-16T16:16:43.538851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556658+0000","last_change":"2024-04-16T16:16:42.557154+0000","last_active":"2024-04-16T16:16:43.556658+0000","last_peered":"2024-04-16T16:16:43.556658+0000","last_clean":"2024-04-16T16:16:43.556658+0000","last_became_active":"2024-04-16T16:16:42.556853+0000","last_became_peered":"2024-04-16T16:16:42.556853+0000","last_unstale":"2024-04-16T16:16:43.556658+0000","last_undegraded":"2024-04-16T16:16:43.556658+0000","last_fullsized":"2024-04-16T16:16:43.556658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:12:32.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536004+0000","last_change":"2024-04-16T16:16:41.520997+0000","last_active":"2024-04-16T16:16:43.536004+0000","last_peered":"2024-04-16T16:16:43.536004+0000","last_clean":"2024-04-16T16:16:43.536004+0000","last_became_active":"2024-04-16T16:16:41.520502+0000","last_became_peered":"2024-04-16T16:16:41.520502+0000","last_unstale":"2024-04-16T16:16:43.536004+0000","last_undegraded":"2024-04-16T16:16:43.536004+0000","last_fullsized":"2024-04-16T16:16:43.536004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542374+0000","last_change":"2024-04-16T16:16:42.551483+0000","last_active":"2024-04-16T16:16:43.542374+0000","last_peered":"2024-04-16T16:16:43.542374+0000","last_clean":"2024-04-16T16:16:43.542374+0000","last_became_active":"2024-04-16T16:16:42.540166+0000","last_became_peered":"2024-04-16T16:16:42.540166+0000","last_unstale":"2024-04-16T16:16:43.542374+0000","last_undegraded":"2024-04-16T16:16:43.542374+0000","last_fullsized":"2024-04-16T16:16:43.542374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538450+0000","last_change":"2024-04-16T16:16:41.523070+0000","last_active":"2024-04-16T16:16:43.538450+0000","last_peered":"2024-04-16T16:16:43.538450+0000","last_clean":"2024-04-16T16:16:43.538450+0000","last_became_active":"2024-04-16T16:16:41.522786+0000","last_became_peered":"2024-04-16T16:16:41.522786+0000","last_unstale":"2024-04-16T16:16:43.538450+0000","last_undegraded":"2024-04-16T16:16:43.538450+0000","last_fullsized":"2024-04-16T16:16:43.538450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:09.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555935+0000","last_change":"2024-04-16T16:16:42.571326+0000","last_active":"2024-04-16T16:16:43.555935+0000","last_peered":"2024-04-16T16:16:43.555935+0000","last_clean":"2024-04-16T16:16:43.555935+0000","last_became_active":"2024-04-16T16:16:42.570406+0000","last_became_peered":"2024-04-16T16:16:42.570406+0000","last_unstale":"2024-04-16T16:16:43.555935+0000","last_undegraded":"2024-04-16T16:16:43.555935+0000","last_fullsized":"2024-04-16T16:16:43.555935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554754+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:16:43.554754+0000","last_peered":"2024-04-16T16:16:43.554754+0000","last_clean":"2024-04-16T16:16:43.554754+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:16:43.554754+0000","last_undegraded":"2024-04-16T16:16:43.554754+0000","last_fullsized":"2024-04-16T16:16:43.554754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541770+0000","last_change":"2024-04-16T16:16:41.518448+0000","last_active":"2024-04-16T16:16:43.541770+0000","last_peered":"2024-04-16T16:16:43.541770+0000","last_clean":"2024-04-16T16:16:43.541770+0000","last_became_active":"2024-04-16T16:16:41.517938+0000","last_became_peered":"2024-04-16T16:16:41.517938+0000","last_unstale":"2024-04-16T16:16:43.541770+0000","last_undegraded":"2024-04-16T16:16:43.541770+0000","last_fullsized":"2024-04-16T16:16:43.541770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693472+0000","last_change":"2024-04-16T16:16:42.537690+0000","last_active":"2024-04-16T16:16:43.693472+0000","last_peered":"2024-04-16T16:16:43.693472+0000","last_clean":"2024-04-16T16:16:43.693472+0000","last_became_active":"2024-04-16T16:16:42.537268+0000","last_became_peered":"2024-04-16T16:16:42.537268+0000","last_unstale":"2024-04-16T16:16:43.693472+0000","last_undegraded":"2024-04-16T16:16:43.693472+0000","last_fullsized":"2024-04-16T16:16:43.693472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554773+0000","last_change":"2024-04-16T16:16:41.522499+0000","last_active":"2024-04-16T16:16:43.554773+0000","last_peered":"2024-04-16T16:16:43.554773+0000","last_clean":"2024-04-16T16:16:43.554773+0000","last_became_active":"2024-04-16T16:16:41.522124+0000","last_became_peered":"2024-04-16T16:16:41.522124+0000","last_unstale":"2024-04-16T16:16:43.554773+0000","last_undegraded":"2024-04-16T16:16:43.554773+0000","last_fullsized":"2024-04-16T16:16:43.554773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693674+0000","last_change":"2024-04-16T16:16:42.554808+0000","last_active":"2024-04-16T16:16:43.693674+0000","last_peered":"2024-04-16T16:16:43.693674+0000","last_clean":"2024-04-16T16:16:43.693674+0000","last_became_active":"2024-04-16T16:16:42.552890+0000","last_became_peered":"2024-04-16T16:16:42.552890+0000","last_unstale":"2024-04-16T16:16:43.693674+0000","last_undegraded":"2024-04-16T16:16:43.693674+0000","last_fullsized":"2024-04-16T16:16:43.693674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:40.482814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538337+0000","last_change":"2024-04-16T16:16:41.517103+0000","last_active":"2024-04-16T16:16:43.538337+0000","last_peered":"2024-04-16T16:16:43.538337+0000","last_clean":"2024-04-16T16:16:43.538337+0000","last_became_active":"2024-04-16T16:16:41.516829+0000","last_became_peered":"2024-04-16T16:16:41.516829+0000","last_unstale":"2024-04-16T16:16:43.538337+0000","last_undegraded":"2024-04-16T16:16:43.538337+0000","last_fullsized":"2024-04-16T16:16:43.538337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535231+0000","last_change":"2024-04-16T16:16:42.541238+0000","last_active":"2024-04-16T16:16:43.535231+0000","last_peered":"2024-04-16T16:16:43.535231+0000","last_clean":"2024-04-16T16:16:43.535231+0000","last_became_active":"2024-04-16T16:16:42.540924+0000","last_became_peered":"2024-04-16T16:16:42.540924+0000","last_unstale":"2024-04-16T16:16:43.535231+0000","last_undegraded":"2024-04-16T16:16:43.535231+0000","last_fullsized":"2024-04-16T16:16:43.535231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542556+0000","last_change":"2024-04-16T16:16:41.519683+0000","last_active":"2024-04-16T16:16:43.542556+0000","last_peered":"2024-04-16T16:16:43.542556+0000","last_clean":"2024-04-16T16:16:43.542556+0000","last_became_active":"2024-04-16T16:16:41.519343+0000","last_became_peered":"2024-04-16T16:16:41.519343+0000","last_unstale":"2024-04-16T16:16:43.542556+0000","last_undegraded":"2024-04-16T16:16:43.542556+0000","last_fullsized":"2024-04-16T16:16:43.542556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540500+0000","last_change":"2024-04-16T16:16:42.542028+0000","last_active":"2024-04-16T16:16:43.540500+0000","last_peered":"2024-04-16T16:16:43.540500+0000","last_clean":"2024-04-16T16:16:43.540500+0000","last_became_active":"2024-04-16T16:16:42.538888+0000","last_became_peered":"2024-04-16T16:16:42.538888+0000","last_unstale":"2024-04-16T16:16:43.540500+0000","last_undegraded":"2024-04-16T16:16:43.540500+0000","last_fullsized":"2024-04-16T16:16:43.540500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:43.311234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.509361+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.509045+0000","last_became_peered":"2024-04-16T16:16:41.509045+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543027+0000","last_change":"2024-04-16T16:16:42.558916+0000","last_active":"2024-04-16T16:16:43.543027+0000","last_peered":"2024-04-16T16:16:43.543027+0000","last_clean":"2024-04-16T16:16:43.543027+0000","last_became_active":"2024-04-16T16:16:42.545348+0000","last_became_peered":"2024-04-16T16:16:42.545348+0000","last_unstale":"2024-04-16T16:16:43.543027+0000","last_undegraded":"2024-04-16T16:16:43.543027+0000","last_fullsized":"2024-04-16T16:16:43.543027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556231+0000","last_change":"2024-04-16T16:16:41.522662+0000","last_active":"2024-04-16T16:16:43.556231+0000","last_peered":"2024-04-16T16:16:43.556231+0000","last_clean":"2024-04-16T16:16:43.556231+0000","last_became_active":"2024-04-16T16:16:41.522355+0000","last_became_peered":"2024-04-16T16:16:41.522355+0000","last_unstale":"2024-04-16T16:16:43.556231+0000","last_undegraded":"2024-04-16T16:16:43.556231+0000","last_fullsized":"2024-04-16T16:16:43.556231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535843+0000","last_change":"2024-04-16T16:16:42.541278+0000","last_active":"2024-04-16T16:16:43.535843+0000","last_peered":"2024-04-16T16:16:43.535843+0000","last_clean":"2024-04-16T16:16:43.535843+0000","last_became_active":"2024-04-16T16:16:42.540838+0000","last_became_peered":"2024-04-16T16:16:42.540838+0000","last_unstale":"2024-04-16T16:16:43.535843+0000","last_undegraded":"2024-04-16T16:16:43.535843+0000","last_fullsized":"2024-04-16T16:16:43.535843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.558097+0000","last_change":"2024-04-16T16:16:41.527012+0000","last_active":"2024-04-16T16:16:43.558097+0000","last_peered":"2024-04-16T16:16:43.558097+0000","last_clean":"2024-04-16T16:16:43.558097+0000","last_became_active":"2024-04-16T16:16:41.526665+0000","last_became_peered":"2024-04-16T16:16:41.526665+0000","last_unstale":"2024-04-16T16:16:43.558097+0000","last_undegraded":"2024-04-16T16:16:43.558097+0000","last_fullsized":"2024-04-16T16:16:43.558097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693473+0000","last_change":"2024-04-16T16:16:42.549680+0000","last_active":"2024-04-16T16:16:43.693473+0000","last_peered":"2024-04-16T16:16:43.693473+0000","last_clean":"2024-04-16T16:16:43.693473+0000","last_became_active":"2024-04-16T16:16:42.547089+0000","last_became_peered":"2024-04-16T16:16:42.547089+0000","last_unstale":"2024-04-16T16:16:43.693473+0000","last_undegraded":"2024-04-16T16:16:43.693473+0000","last_fullsized":"2024-04-16T16:16:43.693473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559737+0000","last_change":"2024-04-16T16:16:41.528043+0000","last_active":"2024-04-16T16:16:43.559737+0000","last_peered":"2024-04-16T16:16:43.559737+0000","last_clean":"2024-04-16T16:16:43.559737+0000","last_became_active":"2024-04-16T16:16:41.527767+0000","last_became_peered":"2024-04-16T16:16:41.527767+0000","last_unstale":"2024-04-16T16:16:43.559737+0000","last_undegraded":"2024-04-16T16:16:43.559737+0000","last_fullsized":"2024-04-16T16:16:43.559737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694076+0000","last_change":"2024-04-16T16:16:42.540712+0000","last_active":"2024-04-16T16:16:43.694076+0000","last_peered":"2024-04-16T16:16:43.694076+0000","last_clean":"2024-04-16T16:16:43.694076+0000","last_became_active":"2024-04-16T16:16:42.538863+0000","last_became_peered":"2024-04-16T16:16:42.538863+0000","last_unstale":"2024-04-16T16:16:43.694076+0000","last_undegraded":"2024-04-16T16:16:43.694076+0000","last_fullsized":"2024-04-16T16:16:43.694076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554585+0000","last_change":"2024-04-16T16:16:41.518575+0000","last_active":"2024-04-16T16:16:43.554585+0000","last_peered":"2024-04-16T16:16:43.554585+0000","last_clean":"2024-04-16T16:16:43.554585+0000","last_became_active":"2024-04-16T16:16:41.517913+0000","last_became_peered":"2024-04-16T16:16:41.517913+0000","last_unstale":"2024-04-16T16:16:43.554585+0000","last_undegraded":"2024-04-16T16:16:43.554585+0000","last_fullsized":"2024-04-16T16:16:43.554585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539618+0000","last_change":"2024-04-16T16:16:42.539495+0000","last_active":"2024-04-16T16:16:43.539618+0000","last_peered":"2024-04-16T16:16:43.539618+0000","last_clean":"2024-04-16T16:16:43.539618+0000","last_became_active":"2024-04-16T16:16:42.539119+0000","last_became_peered":"2024-04-16T16:16:42.539119+0000","last_unstale":"2024-04-16T16:16:43.539618+0000","last_undegraded":"2024-04-16T16:16:43.539618+0000","last_fullsized":"2024-04-16T16:16:43.539618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:30.369821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535447+0000","last_change":"2024-04-16T16:16:41.524546+0000","last_active":"2024-04-16T16:16:43.535447+0000","last_peered":"2024-04-16T16:16:43.535447+0000","last_clean":"2024-04-16T16:16:43.535447+0000","last_became_active":"2024-04-16T16:16:41.521734+0000","last_became_peered":"2024-04-16T16:16:41.521734+0000","last_unstale":"2024-04-16T16:16:43.535447+0000","last_undegraded":"2024-04-16T16:16:43.535447+0000","last_fullsized":"2024-04-16T16:16:43.535447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693061+0000","last_change":"2024-04-16T16:16:42.549899+0000","last_active":"2024-04-16T16:16:43.693061+0000","last_peered":"2024-04-16T16:16:43.693061+0000","last_clean":"2024-04-16T16:16:43.693061+0000","last_became_active":"2024-04-16T16:16:42.545606+0000","last_became_peered":"2024-04-16T16:16:42.545606+0000","last_unstale":"2024-04-16T16:16:43.693061+0000","last_undegraded":"2024-04-16T16:16:43.693061+0000","last_fullsized":"2024-04-16T16:16:43.693061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.515086+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.514804+0000","last_became_peered":"2024-04-16T16:16:41.514804+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694754+0000","last_change":"2024-04-16T16:16:42.539283+0000","last_active":"2024-04-16T16:16:43.694754+0000","last_peered":"2024-04-16T16:16:43.694754+0000","last_clean":"2024-04-16T16:16:43.694754+0000","last_became_active":"2024-04-16T16:16:42.538992+0000","last_became_peered":"2024-04-16T16:16:42.538992+0000","last_unstale":"2024-04-16T16:16:43.694754+0000","last_undegraded":"2024-04-16T16:16:43.694754+0000","last_fullsized":"2024-04-16T16:16:43.694754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555783+0000","last_change":"2024-04-16T16:16:41.528069+0000","last_active":"2024-04-16T16:16:43.555783+0000","last_peered":"2024-04-16T16:16:43.555783+0000","last_clean":"2024-04-16T16:16:43.555783+0000","last_became_active":"2024-04-16T16:16:41.527661+0000","last_became_peered":"2024-04-16T16:16:41.527661+0000","last_unstale":"2024-04-16T16:16:43.555783+0000","last_undegraded":"2024-04-16T16:16:43.555783+0000","last_fullsized":"2024-04-16T16:16:43.555783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559239+0000","last_change":"2024-04-16T16:16:42.555670+0000","last_active":"2024-04-16T16:16:43.559239+0000","last_peered":"2024-04-16T16:16:43.559239+0000","last_clean":"2024-04-16T16:16:43.559239+0000","last_became_active":"2024-04-16T16:16:42.555257+0000","last_became_peered":"2024-04-16T16:16:42.555257+0000","last_unstale":"2024-04-16T16:16:43.559239+0000","last_undegraded":"2024-04-16T16:16:43.559239+0000","last_fullsized":"2024-04-16T16:16:43.559239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542682+0000","last_change":"2024-04-16T16:16:42.528582+0000","last_active":"2024-04-16T16:16:43.542682+0000","last_peered":"2024-04-16T16:16:43.542682+0000","last_clean":"2024-04-16T16:16:43.542682+0000","last_became_active":"2024-04-16T16:16:42.528086+0000","last_became_peered":"2024-04-16T16:16:42.528086+0000","last_unstale":"2024-04-16T16:16:43.542682+0000","last_undegraded":"2024-04-16T16:16:43.542682+0000","last_fullsized":"2024-04-16T16:16:43.542682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555817+0000","last_change":"2024-04-16T16:16:41.525844+0000","last_active":"2024-04-16T16:16:43.555817+0000","last_peered":"2024-04-16T16:16:43.555817+0000","last_clean":"2024-04-16T16:16:43.555817+0000","last_became_active":"2024-04-16T16:16:41.524506+0000","last_became_peered":"2024-04-16T16:16:41.524506+0000","last_unstale":"2024-04-16T16:16:43.555817+0000","last_undegraded":"2024-04-16T16:16:43.555817+0000","last_fullsized":"2024-04-16T16:16:43.555817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541916+0000","last_change":"2024-04-16T16:16:42.529397+0000","last_active":"2024-04-16T16:16:43.541916+0000","last_peered":"2024-04-16T16:16:43.541916+0000","last_clean":"2024-04-16T16:16:43.541916+0000","last_became_active":"2024-04-16T16:16:42.528776+0000","last_became_peered":"2024-04-16T16:16:42.528776+0000","last_unstale":"2024-04-16T16:16:43.541916+0000","last_undegraded":"2024-04-16T16:16:43.541916+0000","last_fullsized":"2024-04-16T16:16:43.541916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556158+0000","last_change":"2024-04-16T16:16:41.531832+0000","last_active":"2024-04-16T16:16:43.556158+0000","last_peered":"2024-04-16T16:16:43.556158+0000","last_clean":"2024-04-16T16:16:43.556158+0000","last_became_active":"2024-04-16T16:16:41.531327+0000","last_became_peered":"2024-04-16T16:16:41.531327+0000","last_unstale":"2024-04-16T16:16:43.556158+0000","last_undegraded":"2024-04-16T16:16:43.556158+0000","last_fullsized":"2024-04-16T16:16:43.556158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694244+0000","last_change":"2024-04-16T16:16:42.570229+0000","last_active":"2024-04-16T16:16:43.694244+0000","last_peered":"2024-04-16T16:16:43.694244+0000","last_clean":"2024-04-16T16:16:43.694244+0000","last_became_active":"2024-04-16T16:16:42.569878+0000","last_became_peered":"2024-04-16T16:16:42.569878+0000","last_unstale":"2024-04-16T16:16:43.694244+0000","last_undegraded":"2024-04-16T16:16:43.694244+0000","last_fullsized":"2024-04-16T16:16:43.694244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695178+0000","last_change":"2024-04-16T16:16:41.514706+0000","last_active":"2024-04-16T16:16:43.695178+0000","last_peered":"2024-04-16T16:16:43.695178+0000","last_clean":"2024-04-16T16:16:43.695178+0000","last_became_active":"2024-04-16T16:16:41.514337+0000","last_became_peered":"2024-04-16T16:16:41.514337+0000","last_unstale":"2024-04-16T16:16:43.695178+0000","last_undegraded":"2024-04-16T16:16:43.695178+0000","last_fullsized":"2024-04-16T16:16:43.695178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695077+0000","last_change":"2024-04-16T16:16:42.544576+0000","last_active":"2024-04-16T16:16:43.695077+0000","last_peered":"2024-04-16T16:16:43.695077+0000","last_clean":"2024-04-16T16:16:43.695077+0000","last_became_active":"2024-04-16T16:16:42.544221+0000","last_became_peered":"2024-04-16T16:16:42.544221+0000","last_unstale":"2024-04-16T16:16:43.695077+0000","last_undegraded":"2024-04-16T16:16:43.695077+0000","last_fullsized":"2024-04-16T16:16:43.695077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694565+0000","last_change":"2024-04-16T16:16:41.519681+0000","last_active":"2024-04-16T16:16:43.694565+0000","last_peered":"2024-04-16T16:16:43.694565+0000","last_clean":"2024-04-16T16:16:43.694565+0000","last_became_active":"2024-04-16T16:16:41.519259+0000","last_became_peered":"2024-04-16T16:16:41.519259+0000","last_unstale":"2024-04-16T16:16:43.694565+0000","last_undegraded":"2024-04-16T16:16:43.694565+0000","last_fullsized":"2024-04-16T16:16:43.694565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:22.558679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:16:52.758 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:16:53.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.013+0000 7fe392e00640 1 Processor -- start 2024-04-16T16:16:53.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.013+0000 7fe392e00640 1 -- start start 2024-04-16T16:16:53.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.014+0000 7fe392e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe38c06eaa0 0x7fe38c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.014+0000 7fe392e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.014+0000 7fe392e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe38c06ee80 0x7fe38c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.014+0000 7fe392e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe38c06cf10 con 0x7fe38c06ee80 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.014+0000 7fe392e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe38c06d160 con 0x7fe38c06eaa0 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.014+0000 7fe392e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe38c06d440 con 0x7fe38c0cc810 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe38c06ee80 0x7fe38c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe38c06ee80 0x7fe38c15c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58384/0 (socket says 172.21.15.22:58384) 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 -- 172.21.15.22:0/4193828525 learned_addr learned my addr 172.21.15.22:0/4193828525 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe391a00640 1 --2- 172.21.15.22:0/4193828525 >> v2:172.21.15.43:3300/0 conn(0x7fe38c06eaa0 0x7fe38c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe391000640 1 --2- 172.21.15.22:0/4193828525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 -- 172.21.15.22:0/4193828525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 msgr2=0x7fe38c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:53.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 --2- 172.21.15.22:0/4193828525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c06df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 -- 172.21.15.22:0/4193828525 >> v2:172.21.15.43:3300/0 conn(0x7fe38c06eaa0 msgr2=0x7fe38c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:53.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 --2- 172.21.15.22:0/4193828525 >> v2:172.21.15.43:3300/0 conn(0x7fe38c06eaa0 0x7fe38c0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.015+0000 7fe392400640 1 -- 172.21.15.22:0/4193828525 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c06d720 con 0x7fe38c06ee80 2024-04-16T16:16:53.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.016+0000 7fe392400640 1 --2- 172.21.15.22:0/4193828525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c15c200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe38c069380 tx=0x7fe38402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4454392cda8744 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:53.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe38be00640 1 -- 172.21.15.22:0/4193828525 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38402ca70 con 0x7fe38c06ee80 2024-04-16T16:16:53.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe38be00640 1 -- 172.21.15.22:0/4193828525 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38402cc10 con 0x7fe38c06ee80 2024-04-16T16:16:53.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe38be00640 1 -- 172.21.15.22:0/4193828525 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3840343f0 con 0x7fe38c06ee80 2024-04-16T16:16:53.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe392e00640 1 -- 172.21.15.22:0/4193828525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 msgr2=0x7fe38c15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe392e00640 1 --2- 172.21.15.22:0/4193828525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c15c200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe38c069380 tx=0x7fe38402bed0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe392e00640 1 -- 172.21.15.22:0/4193828525 shutdown_connections 2024-04-16T16:16:53.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe392e00640 1 --2- 172.21.15.22:0/4193828525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c15c200 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe392e00640 1 --2- 172.21.15.22:0/4193828525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c06df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe392e00640 1 --2- 172.21.15.22:0/4193828525 >> v2:172.21.15.43:3300/0 conn(0x7fe38c06eaa0 0x7fe38c0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.017+0000 7fe392e00640 1 -- 172.21.15.22:0/4193828525 >> 172.21.15.22:0/4193828525 conn(0x7fe38c062440 msgr2=0x7fe38c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:53.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.018+0000 7fe392e00640 1 -- 172.21.15.22:0/4193828525 shutdown_connections 2024-04-16T16:16:53.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.018+0000 7fe392e00640 1 -- 172.21.15.22:0/4193828525 wait complete. 2024-04-16T16:16:53.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.019+0000 7fe392e00640 1 Processor -- start 2024-04-16T16:16:53.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.019+0000 7fe392e00640 1 -- start start 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.020+0000 7fe392e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c06eaa0 0x7fe38c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.020+0000 7fe392e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.020+0000 7fe392e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.020+0000 7fe392e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c06e440 con 0x7fe38c06ee80 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.020+0000 7fe392e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c0b4360 con 0x7fe38c06eaa0 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.020+0000 7fe392e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe38c15c740 con 0x7fe38c0cc810 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58392/0 (socket says 172.21.15.22:58392) 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 -- 172.21.15.22:0/3808907584 learned_addr learned my addr 172.21.15.22:0/3808907584 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe392400640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391a00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c06eaa0 0x7fe38c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 -- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 msgr2=0x7fe38c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 -- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c06eaa0 msgr2=0x7fe38c0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c06eaa0 0x7fe38c0b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 -- 172.21.15.22:0/3808907584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c0b12d0 con 0x7fe38c06ee80 2024-04-16T16:16:53.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.021+0000 7fe391000640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c1519c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe37800d5f0 tx=0x7fe37800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:53.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.022+0000 7fe389600640 1 -- 172.21.15.22:0/3808907584 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3780125f0 con 0x7fe38c06ee80 2024-04-16T16:16:53.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.022+0000 7fe389600640 1 -- 172.21.15.22:0/3808907584 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378019070 con 0x7fe38c06ee80 2024-04-16T16:16:53.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.022+0000 7fe389600640 1 -- 172.21.15.22:0/3808907584 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3780129d0 con 0x7fe38c06ee80 2024-04-16T16:16:53.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.022+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c0b15b0 con 0x7fe38c06ee80 2024-04-16T16:16:53.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.022+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c0b25d0 con 0x7fe38c06ee80 2024-04-16T16:16:53.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.023+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c075f30 con 0x7fe38c06ee80 2024-04-16T16:16:53.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.024+0000 7fe389600640 1 -- 172.21.15.22:0/3808907584 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe378012b70 con 0x7fe38c06ee80 2024-04-16T16:16:53.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.025+0000 7fe389600640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe36c06c8f0 0x7fe36c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.025+0000 7fe389600640 1 -- 172.21.15.22:0/3808907584 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe37808bff0 con 0x7fe38c06ee80 2024-04-16T16:16:53.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.025+0000 7fe391a00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe36c06c8f0 0x7fe36c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.026+0000 7fe391a00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe36c06c8f0 0x7fe36c06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe380006fd0 tx=0x7fe380008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:53.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.029+0000 7fe389600640 1 -- 172.21.15.22:0/3808907584 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe37805a380 con 0x7fe38c06ee80 2024-04-16T16:16:53.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.220+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe38c0b4b70 con 0x7fe36c06c8f0 2024-04-16T16:16:53.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.238+0000 7fe389600640 1 -- 172.21.15.22:0/3808907584 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7fe38c0b4b70 con 0x7fe36c06c8f0 2024-04-16T16:16:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:53.242 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.243+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe36c06c8f0 msgr2=0x7fe36c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.243+0000 7fe392e00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe36c06c8f0 0x7fe36c06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe380006fd0 tx=0x7fe380008040 comp rx=0 tx=0).stop 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.243+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 msgr2=0x7fe38c1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.243+0000 7fe392e00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c1519c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe37800d5f0 tx=0x7fe37800dab0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 shutdown_connections 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe36c06c8f0 0x7fe36c06edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe38c0cc810 0x7fe38c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe38c06ee80 0x7fe38c1519c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 --2- 172.21.15.22:0/3808907584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c06eaa0 0x7fe38c0b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 >> 172.21.15.22:0/3808907584 conn(0x7fe38c062440 msgr2=0x7fe38c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:53.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 shutdown_connections 2024-04-16T16:16:53.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.244+0000 7fe392e00640 1 -- 172.21.15.22:0/3808907584 wait complete. 2024-04-16T16:16:53.263 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-16T16:16:51.707926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252604,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722116,"statfs":{"total":773094113280,"available":772835446784,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.201966"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556501+0000","last_change":"2024-04-16T16:16:42.559736+0000","last_active":"2024-04-16T16:16:43.556501+0000","last_peered":"2024-04-16T16:16:43.556501+0000","last_clean":"2024-04-16T16:16:43.556501+0000","last_became_active":"2024-04-16T16:16:42.559419+0000","last_became_peered":"2024-04-16T16:16:42.559419+0000","last_unstale":"2024-04-16T16:16:43.556501+0000","last_undegraded":"2024-04-16T16:16:43.556501+0000","last_fullsized":"2024-04-16T16:16:43.556501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536010+0000","last_change":"2024-04-16T16:16:42.545904+0000","last_active":"2024-04-16T16:16:43.536010+0000","last_peered":"2024-04-16T16:16:43.536010+0000","last_clean":"2024-04-16T16:16:43.536010+0000","last_became_active":"2024-04-16T16:16:42.545527+0000","last_became_peered":"2024-04-16T16:16:42.545527+0000","last_unstale":"2024-04-16T16:16:43.536010+0000","last_undegraded":"2024-04-16T16:16:43.536010+0000","last_fullsized":"2024-04-16T16:16:43.536010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693597+0000","last_change":"2024-04-16T16:16:42.541313+0000","last_active":"2024-04-16T16:16:43.693597+0000","last_peered":"2024-04-16T16:16:43.693597+0000","last_clean":"2024-04-16T16:16:43.693597+0000","last_became_active":"2024-04-16T16:16:42.540978+0000","last_became_peered":"2024-04-16T16:16:42.540978+0000","last_unstale":"2024-04-16T16:16:43.693597+0000","last_undegraded":"2024-04-16T16:16:43.693597+0000","last_fullsized":"2024-04-16T16:16:43.693597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:35.789405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541482+0000","last_change":"2024-04-16T16:16:42.544651+0000","last_active":"2024-04-16T16:16:43.541482+0000","last_peered":"2024-04-16T16:16:43.541482+0000","last_clean":"2024-04-16T16:16:43.541482+0000","last_became_active":"2024-04-16T16:16:42.542011+0000","last_became_peered":"2024-04-16T16:16:42.542011+0000","last_unstale":"2024-04-16T16:16:43.541482+0000","last_undegraded":"2024-04-16T16:16:43.541482+0000","last_fullsized":"2024-04-16T16:16:43.541482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555229+0000","last_change":"2024-04-16T16:16:42.551072+0000","last_active":"2024-04-16T16:16:43.555229+0000","last_peered":"2024-04-16T16:16:43.555229+0000","last_clean":"2024-04-16T16:16:43.555229+0000","last_became_active":"2024-04-16T16:16:42.550775+0000","last_became_peered":"2024-04-16T16:16:42.550775+0000","last_unstale":"2024-04-16T16:16:43.555229+0000","last_undegraded":"2024-04-16T16:16:43.555229+0000","last_fullsized":"2024-04-16T16:16:43.555229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541943+0000","last_change":"2024-04-16T16:16:42.539682+0000","last_active":"2024-04-16T16:16:43.541943+0000","last_peered":"2024-04-16T16:16:43.541943+0000","last_clean":"2024-04-16T16:16:43.541943+0000","last_became_active":"2024-04-16T16:16:42.539350+0000","last_became_peered":"2024-04-16T16:16:42.539350+0000","last_unstale":"2024-04-16T16:16:43.541943+0000","last_undegraded":"2024-04-16T16:16:43.541943+0000","last_fullsized":"2024-04-16T16:16:43.541943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554743+0000","last_change":"2024-04-16T16:16:42.548040+0000","last_active":"2024-04-16T16:16:43.554743+0000","last_peered":"2024-04-16T16:16:43.554743+0000","last_clean":"2024-04-16T16:16:43.554743+0000","last_became_active":"2024-04-16T16:16:42.547751+0000","last_became_peered":"2024-04-16T16:16:42.547751+0000","last_unstale":"2024-04-16T16:16:43.554743+0000","last_undegraded":"2024-04-16T16:16:43.554743+0000","last_fullsized":"2024-04-16T16:16:43.554743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692888+0000","last_change":"2024-04-16T16:16:42.568826+0000","last_active":"2024-04-16T16:16:43.692888+0000","last_peered":"2024-04-16T16:16:43.692888+0000","last_clean":"2024-04-16T16:16:43.692888+0000","last_became_active":"2024-04-16T16:16:42.568499+0000","last_became_peered":"2024-04-16T16:16:42.568499+0000","last_unstale":"2024-04-16T16:16:43.692888+0000","last_undegraded":"2024-04-16T16:16:43.692888+0000","last_fullsized":"2024-04-16T16:16:43.692888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556655+0000","last_change":"2024-04-16T16:16:42.572131+0000","last_active":"2024-04-16T16:16:43.556655+0000","last_peered":"2024-04-16T16:16:43.556655+0000","last_clean":"2024-04-16T16:16:43.556655+0000","last_became_active":"2024-04-16T16:16:42.571817+0000","last_became_peered":"2024-04-16T16:16:42.571817+0000","last_unstale":"2024-04-16T16:16:43.556655+0000","last_undegraded":"2024-04-16T16:16:43.556655+0000","last_fullsized":"2024-04-16T16:16:43.556655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:54.665217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559687+0000","last_change":"2024-04-16T16:16:42.564515+0000","last_active":"2024-04-16T16:16:43.559687+0000","last_peered":"2024-04-16T16:16:43.559687+0000","last_clean":"2024-04-16T16:16:43.559687+0000","last_became_active":"2024-04-16T16:16:42.564233+0000","last_became_peered":"2024-04-16T16:16:42.564233+0000","last_unstale":"2024-04-16T16:16:43.559687+0000","last_undegraded":"2024-04-16T16:16:43.559687+0000","last_fullsized":"2024-04-16T16:16:43.559687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559928+0000","last_change":"2024-04-16T16:16:42.564502+0000","last_active":"2024-04-16T16:16:43.559928+0000","last_peered":"2024-04-16T16:16:43.559928+0000","last_clean":"2024-04-16T16:16:43.559928+0000","last_became_active":"2024-04-16T16:16:42.563916+0000","last_became_peered":"2024-04-16T16:16:42.563916+0000","last_unstale":"2024-04-16T16:16:43.559928+0000","last_undegraded":"2024-04-16T16:16:43.559928+0000","last_fullsized":"2024-04-16T16:16:43.559928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540676+0000","last_change":"2024-04-16T16:16:42.542716+0000","last_active":"2024-04-16T16:16:43.540676+0000","last_peered":"2024-04-16T16:16:43.540676+0000","last_clean":"2024-04-16T16:16:43.540676+0000","last_became_active":"2024-04-16T16:16:42.542395+0000","last_became_peered":"2024-04-16T16:16:42.542395+0000","last_unstale":"2024-04-16T16:16:43.540676+0000","last_undegraded":"2024-04-16T16:16:43.540676+0000","last_fullsized":"2024-04-16T16:16:43.540676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694675+0000","last_change":"2024-04-16T16:16:42.544561+0000","last_active":"2024-04-16T16:16:43.694675+0000","last_peered":"2024-04-16T16:16:43.694675+0000","last_clean":"2024-04-16T16:16:43.694675+0000","last_became_active":"2024-04-16T16:16:42.544242+0000","last_became_peered":"2024-04-16T16:16:42.544242+0000","last_unstale":"2024-04-16T16:16:43.694675+0000","last_undegraded":"2024-04-16T16:16:43.694675+0000","last_fullsized":"2024-04-16T16:16:43.694675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693350+0000","last_change":"2024-04-16T16:16:42.538809+0000","last_active":"2024-04-16T16:16:43.693350+0000","last_peered":"2024-04-16T16:16:43.693350+0000","last_clean":"2024-04-16T16:16:43.693350+0000","last_became_active":"2024-04-16T16:16:42.538530+0000","last_became_peered":"2024-04-16T16:16:42.538530+0000","last_unstale":"2024-04-16T16:16:43.693350+0000","last_undegraded":"2024-04-16T16:16:43.693350+0000","last_fullsized":"2024-04-16T16:16:43.693350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:14:47.747590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535308+0000","last_change":"2024-04-16T16:16:42.530478+0000","last_active":"2024-04-16T16:16:43.535308+0000","last_peered":"2024-04-16T16:16:43.535308+0000","last_clean":"2024-04-16T16:16:43.535308+0000","last_became_active":"2024-04-16T16:16:42.529997+0000","last_became_peered":"2024-04-16T16:16:42.529997+0000","last_unstale":"2024-04-16T16:16:43.535308+0000","last_undegraded":"2024-04-16T16:16:43.535308+0000","last_fullsized":"2024-04-16T16:16:43.535308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540875+0000","last_change":"2024-04-16T16:16:42.555498+0000","last_active":"2024-04-16T16:16:43.540875+0000","last_peered":"2024-04-16T16:16:43.540875+0000","last_clean":"2024-04-16T16:16:43.540875+0000","last_became_active":"2024-04-16T16:16:42.539784+0000","last_became_peered":"2024-04-16T16:16:42.539784+0000","last_unstale":"2024-04-16T16:16:43.540875+0000","last_undegraded":"2024-04-16T16:16:43.540875+0000","last_fullsized":"2024-04-16T16:16:43.540875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543881+0000","last_change":"2024-04-16T16:16:42.565804+0000","last_active":"2024-04-16T16:16:43.543881+0000","last_peered":"2024-04-16T16:16:43.543881+0000","last_clean":"2024-04-16T16:16:43.543881+0000","last_became_active":"2024-04-16T16:16:42.565289+0000","last_became_peered":"2024-04-16T16:16:42.565289+0000","last_unstale":"2024-04-16T16:16:43.543881+0000","last_undegraded":"2024-04-16T16:16:43.543881+0000","last_fullsized":"2024-04-16T16:16:43.543881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:54:38.716083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538777+0000","last_change":"2024-04-16T16:16:42.545811+0000","last_active":"2024-04-16T16:16:43.538777+0000","last_peered":"2024-04-16T16:16:43.538777+0000","last_clean":"2024-04-16T16:16:43.538777+0000","last_became_active":"2024-04-16T16:16:42.544185+0000","last_became_peered":"2024-04-16T16:16:42.544185+0000","last_unstale":"2024-04-16T16:16:43.538777+0000","last_undegraded":"2024-04-16T16:16:43.538777+0000","last_fullsized":"2024-04-16T16:16:43.538777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556076+0000","last_change":"2024-04-16T16:16:42.554043+0000","last_active":"2024-04-16T16:16:43.556076+0000","last_peered":"2024-04-16T16:16:43.556076+0000","last_clean":"2024-04-16T16:16:43.556076+0000","last_became_active":"2024-04-16T16:16:42.553829+0000","last_became_peered":"2024-04-16T16:16:42.553829+0000","last_unstale":"2024-04-16T16:16:43.556076+0000","last_undegraded":"2024-04-16T16:16:43.556076+0000","last_fullsized":"2024-04-16T16:16:43.556076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559370+0000","last_change":"2024-04-16T16:16:42.557240+0000","last_active":"2024-04-16T16:16:43.559370+0000","last_peered":"2024-04-16T16:16:43.559370+0000","last_clean":"2024-04-16T16:16:43.559370+0000","last_became_active":"2024-04-16T16:16:42.556898+0000","last_became_peered":"2024-04-16T16:16:42.556898+0000","last_unstale":"2024-04-16T16:16:43.559370+0000","last_undegraded":"2024-04-16T16:16:43.559370+0000","last_fullsized":"2024-04-16T16:16:43.559370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693761+0000","last_change":"2024-04-16T16:16:42.559394+0000","last_active":"2024-04-16T16:16:43.693761+0000","last_peered":"2024-04-16T16:16:43.693761+0000","last_clean":"2024-04-16T16:16:43.693761+0000","last_became_active":"2024-04-16T16:16:42.559074+0000","last_became_peered":"2024-04-16T16:16:42.559074+0000","last_unstale":"2024-04-16T16:16:43.693761+0000","last_undegraded":"2024-04-16T16:16:43.693761+0000","last_fullsized":"2024-04-16T16:16:43.693761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542086+0000","last_change":"2024-04-16T16:16:42.566856+0000","last_active":"2024-04-16T16:16:43.542086+0000","last_peered":"2024-04-16T16:16:43.542086+0000","last_clean":"2024-04-16T16:16:43.542086+0000","last_became_active":"2024-04-16T16:16:42.566592+0000","last_became_peered":"2024-04-16T16:16:42.566592+0000","last_unstale":"2024-04-16T16:16:43.542086+0000","last_undegraded":"2024-04-16T16:16:43.542086+0000","last_fullsized":"2024-04-16T16:16:43.542086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:16.261090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693037+0000","last_change":"2024-04-16T16:16:42.538807+0000","last_active":"2024-04-16T16:16:43.693037+0000","last_peered":"2024-04-16T16:16:43.693037+0000","last_clean":"2024-04-16T16:16:43.693037+0000","last_became_active":"2024-04-16T16:16:42.538490+0000","last_became_peered":"2024-04-16T16:16:42.538490+0000","last_unstale":"2024-04-16T16:16:43.693037+0000","last_undegraded":"2024-04-16T16:16:43.693037+0000","last_fullsized":"2024-04-16T16:16:43.693037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541234+0000","last_change":"2024-04-16T16:16:42.555745+0000","last_active":"2024-04-16T16:16:43.541234+0000","last_peered":"2024-04-16T16:16:43.541234+0000","last_clean":"2024-04-16T16:16:43.541234+0000","last_became_active":"2024-04-16T16:16:42.555171+0000","last_became_peered":"2024-04-16T16:16:42.555171+0000","last_unstale":"2024-04-16T16:16:43.541234+0000","last_undegraded":"2024-04-16T16:16:43.541234+0000","last_fullsized":"2024-04-16T16:16:43.541234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693298+0000","last_change":"2024-04-16T16:16:42.552853+0000","last_active":"2024-04-16T16:16:43.693298+0000","last_peered":"2024-04-16T16:16:43.693298+0000","last_clean":"2024-04-16T16:16:43.693298+0000","last_became_active":"2024-04-16T16:16:42.551283+0000","last_became_peered":"2024-04-16T16:16:42.551283+0000","last_unstale":"2024-04-16T16:16:43.693298+0000","last_undegraded":"2024-04-16T16:16:43.693298+0000","last_fullsized":"2024-04-16T16:16:43.693298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559962+0000","last_change":"2024-04-16T16:16:42.546726+0000","last_active":"2024-04-16T16:16:43.559962+0000","last_peered":"2024-04-16T16:16:43.559962+0000","last_clean":"2024-04-16T16:16:43.559962+0000","last_became_active":"2024-04-16T16:16:42.546286+0000","last_became_peered":"2024-04-16T16:16:42.546286+0000","last_unstale":"2024-04-16T16:16:43.559962+0000","last_undegraded":"2024-04-16T16:16:43.559962+0000","last_fullsized":"2024-04-16T16:16:43.559962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536193+0000","last_change":"2024-04-16T16:16:42.542402+0000","last_active":"2024-04-16T16:16:43.536193+0000","last_peered":"2024-04-16T16:16:43.536193+0000","last_clean":"2024-04-16T16:16:43.536193+0000","last_became_active":"2024-04-16T16:16:42.542076+0000","last_became_peered":"2024-04-16T16:16:42.542076+0000","last_unstale":"2024-04-16T16:16:43.536193+0000","last_undegraded":"2024-04-16T16:16:43.536193+0000","last_fullsized":"2024-04-16T16:16:43.536193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693594+0000","last_change":"2024-04-16T16:16:42.550290+0000","last_active":"2024-04-16T16:16:43.693594+0000","last_peered":"2024-04-16T16:16:43.693594+0000","last_clean":"2024-04-16T16:16:43.693594+0000","last_became_active":"2024-04-16T16:16:42.543751+0000","last_became_peered":"2024-04-16T16:16:42.543751+0000","last_unstale":"2024-04-16T16:16:43.693594+0000","last_undegraded":"2024-04-16T16:16:43.693594+0000","last_fullsized":"2024-04-16T16:16:43.693594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693908+0000","last_change":"2024-04-16T16:16:42.551870+0000","last_active":"2024-04-16T16:16:43.693908+0000","last_peered":"2024-04-16T16:16:43.693908+0000","last_clean":"2024-04-16T16:16:43.693908+0000","last_became_active":"2024-04-16T16:16:42.551579+0000","last_became_peered":"2024-04-16T16:16:42.551579+0000","last_unstale":"2024-04-16T16:16:43.693908+0000","last_undegraded":"2024-04-16T16:16:43.693908+0000","last_fullsized":"2024-04-16T16:16:43.693908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:37.101744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542423+0000","last_change":"2024-04-16T16:16:42.540659+0000","last_active":"2024-04-16T16:16:43.542423+0000","last_peered":"2024-04-16T16:16:43.542423+0000","last_clean":"2024-04-16T16:16:43.542423+0000","last_became_active":"2024-04-16T16:16:42.540216+0000","last_became_peered":"2024-04-16T16:16:42.540216+0000","last_unstale":"2024-04-16T16:16:43.542423+0000","last_undegraded":"2024-04-16T16:16:43.542423+0000","last_fullsized":"2024-04-16T16:16:43.542423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538640+0000","last_change":"2024-04-16T16:16:42.540673+0000","last_active":"2024-04-16T16:16:43.538640+0000","last_peered":"2024-04-16T16:16:43.538640+0000","last_clean":"2024-04-16T16:16:43.538640+0000","last_became_active":"2024-04-16T16:16:42.540278+0000","last_became_peered":"2024-04-16T16:16:42.540278+0000","last_unstale":"2024-04-16T16:16:43.538640+0000","last_undegraded":"2024-04-16T16:16:43.538640+0000","last_fullsized":"2024-04-16T16:16:43.538640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:22.960210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559097+0000","last_change":"2024-04-16T16:16:42.544057+0000","last_active":"2024-04-16T16:16:43.559097+0000","last_peered":"2024-04-16T16:16:43.559097+0000","last_clean":"2024-04-16T16:16:43.559097+0000","last_became_active":"2024-04-16T16:16:42.543472+0000","last_became_peered":"2024-04-16T16:16:42.543472+0000","last_unstale":"2024-04-16T16:16:43.559097+0000","last_undegraded":"2024-04-16T16:16:43.559097+0000","last_fullsized":"2024-04-16T16:16:43.559097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539617+0000","last_change":"2024-04-16T16:16:42.527013+0000","last_active":"2024-04-16T16:16:43.539617+0000","last_peered":"2024-04-16T16:16:43.539617+0000","last_clean":"2024-04-16T16:16:43.539617+0000","last_became_active":"2024-04-16T16:16:42.526649+0000","last_became_peered":"2024-04-16T16:16:42.526649+0000","last_unstale":"2024-04-16T16:16:43.539617+0000","last_undegraded":"2024-04-16T16:16:43.539617+0000","last_fullsized":"2024-04-16T16:16:43.539617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:45.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694817+0000","last_change":"2024-04-16T16:16:41.520565+0000","last_active":"2024-04-16T16:16:43.694817+0000","last_peered":"2024-04-16T16:16:43.694817+0000","last_clean":"2024-04-16T16:16:43.694817+0000","last_became_active":"2024-04-16T16:16:41.517406+0000","last_became_peered":"2024-04-16T16:16:41.517406+0000","last_unstale":"2024-04-16T16:16:43.694817+0000","last_undegraded":"2024-04-16T16:16:43.694817+0000","last_fullsized":"2024-04-16T16:16:43.694817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694052+0000","last_change":"2024-04-16T16:16:42.556599+0000","last_active":"2024-04-16T16:16:43.694052+0000","last_peered":"2024-04-16T16:16:43.694052+0000","last_clean":"2024-04-16T16:16:43.694052+0000","last_became_active":"2024-04-16T16:16:42.555600+0000","last_became_peered":"2024-04-16T16:16:42.555600+0000","last_unstale":"2024-04-16T16:16:43.694052+0000","last_undegraded":"2024-04-16T16:16:43.694052+0000","last_fullsized":"2024-04-16T16:16:43.694052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559476+0000","last_change":"2024-04-16T16:16:41.523017+0000","last_active":"2024-04-16T16:16:43.559476+0000","last_peered":"2024-04-16T16:16:43.559476+0000","last_clean":"2024-04-16T16:16:43.559476+0000","last_became_active":"2024-04-16T16:16:41.519934+0000","last_became_peered":"2024-04-16T16:16:41.519934+0000","last_unstale":"2024-04-16T16:16:43.559476+0000","last_undegraded":"2024-04-16T16:16:43.559476+0000","last_fullsized":"2024-04-16T16:16:43.559476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693115+0000","last_change":"2024-04-16T16:16:41.522651+0000","last_active":"2024-04-16T16:16:43.693115+0000","last_peered":"2024-04-16T16:16:43.693115+0000","last_clean":"2024-04-16T16:16:43.693115+0000","last_became_active":"2024-04-16T16:16:41.522339+0000","last_became_peered":"2024-04-16T16:16:41.522339+0000","last_unstale":"2024-04-16T16:16:43.693115+0000","last_undegraded":"2024-04-16T16:16:43.693115+0000","last_fullsized":"2024-04-16T16:16:43.693115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.692933+0000","last_change":"2024-04-16T16:16:42.553919+0000","last_active":"2024-04-16T16:16:43.692933+0000","last_peered":"2024-04-16T16:16:43.692933+0000","last_clean":"2024-04-16T16:16:43.692933+0000","last_became_active":"2024-04-16T16:16:42.553556+0000","last_became_peered":"2024-04-16T16:16:42.553556+0000","last_unstale":"2024-04-16T16:16:43.692933+0000","last_undegraded":"2024-04-16T16:16:43.692933+0000","last_fullsized":"2024-04-16T16:16:43.692933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541425+0000","last_change":"2024-04-16T16:16:41.522408+0000","last_active":"2024-04-16T16:16:43.541425+0000","last_peered":"2024-04-16T16:16:43.541425+0000","last_clean":"2024-04-16T16:16:43.541425+0000","last_became_active":"2024-04-16T16:16:41.520458+0000","last_became_peered":"2024-04-16T16:16:41.520458+0000","last_unstale":"2024-04-16T16:16:43.541425+0000","last_undegraded":"2024-04-16T16:16:43.541425+0000","last_fullsized":"2024-04-16T16:16:43.541425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535473+0000","last_change":"2024-04-16T16:16:42.541508+0000","last_active":"2024-04-16T16:16:43.535473+0000","last_peered":"2024-04-16T16:16:43.535473+0000","last_clean":"2024-04-16T16:16:43.535473+0000","last_became_active":"2024-04-16T16:16:42.541115+0000","last_became_peered":"2024-04-16T16:16:42.541115+0000","last_unstale":"2024-04-16T16:16:43.535473+0000","last_undegraded":"2024-04-16T16:16:43.535473+0000","last_fullsized":"2024-04-16T16:16:43.535473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:35.424642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559608+0000","last_change":"2024-04-16T16:16:41.530254+0000","last_active":"2024-04-16T16:16:43.559608+0000","last_peered":"2024-04-16T16:16:43.559608+0000","last_clean":"2024-04-16T16:16:43.559608+0000","last_became_active":"2024-04-16T16:16:41.529897+0000","last_became_peered":"2024-04-16T16:16:41.529897+0000","last_unstale":"2024-04-16T16:16:43.559608+0000","last_undegraded":"2024-04-16T16:16:43.559608+0000","last_fullsized":"2024-04-16T16:16:43.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543317+0000","last_change":"2024-04-16T16:16:42.554549+0000","last_active":"2024-04-16T16:16:43.543317+0000","last_peered":"2024-04-16T16:16:43.543317+0000","last_clean":"2024-04-16T16:16:43.543317+0000","last_became_active":"2024-04-16T16:16:42.554246+0000","last_became_peered":"2024-04-16T16:16:42.554246+0000","last_unstale":"2024-04-16T16:16:43.543317+0000","last_undegraded":"2024-04-16T16:16:43.543317+0000","last_fullsized":"2024-04-16T16:16:43.543317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543183+0000","last_change":"2024-04-16T16:16:41.531843+0000","last_active":"2024-04-16T16:16:43.543183+0000","last_peered":"2024-04-16T16:16:43.543183+0000","last_clean":"2024-04-16T16:16:43.543183+0000","last_became_active":"2024-04-16T16:16:41.531238+0000","last_became_peered":"2024-04-16T16:16:41.531238+0000","last_unstale":"2024-04-16T16:16:43.543183+0000","last_undegraded":"2024-04-16T16:16:43.543183+0000","last_fullsized":"2024-04-16T16:16:43.543183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694381+0000","last_change":"2024-04-16T16:16:42.556349+0000","last_active":"2024-04-16T16:16:43.694381+0000","last_peered":"2024-04-16T16:16:43.694381+0000","last_clean":"2024-04-16T16:16:43.694381+0000","last_became_active":"2024-04-16T16:16:42.556013+0000","last_became_peered":"2024-04-16T16:16:42.556013+0000","last_unstale":"2024-04-16T16:16:43.694381+0000","last_undegraded":"2024-04-16T16:16:43.694381+0000","last_fullsized":"2024-04-16T16:16:43.694381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:08.705585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535872+0000","last_change":"2024-04-16T16:16:41.524793+0000","last_active":"2024-04-16T16:16:43.535872+0000","last_peered":"2024-04-16T16:16:43.535872+0000","last_clean":"2024-04-16T16:16:43.535872+0000","last_became_active":"2024-04-16T16:16:41.524086+0000","last_became_peered":"2024-04-16T16:16:41.524086+0000","last_unstale":"2024-04-16T16:16:43.535872+0000","last_undegraded":"2024-04-16T16:16:43.535872+0000","last_fullsized":"2024-04-16T16:16:43.535872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541069+0000","last_change":"2024-04-16T16:16:42.551097+0000","last_active":"2024-04-16T16:16:43.541069+0000","last_peered":"2024-04-16T16:16:43.541069+0000","last_clean":"2024-04-16T16:16:43.541069+0000","last_became_active":"2024-04-16T16:16:42.548624+0000","last_became_peered":"2024-04-16T16:16:42.548624+0000","last_unstale":"2024-04-16T16:16:43.541069+0000","last_undegraded":"2024-04-16T16:16:43.541069+0000","last_fullsized":"2024-04-16T16:16:43.541069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:40.365642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559402+0000","last_change":"2024-04-16T16:16:41.523855+0000","last_active":"2024-04-16T16:16:43.559402+0000","last_peered":"2024-04-16T16:16:43.559402+0000","last_clean":"2024-04-16T16:16:43.559402+0000","last_became_active":"2024-04-16T16:16:41.523499+0000","last_became_peered":"2024-04-16T16:16:41.523499+0000","last_unstale":"2024-04-16T16:16:43.559402+0000","last_undegraded":"2024-04-16T16:16:43.559402+0000","last_fullsized":"2024-04-16T16:16:43.559402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555794+0000","last_change":"2024-04-16T16:16:42.557535+0000","last_active":"2024-04-16T16:16:43.555794+0000","last_peered":"2024-04-16T16:16:43.555794+0000","last_clean":"2024-04-16T16:16:43.555794+0000","last_became_active":"2024-04-16T16:16:42.557352+0000","last_became_peered":"2024-04-16T16:16:42.557352+0000","last_unstale":"2024-04-16T16:16:43.555794+0000","last_undegraded":"2024-04-16T16:16:43.555794+0000","last_fullsized":"2024-04-16T16:16:43.555794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694160+0000","last_change":"2024-04-16T16:16:41.509775+0000","last_active":"2024-04-16T16:16:43.694160+0000","last_peered":"2024-04-16T16:16:43.694160+0000","last_clean":"2024-04-16T16:16:43.694160+0000","last_became_active":"2024-04-16T16:16:41.509405+0000","last_became_peered":"2024-04-16T16:16:41.509405+0000","last_unstale":"2024-04-16T16:16:43.694160+0000","last_undegraded":"2024-04-16T16:16:43.694160+0000","last_fullsized":"2024-04-16T16:16:43.694160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:41:24.584086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693565+0000","last_change":"2024-04-16T16:16:42.559637+0000","last_active":"2024-04-16T16:16:43.693565+0000","last_peered":"2024-04-16T16:16:43.693565+0000","last_clean":"2024-04-16T16:16:43.693565+0000","last_became_active":"2024-04-16T16:16:42.559112+0000","last_became_peered":"2024-04-16T16:16:42.559112+0000","last_unstale":"2024-04-16T16:16:43.693565+0000","last_undegraded":"2024-04-16T16:16:43.693565+0000","last_fullsized":"2024-04-16T16:16:43.693565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:58:54.293764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542320+0000","last_change":"2024-04-16T16:16:41.523971+0000","last_active":"2024-04-16T16:16:43.542320+0000","last_peered":"2024-04-16T16:16:43.542320+0000","last_clean":"2024-04-16T16:16:43.542320+0000","last_became_active":"2024-04-16T16:16:41.523700+0000","last_became_peered":"2024-04-16T16:16:41.523700+0000","last_unstale":"2024-04-16T16:16:43.542320+0000","last_undegraded":"2024-04-16T16:16:43.542320+0000","last_fullsized":"2024-04-16T16:16:43.542320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555684+0000","last_change":"2024-04-16T16:16:42.560857+0000","last_active":"2024-04-16T16:16:43.555684+0000","last_peered":"2024-04-16T16:16:43.555684+0000","last_clean":"2024-04-16T16:16:43.555684+0000","last_became_active":"2024-04-16T16:16:42.560540+0000","last_became_peered":"2024-04-16T16:16:42.560540+0000","last_unstale":"2024-04-16T16:16:43.555684+0000","last_undegraded":"2024-04-16T16:16:43.555684+0000","last_fullsized":"2024-04-16T16:16:43.555684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559052+0000","last_change":"2024-04-16T16:16:41.524165+0000","last_active":"2024-04-16T16:16:43.559052+0000","last_peered":"2024-04-16T16:16:43.559052+0000","last_clean":"2024-04-16T16:16:43.559052+0000","last_became_active":"2024-04-16T16:16:41.520052+0000","last_became_peered":"2024-04-16T16:16:41.520052+0000","last_unstale":"2024-04-16T16:16:43.559052+0000","last_undegraded":"2024-04-16T16:16:43.559052+0000","last_fullsized":"2024-04-16T16:16:43.559052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559159+0000","last_change":"2024-04-16T16:16:42.543827+0000","last_active":"2024-04-16T16:16:43.559159+0000","last_peered":"2024-04-16T16:16:43.559159+0000","last_clean":"2024-04-16T16:16:43.559159+0000","last_became_active":"2024-04-16T16:16:42.543057+0000","last_became_peered":"2024-04-16T16:16:42.543057+0000","last_unstale":"2024-04-16T16:16:43.559159+0000","last_undegraded":"2024-04-16T16:16:43.559159+0000","last_fullsized":"2024-04-16T16:16:43.559159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538345+0000","last_change":"2024-04-16T16:16:41.515275+0000","last_active":"2024-04-16T16:16:43.538345+0000","last_peered":"2024-04-16T16:16:43.538345+0000","last_clean":"2024-04-16T16:16:43.538345+0000","last_became_active":"2024-04-16T16:16:41.511512+0000","last_became_peered":"2024-04-16T16:16:41.511512+0000","last_unstale":"2024-04-16T16:16:43.538345+0000","last_undegraded":"2024-04-16T16:16:43.538345+0000","last_fullsized":"2024-04-16T16:16:43.538345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:56.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554847+0000","last_change":"2024-04-16T16:16:42.553481+0000","last_active":"2024-04-16T16:16:43.554847+0000","last_peered":"2024-04-16T16:16:43.554847+0000","last_clean":"2024-04-16T16:16:43.554847+0000","last_became_active":"2024-04-16T16:16:42.553097+0000","last_became_peered":"2024-04-16T16:16:42.553097+0000","last_unstale":"2024-04-16T16:16:43.554847+0000","last_undegraded":"2024-04-16T16:16:43.554847+0000","last_fullsized":"2024-04-16T16:16:43.554847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:13.063895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541627+0000","last_change":"2024-04-16T16:16:41.498748+0000","last_active":"2024-04-16T16:16:43.541627+0000","last_peered":"2024-04-16T16:16:43.541627+0000","last_clean":"2024-04-16T16:16:43.541627+0000","last_became_active":"2024-04-16T16:16:41.497561+0000","last_became_peered":"2024-04-16T16:16:41.497561+0000","last_unstale":"2024-04-16T16:16:43.541627+0000","last_undegraded":"2024-04-16T16:16:43.541627+0000","last_fullsized":"2024-04-16T16:16:43.541627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:50.555761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556264+0000","last_change":"2024-04-16T16:16:42.556235+0000","last_active":"2024-04-16T16:16:43.556264+0000","last_peered":"2024-04-16T16:16:43.556264+0000","last_clean":"2024-04-16T16:16:43.556264+0000","last_became_active":"2024-04-16T16:16:42.555772+0000","last_became_peered":"2024-04-16T16:16:42.555772+0000","last_unstale":"2024-04-16T16:16:43.556264+0000","last_undegraded":"2024-04-16T16:16:43.556264+0000","last_fullsized":"2024-04-16T16:16:43.556264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:54:03.321332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538851+0000","last_change":"2024-04-16T16:16:41.513088+0000","last_active":"2024-04-16T16:16:43.538851+0000","last_peered":"2024-04-16T16:16:43.538851+0000","last_clean":"2024-04-16T16:16:43.538851+0000","last_became_active":"2024-04-16T16:16:41.512316+0000","last_became_peered":"2024-04-16T16:16:41.512316+0000","last_unstale":"2024-04-16T16:16:43.538851+0000","last_undegraded":"2024-04-16T16:16:43.538851+0000","last_fullsized":"2024-04-16T16:16:43.538851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556658+0000","last_change":"2024-04-16T16:16:42.557154+0000","last_active":"2024-04-16T16:16:43.556658+0000","last_peered":"2024-04-16T16:16:43.556658+0000","last_clean":"2024-04-16T16:16:43.556658+0000","last_became_active":"2024-04-16T16:16:42.556853+0000","last_became_peered":"2024-04-16T16:16:42.556853+0000","last_unstale":"2024-04-16T16:16:43.556658+0000","last_undegraded":"2024-04-16T16:16:43.556658+0000","last_fullsized":"2024-04-16T16:16:43.556658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:12:32.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.536004+0000","last_change":"2024-04-16T16:16:41.520997+0000","last_active":"2024-04-16T16:16:43.536004+0000","last_peered":"2024-04-16T16:16:43.536004+0000","last_clean":"2024-04-16T16:16:43.536004+0000","last_became_active":"2024-04-16T16:16:41.520502+0000","last_became_peered":"2024-04-16T16:16:41.520502+0000","last_unstale":"2024-04-16T16:16:43.536004+0000","last_undegraded":"2024-04-16T16:16:43.536004+0000","last_fullsized":"2024-04-16T16:16:43.536004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542374+0000","last_change":"2024-04-16T16:16:42.551483+0000","last_active":"2024-04-16T16:16:43.542374+0000","last_peered":"2024-04-16T16:16:43.542374+0000","last_clean":"2024-04-16T16:16:43.542374+0000","last_became_active":"2024-04-16T16:16:42.540166+0000","last_became_peered":"2024-04-16T16:16:42.540166+0000","last_unstale":"2024-04-16T16:16:43.542374+0000","last_undegraded":"2024-04-16T16:16:43.542374+0000","last_fullsized":"2024-04-16T16:16:43.542374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538450+0000","last_change":"2024-04-16T16:16:41.523070+0000","last_active":"2024-04-16T16:16:43.538450+0000","last_peered":"2024-04-16T16:16:43.538450+0000","last_clean":"2024-04-16T16:16:43.538450+0000","last_became_active":"2024-04-16T16:16:41.522786+0000","last_became_peered":"2024-04-16T16:16:41.522786+0000","last_unstale":"2024-04-16T16:16:43.538450+0000","last_undegraded":"2024-04-16T16:16:43.538450+0000","last_fullsized":"2024-04-16T16:16:43.538450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:09.544258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555935+0000","last_change":"2024-04-16T16:16:42.571326+0000","last_active":"2024-04-16T16:16:43.555935+0000","last_peered":"2024-04-16T16:16:43.555935+0000","last_clean":"2024-04-16T16:16:43.555935+0000","last_became_active":"2024-04-16T16:16:42.570406+0000","last_became_peered":"2024-04-16T16:16:42.570406+0000","last_unstale":"2024-04-16T16:16:43.555935+0000","last_undegraded":"2024-04-16T16:16:43.555935+0000","last_fullsized":"2024-04-16T16:16:43.555935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554754+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:16:43.554754+0000","last_peered":"2024-04-16T16:16:43.554754+0000","last_clean":"2024-04-16T16:16:43.554754+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:16:43.554754+0000","last_undegraded":"2024-04-16T16:16:43.554754+0000","last_fullsized":"2024-04-16T16:16:43.554754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541770+0000","last_change":"2024-04-16T16:16:41.518448+0000","last_active":"2024-04-16T16:16:43.541770+0000","last_peered":"2024-04-16T16:16:43.541770+0000","last_clean":"2024-04-16T16:16:43.541770+0000","last_became_active":"2024-04-16T16:16:41.517938+0000","last_became_peered":"2024-04-16T16:16:41.517938+0000","last_unstale":"2024-04-16T16:16:43.541770+0000","last_undegraded":"2024-04-16T16:16:43.541770+0000","last_fullsized":"2024-04-16T16:16:43.541770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693472+0000","last_change":"2024-04-16T16:16:42.537690+0000","last_active":"2024-04-16T16:16:43.693472+0000","last_peered":"2024-04-16T16:16:43.693472+0000","last_clean":"2024-04-16T16:16:43.693472+0000","last_became_active":"2024-04-16T16:16:42.537268+0000","last_became_peered":"2024-04-16T16:16:42.537268+0000","last_unstale":"2024-04-16T16:16:43.693472+0000","last_undegraded":"2024-04-16T16:16:43.693472+0000","last_fullsized":"2024-04-16T16:16:43.693472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554773+0000","last_change":"2024-04-16T16:16:41.522499+0000","last_active":"2024-04-16T16:16:43.554773+0000","last_peered":"2024-04-16T16:16:43.554773+0000","last_clean":"2024-04-16T16:16:43.554773+0000","last_became_active":"2024-04-16T16:16:41.522124+0000","last_became_peered":"2024-04-16T16:16:41.522124+0000","last_unstale":"2024-04-16T16:16:43.554773+0000","last_undegraded":"2024-04-16T16:16:43.554773+0000","last_fullsized":"2024-04-16T16:16:43.554773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693674+0000","last_change":"2024-04-16T16:16:42.554808+0000","last_active":"2024-04-16T16:16:43.693674+0000","last_peered":"2024-04-16T16:16:43.693674+0000","last_clean":"2024-04-16T16:16:43.693674+0000","last_became_active":"2024-04-16T16:16:42.552890+0000","last_became_peered":"2024-04-16T16:16:42.552890+0000","last_unstale":"2024-04-16T16:16:43.693674+0000","last_undegraded":"2024-04-16T16:16:43.693674+0000","last_fullsized":"2024-04-16T16:16:43.693674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:40.482814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.538337+0000","last_change":"2024-04-16T16:16:41.517103+0000","last_active":"2024-04-16T16:16:43.538337+0000","last_peered":"2024-04-16T16:16:43.538337+0000","last_clean":"2024-04-16T16:16:43.538337+0000","last_became_active":"2024-04-16T16:16:41.516829+0000","last_became_peered":"2024-04-16T16:16:41.516829+0000","last_unstale":"2024-04-16T16:16:43.538337+0000","last_undegraded":"2024-04-16T16:16:43.538337+0000","last_fullsized":"2024-04-16T16:16:43.538337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535231+0000","last_change":"2024-04-16T16:16:42.541238+0000","last_active":"2024-04-16T16:16:43.535231+0000","last_peered":"2024-04-16T16:16:43.535231+0000","last_clean":"2024-04-16T16:16:43.535231+0000","last_became_active":"2024-04-16T16:16:42.540924+0000","last_became_peered":"2024-04-16T16:16:42.540924+0000","last_unstale":"2024-04-16T16:16:43.535231+0000","last_undegraded":"2024-04-16T16:16:43.535231+0000","last_fullsized":"2024-04-16T16:16:43.535231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:34:15.526150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542556+0000","last_change":"2024-04-16T16:16:41.519683+0000","last_active":"2024-04-16T16:16:43.542556+0000","last_peered":"2024-04-16T16:16:43.542556+0000","last_clean":"2024-04-16T16:16:43.542556+0000","last_became_active":"2024-04-16T16:16:41.519343+0000","last_became_peered":"2024-04-16T16:16:41.519343+0000","last_unstale":"2024-04-16T16:16:43.542556+0000","last_undegraded":"2024-04-16T16:16:43.542556+0000","last_fullsized":"2024-04-16T16:16:43.542556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.540500+0000","last_change":"2024-04-16T16:16:42.542028+0000","last_active":"2024-04-16T16:16:43.540500+0000","last_peered":"2024-04-16T16:16:43.540500+0000","last_clean":"2024-04-16T16:16:43.540500+0000","last_became_active":"2024-04-16T16:16:42.538888+0000","last_became_peered":"2024-04-16T16:16:42.538888+0000","last_unstale":"2024-04-16T16:16:43.540500+0000","last_undegraded":"2024-04-16T16:16:43.540500+0000","last_fullsized":"2024-04-16T16:16:43.540500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:43.311234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.509361+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.509045+0000","last_became_peered":"2024-04-16T16:16:41.509045+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.543027+0000","last_change":"2024-04-16T16:16:42.558916+0000","last_active":"2024-04-16T16:16:43.543027+0000","last_peered":"2024-04-16T16:16:43.543027+0000","last_clean":"2024-04-16T16:16:43.543027+0000","last_became_active":"2024-04-16T16:16:42.545348+0000","last_became_peered":"2024-04-16T16:16:42.545348+0000","last_unstale":"2024-04-16T16:16:43.543027+0000","last_undegraded":"2024-04-16T16:16:43.543027+0000","last_fullsized":"2024-04-16T16:16:43.543027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:12.562693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556231+0000","last_change":"2024-04-16T16:16:41.522662+0000","last_active":"2024-04-16T16:16:43.556231+0000","last_peered":"2024-04-16T16:16:43.556231+0000","last_clean":"2024-04-16T16:16:43.556231+0000","last_became_active":"2024-04-16T16:16:41.522355+0000","last_became_peered":"2024-04-16T16:16:41.522355+0000","last_unstale":"2024-04-16T16:16:43.556231+0000","last_undegraded":"2024-04-16T16:16:43.556231+0000","last_fullsized":"2024-04-16T16:16:43.556231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:55.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535843+0000","last_change":"2024-04-16T16:16:42.541278+0000","last_active":"2024-04-16T16:16:43.535843+0000","last_peered":"2024-04-16T16:16:43.535843+0000","last_clean":"2024-04-16T16:16:43.535843+0000","last_became_active":"2024-04-16T16:16:42.540838+0000","last_became_peered":"2024-04-16T16:16:42.540838+0000","last_unstale":"2024-04-16T16:16:43.535843+0000","last_undegraded":"2024-04-16T16:16:43.535843+0000","last_fullsized":"2024-04-16T16:16:43.535843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.558097+0000","last_change":"2024-04-16T16:16:41.527012+0000","last_active":"2024-04-16T16:16:43.558097+0000","last_peered":"2024-04-16T16:16:43.558097+0000","last_clean":"2024-04-16T16:16:43.558097+0000","last_became_active":"2024-04-16T16:16:41.526665+0000","last_became_peered":"2024-04-16T16:16:41.526665+0000","last_unstale":"2024-04-16T16:16:43.558097+0000","last_undegraded":"2024-04-16T16:16:43.558097+0000","last_fullsized":"2024-04-16T16:16:43.558097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693473+0000","last_change":"2024-04-16T16:16:42.549680+0000","last_active":"2024-04-16T16:16:43.693473+0000","last_peered":"2024-04-16T16:16:43.693473+0000","last_clean":"2024-04-16T16:16:43.693473+0000","last_became_active":"2024-04-16T16:16:42.547089+0000","last_became_peered":"2024-04-16T16:16:42.547089+0000","last_unstale":"2024-04-16T16:16:43.693473+0000","last_undegraded":"2024-04-16T16:16:43.693473+0000","last_fullsized":"2024-04-16T16:16:43.693473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:51.959727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559737+0000","last_change":"2024-04-16T16:16:41.528043+0000","last_active":"2024-04-16T16:16:43.559737+0000","last_peered":"2024-04-16T16:16:43.559737+0000","last_clean":"2024-04-16T16:16:43.559737+0000","last_became_active":"2024-04-16T16:16:41.527767+0000","last_became_peered":"2024-04-16T16:16:41.527767+0000","last_unstale":"2024-04-16T16:16:43.559737+0000","last_undegraded":"2024-04-16T16:16:43.559737+0000","last_fullsized":"2024-04-16T16:16:43.559737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694076+0000","last_change":"2024-04-16T16:16:42.540712+0000","last_active":"2024-04-16T16:16:43.694076+0000","last_peered":"2024-04-16T16:16:43.694076+0000","last_clean":"2024-04-16T16:16:43.694076+0000","last_became_active":"2024-04-16T16:16:42.538863+0000","last_became_peered":"2024-04-16T16:16:42.538863+0000","last_unstale":"2024-04-16T16:16:43.694076+0000","last_undegraded":"2024-04-16T16:16:43.694076+0000","last_fullsized":"2024-04-16T16:16:43.694076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:09.755584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.554585+0000","last_change":"2024-04-16T16:16:41.518575+0000","last_active":"2024-04-16T16:16:43.554585+0000","last_peered":"2024-04-16T16:16:43.554585+0000","last_clean":"2024-04-16T16:16:43.554585+0000","last_became_active":"2024-04-16T16:16:41.517913+0000","last_became_peered":"2024-04-16T16:16:41.517913+0000","last_unstale":"2024-04-16T16:16:43.554585+0000","last_undegraded":"2024-04-16T16:16:43.554585+0000","last_fullsized":"2024-04-16T16:16:43.554585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:44.067387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.539618+0000","last_change":"2024-04-16T16:16:42.539495+0000","last_active":"2024-04-16T16:16:43.539618+0000","last_peered":"2024-04-16T16:16:43.539618+0000","last_clean":"2024-04-16T16:16:43.539618+0000","last_became_active":"2024-04-16T16:16:42.539119+0000","last_became_peered":"2024-04-16T16:16:42.539119+0000","last_unstale":"2024-04-16T16:16:43.539618+0000","last_undegraded":"2024-04-16T16:16:43.539618+0000","last_fullsized":"2024-04-16T16:16:43.539618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:30.369821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535447+0000","last_change":"2024-04-16T16:16:41.524546+0000","last_active":"2024-04-16T16:16:43.535447+0000","last_peered":"2024-04-16T16:16:43.535447+0000","last_clean":"2024-04-16T16:16:43.535447+0000","last_became_active":"2024-04-16T16:16:41.521734+0000","last_became_peered":"2024-04-16T16:16:41.521734+0000","last_unstale":"2024-04-16T16:16:43.535447+0000","last_undegraded":"2024-04-16T16:16:43.535447+0000","last_fullsized":"2024-04-16T16:16:43.535447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.693061+0000","last_change":"2024-04-16T16:16:42.549899+0000","last_active":"2024-04-16T16:16:43.693061+0000","last_peered":"2024-04-16T16:16:43.693061+0000","last_clean":"2024-04-16T16:16:43.693061+0000","last_became_active":"2024-04-16T16:16:42.545606+0000","last_became_peered":"2024-04-16T16:16:42.545606+0000","last_unstale":"2024-04-16T16:16:43.693061+0000","last_undegraded":"2024-04-16T16:16:43.693061+0000","last_fullsized":"2024-04-16T16:16:43.693061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.535864+0000","last_change":"2024-04-16T16:16:41.515086+0000","last_active":"2024-04-16T16:16:43.535864+0000","last_peered":"2024-04-16T16:16:43.535864+0000","last_clean":"2024-04-16T16:16:43.535864+0000","last_became_active":"2024-04-16T16:16:41.514804+0000","last_became_peered":"2024-04-16T16:16:41.514804+0000","last_unstale":"2024-04-16T16:16:43.535864+0000","last_undegraded":"2024-04-16T16:16:43.535864+0000","last_fullsized":"2024-04-16T16:16:43.535864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:18.941276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694754+0000","last_change":"2024-04-16T16:16:42.539283+0000","last_active":"2024-04-16T16:16:43.694754+0000","last_peered":"2024-04-16T16:16:43.694754+0000","last_clean":"2024-04-16T16:16:43.694754+0000","last_became_active":"2024-04-16T16:16:42.538992+0000","last_became_peered":"2024-04-16T16:16:42.538992+0000","last_unstale":"2024-04-16T16:16:43.694754+0000","last_undegraded":"2024-04-16T16:16:43.694754+0000","last_fullsized":"2024-04-16T16:16:43.694754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:39.989527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555783+0000","last_change":"2024-04-16T16:16:41.528069+0000","last_active":"2024-04-16T16:16:43.555783+0000","last_peered":"2024-04-16T16:16:43.555783+0000","last_clean":"2024-04-16T16:16:43.555783+0000","last_became_active":"2024-04-16T16:16:41.527661+0000","last_became_peered":"2024-04-16T16:16:41.527661+0000","last_unstale":"2024-04-16T16:16:43.555783+0000","last_undegraded":"2024-04-16T16:16:43.555783+0000","last_fullsized":"2024-04-16T16:16:43.555783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:42.294530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.559239+0000","last_change":"2024-04-16T16:16:42.555670+0000","last_active":"2024-04-16T16:16:43.559239+0000","last_peered":"2024-04-16T16:16:43.559239+0000","last_clean":"2024-04-16T16:16:43.559239+0000","last_became_active":"2024-04-16T16:16:42.555257+0000","last_became_peered":"2024-04-16T16:16:42.555257+0000","last_unstale":"2024-04-16T16:16:43.559239+0000","last_undegraded":"2024-04-16T16:16:43.559239+0000","last_fullsized":"2024-04-16T16:16:43.559239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.542682+0000","last_change":"2024-04-16T16:16:42.528582+0000","last_active":"2024-04-16T16:16:43.542682+0000","last_peered":"2024-04-16T16:16:43.542682+0000","last_clean":"2024-04-16T16:16:43.542682+0000","last_became_active":"2024-04-16T16:16:42.528086+0000","last_became_peered":"2024-04-16T16:16:42.528086+0000","last_unstale":"2024-04-16T16:16:43.542682+0000","last_undegraded":"2024-04-16T16:16:43.542682+0000","last_fullsized":"2024-04-16T16:16:43.542682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:54.588152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.555817+0000","last_change":"2024-04-16T16:16:41.525844+0000","last_active":"2024-04-16T16:16:43.555817+0000","last_peered":"2024-04-16T16:16:43.555817+0000","last_clean":"2024-04-16T16:16:43.555817+0000","last_became_active":"2024-04-16T16:16:41.524506+0000","last_became_peered":"2024-04-16T16:16:41.524506+0000","last_unstale":"2024-04-16T16:16:43.555817+0000","last_undegraded":"2024-04-16T16:16:43.555817+0000","last_fullsized":"2024-04-16T16:16:43.555817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:21.943506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.541916+0000","last_change":"2024-04-16T16:16:42.529397+0000","last_active":"2024-04-16T16:16:43.541916+0000","last_peered":"2024-04-16T16:16:43.541916+0000","last_clean":"2024-04-16T16:16:43.541916+0000","last_became_active":"2024-04-16T16:16:42.528776+0000","last_became_peered":"2024-04-16T16:16:42.528776+0000","last_unstale":"2024-04-16T16:16:43.541916+0000","last_undegraded":"2024-04-16T16:16:43.541916+0000","last_fullsized":"2024-04-16T16:16:43.541916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:52.405722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.556158+0000","last_change":"2024-04-16T16:16:41.531832+0000","last_active":"2024-04-16T16:16:43.556158+0000","last_peered":"2024-04-16T16:16:43.556158+0000","last_clean":"2024-04-16T16:16:43.556158+0000","last_became_active":"2024-04-16T16:16:41.531327+0000","last_became_peered":"2024-04-16T16:16:41.531327+0000","last_unstale":"2024-04-16T16:16:43.556158+0000","last_undegraded":"2024-04-16T16:16:43.556158+0000","last_fullsized":"2024-04-16T16:16:43.556158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694244+0000","last_change":"2024-04-16T16:16:42.570229+0000","last_active":"2024-04-16T16:16:43.694244+0000","last_peered":"2024-04-16T16:16:43.694244+0000","last_clean":"2024-04-16T16:16:43.694244+0000","last_became_active":"2024-04-16T16:16:42.569878+0000","last_became_peered":"2024-04-16T16:16:42.569878+0000","last_unstale":"2024-04-16T16:16:43.694244+0000","last_undegraded":"2024-04-16T16:16:43.694244+0000","last_fullsized":"2024-04-16T16:16:43.694244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:36.686445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695178+0000","last_change":"2024-04-16T16:16:41.514706+0000","last_active":"2024-04-16T16:16:43.695178+0000","last_peered":"2024-04-16T16:16:43.695178+0000","last_clean":"2024-04-16T16:16:43.695178+0000","last_became_active":"2024-04-16T16:16:41.514337+0000","last_became_peered":"2024-04-16T16:16:41.514337+0000","last_unstale":"2024-04-16T16:16:43.695178+0000","last_undegraded":"2024-04-16T16:16:43.695178+0000","last_fullsized":"2024-04-16T16:16:43.695178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:29.353117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.695077+0000","last_change":"2024-04-16T16:16:42.544576+0000","last_active":"2024-04-16T16:16:43.695077+0000","last_peered":"2024-04-16T16:16:43.695077+0000","last_clean":"2024-04-16T16:16:43.695077+0000","last_became_active":"2024-04-16T16:16:42.544221+0000","last_became_peered":"2024-04-16T16:16:42.544221+0000","last_unstale":"2024-04-16T16:16:43.695077+0000","last_undegraded":"2024-04-16T16:16:43.695077+0000","last_fullsized":"2024-04-16T16:16:43.695077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:41.472860+0000","last_clean_scrub_stamp":"2024-04-16T16:16:41.472860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:53.221747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-16T16:16:43.694565+0000","last_change":"2024-04-16T16:16:41.519681+0000","last_active":"2024-04-16T16:16:43.694565+0000","last_peered":"2024-04-16T16:16:43.694565+0000","last_clean":"2024-04-16T16:16:43.694565+0000","last_became_active":"2024-04-16T16:16:41.519259+0000","last_became_peered":"2024-04-16T16:16:41.519259+0000","last_unstale":"2024-04-16T16:16:43.694565+0000","last_undegraded":"2024-04-16T16:16:43.694565+0000","last_fullsized":"2024-04-16T16:16:43.694565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:40.456155+0000","last_clean_scrub_stamp":"2024-04-16T16:16:40.456155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:22.558679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:16:53.266 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T16:16:53.266 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-16T16:16:53.266 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-16T16:16:53.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-16T16:16:53.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.519+0000 7f9514a00640 1 Processor -- start 2024-04-16T16:16:53.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.520+0000 7f9514a00640 1 -- start start 2024-04-16T16:16:53.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.521+0000 7f9514a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f951006eaa0 0x7f95100b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.521+0000 7f9514a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f951006ee80 0x7f951015c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.521+0000 7f9514a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951006d160 con 0x7f95100cc810 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.521+0000 7f9514a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f951006cf10 con 0x7f951006ee80 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.521+0000 7f9514a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f951006d440 con 0x7f951006eaa0 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f951006ee80 0x7f951015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f951006ee80 0x7f951015c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58394/0 (socket says 172.21.15.22:58394) 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950fe00640 1 -- 172.21.15.22:0/342058301 learned_addr learned my addr 172.21.15.22:0/342058301 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950f400640 1 --2- 172.21.15.22:0/342058301 >> v2:172.21.15.43:3300/0 conn(0x7f951006eaa0 0x7f95100b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950fe00640 1 -- 172.21.15.22:0/342058301 >> v2:172.21.15.43:3300/0 conn(0x7f951006eaa0 msgr2=0x7f95100b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950fe00640 1 --2- 172.21.15.22:0/342058301 >> v2:172.21.15.43:3300/0 conn(0x7f951006eaa0 0x7f95100b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950fe00640 1 -- 172.21.15.22:0/342058301 >> v1:172.21.15.43:6789/0 conn(0x7f95100cc810 legacy=0x7f951006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:53.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.522+0000 7f950fe00640 1 -- 172.21.15.22:0/342058301 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951006d720 con 0x7f951006ee80 2024-04-16T16:16:53.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.523+0000 7f950fe00640 1 --2- 172.21.15.22:0/342058301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f951006ee80 0x7f951015c200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9508009e50 tx=0x7f950802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd18c9ab9860c300 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:53.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.523+0000 7f950ea00640 1 -- 172.21.15.22:0/342058301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950802ca80 con 0x7f951006ee80 2024-04-16T16:16:53.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f950ea00640 1 -- 172.21.15.22:0/342058301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950802cc20 con 0x7f951006ee80 2024-04-16T16:16:53.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f950ea00640 1 -- 172.21.15.22:0/342058301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080343f0 con 0x7f951006ee80 2024-04-16T16:16:53.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f9514a00640 1 -- 172.21.15.22:0/342058301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f951006ee80 msgr2=0x7f951015c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f9514a00640 1 --2- 172.21.15.22:0/342058301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f951006ee80 0x7f951015c200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9508009e50 tx=0x7f950802bee0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f9514a00640 1 -- 172.21.15.22:0/342058301 shutdown_connections 2024-04-16T16:16:53.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f9514a00640 1 --2- 172.21.15.22:0/342058301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f951006ee80 0x7f951015c200 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f9514a00640 1 --2- 172.21.15.22:0/342058301 >> v2:172.21.15.43:3300/0 conn(0x7f951006eaa0 0x7f95100b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.524+0000 7f9514a00640 1 -- 172.21.15.22:0/342058301 >> 172.21.15.22:0/342058301 conn(0x7f9510062440 msgr2=0x7f9510062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.525+0000 7f9514a00640 1 -- 172.21.15.22:0/342058301 shutdown_connections 2024-04-16T16:16:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.525+0000 7f9514a00640 1 -- 172.21.15.22:0/342058301 wait complete. 2024-04-16T16:16:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.526+0000 7f9514a00640 1 Processor -- start 2024-04-16T16:16:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.526+0000 7f9514a00640 1 -- start start 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f9514a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f951006eaa0 0x7f95101e5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f9514a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f951006ee80 0x7f95101f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f9514a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95100cc810 0x7f95101f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f9514a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f951015c740 con 0x7f95100cc810 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f9514a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f95100b4360 con 0x7f951006eaa0 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f9514a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f951015c8c0 con 0x7f951006ee80 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f950fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95100cc810 0x7f95101f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f950fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95100cc810 0x7f95101f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58406/0 (socket says 172.21.15.22:58406) 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.527+0000 7f950fe00640 1 -- 172.21.15.22:0/2010351275 learned_addr learned my addr 172.21.15.22:0/2010351275 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950f400640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f951006eaa0 0x7f95101e5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f9507e00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f951006ee80 0x7f95101f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950fe00640 1 -- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f951006ee80 msgr2=0x7f95101f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950fe00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f951006ee80 0x7f95101f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950fe00640 1 -- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f951006eaa0 msgr2=0x7f95101e5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950fe00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f951006eaa0 0x7f95101e5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950fe00640 1 -- 172.21.15.22:0/2010351275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95100b0bd0 con 0x7f95100cc810 2024-04-16T16:16:53.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950f400640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f951006eaa0 0x7f95101e5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:53.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f950fe00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95100cc810 0x7f95101f8730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9508036040 tx=0x7f9508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:53.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.528+0000 7f9507400640 1 -- 172.21.15.22:0/2010351275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508043020 con 0x7f95100cc810 2024-04-16T16:16:53.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.529+0000 7f9507400640 1 -- 172.21.15.22:0/2010351275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950803e450 con 0x7f95100cc810 2024-04-16T16:16:53.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.529+0000 7f9507400640 1 -- 172.21.15.22:0/2010351275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508009510 con 0x7f95100cc810 2024-04-16T16:16:53.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.529+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95100b0eb0 con 0x7f95100cc810 2024-04-16T16:16:53.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.529+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101e54d0 con 0x7f95100cc810 2024-04-16T16:16:53.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.530+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9510075f30 con 0x7f95100cc810 2024-04-16T16:16:53.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.531+0000 7f9507400640 1 -- 172.21.15.22:0/2010351275 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9508046020 con 0x7f95100cc810 2024-04-16T16:16:53.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.532+0000 7f9507400640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f94ec06c8f0 0x7f94ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:53.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.532+0000 7f9507400640 1 -- 172.21.15.22:0/2010351275 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95080ae330 con 0x7f95100cc810 2024-04-16T16:16:53.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.532+0000 7f950f400640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f94ec06c8f0 0x7f94ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:53.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.533+0000 7f950f400640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f94ec06c8f0 0x7f94ec06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9500006fd0 tx=0x7f9500008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:53.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.536+0000 7f9507400640 1 -- 172.21.15.22:0/2010351275 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f950804d030 con 0x7f95100cc810 2024-04-16T16:16:53.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.772+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f95100b4b70 con 0x7f95100cc810 2024-04-16T16:16:53.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.773+0000 7f9507400640 1 -- 172.21.15.22:0/2010351275 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f950807c7d0 con 0x7f95100cc810 2024-04-16T16:16:53.773 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:53.773 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.775+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f94ec06c8f0 msgr2=0x7f94ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.775+0000 7f9514a00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f94ec06c8f0 0x7f94ec06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9500006fd0 tx=0x7f9500008040 comp rx=0 tx=0).stop 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.775+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95100cc810 msgr2=0x7f95101f8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.775+0000 7f9514a00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95100cc810 0x7f95101f8730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9508036040 tx=0x7f9508004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 shutdown_connections 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f94ec06c8f0 0x7f94ec06edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95100cc810 0x7f95101f8730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f951006ee80 0x7f95101f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 --2- 172.21.15.22:0/2010351275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f951006eaa0 0x7f95101e5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 >> 172.21.15.22:0/2010351275 conn(0x7f9510062440 msgr2=0x7f95100b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 shutdown_connections 2024-04-16T16:16:53.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:53.776+0000 7f9514a00640 1 -- 172.21.15.22:0/2010351275 wait complete. 2024-04-16T16:16:53.796 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-16T16:16:53.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:54.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.006+0000 7faf2f200640 1 Processor -- start 2024-04-16T16:16:54.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.006+0000 7faf2f200640 1 -- start start 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2f200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf30072e30 0x7faf300af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2f200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf30071f60 0x7faf300d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2f200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf300b3720 con 0x7faf300d0090 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2f200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7faf300d0a10 con 0x7faf30071f60 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2f200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7faf300b3a00 con 0x7faf30072e30 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf30071f60 0x7faf300d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf30071f60 0x7faf300d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58416/0 (socket says 172.21.15.22:58416) 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2e800640 1 -- 172.21.15.22:0/184444756 learned_addr learned my addr 172.21.15.22:0/184444756 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:54.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.008+0000 7faf2de00640 1 --2- 172.21.15.22:0/184444756 >> v2:172.21.15.43:3300/0 conn(0x7faf30072e30 0x7faf300af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.009+0000 7faf2e800640 1 -- 172.21.15.22:0/184444756 >> v2:172.21.15.43:3300/0 conn(0x7faf30072e30 msgr2=0x7faf300af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:54.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.009+0000 7faf2e800640 1 --2- 172.21.15.22:0/184444756 >> v2:172.21.15.43:3300/0 conn(0x7faf30072e30 0x7faf300af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.009+0000 7faf2e800640 1 -- 172.21.15.22:0/184444756 >> v1:172.21.15.43:6789/0 conn(0x7faf300d0090 legacy=0x7faf301669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:54.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.009+0000 7faf2e800640 1 -- 172.21.15.22:0/184444756 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf300b3ce0 con 0x7faf30071f60 2024-04-16T16:16:54.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.010+0000 7faf2e800640 1 --2- 172.21.15.22:0/184444756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30071f60 0x7faf300d04d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faf300b57a0 tx=0x7faf2802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdee92ca9c1771c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.010+0000 7faf2d400640 1 -- 172.21.15.22:0/184444756 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2802ca80 con 0x7faf30071f60 2024-04-16T16:16:54.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.010+0000 7faf2d400640 1 -- 172.21.15.22:0/184444756 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2802cc20 con 0x7faf30071f60 2024-04-16T16:16:54.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.010+0000 7faf2d400640 1 -- 172.21.15.22:0/184444756 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf280343f0 con 0x7faf30071f60 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 -- 172.21.15.22:0/184444756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30071f60 msgr2=0x7faf300d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 --2- 172.21.15.22:0/184444756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30071f60 0x7faf300d04d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faf300b57a0 tx=0x7faf2802bee0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 -- 172.21.15.22:0/184444756 shutdown_connections 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 --2- 172.21.15.22:0/184444756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30071f60 0x7faf300d04d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 --2- 172.21.15.22:0/184444756 >> v2:172.21.15.43:3300/0 conn(0x7faf30072e30 0x7faf300af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 -- 172.21.15.22:0/184444756 >> 172.21.15.22:0/184444756 conn(0x7faf30062440 msgr2=0x7faf30062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 -- 172.21.15.22:0/184444756 shutdown_connections 2024-04-16T16:16:54.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.011+0000 7faf2f200640 1 -- 172.21.15.22:0/184444756 wait complete. 2024-04-16T16:16:54.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.013+0000 7faf2f200640 1 Processor -- start 2024-04-16T16:16:54.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.013+0000 7faf2f200640 1 -- start start 2024-04-16T16:16:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf30071f60 0x7faf3015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf30072e30 0x7faf301651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf300d0090 0x7faf301572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf300afe30 con 0x7faf300d0090 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf300b42a0 con 0x7faf30071f60 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faf300b3410 con 0x7faf30072e30 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf300d0090 0x7faf301572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf300d0090 0x7faf301572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58432/0 (socket says 172.21.15.22:58432) 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2e800640 1 -- 172.21.15.22:0/2137448536 learned_addr learned my addr 172.21.15.22:0/2137448536 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2de00640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf30071f60 0x7faf3015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf27e00640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf30072e30 0x7faf301651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2e800640 1 -- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf30072e30 msgr2=0x7faf301651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.014+0000 7faf2e800640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf30072e30 0x7faf301651a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf2e800640 1 -- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf30071f60 msgr2=0x7faf3015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf2e800640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf30071f60 0x7faf3015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf2e800640 1 -- 172.21.15.22:0/2137448536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3015bf80 con 0x7faf300d0090 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf2de00640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf30071f60 0x7faf3015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:54.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf2e800640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf300d0090 0x7faf301572d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf28036040 tx=0x7faf28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf26000640 1 -- 172.21.15.22:0/2137448536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28043020 con 0x7faf300d0090 2024-04-16T16:16:54.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf26000640 1 -- 172.21.15.22:0/2137448536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2803e450 con 0x7faf300d0090 2024-04-16T16:16:54.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3015c260 con 0x7faf300d0090 2024-04-16T16:16:54.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf26000640 1 -- 172.21.15.22:0/2137448536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28009510 con 0x7faf300d0090 2024-04-16T16:16:54.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.015+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf301586e0 con 0x7faf300d0090 2024-04-16T16:16:54.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.016+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf30075f30 con 0x7faf300d0090 2024-04-16T16:16:54.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.017+0000 7faf26000640 1 -- 172.21.15.22:0/2137448536 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf28046020 con 0x7faf300d0090 2024-04-16T16:16:54.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.018+0000 7faf26000640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faf0c06c8f0 0x7faf0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.018+0000 7faf26000640 1 -- 172.21.15.22:0/2137448536 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf280ae470 con 0x7faf300d0090 2024-04-16T16:16:54.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.018+0000 7faf2de00640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faf0c06c8f0 0x7faf0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.019+0000 7faf2de00640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faf0c06c8f0 0x7faf0c06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf20006fd0 tx=0x7faf20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.022+0000 7faf26000640 1 -- 172.21.15.22:0/2137448536 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf2804d030 con 0x7faf300d0090 2024-04-16T16:16:54.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.218+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf3015c430 con 0x7faf300d0090 2024-04-16T16:16:54.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.220+0000 7faf26000640 1 -- 172.21.15.22:0/2137448536 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7faf2807c800 con 0x7faf300d0090 2024-04-16T16:16:54.220 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:54.220 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:54.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faf0c06c8f0 msgr2=0x7faf0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faf0c06c8f0 0x7faf0c06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf20006fd0 tx=0x7faf20008040 comp rx=0 tx=0).stop 2024-04-16T16:16:54.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf300d0090 msgr2=0x7faf301572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf300d0090 0x7faf301572d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf28036040 tx=0x7faf28004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 shutdown_connections 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faf0c06c8f0 0x7faf0c06edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf300d0090 0x7faf301572d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf30072e30 0x7faf301651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 --2- 172.21.15.22:0/2137448536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf30071f60 0x7faf3015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 >> 172.21.15.22:0/2137448536 conn(0x7faf30062440 msgr2=0x7faf30071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.222+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 shutdown_connections 2024-04-16T16:16:54.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.223+0000 7faf2f200640 1 -- 172.21.15.22:0/2137448536 wait complete. 2024-04-16T16:16:54.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:16:54.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:16:54.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.469+0000 7fde8dc00640 1 Processor -- start 2024-04-16T16:16:54.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.469+0000 7fde8dc00640 1 -- start start 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.470+0000 7fde8dc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde8815f0a0 0x7fde880cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde8dc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cfdb0 0x7fde881626e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde8dc00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8806ed90 con 0x7fde880cc530 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde8dc00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fde880d11a0 con 0x7fde8815f0a0 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde8dc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde880cc910 con 0x7fde880cfdb0 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde86a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fde880cc530 0x7fde880d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35150/0 (socket says 172.21.15.22:35150) 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde86a00640 1 -- 172.21.15.22:0/3171563197 learned_addr learned my addr 172.21.15.22:0/3171563197 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde7e000640 1 --2- 172.21.15.22:0/3171563197 >> v2:172.21.15.22:3300/0 conn(0x7fde8815f0a0 0x7fde880cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde87400640 1 --2- 172.21.15.22:0/3171563197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cfdb0 0x7fde881626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde86000640 1 -- 172.21.15.22:0/3171563197 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156057701 0 0) 0x7fde8806ed90 con 0x7fde880cc530 2024-04-16T16:16:54.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.471+0000 7fde86000640 1 -- 172.21.15.22:0/3171563197 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde6c003520 con 0x7fde880cc530 2024-04-16T16:16:54.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.472+0000 7fde7e000640 1 -- 172.21.15.22:0/3171563197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cfdb0 msgr2=0x7fde881626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:54.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.472+0000 7fde7e000640 1 --2- 172.21.15.22:0/3171563197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cfdb0 0x7fde881626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.472+0000 7fde7e000640 1 -- 172.21.15.22:0/3171563197 >> v1:172.21.15.22:6789/0 conn(0x7fde880cc530 legacy=0x7fde880d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.472+0000 7fde7e000640 1 -- 172.21.15.22:0/3171563197 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8806d690 con 0x7fde8815f0a0 2024-04-16T16:16:54.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.472+0000 7fde87400640 1 --2- 172.21.15.22:0/3171563197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cfdb0 0x7fde881626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:16:54.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.473+0000 7fde7e000640 1 --2- 172.21.15.22:0/3171563197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8815f0a0 0x7fde880cf870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde700097a0 tx=0x7fde7002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1d710cd15e0be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.473+0000 7fde86000640 1 -- 172.21.15.22:0/3171563197 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70035020 con 0x7fde8815f0a0 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.473+0000 7fde86000640 1 -- 172.21.15.22:0/3171563197 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde70031810 con 0x7fde8815f0a0 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.473+0000 7fde86000640 1 -- 172.21.15.22:0/3171563197 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70031be0 con 0x7fde8815f0a0 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.473+0000 7fde8dc00640 1 -- 172.21.15.22:0/3171563197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8815f0a0 msgr2=0x7fde880cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.473+0000 7fde8dc00640 1 --2- 172.21.15.22:0/3171563197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8815f0a0 0x7fde880cf870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde700097a0 tx=0x7fde7002b8b0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.474+0000 7fde8dc00640 1 -- 172.21.15.22:0/3171563197 shutdown_connections 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.474+0000 7fde8dc00640 1 --2- 172.21.15.22:0/3171563197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cfdb0 0x7fde881626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.474+0000 7fde8dc00640 1 --2- 172.21.15.22:0/3171563197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8815f0a0 0x7fde880cf870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.474+0000 7fde8dc00640 1 -- 172.21.15.22:0/3171563197 >> 172.21.15.22:0/3171563197 conn(0x7fde880b37e0 msgr2=0x7fde880b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:54.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.474+0000 7fde8dc00640 1 -- 172.21.15.22:0/3171563197 shutdown_connections 2024-04-16T16:16:54.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.474+0000 7fde8dc00640 1 -- 172.21.15.22:0/3171563197 wait complete. 2024-04-16T16:16:54.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.475+0000 7fde8dc00640 1 Processor -- start 2024-04-16T16:16:54.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.476+0000 7fde8dc00640 1 -- start start 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde8dc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cc530 0x7fde88146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde8dc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde880cfdb0 0x7fde8815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde8dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde88146c00 0x7fde88157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde8dc00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fde8806dc50 con 0x7fde880cfdb0 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde8dc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde8806dfc0 con 0x7fde88146c00 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde8dc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde880d01e0 con 0x7fde880cc530 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde880cfdb0 0x7fde8815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde880cfdb0 0x7fde8815d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58452/0 (socket says 172.21.15.22:58452) 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 -- 172.21.15.22:0/614721635 learned_addr learned my addr 172.21.15.22:0/614721635 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde86a00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cc530 0x7fde88146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde87400640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde88146c00 0x7fde88157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 -- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cc530 msgr2=0x7fde88146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cc530 0x7fde88146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 -- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde88146c00 msgr2=0x7fde88157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde88146c00 0x7fde88157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde7e000640 1 -- 172.21.15.22:0/614721635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde88153020 con 0x7fde880cfdb0 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.477+0000 7fde87400640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde88146c00 0x7fde88157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.478+0000 7fde7e000640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde880cfdb0 0x7fde8815d770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde7002bec0 tx=0x7fde700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.478+0000 7fde7f400640 1 -- 172.21.15.22:0/614721635 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70041070 con 0x7fde880cfdb0 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.478+0000 7fde7f400640 1 -- 172.21.15.22:0/614721635 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7003ad00 con 0x7fde880cfdb0 2024-04-16T16:16:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.478+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde88156b20 con 0x7fde880cfdb0 2024-04-16T16:16:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.478+0000 7fde7f400640 1 -- 172.21.15.22:0/614721635 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70035040 con 0x7fde880cfdb0 2024-04-16T16:16:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.478+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881570e0 con 0x7fde880cfdb0 2024-04-16T16:16:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.479+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8804fd90 con 0x7fde880cfdb0 2024-04-16T16:16:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.480+0000 7fde7f400640 1 -- 172.21.15.22:0/614721635 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde7004c060 con 0x7fde880cfdb0 2024-04-16T16:16:54.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.481+0000 7fde7f400640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde6406c8f0 0x7fde6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.481+0000 7fde7f400640 1 -- 172.21.15.22:0/614721635 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fde700ad690 con 0x7fde880cfdb0 2024-04-16T16:16:54.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.482+0000 7fde86a00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde6406c8f0 0x7fde6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.482+0000 7fde86a00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde6406c8f0 0x7fde6406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde78001580 tx=0x7fde78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.486+0000 7fde7f400640 1 -- 172.21.15.22:0/614721635 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde7004b2c0 con 0x7fde880cfdb0 2024-04-16T16:16:54.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.691+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fde880cd030 con 0x7fde880cfdb0 2024-04-16T16:16:54.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.692+0000 7fde7f400640 1 -- 172.21.15.22:0/614721635 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fde7007bb50 con 0x7fde880cfdb0 2024-04-16T16:16:54.692 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:16:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde6406c8f0 msgr2=0x7fde6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde6406c8f0 0x7fde6406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde78001580 tx=0x7fde78009040 comp rx=0 tx=0).stop 2024-04-16T16:16:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde880cfdb0 msgr2=0x7fde8815d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde880cfdb0 0x7fde8815d770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde7002bec0 tx=0x7fde700046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 shutdown_connections 2024-04-16T16:16:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde6406c8f0 0x7fde6406edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde88146c00 0x7fde88157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde880cfdb0 0x7fde8815d770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 --2- 172.21.15.22:0/614721635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde880cc530 0x7fde88146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 >> 172.21.15.22:0/614721635 conn(0x7fde880b37e0 msgr2=0x7fde8815f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 shutdown_connections 2024-04-16T16:16:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.695+0000 7fde8dc00640 1 -- 172.21.15.22:0/614721635 wait complete. 2024-04-16T16:16:54.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:16:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.942+0000 7f4f4b800640 1 Processor -- start 2024-04-16T16:16:54.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.942+0000 7f4f4b800640 1 -- start start 2024-04-16T16:16:54.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.944+0000 7f4f4b800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 0x7f4f440711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.944+0000 7f4f4b800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f440b5a70 con 0x7f4f44164030 2024-04-16T16:16:54.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.944+0000 7f4f4b800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f44164410 con 0x7f4f440b41a0 2024-04-16T16:16:54.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.944+0000 7f4f4b800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4f44071700 con 0x7f4f440b2b30 2024-04-16T16:16:54.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.944+0000 7f4f48e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4f44164030 0x7f4f440b2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35160/0 (socket says 172.21.15.22:35160) 2024-04-16T16:16:54.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.944+0000 7f4f48e00640 1 -- 172.21.15.22:0/2102354608 learned_addr learned my addr 172.21.15.22:0/2102354608 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43e00640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 0x7f4f440711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719846385 0 0) 0x7f4f440b5a70 con 0x7f4f44164030 2024-04-16T16:16:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f28003520 con 0x7f4f44164030 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3806590030 0 0) 0x7f4f28003520 con 0x7f4f44164030 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 msgr2=0x7f4f440711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 0x7f4f440711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 >> v1:172.21.15.43:6789/0 conn(0x7f4f440b41a0 legacy=0x7f4f44160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f44163430 con 0x7f4f44164030 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f4f340019f0 con 0x7f4f44164030 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 >> v1:172.21.15.22:6789/0 conn(0x7f4f44164030 legacy=0x7f4f440b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.945+0000 7f4f43400640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f280039e0 0x7f4f28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43400640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43400640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 0x7f4f280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f44071700 con 0x7f4f28004800 2024-04-16T16:16:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2800ba70 con 0x7f4f280039e0 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2800bc70 con 0x7f4f440b2b30 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43e00640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f48e00640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f280039e0 0x7f4f28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f49800640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 0x7f4f280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43e00640 1 -- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 msgr2=0x7f4f280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43e00640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 0x7f4f280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43e00640 1 -- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f280039e0 msgr2=0x7f4f28003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43e00640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f280039e0 0x7f4f28003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f43e00640 1 -- 172.21.15.22:0/2102354608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f28003520 con 0x7f4f28004800 2024-04-16T16:16:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.946+0000 7f4f49800640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f440b2b30 0x7f4f280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.947+0000 7f4f43e00640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f28004c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009a90 tx=0x7f4f28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ddaefc38a6aba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c039070 con 0x7f4f28004800 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c02c680 con 0x7f4f28004800 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f43400640 1 -- 172.21.15.22:0/2102354608 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c009690 con 0x7f4f28004800 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f4b800640 1 -- 172.21.15.22:0/2102354608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 msgr2=0x7f4f28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f4b800640 1 --2- 172.21.15.22:0/2102354608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f28004c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009a90 tx=0x7f4f28005830 comp rx=0 tx=0).stop 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f49800640 1 -- 172.21.15.22:0/2102354608 reap_dead start 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f4b800640 1 -- 172.21.15.22:0/2102354608 shutdown_connections 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f4b800640 1 -- 172.21.15.22:0/2102354608 >> 172.21.15.22:0/2102354608 conn(0x7f4f44062440 msgr2=0x7f4f44062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f4b800640 1 -- 172.21.15.22:0/2102354608 shutdown_connections 2024-04-16T16:16:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.948+0000 7f4f4b800640 1 -- 172.21.15.22:0/2102354608 wait complete. 2024-04-16T16:16:54.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.950+0000 7f4f4b800640 1 Processor -- start 2024-04-16T16:16:54.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.951+0000 7f4f4b800640 1 -- start start 2024-04-16T16:16:54.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.951+0000 7f4f4b800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f44148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.951+0000 7f4f4b800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f4415d840 0x7f4f4415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.951+0000 7f4f4b800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f4415ae30 0x7f4f4415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f4b800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f44072d30 con 0x7f4f28004800 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f4b800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f44073010 con 0x7f4f4415d840 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f4b800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4f440732f0 con 0x7f4f4415ae30 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f44148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f44148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58480/0 (socket says 172.21.15.22:58480) 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 -- 172.21.15.22:0/1410500605 learned_addr learned my addr 172.21.15.22:0/1410500605 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f43e00640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f4415d840 0x7f4f4415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f49800640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f4415ae30 0x7f4f4415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 -- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f4415ae30 msgr2=0x7f4f4415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f4415ae30 0x7f4f4415b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 -- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f4415d840 msgr2=0x7f4f4415f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f4415d840 0x7f4f4415f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.952+0000 7f4f48e00640 1 -- 172.21.15.22:0/1410500605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f44149530 con 0x7f4f28004800 2024-04-16T16:16:54.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.953+0000 7f4f48e00640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f44148ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f340012e0 tx=0x7f4f3400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.953+0000 7f4f40c00640 1 -- 172.21.15.22:0/1410500605 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34013420 con 0x7f4f28004800 2024-04-16T16:16:54.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.953+0000 7f4f40c00640 1 -- 172.21.15.22:0/1410500605 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f34018070 con 0x7f4f28004800 2024-04-16T16:16:54.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.953+0000 7f4f40c00640 1 -- 172.21.15.22:0/1410500605 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34013820 con 0x7f4f28004800 2024-04-16T16:16:54.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.953+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4415f9e0 con 0x7f4f28004800 2024-04-16T16:16:54.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.953+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4415ffa0 con 0x7f4f28004800 2024-04-16T16:16:54.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.954+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4404fd90 con 0x7f4f28004800 2024-04-16T16:16:54.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.955+0000 7f4f40c00640 1 -- 172.21.15.22:0/1410500605 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f340139c0 con 0x7f4f28004800 2024-04-16T16:16:54.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.956+0000 7f4f40c00640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4f2006c920 0x7f4f2006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:54.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.956+0000 7f4f40c00640 1 -- 172.21.15.22:0/1410500605 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f3408c280 con 0x7f4f28004800 2024-04-16T16:16:54.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.956+0000 7f4f43e00640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4f2006c920 0x7f4f2006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:54.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.957+0000 7f4f43e00640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4f2006c920 0x7f4f2006ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c036000 tx=0x7f4f2c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:54.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:54.961+0000 7f4f40c00640 1 -- 172.21.15.22:0/1410500605 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f3405a6b0 con 0x7f4f28004800 2024-04-16T16:16:55.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.163+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4f44165370 con 0x7f4f28004800 2024-04-16T16:16:55.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.164+0000 7f4f40c00640 1 -- 172.21.15.22:0/1410500605 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f4f34059fb0 con 0x7f4f28004800 2024-04-16T16:16:55.164 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:16:55.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4f2006c920 msgr2=0x7f4f2006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4f2006c920 0x7f4f2006ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c036000 tx=0x7f4f2c030000 comp rx=0 tx=0).stop 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 msgr2=0x7f4f44148ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f44148ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f340012e0 tx=0x7f4f3400e530 comp rx=0 tx=0).stop 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 shutdown_connections 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4f2006c920 0x7f4f2006ede0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f4415ae30 0x7f4f4415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f4415d840 0x7f4f4415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 --2- 172.21.15.22:0/1410500605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f28004800 0x7f4f44148ff0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.167+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 >> 172.21.15.22:0/1410500605 conn(0x7f4f44062440 msgr2=0x7f4f441645e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.168+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 shutdown_connections 2024-04-16T16:16:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.168+0000 7f4f4b800640 1 -- 172.21.15.22:0/1410500605 wait complete. 2024-04-16T16:16:55.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:16:55.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.404+0000 7f02f6800640 1 Processor -- start 2024-04-16T16:16:55.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.404+0000 7f02f6800640 1 -- start start 2024-04-16T16:16:55.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.405+0000 7f02f6800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02f015eb60 0x7f02f00cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.405+0000 7f02f6800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d3a60 0x7f02f00b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.405+0000 7f02f6800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f00d3ef0 con 0x7f02f00d35f0 2024-04-16T16:16:55.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.405+0000 7f02f6800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f02f00d41d0 con 0x7f02f015eb60 2024-04-16T16:16:55.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.405+0000 7f02f6800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f02f00d44b0 con 0x7f02f00d3a60 2024-04-16T16:16:55.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.406+0000 7f02f5400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02f015eb60 0x7f02f00cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.406+0000 7f02f5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d3a60 0x7f02f00b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.406+0000 7f02f5400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02f015eb60 0x7f02f00cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:58788/0 (socket says 172.21.15.22:58788) 2024-04-16T16:16:55.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.406+0000 7f02f5400640 1 -- 172.21.15.22:0/2552671514 learned_addr learned my addr 172.21.15.22:0/2552671514 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.407+0000 7f02f5400640 1 -- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d3a60 msgr2=0x7f02f00b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.407+0000 7f02f5400640 1 --2- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d3a60 0x7f02f00b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.407+0000 7f02f5400640 1 -- 172.21.15.22:0/2552671514 >> v1:172.21.15.43:6789/0 conn(0x7f02f00d35f0 legacy=0x7f02f00d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.407+0000 7f02f5400640 1 -- 172.21.15.22:0/2552671514 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f00b7db0 con 0x7f02f015eb60 2024-04-16T16:16:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.407+0000 7f02f5e00640 1 --2- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d3a60 0x7f02f00b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:55.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.409+0000 7f02f5400640 1 --2- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f015eb60 0x7f02f00cfcc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009e50 tx=0x7f02e402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f135e90d4fdb0ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:55.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.409+0000 7f02efe00640 1 -- 172.21.15.22:0/2552671514 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e402cb00 con 0x7f02f015eb60 2024-04-16T16:16:55.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.409+0000 7f02efe00640 1 -- 172.21.15.22:0/2552671514 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e402cca0 con 0x7f02f015eb60 2024-04-16T16:16:55.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.409+0000 7f02efe00640 1 -- 172.21.15.22:0/2552671514 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4034610 con 0x7f02f015eb60 2024-04-16T16:16:55.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 -- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f015eb60 msgr2=0x7f02f00cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 --2- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f015eb60 0x7f02f00cfcc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009e50 tx=0x7f02e402bf60 comp rx=0 tx=0).stop 2024-04-16T16:16:55.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 -- 172.21.15.22:0/2552671514 shutdown_connections 2024-04-16T16:16:55.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 --2- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d3a60 0x7f02f00b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 --2- 172.21.15.22:0/2552671514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f015eb60 0x7f02f00cfcc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 -- 172.21.15.22:0/2552671514 >> 172.21.15.22:0/2552671514 conn(0x7f02f0072460 msgr2=0x7f02f0072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:55.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 -- 172.21.15.22:0/2552671514 shutdown_connections 2024-04-16T16:16:55.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.410+0000 7f02f6800640 1 -- 172.21.15.22:0/2552671514 wait complete. 2024-04-16T16:16:55.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.412+0000 7f02f6800640 1 Processor -- start 2024-04-16T16:16:55.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.412+0000 7f02f6800640 1 -- start start 2024-04-16T16:16:55.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.413+0000 7f02f6800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d35f0 0x7f02f01f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.413+0000 7f02f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f015eb60 0x7f02f01f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.413+0000 7f02f6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f00ab890 0x7f02f00abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.413+0000 7f02f6800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f02f00d2030 con 0x7f02f015eb60 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.413+0000 7f02f6800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f02f00d1eb0 con 0x7f02f00ab890 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.413+0000 7f02f6800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f02f00b8810 con 0x7f02f00d35f0 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f015eb60 0x7f02f01f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f015eb60 0x7f02f01f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58492/0 (socket says 172.21.15.22:58492) 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 -- 172.21.15.22:0/987785447 learned_addr learned my addr 172.21.15.22:0/987785447 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f5400640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d35f0 0x7f02f01f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f5e00640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f00ab890 0x7f02f00abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 -- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d35f0 msgr2=0x7f02f01f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d35f0 0x7f02f01f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 -- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f00ab890 msgr2=0x7f02f00abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f00ab890 0x7f02f00abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.414+0000 7f02f4a00640 1 -- 172.21.15.22:0/987785447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f0160320 con 0x7f02f015eb60 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.415+0000 7f02f4a00640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f015eb60 0x7f02f01f5fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c480 tx=0x7f02dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.415+0000 7f02ed600640 1 -- 172.21.15.22:0/987785447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0052d0 con 0x7f02f015eb60 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.415+0000 7f02ed600640 1 -- 172.21.15.22:0/987785447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc005470 con 0x7f02f015eb60 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.415+0000 7f02ed600640 1 -- 172.21.15.22:0/987785447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc012870 con 0x7f02f015eb60 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.415+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f0160600 con 0x7f02f015eb60 2024-04-16T16:16:55.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.415+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f01f64f0 con 0x7f02f015eb60 2024-04-16T16:16:55.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.416+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f0075f30 con 0x7f02f015eb60 2024-04-16T16:16:55.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.417+0000 7f02ed600640 1 -- 172.21.15.22:0/987785447 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02dc012a10 con 0x7f02f015eb60 2024-04-16T16:16:55.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.418+0000 7f02ed600640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02d006c8f0 0x7f02d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.418+0000 7f02ed600640 1 -- 172.21.15.22:0/987785447 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f02dc08b800 con 0x7f02f015eb60 2024-04-16T16:16:55.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.418+0000 7f02f5400640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02d006c8f0 0x7f02d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.419+0000 7f02f5400640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02d006c8f0 0x7f02d006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02e4035000 tx=0x7f02e4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.422+0000 7f02ed600640 1 -- 172.21.15.22:0/987785447 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02dc059c20 con 0x7f02f015eb60 2024-04-16T16:16:55.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.627+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f02f0068f70 con 0x7f02f015eb60 2024-04-16T16:16:55.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.628+0000 7f02ed600640 1 -- 172.21.15.22:0/987785447 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f02dc059520 con 0x7f02f015eb60 2024-04-16T16:16:55.628 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:16:55.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02d006c8f0 msgr2=0x7f02d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02d006c8f0 0x7f02d006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02e4035000 tx=0x7f02e4030000 comp rx=0 tx=0).stop 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f015eb60 msgr2=0x7f02f01f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f015eb60 0x7f02f01f5fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c480 tx=0x7f02dc00c940 comp rx=0 tx=0).stop 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 shutdown_connections 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02d006c8f0 0x7f02d006edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02f00ab890 0x7f02f00abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.630+0000 7f02f6800640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f015eb60 0x7f02f01f5fb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.631+0000 7f02f6800640 1 --2- 172.21.15.22:0/987785447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02f00d35f0 0x7f02f01f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.631+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 >> 172.21.15.22:0/987785447 conn(0x7f02f0072460 msgr2=0x7f02f00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.631+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 shutdown_connections 2024-04-16T16:16:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.631+0000 7f02f6800640 1 -- 172.21.15.22:0/987785447 wait complete. 2024-04-16T16:16:55.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:16:55.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.869+0000 7f52bae00640 1 Processor -- start 2024-04-16T16:16:55.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.870+0000 7f52bae00640 1 -- start start 2024-04-16T16:16:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.871+0000 7f52bae00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52b415eab0 0x7f52b40d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.871+0000 7f52bae00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f52b40b80f0 0x7f52b40d4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.871+0000 7f52bae00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b40d31f0 con 0x7f52b40ba660 2024-04-16T16:16:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.871+0000 7f52bae00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f52b40d34d0 con 0x7f52b415eab0 2024-04-16T16:16:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.871+0000 7f52bae00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f52b40d37b0 con 0x7f52b40b80f0 2024-04-16T16:16:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52b9a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52b415eab0 0x7f52b40d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52b9a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52b415eab0 0x7f52b40d2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58504/0 (socket says 172.21.15.22:58504) 2024-04-16T16:16:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52b9a00640 1 -- 172.21.15.22:0/3494379888 learned_addr learned my addr 172.21.15.22:0/3494379888 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52ba400640 1 --2- 172.21.15.22:0/3494379888 >> v2:172.21.15.43:3300/0 conn(0x7f52b40b80f0 0x7f52b40d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52b9a00640 1 -- 172.21.15.22:0/3494379888 >> v2:172.21.15.43:3300/0 conn(0x7f52b40b80f0 msgr2=0x7f52b40d4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52b9a00640 1 --2- 172.21.15.22:0/3494379888 >> v2:172.21.15.43:3300/0 conn(0x7f52b40b80f0 0x7f52b40d4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52b9a00640 1 -- 172.21.15.22:0/3494379888 >> v1:172.21.15.43:6789/0 conn(0x7f52b40ba660 legacy=0x7f52b40b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.872+0000 7f52b9a00640 1 -- 172.21.15.22:0/3494379888 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b40d3a90 con 0x7f52b415eab0 2024-04-16T16:16:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.874+0000 7f52b9a00640 1 --2- 172.21.15.22:0/3494379888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b40d2910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52b40d3d70 tx=0x7f52a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce17777f952c637 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.874+0000 7f52b3e00640 1 -- 172.21.15.22:0/3494379888 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4035020 con 0x7f52b415eab0 2024-04-16T16:16:55.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.874+0000 7f52b3e00640 1 -- 172.21.15.22:0/3494379888 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a4031870 con 0x7f52b415eab0 2024-04-16T16:16:55.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.874+0000 7f52b3e00640 1 -- 172.21.15.22:0/3494379888 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4031c40 con 0x7f52b415eab0 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 -- 172.21.15.22:0/3494379888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 msgr2=0x7f52b40d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 --2- 172.21.15.22:0/3494379888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b40d2910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52b40d3d70 tx=0x7f52a402b910 comp rx=0 tx=0).stop 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 -- 172.21.15.22:0/3494379888 shutdown_connections 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 --2- 172.21.15.22:0/3494379888 >> v2:172.21.15.43:3300/0 conn(0x7f52b40b80f0 0x7f52b40d4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 --2- 172.21.15.22:0/3494379888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b40d2910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 -- 172.21.15.22:0/3494379888 >> 172.21.15.22:0/3494379888 conn(0x7f52b4072430 msgr2=0x7f52b4072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 -- 172.21.15.22:0/3494379888 shutdown_connections 2024-04-16T16:16:55.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.875+0000 7f52bae00640 1 -- 172.21.15.22:0/3494379888 wait complete. 2024-04-16T16:16:55.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.877+0000 7f52bae00640 1 Processor -- start 2024-04-16T16:16:55.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.877+0000 7f52bae00640 1 -- start start 2024-04-16T16:16:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52bae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b40b80f0 0x7f52b4160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52bae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52b40ba660 0x7f52b41571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52bae00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52bae00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52b415f010 con 0x7f52b415eab0 2024-04-16T16:16:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52bae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52b415ee90 con 0x7f52b40b80f0 2024-04-16T16:16:55.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52bae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f52b40b8540 con 0x7f52b40ba660 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b4159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58510/0 (socket says 172.21.15.22:58510) 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 -- 172.21.15.22:0/1883919021 learned_addr learned my addr 172.21.15.22:0/1883919021 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52b9a00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b40b80f0 0x7f52b4160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52b9000640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52b40ba660 0x7f52b41571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 -- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52b40ba660 msgr2=0x7f52b41571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52b40ba660 0x7f52b41571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 -- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b40b80f0 msgr2=0x7f52b4160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b40b80f0 0x7f52b4160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.878+0000 7f52ba400640 1 -- 172.21.15.22:0/1883919021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b415a8c0 con 0x7f52b415eab0 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52b9a00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b40b80f0 0x7f52b4160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52b9000640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52b40ba660 0x7f52b41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52ba400640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b4159ee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00d800 tx=0x7f52ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:55.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52b1600640 1 -- 172.21.15.22:0/1883919021 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac00b6c0 con 0x7f52b415eab0 2024-04-16T16:16:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52b1600640 1 -- 172.21.15.22:0/1883919021 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac019070 con 0x7f52b415eab0 2024-04-16T16:16:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b415aba0 con 0x7f52b415eab0 2024-04-16T16:16:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52b1600640 1 -- 172.21.15.22:0/1883919021 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac00bac0 con 0x7f52b415eab0 2024-04-16T16:16:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.879+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b4155be0 con 0x7f52b415eab0 2024-04-16T16:16:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.881+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b4155de0 con 0x7f52b415eab0 2024-04-16T16:16:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.881+0000 7f52b1600640 1 -- 172.21.15.22:0/1883919021 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52ac00bc60 con 0x7f52b415eab0 2024-04-16T16:16:55.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.882+0000 7f52b1600640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f529406c940 0x7f529406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:55.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.882+0000 7f52b1600640 1 -- 172.21.15.22:0/1883919021 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f52ac08bf80 con 0x7f52b415eab0 2024-04-16T16:16:55.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.883+0000 7f52b9a00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f529406c940 0x7f529406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:55.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.883+0000 7f52b9a00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f529406c940 0x7f529406ee00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52a4036000 tx=0x7f52a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:55.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:55.887+0000 7f52b1600640 1 -- 172.21.15.22:0/1883919021 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52b4155de0 con 0x7f52b415eab0 2024-04-16T16:16:56.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.129+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52b415b0c0 con 0x7f52b415eab0 2024-04-16T16:16:56.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.130+0000 7f52b1600640 1 -- 172.21.15.22:0/1883919021 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f52ac05a420 con 0x7f52b415eab0 2024-04-16T16:16:56.130 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:56.130 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:16:56.130 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.132+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f529406c940 msgr2=0x7f529406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.132+0000 7f52bae00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f529406c940 0x7f529406ee00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52a4036000 tx=0x7f52a4008030 comp rx=0 tx=0).stop 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.132+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 msgr2=0x7f52b4159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.132+0000 7f52bae00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b4159ee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00d800 tx=0x7f52ac00dcc0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.132+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 shutdown_connections 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.133+0000 7f52bae00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f529406c940 0x7f529406ee00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.133+0000 7f52bae00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b415eab0 0x7f52b4159ee0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.133+0000 7f52bae00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52b40ba660 0x7f52b41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.133+0000 7f52bae00640 1 --2- 172.21.15.22:0/1883919021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b40b80f0 0x7f52b4160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.133+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 >> 172.21.15.22:0/1883919021 conn(0x7f52b4072430 msgr2=0x7f52b40cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:56.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.133+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 shutdown_connections 2024-04-16T16:16:56.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.133+0000 7f52bae00640 1 -- 172.21.15.22:0/1883919021 wait complete. 2024-04-16T16:16:56.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:56.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.370+0000 7fa4f5e00640 1 Processor -- start 2024-04-16T16:16:56.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.371+0000 7fa4f5e00640 1 -- start start 2024-04-16T16:16:56.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.372+0000 7fa4f5e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4f015ea50 0x7fa4f00ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.372+0000 7fa4f5e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f00b9080 con 0x7fa4f00b8aa0 2024-04-16T16:16:56.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.372+0000 7fa4f5e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f00b9360 con 0x7fa4f00cf630 2024-04-16T16:16:56.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.372+0000 7fa4f5e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f00b9c90 con 0x7fa4f015ea50 2024-04-16T16:16:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.372+0000 7fa4f5400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa4f00b8aa0 0x7fa4f00d34d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35162/0 (socket says 172.21.15.22:35162) 2024-04-16T16:16:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.372+0000 7fa4f5400640 1 -- 172.21.15.22:0/2735511371 learned_addr learned my addr 172.21.15.22:0/2735511371 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4f4a00640 1 --2- 172.21.15.22:0/2735511371 >> v2:172.21.15.43:3300/0 conn(0x7fa4f015ea50 0x7fa4f00ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800530068 0 0) 0x7fa4f00b9080 con 0x7fa4f00b8aa0 2024-04-16T16:16:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4d8003520 con 0x7fa4f00b8aa0 2024-04-16T16:16:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2992730462 0 0) 0x7fa4d8003520 con 0x7fa4f00b8aa0 2024-04-16T16:16:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 >> v2:172.21.15.43:3300/0 conn(0x7fa4f015ea50 msgr2=0x7fa4f00ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 --2- 172.21.15.22:0/2735511371 >> v2:172.21.15.43:3300/0 conn(0x7fa4f015ea50 0x7fa4f00ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 >> v1:172.21.15.43:6789/0 conn(0x7fa4f00cf630 legacy=0x7fa4f00d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f00b9640 con 0x7fa4f00b8aa0 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fa4e80019f0 con 0x7fa4f00b8aa0 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 >> v1:172.21.15.22:6789/0 conn(0x7fa4f00b8aa0 legacy=0x7fa4f00d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8003a00 0x7fa4d8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4d8004800 0x7fa4d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.373+0000 7fa4ef400640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4d80052e0 0x7fa4d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f00b9c90 con 0x7fa4d8004800 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d800c1e0 con 0x7fa4d8003a00 2024-04-16T16:16:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d800c3e0 con 0x7fa4d80052e0 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4efe00640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4d8004800 0x7fa4d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4f4a00640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8003a00 0x7fa4d8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4efe00640 1 -- 172.21.15.22:0/2735511371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4d80052e0 msgr2=0x7fa4d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4efe00640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4d80052e0 0x7fa4d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4efe00640 1 -- 172.21.15.22:0/2735511371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8003a00 msgr2=0x7fa4d8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4efe00640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8003a00 0x7fa4d8003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4efe00640 1 -- 172.21.15.22:0/2735511371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d8003520 con 0x7fa4d8004800 2024-04-16T16:16:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.374+0000 7fa4f5400640 1 -- 172.21.15.22:0/2735511371 reap_dead start 2024-04-16T16:16:56.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.375+0000 7fa4efe00640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4d8004800 0x7fa4d8004c80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc001750 tx=0x7fa4d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7502c7a3bef861ad server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:56.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.375+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc001370 con 0x7fa4d8004800 2024-04-16T16:16:56.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.375+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc0052d0 con 0x7fa4d8004800 2024-04-16T16:16:56.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.375+0000 7fa4ef400640 1 -- 172.21.15.22:0/2735511371 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc003830 con 0x7fa4d8004800 2024-04-16T16:16:56.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.376+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2735511371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4d8004800 msgr2=0x7fa4d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.376+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4d8004800 0x7fa4d8004c80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc001750 tx=0x7fa4d8005830 comp rx=0 tx=0).stop 2024-04-16T16:16:56.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.376+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2735511371 shutdown_connections 2024-04-16T16:16:56.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.376+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2735511371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4d8004800 0x7fa4d8004c80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.376+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2735511371 >> 172.21.15.22:0/2735511371 conn(0x7fa4f0072430 msgr2=0x7fa4f0072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:56.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.376+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2735511371 shutdown_connections 2024-04-16T16:16:56.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.376+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2735511371 wait complete. 2024-04-16T16:16:56.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.378+0000 7fa4f5e00640 1 Processor -- start 2024-04-16T16:16:56.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.378+0000 7fa4f5e00640 1 -- start start 2024-04-16T16:16:56.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.379+0000 7fa4f5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8004800 0x7fa4f0147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.379+0000 7fa4f5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4f015efb0 0x7fa4f015f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.379+0000 7fa4f5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4f0160f60 0x7fa4f01613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.379+0000 7fa4f5e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f00cfaa0 con 0x7fa4f0160f60 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.379+0000 7fa4f5e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f015ee30 con 0x7fa4d8004800 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.379+0000 7fa4f5e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f00cfc20 con 0x7fa4f015efb0 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.379+0000 7fa4f5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4f0160f60 0x7fa4f01613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4f0160f60 0x7fa4f01613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58536/0 (socket says 172.21.15.22:58536) 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 -- 172.21.15.22:0/2832531233 learned_addr learned my addr 172.21.15.22:0/2832531233 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f4a00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8004800 0x7fa4f0147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4efe00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4f015efb0 0x7fa4f015f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 -- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4f015efb0 msgr2=0x7fa4f015f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4f015efb0 0x7fa4f015f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 -- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8004800 msgr2=0x7fa4f0147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8004800 0x7fa4f0147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 -- 172.21.15.22:0/2832531233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f0161920 con 0x7fa4f0160f60 2024-04-16T16:16:56.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.380+0000 7fa4f5400640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4f0160f60 0x7fa4f01613e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00d5a30 tx=0x7fa4e800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:56.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.381+0000 7fa4ecc00640 1 -- 172.21.15.22:0/2832531233 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800a5e0 con 0x7fa4f0160f60 2024-04-16T16:16:56.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.381+0000 7fa4ecc00640 1 -- 172.21.15.22:0/2832531233 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e800a780 con 0x7fa4f0160f60 2024-04-16T16:16:56.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.381+0000 7fa4ecc00640 1 -- 172.21.15.22:0/2832531233 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800ab70 con 0x7fa4f0160f60 2024-04-16T16:16:56.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.381+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f0161bd0 con 0x7fa4f0160f60 2024-04-16T16:16:56.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.381+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f00cce00 con 0x7fa4f0160f60 2024-04-16T16:16:56.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.382+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f0075f30 con 0x7fa4f0160f60 2024-04-16T16:16:56.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.383+0000 7fa4ecc00640 1 -- 172.21.15.22:0/2832531233 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4e800ad10 con 0x7fa4f0160f60 2024-04-16T16:16:56.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.384+0000 7fa4ecc00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa4d006c8f0 0x7fa4d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.384+0000 7fa4ecc00640 1 -- 172.21.15.22:0/2832531233 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa4e808b0e0 con 0x7fa4f0160f60 2024-04-16T16:16:56.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.384+0000 7fa4f4a00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa4d006c8f0 0x7fa4d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.385+0000 7fa4f4a00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa4d006c8f0 0x7fa4d006edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0069190 tx=0x7fa4e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:56.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.389+0000 7fa4ecc00640 1 -- 172.21.15.22:0/2832531233 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4e801b070 con 0x7fa4f0160f60 2024-04-16T16:16:56.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.594+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4f015d800 con 0x7fa4f0160f60 2024-04-16T16:16:56.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.597+0000 7fa4ecc00640 1 -- 172.21.15.22:0/2832531233 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7fa4e8059500 con 0x7fa4f0160f60 2024-04-16T16:16:56.597 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:56.597 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:56.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa4d006c8f0 msgr2=0x7fa4d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa4d006c8f0 0x7fa4d006edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0069190 tx=0x7fa4e4008040 comp rx=0 tx=0).stop 2024-04-16T16:16:56.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4f0160f60 msgr2=0x7fa4f01613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4f0160f60 0x7fa4f01613e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00d5a30 tx=0x7fa4e800ccd0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 shutdown_connections 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa4d006c8f0 0x7fa4d006edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4f0160f60 0x7fa4f01613e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4f015efb0 0x7fa4f015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 --2- 172.21.15.22:0/2832531233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4d8004800 0x7fa4f0147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 >> 172.21.15.22:0/2832531233 conn(0x7fa4f0072430 msgr2=0x7fa4f0154f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 shutdown_connections 2024-04-16T16:16:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.600+0000 7fa4f5e00640 1 -- 172.21.15.22:0/2832531233 wait complete. 2024-04-16T16:16:56.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:16:56.620 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:16:56.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.840+0000 7f0da9800640 1 Processor -- start 2024-04-16T16:16:56.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.840+0000 7f0da9800640 1 -- start start 2024-04-16T16:16:56.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.841+0000 7f0da9800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da40cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.841+0000 7f0da9800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0da40b8680 0x7f0da40b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.841+0000 7f0da9800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da40d00a0 con 0x7f0da40b6530 2024-04-16T16:16:56.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.841+0000 7f0da9800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f0da40ba6b0 con 0x7f0da40b8680 2024-04-16T16:16:56.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.841+0000 7f0da9800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0da40b9000 con 0x7f0da40cf780 2024-04-16T16:16:56.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.842+0000 7f0da2a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da40cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.842+0000 7f0da2000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0da40b8680 0x7f0da40b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.842+0000 7f0da2a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da40cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:58130/0 (socket says 172.21.15.22:58130) 2024-04-16T16:16:56.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.842+0000 7f0da2a00640 1 -- 172.21.15.22:0/2255723873 learned_addr learned my addr 172.21.15.22:0/2255723873 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:56.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.843+0000 7f0da2000640 1 -- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 msgr2=0x7f0da40cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:56.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.843+0000 7f0da2000640 1 --2- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da40cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.843+0000 7f0da2000640 1 -- 172.21.15.22:0/2255723873 >> v1:172.21.15.43:6789/0 conn(0x7f0da40b6530 legacy=0x7f0da40b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.843+0000 7f0da1600640 1 -- 172.21.15.22:0/2255723873 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696780852 0 0) 0x7f0da40d00a0 con 0x7f0da40b6530 2024-04-16T16:16:56.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.843+0000 7f0da2000640 1 -- 172.21.15.22:0/2255723873 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da40b9240 con 0x7f0da40b8680 2024-04-16T16:16:56.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.843+0000 7f0da2a00640 1 --2- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da40cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:16:56.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.844+0000 7f0da2000640 1 --2- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da40b8ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0097d0 tx=0x7f0d8c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8621b8d7875809ec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:56.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.845+0000 7f0da1600640 1 -- 172.21.15.22:0/2255723873 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c035020 con 0x7f0da40b8680 2024-04-16T16:16:56.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.845+0000 7f0da1600640 1 -- 172.21.15.22:0/2255723873 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c031800 con 0x7f0da40b8680 2024-04-16T16:16:56.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.845+0000 7f0da1600640 1 -- 172.21.15.22:0/2255723873 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c031bd0 con 0x7f0da40b8680 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.845+0000 7f0da9800640 1 -- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 msgr2=0x7f0da40b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.845+0000 7f0da9800640 1 --2- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da40b8ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0097d0 tx=0x7f0d8c02b8a0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.846+0000 7f0da9800640 1 -- 172.21.15.22:0/2255723873 shutdown_connections 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.846+0000 7f0da9800640 1 --2- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da40b8ac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.846+0000 7f0da9800640 1 --2- 172.21.15.22:0/2255723873 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da40cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.846+0000 7f0da9800640 1 -- 172.21.15.22:0/2255723873 >> 172.21.15.22:0/2255723873 conn(0x7f0da4072460 msgr2=0x7f0da4072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.846+0000 7f0da9800640 1 -- 172.21.15.22:0/2255723873 shutdown_connections 2024-04-16T16:16:56.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.846+0000 7f0da9800640 1 -- 172.21.15.22:0/2255723873 wait complete. 2024-04-16T16:16:56.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.848+0000 7f0da9800640 1 Processor -- start 2024-04-16T16:16:56.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.848+0000 7f0da9800640 1 -- start start 2024-04-16T16:16:56.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0da40b6530 0x7f0da4159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da9800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da414cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da9800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da415a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da9800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0da40b9800 con 0x7f0da40b6530 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da9800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0da40b9e50 con 0x7f0da40b8680 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da9800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0da40b9ae0 con 0x7f0da40cf780 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0da40b6530 0x7f0da4159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0da40b6530 0x7f0da4159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58542/0 (socket says 172.21.15.22:58542) 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da2a00640 1 -- 172.21.15.22:0/1137167051 learned_addr learned my addr 172.21.15.22:0/1137167051 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da2000640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da414cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.849+0000 7f0da3400640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da2a00640 1 -- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 msgr2=0x7f0da415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da2a00640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da2a00640 1 -- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 msgr2=0x7f0da414cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da2a00640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da414cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da2a00640 1 -- 172.21.15.22:0/1137167051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da41614f0 con 0x7f0da40b6530 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da2000640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da414cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da3400640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da2a00640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0da40b6530 0x7f0da4159250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400e9d0 tx=0x7f0d9400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0d9aa00640 1 -- 172.21.15.22:0/1137167051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94017070 con 0x7f0da40b6530 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0d9aa00640 1 -- 172.21.15.22:0/1137167051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9400ca60 con 0x7f0da40b6530 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da41617d0 con 0x7f0da40b6530 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.850+0000 7f0d9aa00640 1 -- 172.21.15.22:0/1137167051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400ce10 con 0x7f0da40b6530 2024-04-16T16:16:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.851+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da4159790 con 0x7f0da40b6530 2024-04-16T16:16:56.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.852+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da4161cf0 con 0x7f0da40b6530 2024-04-16T16:16:56.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.853+0000 7f0d9aa00640 1 -- 172.21.15.22:0/1137167051 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d9401a070 con 0x7f0da40b6530 2024-04-16T16:16:56.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.854+0000 7f0d9aa00640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d8006c8f0 0x7f0d8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:56.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.854+0000 7f0d9aa00640 1 -- 172.21.15.22:0/1137167051 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0d9408bb70 con 0x7f0da40b6530 2024-04-16T16:16:56.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.854+0000 7f0da2000640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d8006c8f0 0x7f0d8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:56.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.855+0000 7f0da2000640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d8006c8f0 0x7f0d8006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c036000 tx=0x7f0d8c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:56.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:56.858+0000 7f0d9aa00640 1 -- 172.21.15.22:0/1137167051 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0da4161cf0 con 0x7f0da40b6530 2024-04-16T16:16:57.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.060+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0da40d53d0 con 0x7f0da40b6530 2024-04-16T16:16:57.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.060+0000 7f0d9aa00640 1 -- 172.21.15.22:0/1137167051 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f0da40d53d0 con 0x7f0da40b6530 2024-04-16T16:16:57.060 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:16:57.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.063+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d8006c8f0 msgr2=0x7f0d8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.063+0000 7f0da9800640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d8006c8f0 0x7f0d8006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c036000 tx=0x7f0d8c008030 comp rx=0 tx=0).stop 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.063+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0da40b6530 msgr2=0x7f0da4159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.063+0000 7f0da9800640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0da40b6530 0x7f0da4159250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400e9d0 tx=0x7f0d9400ee90 comp rx=0 tx=0).stop 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 shutdown_connections 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d8006c8f0 0x7f0d8006edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0da40cf780 0x7f0da415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0da40b8680 0x7f0da414cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 --2- 172.21.15.22:0/1137167051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0da40b6530 0x7f0da4159250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 >> 172.21.15.22:0/1137167051 conn(0x7f0da4072460 msgr2=0x7f0da4072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 shutdown_connections 2024-04-16T16:16:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.064+0000 7f0da9800640 1 -- 172.21.15.22:0/1137167051 wait complete. 2024-04-16T16:16:57.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:16:57.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.303+0000 7ff64e800640 1 Processor -- start 2024-04-16T16:16:57.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.303+0000 7ff64e800640 1 -- start start 2024-04-16T16:16:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64e800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff64815c670 0x7ff6480af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff64806e0a0 0x7ff6480d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64e800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff648162790 con 0x7ff6480d1eb0 2024-04-16T16:16:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64e800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff648162540 con 0x7ff64806e0a0 2024-04-16T16:16:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64e800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff6481630c0 con 0x7ff64815c670 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64ca00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff64806e0a0 0x7ff6480d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64ca00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff64806e0a0 0x7ff6480d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58552/0 (socket says 172.21.15.22:58552) 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64ca00640 1 -- 172.21.15.22:0/2609681425 learned_addr learned my addr 172.21.15.22:0/2609681425 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.305+0000 7ff64d400640 1 --2- 172.21.15.22:0/2609681425 >> v2:172.21.15.43:3300/0 conn(0x7ff64815c670 0x7ff6480af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.306+0000 7ff64ca00640 1 -- 172.21.15.22:0/2609681425 >> v2:172.21.15.43:3300/0 conn(0x7ff64815c670 msgr2=0x7ff6480af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.306+0000 7ff64ca00640 1 --2- 172.21.15.22:0/2609681425 >> v2:172.21.15.43:3300/0 conn(0x7ff64815c670 0x7ff6480af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.306+0000 7ff64ca00640 1 -- 172.21.15.22:0/2609681425 >> v1:172.21.15.43:6789/0 conn(0x7ff6480d1eb0 legacy=0x7ff648062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.306+0000 7ff64ca00640 1 -- 172.21.15.22:0/2609681425 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff648162a70 con 0x7ff64806e0a0 2024-04-16T16:16:57.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.307+0000 7ff64ca00640 1 --2- 172.21.15.22:0/2609681425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64806e0a0 0x7ff6480d1970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff648072e70 tx=0x7ff63402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70d39222e11f46e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:57.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.307+0000 7ff647e00640 1 -- 172.21.15.22:0/2609681425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634035020 con 0x7ff64806e0a0 2024-04-16T16:16:57.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.307+0000 7ff647e00640 1 -- 172.21.15.22:0/2609681425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff634031870 con 0x7ff64806e0a0 2024-04-16T16:16:57.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.307+0000 7ff647e00640 1 -- 172.21.15.22:0/2609681425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634031c40 con 0x7ff64806e0a0 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 -- 172.21.15.22:0/2609681425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64806e0a0 msgr2=0x7ff6480d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 --2- 172.21.15.22:0/2609681425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64806e0a0 0x7ff6480d1970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff648072e70 tx=0x7ff63402b910 comp rx=0 tx=0).stop 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 -- 172.21.15.22:0/2609681425 shutdown_connections 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 --2- 172.21.15.22:0/2609681425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64806e0a0 0x7ff6480d1970 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 --2- 172.21.15.22:0/2609681425 >> v2:172.21.15.43:3300/0 conn(0x7ff64815c670 0x7ff6480af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 -- 172.21.15.22:0/2609681425 >> 172.21.15.22:0/2609681425 conn(0x7ff64806be40 msgr2=0x7ff64806c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 -- 172.21.15.22:0/2609681425 shutdown_connections 2024-04-16T16:16:57.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.308+0000 7ff64e800640 1 -- 172.21.15.22:0/2609681425 wait complete. 2024-04-16T16:16:57.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.310+0000 7ff64e800640 1 Processor -- start 2024-04-16T16:16:57.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.310+0000 7ff64e800640 1 -- start start 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff64806e0a0 0x7ff648151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6480d1eb0 0x7ff6480b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff64815c670 0x7ff6480b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64e800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff64806e570 con 0x7ff6480d1eb0 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64e800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff6480af6b0 con 0x7ff64806e0a0 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff64806e6f0 con 0x7ff64815c670 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6480d1eb0 0x7ff6480b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6480d1eb0 0x7ff6480b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58556/0 (socket says 172.21.15.22:58556) 2024-04-16T16:16:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 -- 172.21.15.22:0/875024902 learned_addr learned my addr 172.21.15.22:0/875024902 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64d400640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff64806e0a0 0x7ff648151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 -- 172.21.15.22:0/875024902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff64815c670 msgr2=0x7ff6480b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff64815c670 0x7ff6480b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 -- 172.21.15.22:0/875024902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff64806e0a0 msgr2=0x7ff648151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff64806e0a0 0x7ff648151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.311+0000 7ff64ca00640 1 -- 172.21.15.22:0/875024902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64815b210 con 0x7ff6480d1eb0 2024-04-16T16:16:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.312+0000 7ff64ca00640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6480d1eb0 0x7ff6480b54d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff63402b950 tx=0x7ff6340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.312+0000 7ff645600640 1 -- 172.21.15.22:0/875024902 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634040070 con 0x7ff6480d1eb0 2024-04-16T16:16:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.312+0000 7ff645600640 1 -- 172.21.15.22:0/875024902 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff634030d00 con 0x7ff6480d1eb0 2024-04-16T16:16:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.312+0000 7ff645600640 1 -- 172.21.15.22:0/875024902 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634035040 con 0x7ff6480d1eb0 2024-04-16T16:16:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.312+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64815b4f0 con 0x7ff6480d1eb0 2024-04-16T16:16:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.312+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6481589c0 con 0x7ff6480d1eb0 2024-04-16T16:16:57.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.314+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6480b03a0 con 0x7ff6480d1eb0 2024-04-16T16:16:57.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.314+0000 7ff645600640 1 -- 172.21.15.22:0/875024902 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff634038020 con 0x7ff6480d1eb0 2024-04-16T16:16:57.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.315+0000 7ff645600640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff62806c8f0 0x7ff62806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.315+0000 7ff645600640 1 -- 172.21.15.22:0/875024902 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff6340ad980 con 0x7ff6480d1eb0 2024-04-16T16:16:57.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.316+0000 7ff64d400640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff62806c8f0 0x7ff62806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.316+0000 7ff64d400640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff62806c8f0 0x7ff62806edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff63c006fd0 tx=0x7ff63c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:57.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.320+0000 7ff645600640 1 -- 172.21.15.22:0/875024902 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff6480b03a0 con 0x7ff6480d1eb0 2024-04-16T16:16:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.515+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff648075f30 con 0x7ff6480d1eb0 2024-04-16T16:16:57.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.516+0000 7ff645600640 1 -- 172.21.15.22:0/875024902 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff63407be40 con 0x7ff6480d1eb0 2024-04-16T16:16:57.516 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.518+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff62806c8f0 msgr2=0x7ff62806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.518+0000 7ff64e800640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff62806c8f0 0x7ff62806edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff63c006fd0 tx=0x7ff63c008040 comp rx=0 tx=0).stop 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.518+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6480d1eb0 msgr2=0x7ff6480b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.518+0000 7ff64e800640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6480d1eb0 0x7ff6480b54d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff63402b950 tx=0x7ff6340046c0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 shutdown_connections 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff62806c8f0 0x7ff62806edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff64815c670 0x7ff6480b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6480d1eb0 0x7ff6480b54d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 --2- 172.21.15.22:0/875024902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff64806e0a0 0x7ff648151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 >> 172.21.15.22:0/875024902 conn(0x7ff64806be40 msgr2=0x7ff64815feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:57.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 shutdown_connections 2024-04-16T16:16:57.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.519+0000 7ff64e800640 1 -- 172.21.15.22:0/875024902 wait complete. 2024-04-16T16:16:57.536 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:16:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.760+0000 7f23fb200640 1 Processor -- start 2024-04-16T16:16:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.761+0000 7f23fb200640 1 -- start start 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.762+0000 7f23fb200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23fc15fe30 0x7f23fc070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.762+0000 7f23fb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.762+0000 7f23fb200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23fc0715c0 con 0x7f23fc0b4fa0 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.762+0000 7f23fb200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f23fc071360 con 0x7f23fc15fe30 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.762+0000 7f23fb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f23fc0718a0 con 0x7f23fc0b33a0 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.762+0000 7f23f3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23fc15fe30 0x7f23fc070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f9e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f23fc0b4fa0 0x7f23fc15f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35178/0 (socket says 172.21.15.22:35178) 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f9e00640 1 -- 172.21.15.22:0/831578912 learned_addr learned my addr 172.21.15.22:0/831578912 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23fa800640 1 --2- 172.21.15.22:0/831578912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f9400640 1 -- 172.21.15.22:0/831578912 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531175061 0 0) 0x7f23fc0715c0 con 0x7f23fc0b4fa0 2024-04-16T16:16:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f9400640 1 -- 172.21.15.22:0/831578912 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23e0003520 con 0x7f23fc0b4fa0 2024-04-16T16:16:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f3e00640 1 -- 172.21.15.22:0/831578912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 msgr2=0x7f23fc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f3e00640 1 --2- 172.21.15.22:0/831578912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f3e00640 1 -- 172.21.15.22:0/831578912 >> v1:172.21.15.22:6789/0 conn(0x7f23fc0b4fa0 legacy=0x7f23fc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.763+0000 7f23f3e00640 1 -- 172.21.15.22:0/831578912 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc071b80 con 0x7f23fc15fe30 2024-04-16T16:16:57.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.764+0000 7f23f3e00640 1 --2- 172.21.15.22:0/831578912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc070e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23e40097a0 tx=0x7f23e402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4226cedcfb45ed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:57.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23f9400640 1 -- 172.21.15.22:0/831578912 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4035020 con 0x7f23fc15fe30 2024-04-16T16:16:57.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23f9400640 1 -- 172.21.15.22:0/831578912 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e4031810 con 0x7f23fc15fe30 2024-04-16T16:16:57.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23f9400640 1 -- 172.21.15.22:0/831578912 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4031be0 con 0x7f23fc15fe30 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23fb200640 1 -- 172.21.15.22:0/831578912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 msgr2=0x7f23fc070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23fb200640 1 --2- 172.21.15.22:0/831578912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc070e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23e40097a0 tx=0x7f23e402b8b0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23fb200640 1 -- 172.21.15.22:0/831578912 shutdown_connections 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23fb200640 1 --2- 172.21.15.22:0/831578912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23fb200640 1 --2- 172.21.15.22:0/831578912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc070e20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.765+0000 7f23fb200640 1 -- 172.21.15.22:0/831578912 >> 172.21.15.22:0/831578912 conn(0x7f23fc075070 msgr2=0x7f23fc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.766+0000 7f23fb200640 1 -- 172.21.15.22:0/831578912 shutdown_connections 2024-04-16T16:16:57.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.766+0000 7f23fb200640 1 -- 172.21.15.22:0/831578912 wait complete. 2024-04-16T16:16:57.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.767+0000 7f23fb200640 1 Processor -- start 2024-04-16T16:16:57.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.767+0000 7f23fb200640 1 -- start start 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.768+0000 7f23fb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.768+0000 7f23fb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23fc0b4fa0 0x7f23fc06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.768+0000 7f23fb200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc1462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.768+0000 7f23fb200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc0b5380 con 0x7f23fc15fe30 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.768+0000 7f23fb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc0ce630 con 0x7f23fc0b4fa0 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.768+0000 7f23fb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f23fc0b5500 con 0x7f23fc0b33a0 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc1462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc1462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58578/0 (socket says 172.21.15.22:58578) 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 -- 172.21.15.22:0/951588514 learned_addr learned my addr 172.21.15.22:0/951588514 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:57.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23f9e00640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23f3e00640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23fc0b4fa0 0x7f23fc06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 -- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 msgr2=0x7f23fc147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 -- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23fc0b4fa0 msgr2=0x7f23fc06e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23fc0b4fa0 0x7f23fc06e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 -- 172.21.15.22:0/951588514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc06e8c0 con 0x7f23fc15fe30 2024-04-16T16:16:57.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.769+0000 7f23fa800640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc1462f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23f4007e90 tx=0x7f23f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:57.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.770+0000 7f23f2000640 1 -- 172.21.15.22:0/951588514 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4014420 con 0x7f23fc15fe30 2024-04-16T16:16:57.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.770+0000 7f23f2000640 1 -- 172.21.15.22:0/951588514 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f4019070 con 0x7f23fc15fe30 2024-04-16T16:16:57.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.770+0000 7f23f2000640 1 -- 172.21.15.22:0/951588514 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4014800 con 0x7f23fc15fe30 2024-04-16T16:16:57.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.770+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc147ac0 con 0x7f23fc15fe30 2024-04-16T16:16:57.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.770+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc152540 con 0x7f23fc15fe30 2024-04-16T16:16:57.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.771+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23fc075f30 con 0x7f23fc15fe30 2024-04-16T16:16:57.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.772+0000 7f23f2000640 1 -- 172.21.15.22:0/951588514 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23f40149a0 con 0x7f23fc15fe30 2024-04-16T16:16:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.774+0000 7f23f2000640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f23d806c8f0 0x7f23d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.774+0000 7f23f2000640 1 -- 172.21.15.22:0/951588514 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23f408c3b0 con 0x7f23fc15fe30 2024-04-16T16:16:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.774+0000 7f23f9e00640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f23d806c8f0 0x7f23d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.774+0000 7f23f9e00640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f23d806c8f0 0x7f23d806edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23ec005880 tx=0x7f23ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:57.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.779+0000 7f23f2000640 1 -- 172.21.15.22:0/951588514 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23f405a7d0 con 0x7f23fc15fe30 2024-04-16T16:16:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.981+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f23fc070e20 con 0x7f23fc15fe30 2024-04-16T16:16:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.982+0000 7f23f2000640 1 -- 172.21.15.22:0/951588514 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f23f405a0d0 con 0x7f23fc15fe30 2024-04-16T16:16:57.982 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f23d806c8f0 msgr2=0x7f23d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f23d806c8f0 0x7f23d806edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23ec005880 tx=0x7f23ec009040 comp rx=0 tx=0).stop 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 msgr2=0x7f23fc1462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc1462f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23f4007e90 tx=0x7f23f400e4b0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 shutdown_connections 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f23d806c8f0 0x7f23d806edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23fc15fe30 0x7f23fc1462f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23fc0b4fa0 0x7f23fc06e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 --2- 172.21.15.22:0/951588514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23fc0b33a0 0x7f23fc147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:57.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 >> 172.21.15.22:0/951588514 conn(0x7f23fc075070 msgr2=0x7f23fc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:57.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 shutdown_connections 2024-04-16T16:16:57.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:57.985+0000 7f23fb200640 1 -- 172.21.15.22:0/951588514 wait complete. 2024-04-16T16:16:58.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:16:58.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.228+0000 7f51e7c00640 1 Processor -- start 2024-04-16T16:16:58.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.228+0000 7f51e7c00640 1 -- start start 2024-04-16T16:16:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.229+0000 7f51e7c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51e015b7e0 0x7f51e015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.229+0000 7f51e7c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e00af6b0 0x7f51e006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.229+0000 7f51e7c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e00b47f0 con 0x7f51e00afb10 2024-04-16T16:16:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.229+0000 7f51e7c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f51e00b45c0 con 0x7f51e015b7e0 2024-04-16T16:16:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.229+0000 7f51e7c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f51e00b4ad0 con 0x7f51e00af6b0 2024-04-16T16:16:58.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.230+0000 7f51e5200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51e015b7e0 0x7f51e015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.230+0000 7f51dfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e00af6b0 0x7f51e006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.230+0000 7f51e5200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51e015b7e0 0x7f51e015cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:58888/0 (socket says 172.21.15.22:58888) 2024-04-16T16:16:58.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.230+0000 7f51e5200640 1 -- 172.21.15.22:0/3709580048 learned_addr learned my addr 172.21.15.22:0/3709580048 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:58.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.231+0000 7f51e5200640 1 -- 172.21.15.22:0/3709580048 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e00af6b0 msgr2=0x7f51e006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:58.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.231+0000 7f51e5200640 1 --2- 172.21.15.22:0/3709580048 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e00af6b0 0x7f51e006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.231+0000 7f51e5200640 1 -- 172.21.15.22:0/3709580048 >> v1:172.21.15.43:6789/0 conn(0x7f51e00afb10 legacy=0x7f51e015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.231+0000 7f51e5200640 1 -- 172.21.15.22:0/3709580048 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e00b4db0 con 0x7f51e015b7e0 2024-04-16T16:16:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.232+0000 7f51e5200640 1 --2- 172.21.15.22:0/3709580048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e015b7e0 0x7f51e015cb70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d150 tx=0x7f51d002e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c55ccbcb091f249d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.233+0000 7f51df400640 1 -- 172.21.15.22:0/3709580048 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d002ea80 con 0x7f51e015b7e0 2024-04-16T16:16:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.233+0000 7f51df400640 1 -- 172.21.15.22:0/3709580048 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d002ec20 con 0x7f51e015b7e0 2024-04-16T16:16:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.233+0000 7f51df400640 1 -- 172.21.15.22:0/3709580048 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0009600 con 0x7f51e015b7e0 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 -- 172.21.15.22:0/3709580048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e015b7e0 msgr2=0x7f51e015cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 --2- 172.21.15.22:0/3709580048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e015b7e0 0x7f51e015cb70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d150 tx=0x7f51d002e0e0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 -- 172.21.15.22:0/3709580048 shutdown_connections 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 --2- 172.21.15.22:0/3709580048 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e00af6b0 0x7f51e006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 --2- 172.21.15.22:0/3709580048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e015b7e0 0x7f51e015cb70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 -- 172.21.15.22:0/3709580048 >> 172.21.15.22:0/3709580048 conn(0x7f51e0062440 msgr2=0x7f51e0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 -- 172.21.15.22:0/3709580048 shutdown_connections 2024-04-16T16:16:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.234+0000 7f51e7c00640 1 -- 172.21.15.22:0/3709580048 wait complete. 2024-04-16T16:16:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.236+0000 7f51e7c00640 1 Processor -- start 2024-04-16T16:16:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.236+0000 7f51e7c00640 1 -- start start 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e7c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e00af6b0 0x7f51e0140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e7c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e00afb10 0x7f51e013fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e7c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e015b7e0 0x7f51e0157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e7c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f51e015bd40 con 0x7f51e00af6b0 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e7c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51e015bbc0 con 0x7f51e00afb10 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e7c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f51e0072710 con 0x7f51e015b7e0 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e00af6b0 0x7f51e0140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e00af6b0 0x7f51e0140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58582/0 (socket says 172.21.15.22:58582) 2024-04-16T16:16:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.237+0000 7f51e5200640 1 -- 172.21.15.22:0/2731217991 learned_addr learned my addr 172.21.15.22:0/2731217991 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:58.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51dfe00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e00afb10 0x7f51e013fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e015b7e0 0x7f51e0157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5200640 1 -- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e015b7e0 msgr2=0x7f51e0157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5200640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e015b7e0 0x7f51e0157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5200640 1 -- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e00afb10 msgr2=0x7f51e013fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5200640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e00afb10 0x7f51e013fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5200640 1 -- 172.21.15.22:0/2731217991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e015a930 con 0x7f51e00af6b0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e015b7e0 0x7f51e0157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e5200640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e00af6b0 0x7f51e0140220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f51d0038040 tx=0x7f51d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51dcc00640 1 -- 172.21.15.22:0/2731217991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d002ea80 con 0x7f51e00af6b0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51dcc00640 1 -- 172.21.15.22:0/2731217991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d0045070 con 0x7f51e00af6b0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51dcc00640 1 -- 172.21.15.22:0/2731217991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0036a60 con 0x7f51e00af6b0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.238+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e00b1710 con 0x7f51e00af6b0 2024-04-16T16:16:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.239+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e0158040 con 0x7f51e00af6b0 2024-04-16T16:16:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.240+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e00b1500 con 0x7f51e00af6b0 2024-04-16T16:16:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.241+0000 7f51dcc00640 1 -- 172.21.15.22:0/2731217991 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51d0036c00 con 0x7f51e00af6b0 2024-04-16T16:16:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.242+0000 7f51dcc00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f51c006c8f0 0x7f51c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.242+0000 7f51dcc00640 1 -- 172.21.15.22:0/2731217991 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f51d00ae8a0 con 0x7f51e00af6b0 2024-04-16T16:16:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.242+0000 7f51dfe00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f51c006c8f0 0x7f51c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.243+0000 7f51dfe00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f51c006c8f0 0x7f51c006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51e0153440 tx=0x7f51cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.246+0000 7f51dcc00640 1 -- 172.21.15.22:0/2731217991 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51d007cce0 con 0x7f51e00af6b0 2024-04-16T16:16:58.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.493+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51e004fd90 con 0x7f51e00af6b0 2024-04-16T16:16:58.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.494+0000 7f51dcc00640 1 -- 172.21.15.22:0/2731217991 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f51d007c5e0 con 0x7f51e00af6b0 2024-04-16T16:16:58.494 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:58.494 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:16:58.494 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f51c006c8f0 msgr2=0x7f51c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f51c006c8f0 0x7f51c006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51e0153440 tx=0x7f51cc008040 comp rx=0 tx=0).stop 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e00af6b0 msgr2=0x7f51e0140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e00af6b0 0x7f51e0140220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f51d0038040 tx=0x7f51d0004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 shutdown_connections 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f51c006c8f0 0x7f51c006edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51e015b7e0 0x7f51e0157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e00afb10 0x7f51e013fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 --2- 172.21.15.22:0/2731217991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e00af6b0 0x7f51e0140220 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 >> 172.21.15.22:0/2731217991 conn(0x7f51e0062440 msgr2=0x7f51e0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:58.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 shutdown_connections 2024-04-16T16:16:58.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.497+0000 7f51e7c00640 1 -- 172.21.15.22:0/2731217991 wait complete. 2024-04-16T16:16:58.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:16:58.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.722+0000 7fa3f5200640 1 Processor -- start 2024-04-16T16:16:58.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.723+0000 7fa3f5200640 1 -- start start 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3f5200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3f015ea50 0x7fa3f00ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3f5200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3f00cf630 0x7fa3f00cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3f5200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f00d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3f5200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa3f00cffe0 con 0x7fa3f00cf630 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3f5200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa3f00b9c90 con 0x7fa3f015ea50 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3f5200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f00b9080 con 0x7fa3f00d2dc0 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3eea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3f00cf630 0x7fa3f00cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3eea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3f00cf630 0x7fa3f00cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58596/0 (socket says 172.21.15.22:58596) 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3eea00640 1 -- 172.21.15.22:0/1980360590 learned_addr learned my addr 172.21.15.22:0/1980360590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.724+0000 7fa3ef400640 1 --2- 172.21.15.22:0/1980360590 >> v2:172.21.15.43:3300/0 conn(0x7fa3f015ea50 0x7fa3f00ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.725+0000 7fa3efe00640 1 --2- 172.21.15.22:0/1980360590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f00d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.725+0000 7fa3eea00640 1 -- 172.21.15.22:0/1980360590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 msgr2=0x7fa3f00d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.725+0000 7fa3eea00640 1 --2- 172.21.15.22:0/1980360590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f00d3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.725+0000 7fa3eea00640 1 -- 172.21.15.22:0/1980360590 >> v2:172.21.15.43:3300/0 conn(0x7fa3f015ea50 msgr2=0x7fa3f00ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.725+0000 7fa3eea00640 1 --2- 172.21.15.22:0/1980360590 >> v2:172.21.15.43:3300/0 conn(0x7fa3f015ea50 0x7fa3f00ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.725+0000 7fa3eea00640 1 -- 172.21.15.22:0/1980360590 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f00b9360 con 0x7fa3f00cf630 2024-04-16T16:16:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.726+0000 7fa3eea00640 1 --2- 172.21.15.22:0/1980360590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f00cf630 0x7fa3f00cfaa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00d1340 tx=0x7fa3dc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2e338667bc9044 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.726+0000 7fa3ee000640 1 -- 172.21.15.22:0/1980360590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc038070 con 0x7fa3f00cf630 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.726+0000 7fa3ee000640 1 -- 172.21.15.22:0/1980360590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc031740 con 0x7fa3f00cf630 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.726+0000 7fa3ee000640 1 -- 172.21.15.22:0/1980360590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc02f050 con 0x7fa3f00cf630 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 -- 172.21.15.22:0/1980360590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f00cf630 msgr2=0x7fa3f00cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 --2- 172.21.15.22:0/1980360590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f00cf630 0x7fa3f00cfaa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00d1340 tx=0x7fa3dc02b7e0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 -- 172.21.15.22:0/1980360590 shutdown_connections 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 --2- 172.21.15.22:0/1980360590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f00d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 --2- 172.21.15.22:0/1980360590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f00cf630 0x7fa3f00cfaa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 --2- 172.21.15.22:0/1980360590 >> v2:172.21.15.43:3300/0 conn(0x7fa3f015ea50 0x7fa3f00ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 -- 172.21.15.22:0/1980360590 >> 172.21.15.22:0/1980360590 conn(0x7fa3f0072430 msgr2=0x7fa3f0072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 -- 172.21.15.22:0/1980360590 shutdown_connections 2024-04-16T16:16:58.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.727+0000 7fa3f5200640 1 -- 172.21.15.22:0/1980360590 wait complete. 2024-04-16T16:16:58.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.729+0000 7fa3f5200640 1 Processor -- start 2024-04-16T16:16:58.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.729+0000 7fa3f5200640 1 -- start start 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3f5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3f00cf630 0x7fa3f0159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3f5200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f0161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3f5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f015ea50 0x7fa3f0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3f5200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f015ee30 con 0x7fa3f015ea50 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3f5200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f00b9920 con 0x7fa3f00cf630 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3f5200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f00ba7c0 con 0x7fa3f00d2dc0 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3efe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f015ea50 0x7fa3f0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3efe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f015ea50 0x7fa3f0152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58606/0 (socket says 172.21.15.22:58606) 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3efe00640 1 -- 172.21.15.22:0/243187224 learned_addr learned my addr 172.21.15.22:0/243187224 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3eea00640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f0161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3ef400640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3f00cf630 0x7fa3f0159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.730+0000 7fa3efe00640 1 -- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 msgr2=0x7fa3f0161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3efe00640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f0161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3efe00640 1 -- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3f00cf630 msgr2=0x7fa3f0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3efe00640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3f00cf630 0x7fa3f0159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3efe00640 1 -- 172.21.15.22:0/243187224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f0158f90 con 0x7fa3f015ea50 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3efe00640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f015ea50 0x7fa3f0152720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800cd70 tx=0x7fa3e800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3e7400640 1 -- 172.21.15.22:0/243187224 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8003b90 con 0x7fa3f015ea50 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3e7400640 1 -- 172.21.15.22:0/243187224 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e8003d30 con 0x7fa3f015ea50 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3e7400640 1 -- 172.21.15.22:0/243187224 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8004240 con 0x7fa3f015ea50 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f01586f0 con 0x7fa3f015ea50 2024-04-16T16:16:58.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.731+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f0158cb0 con 0x7fa3f015ea50 2024-04-16T16:16:58.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.732+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f0075f30 con 0x7fa3f015ea50 2024-04-16T16:16:58.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.733+0000 7fa3e7400640 1 -- 172.21.15.22:0/243187224 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3e80043e0 con 0x7fa3f015ea50 2024-04-16T16:16:58.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.734+0000 7fa3e7400640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa3d006c8f0 0x7fa3d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:58.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.734+0000 7fa3e7400640 1 -- 172.21.15.22:0/243187224 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa3e808c640 con 0x7fa3f015ea50 2024-04-16T16:16:58.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.735+0000 7fa3ef400640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa3d006c8f0 0x7fa3d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:58.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.735+0000 7fa3ef400640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa3d006c8f0 0x7fa3d006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0006fd0 tx=0x7fa3e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:58.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.739+0000 7fa3e7400640 1 -- 172.21.15.22:0/243187224 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3e805aa60 con 0x7fa3f015ea50 2024-04-16T16:16:58.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.949+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3f015bca0 con 0x7fa3f015ea50 2024-04-16T16:16:58.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.951+0000 7fa3e7400640 1 -- 172.21.15.22:0/243187224 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7fa3e805a360 con 0x7fa3f015ea50 2024-04-16T16:16:58.951 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:58.951 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.953+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa3d006c8f0 msgr2=0x7fa3d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.953+0000 7fa3f5200640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa3d006c8f0 0x7fa3d006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0006fd0 tx=0x7fa3e0008040 comp rx=0 tx=0).stop 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.953+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f015ea50 msgr2=0x7fa3f0152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.953+0000 7fa3f5200640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f015ea50 0x7fa3f0152720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800cd70 tx=0x7fa3e800a660 comp rx=0 tx=0).stop 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 shutdown_connections 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa3d006c8f0 0x7fa3d006edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f015ea50 0x7fa3f0152720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3f00d2dc0 0x7fa3f0161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 --2- 172.21.15.22:0/243187224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3f00cf630 0x7fa3f0159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 >> 172.21.15.22:0/243187224 conn(0x7fa3f0072430 msgr2=0x7fa3f00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 shutdown_connections 2024-04-16T16:16:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:58.954+0000 7fa3f5200640 1 -- 172.21.15.22:0/243187224 wait complete. 2024-04-16T16:16:58.973 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:16:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.192+0000 7fd7a7200640 1 Processor -- start 2024-04-16T16:16:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.192+0000 7fd7a7200640 1 -- start start 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.193+0000 7fd7a7200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd7a815e920 0x7fd7a80b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.193+0000 7fd7a7200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7a80b4600 0x7fd7a806de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a8062440 0x7fd7a8062870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a7200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a80b09c0 con 0x7fd7a80b4600 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a7200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a806e360 con 0x7fd7a815e920 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a8062db0 con 0x7fd7a8062440 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a5400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7a80b4600 0x7fd7a806de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a5400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7a80b4600 0x7fd7a806de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58614/0 (socket says 172.21.15.22:58614) 2024-04-16T16:16:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a5400640 1 -- 172.21.15.22:0/3344794613 learned_addr learned my addr 172.21.15.22:0/3344794613 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/3344794613 >> v2:172.21.15.43:3300/0 conn(0x7fd7a815e920 0x7fd7a80b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a5400640 1 -- 172.21.15.22:0/3344794613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a8062440 msgr2=0x7fd7a8062870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.194+0000 7fd7a6800640 1 --2- 172.21.15.22:0/3344794613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a8062440 0x7fd7a8062870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.195+0000 7fd7a5400640 1 --2- 172.21.15.22:0/3344794613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a8062440 0x7fd7a8062870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.195+0000 7fd7a5400640 1 -- 172.21.15.22:0/3344794613 >> v2:172.21.15.43:3300/0 conn(0x7fd7a815e920 msgr2=0x7fd7a80b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.195+0000 7fd7a5400640 1 --2- 172.21.15.22:0/3344794613 >> v2:172.21.15.43:3300/0 conn(0x7fd7a815e920 0x7fd7a80b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.195+0000 7fd7a5400640 1 -- 172.21.15.22:0/3344794613 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a80d1370 con 0x7fd7a80b4600 2024-04-16T16:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.195+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/3344794613 >> v2:172.21.15.43:3300/0 conn(0x7fd7a815e920 0x7fd7a80b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.195+0000 7fd7a6800640 1 --2- 172.21.15.22:0/3344794613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a8062440 0x7fd7a8062870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.196+0000 7fd7a5400640 1 --2- 172.21.15.22:0/3344794613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a806de20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8063190 tx=0x7fd79002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bc250e775e7df server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.196+0000 7fd7a4a00640 1 -- 172.21.15.22:0/3344794613 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79002ca70 con 0x7fd7a80b4600 2024-04-16T16:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.196+0000 7fd7a4a00640 1 -- 172.21.15.22:0/3344794613 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79002cc10 con 0x7fd7a80b4600 2024-04-16T16:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.196+0000 7fd7a4a00640 1 -- 172.21.15.22:0/3344794613 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7900343f0 con 0x7fd7a80b4600 2024-04-16T16:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 -- 172.21.15.22:0/3344794613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 msgr2=0x7fd7a806de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 --2- 172.21.15.22:0/3344794613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a806de20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8063190 tx=0x7fd79002bed0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 -- 172.21.15.22:0/3344794613 shutdown_connections 2024-04-16T16:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 --2- 172.21.15.22:0/3344794613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a8062440 0x7fd7a8062870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 --2- 172.21.15.22:0/3344794613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a806de20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 --2- 172.21.15.22:0/3344794613 >> v2:172.21.15.43:3300/0 conn(0x7fd7a815e920 0x7fd7a80b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 -- 172.21.15.22:0/3344794613 >> 172.21.15.22:0/3344794613 conn(0x7fd7a806ba20 msgr2=0x7fd7a806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 -- 172.21.15.22:0/3344794613 shutdown_connections 2024-04-16T16:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.197+0000 7fd7a7200640 1 -- 172.21.15.22:0/3344794613 wait complete. 2024-04-16T16:16:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.199+0000 7fd7a7200640 1 Processor -- start 2024-04-16T16:16:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.199+0000 7fd7a7200640 1 -- start start 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8062440 0x7fd7a81512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a815e920 0x7fd7a815d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a7200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a80b0e00 con 0x7fd7a80b4600 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a806fb50 con 0x7fd7a8062440 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a806fe30 con 0x7fd7a815e920 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a814fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58628/0 (socket says 172.21.15.22:58628) 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a5400640 1 -- 172.21.15.22:0/4172215458 learned_addr learned my addr 172.21.15.22:0/4172215458 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a6800640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a815e920 0x7fd7a815d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a5400640 1 -- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a815e920 msgr2=0x7fd7a815d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a5400640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a815e920 0x7fd7a815d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.200+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8062440 0x7fd7a81512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd7a5400640 1 -- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8062440 msgr2=0x7fd7a81512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd7a5400640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8062440 0x7fd7a81512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd7a5400640 1 -- 172.21.15.22:0/4172215458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a8150500 con 0x7fd7a80b4600 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8062440 0x7fd7a81512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd7a5400640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a814fd60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd790000f80 tx=0x7fd790004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd79e000640 1 -- 172.21.15.22:0/4172215458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790043020 con 0x7fd7a80b4600 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd79e000640 1 -- 172.21.15.22:0/4172215458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79003e450 con 0x7fd7a80b4600 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd79e000640 1 -- 172.21.15.22:0/4172215458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79003e820 con 0x7fd7a80b4600 2024-04-16T16:16:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a81507e0 con 0x7fd7a80b4600 2024-04-16T16:16:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.201+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a8150da0 con 0x7fd7a80b4600 2024-04-16T16:16:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.203+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a8075f30 con 0x7fd7a80b4600 2024-04-16T16:16:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.203+0000 7fd79e000640 1 -- 172.21.15.22:0/4172215458 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd790005d10 con 0x7fd7a80b4600 2024-04-16T16:16:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.204+0000 7fd79e000640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406c8f0 0x7fd78406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:16:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.205+0000 7fd79e000640 1 -- 172.21.15.22:0/4172215458 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7900ae790 con 0x7fd7a80b4600 2024-04-16T16:16:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.205+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406c8f0 0x7fd78406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:16:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.206+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406c8f0 0x7fd78406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd798008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:16:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.209+0000 7fd79e000640 1 -- 172.21.15.22:0/4172215458 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd79007cbb0 con 0x7fd7a80b4600 2024-04-16T16:16:59.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.452+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7a80b6b00 con 0x7fd7a80b4600 2024-04-16T16:16:59.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.454+0000 7fd79e000640 1 -- 172.21.15.22:0/4172215458 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fd79007c4b0 con 0x7fd7a80b4600 2024-04-16T16:16:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:16:59.454 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:16:59.454 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:16:59.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406c8f0 msgr2=0x7fd78406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:59.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406c8f0 0x7fd78406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd798008040 comp rx=0 tx=0).stop 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 msgr2=0x7fd7a814fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a814fd60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd790000f80 tx=0x7fd790004a40 comp rx=0 tx=0).stop 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 shutdown_connections 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406c8f0 0x7fd78406edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a815e920 0x7fd7a815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a80b4600 0x7fd7a814fd60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 --2- 172.21.15.22:0/4172215458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8062440 0x7fd7a81512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.456+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 >> 172.21.15.22:0/4172215458 conn(0x7fd7a806ba20 msgr2=0x7fd7a80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.457+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 shutdown_connections 2024-04-16T16:16:59.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:16:59.457+0000 7fd7a7200640 1 -- 172.21.15.22:0/4172215458 wait complete. 2024-04-16T16:16:59.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T16:16:41.978381+0000', 'modified': '2024-04-16T16:16:45.073330+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6833/3889023021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6832', 'nonce': 3889023021}, {'type': 'v1', 'addr': '172.21.15.43:6833', 'nonce': 3889023021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4266, 'qdb_cluster': [4266]} 2024-04-16T16:16:59.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T16:16:59.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-16T16:17:00.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.108+0000 7f01a7200640 1 Processor -- start 2024-04-16T16:17:00.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.108+0000 7f01a7200640 1 -- start start 2024-04-16T16:17:00.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 0x7f01a80d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a7200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f01a815cd90 0x7f01a80d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a7200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a815d300 con 0x7f01a8160380 2024-04-16T16:17:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a7200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f01a815d5e0 con 0x7f01a815cd90 2024-04-16T16:17:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f01a815d8c0 con 0x7f01a815a240 2024-04-16T16:17:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a6800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f01a8160380 0x7f01a8070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47860/0 (socket says 172.21.15.22:47860) 2024-04-16T16:17:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a6800640 1 -- 172.21.15.22:0/905264507 learned_addr learned my addr 172.21.15.22:0/905264507 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:00.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a5e00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 0x7f01a80d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.110+0000 7f01a5400640 1 --2- 172.21.15.22:0/905264507 >> v2:172.21.15.43:3300/0 conn(0x7f01a815cd90 0x7f01a80d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710921537 0 0) 0x7f01a815d300 con 0x7f01a8160380 2024-04-16T16:17:00.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f018c003520 con 0x7f01a8160380 2024-04-16T16:17:00.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2947677583 0 0) 0x7f018c003520 con 0x7f01a8160380 2024-04-16T16:17:00.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 msgr2=0x7f01a80d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 0x7f01a80d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 >> v2:172.21.15.43:3300/0 conn(0x7f01a815cd90 msgr2=0x7f01a80d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 --2- 172.21.15.22:0/905264507 >> v2:172.21.15.43:3300/0 conn(0x7f01a815cd90 0x7f01a80d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a815dba0 con 0x7f01a8160380 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f01a00019f0 con 0x7f01a8160380 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 >> v1:172.21.15.22:6789/0 conn(0x7f01a8160380 legacy=0x7f01a8070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c003a20 0x7f018c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c004800 0x7f018c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 0x7f018c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01a815d5e0 con 0x7f018c003a20 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01a815d8c0 con 0x7f018c004800 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f018c00fdd0 con 0x7f01a815a240 2024-04-16T16:17:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.111+0000 7f01a5e00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c003a20 0x7f018c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.112+0000 7f01a6800640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 0x7f018c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.112+0000 7f01a5e00640 1 -- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 msgr2=0x7f018c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.112+0000 7f01a5e00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 0x7f018c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.112+0000 7f01a5e00640 1 -- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c004800 msgr2=0x7f018c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.112+0000 7f01a5e00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c004800 0x7f018c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.112+0000 7f01a5e00640 1 -- 172.21.15.22:0/905264507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c003520 con 0x7f018c003a20 2024-04-16T16:17:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.112+0000 7f01a6800640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a815a240 0x7f018c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.113+0000 7f01a5e00640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c003a20 0x7f018c003e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0198009af0 tx=0x7f018c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819f856c196525b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.113+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198039070 con 0x7f018c003a20 2024-04-16T16:17:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.113+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019802c6b0 con 0x7f018c003a20 2024-04-16T16:17:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.113+0000 7f01a4a00640 1 -- 172.21.15.22:0/905264507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198009690 con 0x7f018c003a20 2024-04-16T16:17:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.114+0000 7f01a7200640 1 -- 172.21.15.22:0/905264507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c003a20 msgr2=0x7f018c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.114+0000 7f01a7200640 1 --2- 172.21.15.22:0/905264507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c003a20 0x7f018c003e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0198009af0 tx=0x7f018c005830 comp rx=0 tx=0).stop 2024-04-16T16:17:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.114+0000 7f01a6800640 1 -- 172.21.15.22:0/905264507 reap_dead start 2024-04-16T16:17:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.114+0000 7f01a7200640 1 -- 172.21.15.22:0/905264507 shutdown_connections 2024-04-16T16:17:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.114+0000 7f01a7200640 1 -- 172.21.15.22:0/905264507 >> 172.21.15.22:0/905264507 conn(0x7f01a8075070 msgr2=0x7f01a8062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.114+0000 7f01a7200640 1 -- 172.21.15.22:0/905264507 shutdown_connections 2024-04-16T16:17:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.114+0000 7f01a7200640 1 -- 172.21.15.22:0/905264507 wait complete. 2024-04-16T16:17:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.116+0000 7f01a7200640 1 Processor -- start 2024-04-16T16:17:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.116+0000 7f01a7200640 1 -- start start 2024-04-16T16:17:00.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.117+0000 7f01a7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c003a20 0x7f01a80b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.117+0000 7f01a7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01a80b0010 0x7f01a8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.117+0000 7f01a7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a8145a40 0x7f01a8145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.117+0000 7f01a7200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8073120 con 0x7f01a80b0010 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.117+0000 7f01a7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8072fa0 con 0x7f018c003a20 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.117+0000 7f01a7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f01a815a620 con 0x7f01a8145a40 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01a80b0010 0x7f01a8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01a80b0010 0x7f01a8152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44016/0 (socket says 172.21.15.22:44016) 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 -- 172.21.15.22:0/4235379505 learned_addr learned my addr 172.21.15.22:0/4235379505 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c003a20 0x7f01a80b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 -- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a8145a40 msgr2=0x7f01a8145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a6800640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a8145a40 0x7f01a8145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a8145a40 0x7f01a8145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 -- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c003a20 msgr2=0x7f01a80b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c003a20 0x7f01a80b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 -- 172.21.15.22:0/4235379505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a80b0580 con 0x7f01a80b0010 2024-04-16T16:17:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c003a20 0x7f01a80b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f01a5400640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01a80b0010 0x7f01a8152b40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f019400e8c0 tx=0x7f019400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.118+0000 7f019e000640 1 -- 172.21.15.22:0/4235379505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194017070 con 0x7f01a80b0010 2024-04-16T16:17:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.119+0000 7f019e000640 1 -- 172.21.15.22:0/4235379505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019400c940 con 0x7f01a80b0010 2024-04-16T16:17:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.119+0000 7f019e000640 1 -- 172.21.15.22:0/4235379505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019400cd10 con 0x7f01a80b0010 2024-04-16T16:17:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.119+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a80b0860 con 0x7f01a80b0010 2024-04-16T16:17:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.119+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a80b0e20 con 0x7f01a80b0010 2024-04-16T16:17:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.121+0000 7f019e000640 1 -- 172.21.15.22:0/4235379505 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f019401a070 con 0x7f01a80b0010 2024-04-16T16:17:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.122+0000 7f019e000640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f018806c970 0x7f018806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.122+0000 7f019e000640 1 -- 172.21.15.22:0/4235379505 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f019408bca0 con 0x7f01a80b0010 2024-04-16T16:17:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.122+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f018806c970 0x7f018806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.122+0000 7f01aff82740 1 Processor -- start 2024-04-16T16:17:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.123+0000 7f01aff82740 1 -- start start 2024-04-16T16:17:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.123+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f018806c970 0x7f018806ee30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0198036000 tx=0x7f0198030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.123+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9d890 0x55a429bbc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 0x55a429b76570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01aff82740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b76ab0 0x55a429b74440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01aff82740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a429adb9c0 con 0x55a429b76ab0 2024-04-16T16:17:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a429a82560 con 0x55a429b9d890 2024-04-16T16:17:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a429ad7980 con 0x55a429b9dc70 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b76ab0 0x55a429b74440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b76ab0 0x55a429b74440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44030/0 (socket says 172.21.15.22:44030) 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 -- 172.21.15.22:0/4165458797 learned_addr learned my addr 172.21.15.22:0/4165458797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 -- 172.21.15.22:0/4165458797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 msgr2=0x55a429b76570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 0x55a429b76570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9d890 0x55a429bbc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 -- 172.21.15.22:0/4165458797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9d890 msgr2=0x55a429bbc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9d890 0x55a429bbc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.124+0000 7f01a6800640 1 -- 172.21.15.22:0/4165458797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4297ee2d0 con 0x55a429b76ab0 2024-04-16T16:17:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.125+0000 7f01a6800640 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b76ab0 0x55a429b74440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01a806f1f0 tx=0x7f01a815dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f278a9c7d5df169 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.125+0000 7f0192a00640 1 -- 172.21.15.22:0/4165458797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0018070 con 0x55a429b76ab0 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.125+0000 7f0192a00640 1 -- 172.21.15.22:0/4165458797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a0004d60 con 0x55a429b76ab0 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.125+0000 7f0192a00640 1 -- 172.21.15.22:0/4165458797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0007290 con 0x55a429b76ab0 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.125+0000 7f01aff82740 1 -- 172.21.15.22:0/4165458797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b76ab0 msgr2=0x55a429b74440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.125+0000 7f01aff82740 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b76ab0 0x55a429b74440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01a806f1f0 tx=0x7f01a815dd70 comp rx=0 tx=0).stop 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 -- 172.21.15.22:0/4165458797 shutdown_connections 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b76ab0 0x55a429b74440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 0x55a429b76570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 --2- 172.21.15.22:0/4165458797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9d890 0x55a429bbc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 -- 172.21.15.22:0/4165458797 >> 172.21.15.22:0/4165458797 conn(0x55a429b72b50 msgr2=0x55a429bbb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 -- 172.21.15.22:0/4165458797 shutdown_connections 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 -- 172.21.15.22:0/4165458797 wait complete. 2024-04-16T16:17:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.126+0000 7f01aff82740 1 -- start start 2024-04-16T16:17:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.127+0000 7f01aff82740 1 Processor -- start 2024-04-16T16:17:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01aff82740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 0x55a429bbdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 0x55a429bcec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01aff82740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a429b70980 con 0x55a429b9d890 2024-04-16T16:17:00.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a429a95920 con 0x55a429bbe520 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a429b76f30 con 0x55a429b9dc70 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01aff82740 10 client.0 _ll_register_callbacks cb 0x55a429a95310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44032/0 (socket says 172.21.15.22:44032) 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 -- 172.21.15.22:0/3089586764 learned_addr learned my addr 172.21.15.22:0/3089586764 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 -- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 msgr2=0x55a429bbdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 0x55a429bbdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 -- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 msgr2=0x55a429bcec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 0x55a429bcec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.128+0000 7f01a5e00640 1 -- 172.21.15.22:0/3089586764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4298b86b0 con 0x55a429b9d890 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f01a5e00640 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbdaa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f01980098e0 tx=0x7f01980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b3ef48d176f0eb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f0187400640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-04-16T16:17:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f0187400640 1 -- 172.21.15.22:0/3089586764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198050060 con 0x55a429b9d890 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f0187400640 1 -- 172.21.15.22:0/3089586764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0198003a20 con 0x55a429b9d890 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01a0004d60 con 0x55a429b9d890 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f0187400640 1 -- 172.21.15.22:0/3089586764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0198039040 con 0x55a429b9d890 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f01aff82740 10 client.4659 fetch_fsmap learned FSMap version 8 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a429bb77d0 con 0x55a429b9d890 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.129+0000 7f0187400640 1 -- 172.21.15.22:0/3089586764 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a0004d60 con 0x55a429b9d890 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f0187400640 1 -- 172.21.15.22:0/3089586764 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f0198003c20 con 0x55a429b9d890 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f01aff82740 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f01aff82740 10 client.4659 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f01aff82740 20 client.4659 populate_metadata read hostname 'smithi022' 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f01aff82740 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429bb9670 0x55a429bda110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f01aff82740 4 client.4659 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 --> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a429a81b70 con 0x55a429bb9670 2024-04-16T16:17:00.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.130+0000 7f01a5400640 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429bb9670 0x55a429bda110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.131+0000 7f01a5400640 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429bb9670 0x55a429bda110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d02ba82085e950 server_cookie=7387f8e8f9aeed1a in_seq=0 out_seq=0 2024-04-16T16:17:00.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.131+0000 7f0187400640 10 client.4659 ms_handle_connect on v2:172.21.15.43:6832/3889023021 2024-04-16T16:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f0187400640 1 -- 172.21.15.22:0/3089586764 <== mds.0 v2:172.21.15.43:6832/3889023021 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a429a81b70 con 0x55a429bb9670 2024-04-16T16:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f0187400640 10 client.4659 handle_command_reply: tid=0 2024-04-16T16:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 client.4659 shutdown 2024-04-16T16:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 msgr2=0x55a429bbdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbdaa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f01980098e0 tx=0x7f01980046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 shutdown_connections 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429bb9670 0x55a429bda110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 0x55a429bcec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9dc70 0x55a429bbdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f0187400640 0 client.4659 ms_handle_reset on v2:172.21.15.43:6832/3889023021 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 --2- 172.21.15.22:0/3089586764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbdaa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 >> 172.21.15.22:0/3089586764 conn(0x55a429b76ab0 msgr2=0x55a429b6f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 shutdown_connections 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.134+0000 7f01aff82740 1 -- 172.21.15.22:0/3089586764 wait complete. 2024-04-16T16:17:00.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.135+0000 7f01aff82740 20 client.4659 trim_cache size 0 max 16384 2024-04-16T16:17:00.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.154+0000 7f01aff82740 1 Processor -- start 2024-04-16T16:17:00.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.154+0000 7f01aff82740 1 -- start start 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.155+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9d890 0x55a429ba4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.155+0000 7f01aff82740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9dc70 0x55a429b6f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.155+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 0x55a429bbb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.155+0000 7f01aff82740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81fc2f0 con 0x55a429b9dc70 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.155+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8157cd0 con 0x55a429bbe520 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.155+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f01a81fbda0 con 0x55a429b9d890 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.155+0000 7f01a5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9dc70 0x55a429b6f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9dc70 0x55a429b6f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44048/0 (socket says 172.21.15.22:44048) 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 -- 172.21.15.22:0/1446998669 learned_addr learned my addr 172.21.15.22:0/1446998669 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5e00640 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9d890 0x55a429ba4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 -- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9d890 msgr2=0x55a429ba4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a6800640 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 0x55a429bbb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9d890 0x55a429ba4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 -- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 msgr2=0x55a429bbb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 0x55a429bbb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 -- 172.21.15.22:0/1446998669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a429b72790 con 0x55a429b9dc70 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5e00640 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9d890 0x55a429ba4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f01a5400640 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9dc70 0x55a429b6f980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0194009730 tx=0x7f01940594b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b3c1911806e3a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f0192000640 1 -- 172.21.15.22:0/1446998669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194021040 con 0x55a429b9dc70 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f0192000640 1 -- 172.21.15.22:0/1446998669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0194062620 con 0x55a429b9dc70 2024-04-16T16:17:00.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.156+0000 7f0192000640 1 -- 172.21.15.22:0/1446998669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194057d40 con 0x55a429b9dc70 2024-04-16T16:17:00.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 -- 172.21.15.22:0/1446998669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9dc70 msgr2=0x55a429b6f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9dc70 0x55a429b6f980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0194009730 tx=0x7f01940594b0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 -- 172.21.15.22:0/1446998669 shutdown_connections 2024-04-16T16:17:00.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429bbe520 0x55a429bbb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9dc70 0x55a429b6f980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 --2- 172.21.15.22:0/1446998669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429b9d890 0x55a429ba4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 -- 172.21.15.22:0/1446998669 >> 172.21.15.22:0/1446998669 conn(0x55a429b76ab0 msgr2=0x55a429bb5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 -- 172.21.15.22:0/1446998669 shutdown_connections 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.157+0000 7f01aff82740 1 -- 172.21.15.22:0/1446998669 wait complete. 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.158+0000 7f01aff82740 1 -- start start 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.158+0000 7f01aff82740 1 Processor -- start 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01aff82740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9dc70 0x55a429c39160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01aff82740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429bbe520 0x55a429c36100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01aff82740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a429bb7ab0 con 0x55a429b9d890 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a429b70980 con 0x55a429b9dc70 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01aff82740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a429bbeb20 con 0x55a429bbe520 2024-04-16T16:17:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01aff82740 10 client.0 _ll_register_callbacks cb 0x7f0198037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44052/0 (socket says 172.21.15.22:44052) 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 -- 172.21.15.22:0/4282766570 learned_addr learned my addr 172.21.15.22:0/4282766570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 -- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429bbe520 msgr2=0x55a429c36100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429bbe520 0x55a429c36100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 -- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9dc70 msgr2=0x55a429c39160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9dc70 0x55a429c39160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.159+0000 7f01a5e00640 1 -- 172.21.15.22:0/4282766570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a429bbbd20 con 0x55a429b9d890 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f01a5e00640 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbb7e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0198009250 tx=0x7f0198009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37f6857953cbbb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f0187400640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-04-16T16:17:00.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f0187400640 1 -- 172.21.15.22:0/4282766570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980044e0 con 0x55a429b9d890 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f0187400640 1 -- 172.21.15.22:0/4282766570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0198034850 con 0x55a429b9d890 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0194062620 con 0x55a429b9d890 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f0187400640 1 -- 172.21.15.22:0/4282766570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0198034a50 con 0x55a429b9d890 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f01aff82740 10 client.4665 fetch_fsmap learned FSMap version 8 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a429bcebb0 con 0x55a429b9d890 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.160+0000 7f0187400640 1 -- 172.21.15.22:0/4282766570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0194062620 con 0x55a429b9d890 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f0187400640 1 -- 172.21.15.22:0/4282766570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f0198034bf0 con 0x55a429b9d890 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f01aff82740 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f01aff82740 10 client.4665 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f01aff82740 20 client.4665 populate_metadata read hostname 'smithi022' 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f01aff82740 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429c358e0 0x55a429b74440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f01aff82740 4 client.4665 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T16:17:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 --> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] -- command(tid 0: {"prefix": "status"}) -- 0x55a429ae93e0 con 0x55a429c358e0 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.161+0000 7f01a5400640 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429c358e0 0x55a429b74440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.162+0000 7f01a5400640 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429c358e0 0x55a429b74440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d4b593a069aa53 server_cookie=e1247cb2405eda87 in_seq=0 out_seq=0 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.162+0000 7f0187400640 10 client.4665 ms_handle_connect on v2:172.21.15.43:6832/3889023021 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f0187400640 1 -- 172.21.15.22:0/4282766570 <== mds.0 v2:172.21.15.43:6832/3889023021 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55a429ae93e0 con 0x55a429c358e0 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f0187400640 10 client.4665 handle_command_reply: tid=0 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 client.4665 shutdown 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 msgr2=0x55a429bbb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbb7e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0198009250 tx=0x7f0198009190 comp rx=0 tx=0).stop 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 shutdown_connections 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:6832/3889023021,v1:172.21.15.43:6833/3889023021] conn(0x55a429c358e0 0x55a429b74440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a429bbe520 0x55a429c36100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a429b9dc70 0x55a429c39160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f0187400640 0 client.4665 ms_handle_reset on v2:172.21.15.43:6832/3889023021 2024-04-16T16:17:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 --2- 172.21.15.22:0/4282766570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a429b9d890 0x55a429bbb7e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 >> 172.21.15.22:0/4282766570 conn(0x55a429b76ab0 msgr2=0x55a429ba41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 shutdown_connections 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 1 -- 172.21.15.22:0/4282766570 wait complete. 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.163+0000 7f01aff82740 20 client.4665 trim_cache size 0 max 16384 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf", 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4266, 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-04-16T16:17:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-04-16T16:17:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-04-16T16:17:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 17.629162695000002, 2024-04-16T16:17:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 8, 2024-04-16T16:17:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 21, 2024-04-16T16:17:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 21, 2024-04-16T16:17:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 25.299094522000001 2024-04-16T16:17:00.167 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f018806c970 msgr2=0x7f018806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f018806c970 0x7f018806ee30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0198036000 tx=0x7f0198030000 comp rx=0 tx=0).stop 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01a80b0010 msgr2=0x7f01a8152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01a80b0010 0x7f01a8152b40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f019400e8c0 tx=0x7f019400ed80 comp rx=0 tx=0).stop 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 shutdown_connections 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f018806c970 0x7f018806ee30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01a8145a40 0x7f01a8145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01a80b0010 0x7f01a8152b40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 --2- 172.21.15.22:0/4235379505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f018c003a20 0x7f01a80b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:00.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 >> 172.21.15.22:0/4235379505 conn(0x7f01a8075070 msgr2=0x7f01a806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:00.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 shutdown_connections 2024-04-16T16:17:00.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:00.164+0000 7f01a7200640 1 -- 172.21.15.22:0/4235379505 wait complete. 2024-04-16T16:17:00.180 INFO:teuthology.run_tasks:Running task sequential... 2024-04-16T16:17:00.189 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-16T16:17:00.189 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-16T16:17:00.189 INFO:teuthology.task.print:Enabling mgr modules 2024-04-16T16:17:00.189 INFO:teuthology.run_tasks:Running task kclient... 2024-04-16T16:17:00.212 INFO:tasks.kclient:Mounting kernel clients... 2024-04-16T16:17:00.212 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-16T16:17:00.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.212 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:17:00.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.266 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-04-16T16:17:00.365 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2024-04-16T16:17:00.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:17:00.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.369 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:17:00.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-04-16T16:17:00.531 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2024-04-16T16:17:00.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:17:00.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.535 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:17:00.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-16T16:17:00.698 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-04-16T16:17:00.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:17:00.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.703 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:17:00.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:00.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-16T16:17:00.859 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-04-16T16:17:00.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:17:00.864 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-16T16:17:00.864 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T16:17:00.864 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T16:17:00.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:17:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.094+0000 7f60a3e00640 1 Processor -- start 2024-04-16T16:17:01.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.095+0000 7f60a3e00640 1 -- start start 2024-04-16T16:17:01.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.096+0000 7f60a3e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f609c1623b0 0x7f609c0d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.096+0000 7f60a3e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c0d28b0 con 0x7f609c0ba4b0 2024-04-16T16:17:01.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.096+0000 7f60a3e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c0d3660 con 0x7f609c0cfee0 2024-04-16T16:17:01.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.096+0000 7f60a3e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f609c0d3940 con 0x7f609c1623b0 2024-04-16T16:17:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.097+0000 7f60a0a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f609c0ba4b0 0x7f609c0cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47870/0 (socket says 172.21.15.22:47870) 2024-04-16T16:17:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.097+0000 7f60a0a00640 1 -- 172.21.15.22:0/3921636922 learned_addr learned my addr 172.21.15.22:0/3921636922 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.097+0000 7f60a1400640 1 --2- 172.21.15.22:0/3921636922 >> v2:172.21.15.43:3300/0 conn(0x7f609c1623b0 0x7f609c0d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.097+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600120562 0 0) 0x7f609c0d28b0 con 0x7f609c0ba4b0 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.097+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6084003520 con 0x7f609c0ba4b0 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3088641685 0 0) 0x7f6084003520 con 0x7f609c0ba4b0 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 >> v2:172.21.15.43:3300/0 conn(0x7f609c1623b0 msgr2=0x7f609c0d2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 --2- 172.21.15.22:0/3921636922 >> v2:172.21.15.43:3300/0 conn(0x7f609c1623b0 0x7f609c0d2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 >> v1:172.21.15.43:6789/0 conn(0x7f609c0cfee0 legacy=0x7f609c0b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0d3c20 con 0x7f609c0ba4b0 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f6088001670 con 0x7f609c0ba4b0 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 >> v1:172.21.15.22:6789/0 conn(0x7f609c0ba4b0 legacy=0x7f609c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60840039b0 0x7f6084003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6084004800 0x7f6084004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60840051c0 0x7f608400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0d3940 con 0x7f6084004800 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f608400c070 con 0x7f60840039b0 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f608400c270 con 0x7f60840051c0 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f60a0a00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6084004800 0x7f6084004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.098+0000 7f60a1400640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60840039b0 0x7f6084003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.099+0000 7f60a0a00640 1 -- 172.21.15.22:0/3921636922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60840051c0 msgr2=0x7f608400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.099+0000 7f60a0a00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60840051c0 0x7f608400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.099+0000 7f60a0a00640 1 -- 172.21.15.22:0/3921636922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60840039b0 msgr2=0x7f6084003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.099+0000 7f60a0a00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60840039b0 0x7f6084003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.099+0000 7f60a0a00640 1 -- 172.21.15.22:0/3921636922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6084003520 con 0x7f6084004800 2024-04-16T16:17:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.099+0000 7f60a1e00640 1 -- 172.21.15.22:0/3921636922 reap_dead start 2024-04-16T16:17:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.100+0000 7f60a0a00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6084004800 0x7f6084004c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f608800c240 tx=0x7f6084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfb0d00823d6e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.100+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088007d10 con 0x7f6084004800 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.100+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088030070 con 0x7f6084004800 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.100+0000 7f609be00640 1 -- 172.21.15.22:0/3921636922 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608802cda0 con 0x7f6084004800 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.101+0000 7f60a3e00640 1 -- 172.21.15.22:0/3921636922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6084004800 msgr2=0x7f6084004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.101+0000 7f60a3e00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6084004800 0x7f6084004c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f608800c240 tx=0x7f6084005830 comp rx=0 tx=0).stop 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.101+0000 7f60a3e00640 1 -- 172.21.15.22:0/3921636922 shutdown_connections 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.101+0000 7f60a3e00640 1 --2- 172.21.15.22:0/3921636922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6084004800 0x7f6084004c80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.101+0000 7f60a3e00640 1 -- 172.21.15.22:0/3921636922 >> 172.21.15.22:0/3921636922 conn(0x7f609c072460 msgr2=0x7f609c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.101+0000 7f60a3e00640 1 -- 172.21.15.22:0/3921636922 shutdown_connections 2024-04-16T16:17:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.101+0000 7f60a3e00640 1 -- 172.21.15.22:0/3921636922 wait complete. 2024-04-16T16:17:01.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.103+0000 7f60a3e00640 1 Processor -- start 2024-04-16T16:17:01.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.103+0000 7f60a3e00640 1 -- start start 2024-04-16T16:17:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6084004800 0x7f609c14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609c0ca4a0 0x7f609c0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609c1615d0 0x7f609c161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a3e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0d4700 con 0x7f609c0ca4a0 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0d41e0 con 0x7f6084004800 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f609c0c8930 con 0x7f609c1615d0 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a0a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609c0ca4a0 0x7f609c0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a0a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609c0ca4a0 0x7f609c0ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44070/0 (socket says 172.21.15.22:44070) 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.104+0000 7f60a0a00640 1 -- 172.21.15.22:0/1386562678 learned_addr learned my addr 172.21.15.22:0/1386562678 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a1400640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6084004800 0x7f609c14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a1e00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609c1615d0 0x7f609c161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a0a00640 1 -- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609c1615d0 msgr2=0x7f609c161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a0a00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609c1615d0 0x7f609c161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a0a00640 1 -- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6084004800 msgr2=0x7f609c14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a0a00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6084004800 0x7f609c14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a0a00640 1 -- 172.21.15.22:0/1386562678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0c8c10 con 0x7f609c0ca4a0 2024-04-16T16:17:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f60a0a00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609c0ca4a0 0x7f609c0ca900 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6088001970 tx=0x7f608802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.105+0000 7f6099600640 1 -- 172.21.15.22:0/1386562678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088007d10 con 0x7f609c0ca4a0 2024-04-16T16:17:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.106+0000 7f6099600640 1 -- 172.21.15.22:0/1386562678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088004bf0 con 0x7f609c0ca4a0 2024-04-16T16:17:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.106+0000 7f6099600640 1 -- 172.21.15.22:0/1386562678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088007070 con 0x7f609c0ca4a0 2024-04-16T16:17:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.106+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c0c8ef0 con 0x7f609c0ca4a0 2024-04-16T16:17:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.106+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c0c94b0 con 0x7f609c0ca4a0 2024-04-16T16:17:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.107+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609c04fd90 con 0x7f609c0ca4a0 2024-04-16T16:17:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.108+0000 7f6099600640 1 -- 172.21.15.22:0/1386562678 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6088007230 con 0x7f609c0ca4a0 2024-04-16T16:17:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.109+0000 7f6099600640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f607c06c8f0 0x7f607c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.109+0000 7f6099600640 1 -- 172.21.15.22:0/1386562678 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f60880ad2a0 con 0x7f609c0ca4a0 2024-04-16T16:17:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.110+0000 7f60a1400640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f607c06c8f0 0x7f607c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.110+0000 7f60a1400640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f607c06c8f0 0x7f607c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6090009a90 tx=0x7f6090008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:01.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.114+0000 7f6099600640 1 -- 172.21.15.22:0/1386562678 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f608807b6c0 con 0x7f609c0ca4a0 2024-04-16T16:17:01.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.359+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f609c0d1b50 con 0x7f609c0ca4a0 2024-04-16T16:17:01.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.360+0000 7f6099600640 1 -- 172.21.15.22:0/1386562678 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f608807afc0 con 0x7f609c0ca4a0 2024-04-16T16:17:01.360 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:17:01.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f607c06c8f0 msgr2=0x7f607c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:01.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f607c06c8f0 0x7f607c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6090009a90 tx=0x7f6090008040 comp rx=0 tx=0).stop 2024-04-16T16:17:01.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609c0ca4a0 msgr2=0x7f609c0ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:01.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609c0ca4a0 0x7f609c0ca900 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6088001970 tx=0x7f608802e070 comp rx=0 tx=0).stop 2024-04-16T16:17:01.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 shutdown_connections 2024-04-16T16:17:01.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f607c06c8f0 0x7f607c06edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609c1615d0 0x7f609c161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609c0ca4a0 0x7f609c0ca900 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 --2- 172.21.15.22:0/1386562678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6084004800 0x7f609c14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.362+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 >> 172.21.15.22:0/1386562678 conn(0x7f609c072460 msgr2=0x7f609c0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.363+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 shutdown_connections 2024-04-16T16:17:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01.363+0000 7f60a3e00640 1 -- 172.21.15.22:0/1386562678 wait complete. 2024-04-16T16:17:01.382 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T16:17:01.382 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:17:01.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-04-16T16:17:01.383 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T16:17:01.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T16:17:01.383 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T16:17:01.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T16:17:01.383 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:17:01.383 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:17:01.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:01.383 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:01.432 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:01.433 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-04-16T16:17:01.434 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T16:17:01.434 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:01.434 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:01.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-04-16T16:17:01.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-04-16T16:17:01.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-04-16T16:17:01.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T16:17:01.435 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:01.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:02.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:02.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:02.015 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:17:02.097 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-04-16T16:17:02.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:02.101 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-04-16T16:17:02.158 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-04-16T16:17:02.158 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:17:02.158 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:17:02.158 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:17:02.158 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:17:02.159 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:02.159 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:02.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:17:02.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:17:02.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:17:02.159 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:02.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:02.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:02.957 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:17:03.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:03.004 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-04-16T16:17:03.091 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:03.091 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:03.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T16:17:03.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-16T16:17:03.091 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:03.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:03.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:03.326 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-16T16:17:03.326 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:03.326 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:03.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-16T16:17:03.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T16:17:03.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-16T16:17:03.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-16T16:17:03.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-16T16:17:03.327 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:03.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:03.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:03.655 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:03.655 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:03.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-04-16T16:17:03.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T16:17:03.655 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:03.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:03.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:03.859 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T16:17:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:17:03.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:03.899 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T16:17:03.987 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:17:03.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:03.987 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:17:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:17:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:17:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:17:04.897 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:17:04.897 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:17:04.897 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:17:04.897 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:04.897 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:17:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:17:04.939 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-16T16:17:04.939 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:17:04.939 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:17:04.939 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:17:04.939 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:17:04.945 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:17:04.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:04.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T16:17:05.046 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:05.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:05.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:05.202 INFO:teuthology.orchestra.run.smithi022.stdout:client4674 2024-04-16T16:17:05.202 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:05.202 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:05.256 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:05.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:05.408 INFO:teuthology.orchestra.run.smithi022.stdout:client4674 2024-04-16T16:17:05.408 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:05.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:05.565 INFO:teuthology.orchestra.run.smithi022.stdout:client4674 2024-04-16T16:17:05.565 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf.client4674/status') 2024-04-16T16:17:05.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:05.737 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.4674 (3)192.168.0.1:0/4290197135 2024-04-16T16:17:05.738 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2024-04-16T16:17:05.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2024-04-16T16:17:05.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2024-04-16T16:17:05.738 INFO:teuthology.orchestra.run.smithi022.stderr:69 bytes copied, 0.000105474 s, 654 kB/s 2024-04-16T16:17:05.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:05.752 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-16T16:17:05.753 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T16:17:05.753 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T16:17:05.753 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:17:05.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.981+0000 7f6c27000640 1 Processor -- start 2024-04-16T16:17:05.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.981+0000 7f6c27000640 1 -- start start 2024-04-16T16:17:05.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.983+0000 7f6c27000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6c200b3410 0x7f6c200ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.983+0000 7f6c27000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c200af2b0 con 0x7f6c200d01a0 2024-04-16T16:17:05.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.983+0000 7f6c27000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c200af590 con 0x7f6c200aeda0 2024-04-16T16:17:05.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.983+0000 7f6c27000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2006d020 con 0x7f6c200b3410 2024-04-16T16:17:05.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.983+0000 7f6c25c00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6c200d01a0 0x7f6c200d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47872/0 (socket says 172.21.15.22:47872) 2024-04-16T16:17:05.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.983+0000 7f6c25c00640 1 -- 172.21.15.22:0/3892688690 learned_addr learned my addr 172.21.15.22:0/3892688690 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:05.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c25200640 1 --2- 172.21.15.22:0/3892688690 >> v2:172.21.15.43:3300/0 conn(0x7f6c200b3410 0x7f6c200ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860287820 0 0) 0x7f6c200af2b0 con 0x7f6c200d01a0 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c08003520 con 0x7f6c200d01a0 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1367524890 0 0) 0x7f6c08003520 con 0x7f6c200d01a0 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 >> v2:172.21.15.43:3300/0 conn(0x7f6c200b3410 msgr2=0x7f6c200ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c1fe00640 1 --2- 172.21.15.22:0/3892688690 >> v2:172.21.15.43:3300/0 conn(0x7f6c200b3410 0x7f6c200ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 >> v1:172.21.15.43:6789/0 conn(0x7f6c200aeda0 legacy=0x7f6c2006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.984+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2006d250 con 0x7f6c200d01a0 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f6c14001670 con 0x7f6c200d01a0 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 >> v1:172.21.15.22:6789/0 conn(0x7f6c200d01a0 legacy=0x7f6c200d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c080039b0 0x7f6c08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08004800 0x7f6c08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c080051c0 0x7f6c0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0800c040 con 0x7f6c080039b0 2024-04-16T16:17:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0800c1f0 con 0x7f6c08004800 2024-04-16T16:17:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0800c3f0 con 0x7f6c080051c0 2024-04-16T16:17:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c080039b0 0x7f6c08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c25200640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08004800 0x7f6c08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.985+0000 7f6c26600640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c080051c0 0x7f6c0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.986+0000 7f6c25c00640 1 -- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c080051c0 msgr2=0x7f6c0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.986+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c080051c0 0x7f6c0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.986+0000 7f6c25c00640 1 -- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08004800 msgr2=0x7f6c08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.986+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08004800 0x7f6c08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.986+0000 7f6c25c00640 1 -- 172.21.15.22:0/3892688690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c08003520 con 0x7f6c080039b0 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.986+0000 7f6c26600640 1 -- 172.21.15.22:0/3892688690 reap_dead start 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.987+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c080039b0 0x7f6c08003dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c210 tx=0x7f6c08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c427c7210e68cc3c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.987+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14007d30 con 0x7f6c080039b0 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.987+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14030070 con 0x7f6c080039b0 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.987+0000 7f6c1fe00640 1 -- 172.21.15.22:0/3892688690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1402cde0 con 0x7f6c080039b0 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.988+0000 7f6c27000640 1 -- 172.21.15.22:0/3892688690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c080039b0 msgr2=0x7f6c08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.988+0000 7f6c27000640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c080039b0 0x7f6c08003dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c210 tx=0x7f6c08005830 comp rx=0 tx=0).stop 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.988+0000 7f6c27000640 1 -- 172.21.15.22:0/3892688690 shutdown_connections 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.988+0000 7f6c27000640 1 --2- 172.21.15.22:0/3892688690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c080039b0 0x7f6c08003dd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.988+0000 7f6c27000640 1 -- 172.21.15.22:0/3892688690 >> 172.21.15.22:0/3892688690 conn(0x7f6c20062440 msgr2=0x7f6c20062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.988+0000 7f6c27000640 1 -- 172.21.15.22:0/3892688690 shutdown_connections 2024-04-16T16:17:05.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.988+0000 7f6c27000640 1 -- 172.21.15.22:0/3892688690 wait complete. 2024-04-16T16:17:05.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.990+0000 7f6c27000640 1 Processor -- start 2024-04-16T16:17:05.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.990+0000 7f6c27000640 1 -- start start 2024-04-16T16:17:05.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c27000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080039b0 0x7f6c201f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c27000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c20155430 0x7f6c20148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c27000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c20155890 0x7f6c201490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c27000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20162200 con 0x7f6c20155430 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c27000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c200af870 con 0x7f6c080039b0 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c27000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6c20162380 con 0x7f6c20155890 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c25200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c20155430 0x7f6c20148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c25200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c20155430 0x7f6c20148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44082/0 (socket says 172.21.15.22:44082) 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.991+0000 7f6c25200640 1 -- 172.21.15.22:0/3699527338 learned_addr learned my addr 172.21.15.22:0/3699527338 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c26600640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c20155890 0x7f6c201490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080039b0 0x7f6c201f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25200640 1 -- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c20155890 msgr2=0x7f6c201490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25200640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c20155890 0x7f6c201490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25200640 1 -- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080039b0 msgr2=0x7f6c201f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25200640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080039b0 0x7f6c201f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25200640 1 -- 172.21.15.22:0/3699527338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c20158cf0 con 0x7f6c20155430 2024-04-16T16:17:05.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080039b0 0x7f6c201f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:05.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c25200640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c20155430 0x7f6c20148b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0114e0 tx=0x7f6c0c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:05.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c1d600640 1 -- 172.21.15.22:0/3699527338 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c015870 con 0x7f6c20155430 2024-04-16T16:17:05.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c1d600640 1 -- 172.21.15.22:0/3699527338 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c015a10 con 0x7f6c20155430 2024-04-16T16:17:05.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.992+0000 7f6c1d600640 1 -- 172.21.15.22:0/3699527338 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c015dc0 con 0x7f6c20155430 2024-04-16T16:17:05.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.993+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c20158f90 con 0x7f6c20155430 2024-04-16T16:17:05.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.993+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c20159550 con 0x7f6c20155430 2024-04-16T16:17:05.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.994+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c20075f30 con 0x7f6c20155430 2024-04-16T16:17:05.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.995+0000 7f6c1d600640 1 -- 172.21.15.22:0/3699527338 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c0c013400 con 0x7f6c20155430 2024-04-16T16:17:05.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.996+0000 7f6c1d600640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6c0006c920 0x7f6c0006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:05.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.997+0000 7f6c1d600640 1 -- 172.21.15.22:0/3699527338 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6c0c08c330 con 0x7f6c20155430 2024-04-16T16:17:05.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.997+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6c0006c920 0x7f6c0006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:05.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:05.997+0000 7f6c25c00640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6c0006c920 0x7f6c0006ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c14034000 tx=0x7f6c14009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:06.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.001+0000 7f6c1d600640 1 -- 172.21.15.22:0/3699527338 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c0c019030 con 0x7f6c20155430 2024-04-16T16:17:06.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:17:06.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:17:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.253+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6c2015ef90 con 0x7f6c20155430 2024-04-16T16:17:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.254+0000 7f6c1d600640 1 -- 172.21.15.22:0/3699527338 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6c0c05a750 con 0x7f6c20155430 2024-04-16T16:17:06.253 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.256+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6c0006c920 msgr2=0x7f6c0006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.256+0000 7f6c27000640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6c0006c920 0x7f6c0006ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c14034000 tx=0x7f6c14009030 comp rx=0 tx=0).stop 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.256+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c20155430 msgr2=0x7f6c20148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.256+0000 7f6c27000640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c20155430 0x7f6c20148b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0114e0 tx=0x7f6c0c0119a0 comp rx=0 tx=0).stop 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.256+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 shutdown_connections 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.256+0000 7f6c27000640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6c0006c920 0x7f6c0006ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.257+0000 7f6c27000640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c20155890 0x7f6c201490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.257+0000 7f6c27000640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c20155430 0x7f6c20148b60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.257+0000 7f6c27000640 1 --2- 172.21.15.22:0/3699527338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080039b0 0x7f6c201f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.257+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 >> 172.21.15.22:0/3699527338 conn(0x7f6c20062440 msgr2=0x7f6c200b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.257+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 shutdown_connections 2024-04-16T16:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06.257+0000 7f6c27000640 1 -- 172.21.15.22:0/3699527338 wait complete. 2024-04-16T16:17:06.277 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T16:17:06.277 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:17:06.277 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-04-16T16:17:06.278 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-16T16:17:06.278 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T16:17:06.278 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T16:17:06.278 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T16:17:06.278 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:17:06.278 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-16T16:17:06.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:06.278 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:06.321 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42582sec preferred_lft 42582sec 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-04-16T16:17:06.322 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ba:9d:95:17:f0:73 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::d864:8ff:fe17:e583/64 scope link 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ba:9d:95:17:f0:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::b89d:95ff:fe17:f073/64 scope link 2024-04-16T16:17:06.323 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:06.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:06.324 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:17:06.483 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-04-16T16:17:06.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:06.488 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-04-16T16:17:06.546 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-04-16T16:17:06.546 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:17:06.546 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:17:06.546 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:17:06.546 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:17:06.547 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:06.547 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:06.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:17:06.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:17:06.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:17:06.548 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:06.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:06.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:06.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:06.800 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:17:06.855 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T16:17:06.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:06.856 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-04-16T16:17:06.910 INFO:teuthology.orchestra.run.smithi022.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-16T16:17:06.911 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:06.911 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:06.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T16:17:06.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-16T16:17:06.911 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:07.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:07.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:07.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:07.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0e:64:96:34:dd:8c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::c64:96ff:fe34:dd8c/64 scope link 2024-04-16T16:17:07.218 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:07.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T16:17:07.323 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0e:64:96:34:dd:8c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::c64:96ff:fe34:dd8c/64 scope link 2024-04-16T16:17:07.324 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:07.328 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-16T16:17:07.328 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:07.328 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:07.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-16T16:17:07.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T16:17:07.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-16T16:17:07.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-16T16:17:07.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-16T16:17:07.329 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:07.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:07.670 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:07.671 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:17:07.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.1 up 2024-04-16T16:17:07.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T16:17:07.671 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:17:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:07.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:07.907 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-16T16:17:07.957 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-16T16:17:07.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:07.957 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-16T16:17:08.008 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:17:08.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:08.008 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T16:17:08.147 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T16:17:08.147 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T16:17:08.147 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:17:08.169 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T16:17:08.169 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T16:17:08.169 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:17:08.169 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:08.169 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:17:08.196 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:17:08.199 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-16T16:17:08.199 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:17:08.199 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:17:08.199 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:17:08.199 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:17:08.204 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:17:08.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:08.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-16T16:17:08.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:08.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:08.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:client4683 2024-04-16T16:17:08.426 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:08.427 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:08.480 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:08.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:08.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:08.608 INFO:teuthology.orchestra.run.smithi022.stdout:client4683 2024-04-16T16:17:08.608 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:08.732 INFO:teuthology.orchestra.run.smithi022.stdout:client4683 2024-04-16T16:17:08.732 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf.client4683/status') 2024-04-16T16:17:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:08.885 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.4683 (3)192.168.0.2:0/1315944379 2024-04-16T16:17:08.886 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2024-04-16T16:17:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2024-04-16T16:17:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2024-04-16T16:17:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:69 bytes copied, 7.0187e-05 s, 983 kB/s 2024-04-16T16:17:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:08.900 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-16T16:17:08.900 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T16:17:08.900 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T16:17:08.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:17:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.119+0000 7f2221200640 1 Processor -- start 2024-04-16T16:17:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.119+0000 7f2221200640 1 -- start start 2024-04-16T16:17:09.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f2221200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f221c06eaa0 0x7f221c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:09.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f2221200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f221c0cc810 0x7f221c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f2221200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221c06d160 con 0x7f221c06ee80 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f2221200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f221c06cf10 con 0x7f221c06eaa0 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f2221200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f221c06d440 con 0x7f221c0cc810 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f221b400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f221c06eaa0 0x7f221c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f221b400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f221c06eaa0 0x7f221c0b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44096/0 (socket says 172.21.15.22:44096) 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.121+0000 7f221b400640 1 -- 172.21.15.22:0/505170875 learned_addr learned my addr 172.21.15.22:0/505170875 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.122+0000 7f221b400640 1 -- 172.21.15.22:0/505170875 >> v2:172.21.15.43:3300/0 conn(0x7f221c0cc810 msgr2=0x7f221c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.122+0000 7f221b400640 1 --2- 172.21.15.22:0/505170875 >> v2:172.21.15.43:3300/0 conn(0x7f221c0cc810 0x7f221c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.122+0000 7f221b400640 1 -- 172.21.15.22:0/505170875 >> v1:172.21.15.43:6789/0 conn(0x7f221c06ee80 legacy=0x7f221c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.122+0000 7f221b400640 1 -- 172.21.15.22:0/505170875 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c06d720 con 0x7f221c06eaa0 2024-04-16T16:17:09.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.123+0000 7f221b400640 1 --2- 172.21.15.22:0/505170875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06eaa0 0x7f221c0b3e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f220c009870 tx=0x7f220c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7d3a3cbd006975 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:09.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.123+0000 7f221a000640 1 -- 172.21.15.22:0/505170875 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c035020 con 0x7f221c06eaa0 2024-04-16T16:17:09.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.123+0000 7f221a000640 1 -- 172.21.15.22:0/505170875 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220c031870 con 0x7f221c06eaa0 2024-04-16T16:17:09.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.123+0000 7f221a000640 1 -- 172.21.15.22:0/505170875 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c031c40 con 0x7f221c06eaa0 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 -- 172.21.15.22:0/505170875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06eaa0 msgr2=0x7f221c0b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 --2- 172.21.15.22:0/505170875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06eaa0 0x7f221c0b3e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f220c009870 tx=0x7f220c02b910 comp rx=0 tx=0).stop 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 -- 172.21.15.22:0/505170875 shutdown_connections 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 --2- 172.21.15.22:0/505170875 >> v2:172.21.15.43:3300/0 conn(0x7f221c0cc810 0x7f221c06df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 --2- 172.21.15.22:0/505170875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06eaa0 0x7f221c0b3e20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 -- 172.21.15.22:0/505170875 >> 172.21.15.22:0/505170875 conn(0x7f221c062440 msgr2=0x7f221c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 -- 172.21.15.22:0/505170875 shutdown_connections 2024-04-16T16:17:09.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.124+0000 7f2221200640 1 -- 172.21.15.22:0/505170875 wait complete. 2024-04-16T16:17:09.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.126+0000 7f2221200640 1 Processor -- start 2024-04-16T16:17:09.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.126+0000 7f2221200640 1 -- start start 2024-04-16T16:17:09.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f2221200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f221c06eaa0 0x7f221c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:09.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f2221200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06ee80 0x7f221c0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:09.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f2221200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f221c0cc810 0x7f221c1f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:09.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f2221200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f221c06e440 con 0x7f221c06ee80 2024-04-16T16:17:09.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f2221200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f221c0b4360 con 0x7f221c06eaa0 2024-04-16T16:17:09.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f2221200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f221c15c910 con 0x7f221c0cc810 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f221aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06ee80 0x7f221c0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f221aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06ee80 0x7f221c0b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44112/0 (socket says 172.21.15.22:44112) 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.127+0000 7f221aa00640 1 -- 172.21.15.22:0/2602468077 learned_addr learned my addr 172.21.15.22:0/2602468077 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221b400640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f221c06eaa0 0x7f221c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221be00640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f221c0cc810 0x7f221c1f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221aa00640 1 -- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f221c0cc810 msgr2=0x7f221c1f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221aa00640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f221c0cc810 0x7f221c1f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221aa00640 1 -- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f221c06eaa0 msgr2=0x7f221c1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221aa00640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f221c06eaa0 0x7f221c1511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221aa00640 1 -- 172.21.15.22:0/2602468077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c1f55c0 con 0x7f221c06ee80 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221b400640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f221c06eaa0 0x7f221c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f221aa00640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06ee80 0x7f221c0b0050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f220800ba80 tx=0x7f220800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:09.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f2213400640 1 -- 172.21.15.22:0/2602468077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208019070 con 0x7f221c06ee80 2024-04-16T16:17:09.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f2213400640 1 -- 172.21.15.22:0/2602468077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220800cc20 con 0x7f221c06ee80 2024-04-16T16:17:09.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f2213400640 1 -- 172.21.15.22:0/2602468077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208014440 con 0x7f221c06ee80 2024-04-16T16:17:09.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221c1f58a0 con 0x7f221c06ee80 2024-04-16T16:17:09.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.128+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221c0b0590 con 0x7f221c06ee80 2024-04-16T16:17:09.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.130+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221c152420 con 0x7f221c06ee80 2024-04-16T16:17:09.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.131+0000 7f2213400640 1 -- 172.21.15.22:0/2602468077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f220801c070 con 0x7f221c06ee80 2024-04-16T16:17:09.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.132+0000 7f2213400640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21fc06c8f0 0x7f21fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:09.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.132+0000 7f2213400640 1 -- 172.21.15.22:0/2602468077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f220808b8b0 con 0x7f221c06ee80 2024-04-16T16:17:09.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.132+0000 7f221b400640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21fc06c8f0 0x7f21fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:09.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.133+0000 7f221b400640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21fc06c8f0 0x7f21fc06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f220c036000 tx=0x7f220c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:09.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.137+0000 7f2213400640 1 -- 172.21.15.22:0/2602468077 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f221c152420 con 0x7f221c06ee80 2024-04-16T16:17:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.383+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f221c0cde70 con 0x7f221c06ee80 2024-04-16T16:17:09.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.384+0000 7f2213400640 1 -- 172.21.15.22:0/2602468077 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f221c0cde70 con 0x7f221c06ee80 2024-04-16T16:17:09.384 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.386+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21fc06c8f0 msgr2=0x7f21fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.386+0000 7f2221200640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21fc06c8f0 0x7f21fc06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f220c036000 tx=0x7f220c03c040 comp rx=0 tx=0).stop 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.386+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06ee80 msgr2=0x7f221c0b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.386+0000 7f2221200640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06ee80 0x7f221c0b0050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f220800ba80 tx=0x7f220800bf40 comp rx=0 tx=0).stop 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 shutdown_connections 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21fc06c8f0 0x7f21fc06edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f221c0cc810 0x7f221c1f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f221c06ee80 0x7f221c0b0050 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 --2- 172.21.15.22:0/2602468077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f221c06eaa0 0x7f221c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 >> 172.21.15.22:0/2602468077 conn(0x7f221c062440 msgr2=0x7f221c151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:09.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 shutdown_connections 2024-04-16T16:17:09.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:09.387+0000 7f2221200640 1 -- 172.21.15.22:0/2602468077 wait complete. 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:17:09.406 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:17:09.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:09.407 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-16T16:17:09.468 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:09.468 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:09.468 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:17:09.469 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42585sec preferred_lft 42585sec 2024-04-16T16:17:09.470 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-16T16:17:09.470 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:09.470 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:09.470 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:09.470 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-16T16:17:09.471 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T16:17:09.471 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:09.471 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:09.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-04-16T16:17:09.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-04-16T16:17:09.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-04-16T16:17:09.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T16:17:09.471 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:10.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:10.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:10.014 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:17:10.099 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-16T16:17:10.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:10.103 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-16T16:17:10.216 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-16T16:17:10.216 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:17:10.216 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:17:10.216 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:17:10.216 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:17:10.217 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:10.217 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:10.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:17:10.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:17:10.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:17:10.218 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:11.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:11.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:11.036 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:17:11.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:11.092 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-16T16:17:11.147 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:11.147 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:11.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T16:17:11.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-16T16:17:11.147 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:11.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:11.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:11.369 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-16T16:17:11.369 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:11.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:11.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:11.715 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:11.715 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:11.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-16T16:17:11.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T16:17:11.715 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:11.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:11.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:11.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:11.957 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T16:17:12.005 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:17:12.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:12.005 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T16:17:12.098 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:17:12.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:12.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:17:12.244 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:17:12.244 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:17:12.244 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:17:12.974 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:17:12.974 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:17:12.974 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:17:12.974 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:12.974 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:17:13.012 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:17:13.016 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-16T16:17:13.016 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:17:13.016 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:17:13.016 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:17:13.016 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:17:13.020 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:17:13.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:13.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T16:17:13.115 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:13.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:13.242 INFO:teuthology.orchestra.run.smithi043.stdout:client4540 2024-04-16T16:17:13.243 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:13.243 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:13.297 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:13.421 INFO:teuthology.orchestra.run.smithi043.stdout:client4540 2024-04-16T16:17:13.421 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:13.551 INFO:teuthology.orchestra.run.smithi043.stdout:client4540 2024-04-16T16:17:13.552 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf.client4540/status') 2024-04-16T16:17:13.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:13.702 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4540 (3)192.168.0.1:0/3548627236 2024-04-16T16:17:13.702 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-04-16T16:17:13.702 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-04-16T16:17:13.702 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-04-16T16:17:13.702 INFO:teuthology.orchestra.run.smithi043.stderr:69 bytes copied, 8.2115e-05 s, 840 kB/s 2024-04-16T16:17:13.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:13.716 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-16T16:17:13.716 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T16:17:13.716 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T16:17:13.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:17:13.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.950+0000 7f3aa7e00640 1 Processor -- start 2024-04-16T16:17:13.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.950+0000 7f3aa7e00640 1 -- start start 2024-04-16T16:17:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3aa7e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3aa8072e30 0x7f3aa80af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3aa7e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3aa80d0090 0x7f3aa80d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3aa7e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aa80b3720 con 0x7f3aa81669b0 2024-04-16T16:17:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3aa7e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa80d0a10 con 0x7f3aa80d0090 2024-04-16T16:17:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3aa7e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa80b3a00 con 0x7f3aa8072e30 2024-04-16T16:17:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3a9fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3aa80d0090 0x7f3aa80d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3a9fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3aa80d0090 0x7f3aa80d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46190/0 (socket says 172.21.15.22:46190) 2024-04-16T16:17:13.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3a9fe00640 1 -- 172.21.15.22:0/1116845736 learned_addr learned my addr 172.21.15.22:0/1116845736 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:13.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.952+0000 7f3aa7400640 1 --1- 172.21.15.22:0/1116845736 >> v1:172.21.15.22:6789/0 conn(0x7f3aa81669b0 0x7f3aa8166e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38828/0 (socket says 172.21.15.22:38828) 2024-04-16T16:17:13.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.953+0000 7f3aa6a00640 1 --2- 172.21.15.22:0/1116845736 >> v2:172.21.15.43:3300/0 conn(0x7f3aa8072e30 0x7f3aa80af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:13.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.953+0000 7f3a9fe00640 1 -- 172.21.15.22:0/1116845736 >> v2:172.21.15.43:3300/0 conn(0x7f3aa8072e30 msgr2=0x7f3aa80af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:13.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.953+0000 7f3a9fe00640 1 --2- 172.21.15.22:0/1116845736 >> v2:172.21.15.43:3300/0 conn(0x7f3aa8072e30 0x7f3aa80af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:13.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.953+0000 7f3a9fe00640 1 -- 172.21.15.22:0/1116845736 >> v1:172.21.15.22:6789/0 conn(0x7f3aa81669b0 legacy=0x7f3aa8166e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:13.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.953+0000 7f3a9fe00640 1 -- 172.21.15.22:0/1116845736 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa80b3ce0 con 0x7f3aa80d0090 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.954+0000 7f3a9fe00640 1 --2- 172.21.15.22:0/1116845736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa80d04d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80b57a0 tx=0x7f3a9002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414d8e50103f5cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.954+0000 7f3aa6000640 1 -- 172.21.15.22:0/1116845736 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90034070 con 0x7f3aa80d0090 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.954+0000 7f3aa6000640 1 -- 172.21.15.22:0/1116845736 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a90030860 con 0x7f3aa80d0090 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa6000640 1 -- 172.21.15.22:0/1116845736 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90030c30 con 0x7f3aa80d0090 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 -- 172.21.15.22:0/1116845736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 msgr2=0x7f3aa80d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/1116845736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa80d04d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80b57a0 tx=0x7f3a9002b9a0 comp rx=0 tx=0).stop 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 -- 172.21.15.22:0/1116845736 shutdown_connections 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/1116845736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa80d04d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/1116845736 >> v2:172.21.15.43:3300/0 conn(0x7f3aa8072e30 0x7f3aa80af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:13.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 -- 172.21.15.22:0/1116845736 >> 172.21.15.22:0/1116845736 conn(0x7f3aa8062440 msgr2=0x7f3aa8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:13.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 -- 172.21.15.22:0/1116845736 shutdown_connections 2024-04-16T16:17:13.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.955+0000 7f3aa7e00640 1 -- 172.21.15.22:0/1116845736 wait complete. 2024-04-16T16:17:13.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.957+0000 7f3aa7e00640 1 Processor -- start 2024-04-16T16:17:13.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.957+0000 7f3aa7e00640 1 -- start start 2024-04-16T16:17:13.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.958+0000 7f3aa7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3aa8072e30 0x7f3aa81495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:13.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.958+0000 7f3aa7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa8157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:13.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.958+0000 7f3aa7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aa81669b0 0x7f3aa81fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:13.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.958+0000 7f3aa7e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80afe30 con 0x7f3aa80d0090 2024-04-16T16:17:13.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.958+0000 7f3aa7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80b42a0 con 0x7f3aa81669b0 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.958+0000 7f3aa7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80b3410 con 0x7f3aa8072e30 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa8157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa8157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46202/0 (socket says 172.21.15.22:46202) 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 -- 172.21.15.22:0/4038923857 learned_addr learned my addr 172.21.15.22:0/4038923857 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3aa6a00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3aa8072e30 0x7f3aa81495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 -- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3aa8072e30 msgr2=0x7f3aa81495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3aa8072e30 0x7f3aa81495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 -- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aa81669b0 msgr2=0x7f3aa81fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3aa7400640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aa81669b0 0x7f3aa81fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aa81669b0 0x7f3aa81fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3a9fe00640 1 -- 172.21.15.22:0/4038923857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa815a230 con 0x7f3aa80d0090 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.959+0000 7f3aa7400640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aa81669b0 0x7f3aa81fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.960+0000 7f3a9fe00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa8157710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a90000c00 tx=0x7f3a90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.960+0000 7f3a9ea00640 1 -- 172.21.15.22:0/4038923857 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90048070 con 0x7f3aa80d0090 2024-04-16T16:17:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.960+0000 7f3a9ea00640 1 -- 172.21.15.22:0/4038923857 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a90030660 con 0x7f3aa80d0090 2024-04-16T16:17:13.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.960+0000 7f3a9ea00640 1 -- 172.21.15.22:0/4038923857 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90034040 con 0x7f3aa80d0090 2024-04-16T16:17:13.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.960+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa815a510 con 0x7f3aa80d0090 2024-04-16T16:17:13.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.960+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa8164b80 con 0x7f3aa80d0090 2024-04-16T16:17:13.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.961+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa8075f30 con 0x7f3aa80d0090 2024-04-16T16:17:13.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.962+0000 7f3a9ea00640 1 -- 172.21.15.22:0/4038923857 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a9004b070 con 0x7f3aa80d0090 2024-04-16T16:17:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.963+0000 7f3a9ea00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a8406c8f0 0x7f3a8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.963+0000 7f3a9ea00640 1 -- 172.21.15.22:0/4038923857 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3a900add20 con 0x7f3aa80d0090 2024-04-16T16:17:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.963+0000 7f3aa6a00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a8406c8f0 0x7f3a8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:13.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.964+0000 7f3aa6a00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a8406c8f0 0x7f3a8406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3a98006fd0 tx=0x7f3a98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:13.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:13.968+0000 7f3a9ea00640 1 -- 172.21.15.22:0/4038923857 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a9007c0b0 con 0x7f3aa80d0090 2024-04-16T16:17:14.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.216+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3aa815aa30 con 0x7f3aa80d0090 2024-04-16T16:17:14.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.217+0000 7f3a9ea00640 1 -- 172.21.15.22:0/4038923857 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3a9007b9b0 con 0x7f3aa80d0090 2024-04-16T16:17:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a8406c8f0 msgr2=0x7f3a8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a8406c8f0 0x7f3a8406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3a98006fd0 tx=0x7f3a98008040 comp rx=0 tx=0).stop 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 msgr2=0x7f3aa8157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa8157710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a90000c00 tx=0x7f3a90004730 comp rx=0 tx=0).stop 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 shutdown_connections 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a8406c8f0 0x7f3a8406edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aa81669b0 0x7f3aa81fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aa80d0090 0x7f3aa8157710 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 --2- 172.21.15.22:0/4038923857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3aa8072e30 0x7f3aa81495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:14.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 >> 172.21.15.22:0/4038923857 conn(0x7f3aa8062440 msgr2=0x7f3aa8166e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:14.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 shutdown_connections 2024-04-16T16:17:14.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:14.220+0000 7f3aa7e00640 1 -- 172.21.15.22:0/4038923857 wait complete. 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:17:14.240 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-16T16:17:14.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:14.241 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-16T16:17:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42580sec preferred_lft 42580sec 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether ce:17:27:11:48:db brd ff:ff:ff:ff:ff:ff 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:14.304 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::b4ad:c9ff:fedb:4436/64 scope link 2024-04-16T16:17:14.305 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:14.305 INFO:teuthology.orchestra.run.smithi043.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:17:14.305 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether ce:17:27:11:48:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T16:17:14.305 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::cc17:27ff:fe11:48db/64 scope link 2024-04-16T16:17:14.305 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:14.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:14.306 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:17:14.397 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-16T16:17:14.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:14.402 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-16T16:17:14.460 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-16T16:17:14.460 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:17:14.460 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:17:14.460 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:17:14.460 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:17:14.460 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:14.460 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:14.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:17:14.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:17:14.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:17:14.461 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:14.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:14.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:14.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:14.732 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:17:14.785 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T16:17:14.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:14.785 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-16T16:17:14.838 INFO:teuthology.orchestra.run.smithi043.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-16T16:17:14.840 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:14.840 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:14.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T16:17:14.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-16T16:17:14.840 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:14.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:15.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:15.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T16:17:15.134 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:15.134 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:15.134 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:15.134 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 96:79:90:9d:95:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::9479:90ff:fe9d:95ad/64 scope link 2024-04-16T16:17:15.135 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:15.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T16:17:15.237 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 96:79:90:9d:95:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::9479:90ff:fe9d:95ad/64 scope link 2024-04-16T16:17:15.238 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:17:15.242 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-16T16:17:15.243 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:15.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:15.587 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:17:15.587 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:17:15.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.1 up 2024-04-16T16:17:15.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T16:17:15.587 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:17:15.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:15.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:15.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:15.831 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-16T16:17:15.882 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-16T16:17:15.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:17:15.882 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-16T16:17:15.937 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:17:15.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:15.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T16:17:16.082 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T16:17:16.082 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T16:17:16.082 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:17:16.106 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T16:17:16.106 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T16:17:16.107 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:17:16.107 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:16.107 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:16.134 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T16:17:16.134 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T16:17:16.134 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:17:16.134 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:17:16.134 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:17:16.135 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:17:16.135 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:17:16.135 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:17:16.137 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-16T16:17:16.137 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:17:16.137 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:17:16.138 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:17:16.138 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:17:16.142 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:17:16.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:16.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-16T16:17:16.233 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:16.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:16.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:16.358 INFO:teuthology.orchestra.run.smithi043.stdout:client4701 2024-04-16T16:17:16.358 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:16.358 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:16.410 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:16.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:16.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:16.530 INFO:teuthology.orchestra.run.smithi043.stdout:client4701 2024-04-16T16:17:16.530 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:17:16.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:17:16.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:16.659 INFO:teuthology.orchestra.run.smithi043.stdout:client4701 2024-04-16T16:17:16.659 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf.client4701/status') 2024-04-16T16:17:16.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:17:16.810 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4701 (3)172.21.15.43:0/3347040194 2024-04-16T16:17:16.810 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-04-16T16:17:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-04-16T16:17:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-04-16T16:17:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:70 bytes copied, 8.1586e-05 s, 858 kB/s 2024-04-16T16:17:16.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:17:16.823 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-16T16:17:16.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:17.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.067+0000 7fc43a800640 1 Processor -- start 2024-04-16T16:17:17.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.067+0000 7fc43a800640 1 -- start start 2024-04-16T16:17:17.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.068+0000 7fc43a800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4340b80f0 0x7fc434169700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.068+0000 7fc43a800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4340d31f0 con 0x7fc4340ba660 2024-04-16T16:17:17.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.069+0000 7fc43a800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4340d34d0 con 0x7fc43415eab0 2024-04-16T16:17:17.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.069+0000 7fc43a800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc4340d37b0 con 0x7fc4340b80f0 2024-04-16T16:17:17.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.069+0000 7fc438a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc4340ba660 0x7fc4340b79e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38844/0 (socket says 172.21.15.22:38844) 2024-04-16T16:17:17.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.069+0000 7fc438a00640 1 -- 172.21.15.22:0/555651951 learned_addr learned my addr 172.21.15.22:0/555651951 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.069+0000 7fc439e00640 1 --2- 172.21.15.22:0/555651951 >> v2:172.21.15.43:3300/0 conn(0x7fc4340b80f0 0x7fc434169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.069+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257536037 0 0) 0x7fc4340d31f0 con 0x7fc4340ba660 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.069+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc41c003520 con 0x7fc4340ba660 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3418540287 0 0) 0x7fc41c003520 con 0x7fc4340ba660 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 >> v2:172.21.15.43:3300/0 conn(0x7fc4340b80f0 msgr2=0x7fc434169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 --2- 172.21.15.22:0/555651951 >> v2:172.21.15.43:3300/0 conn(0x7fc4340b80f0 0x7fc434169700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 >> v1:172.21.15.43:6789/0 conn(0x7fc43415eab0 legacy=0x7fc4340d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4340d3a90 con 0x7fc4340ba660 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fc420001670 con 0x7fc4340ba660 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 >> v1:172.21.15.22:6789/0 conn(0x7fc4340ba660 legacy=0x7fc4340b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc41c0039b0 0x7fc41c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c004800 0x7fc41c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c0051c0 0x7fc41c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340d37b0 con 0x7fc41c004800 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c00c060 con 0x7fc41c0039b0 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c00c260 con 0x7fc41c0051c0 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.070+0000 7fc438a00640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c004800 0x7fc41c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.071+0000 7fc438a00640 1 -- 172.21.15.22:0/555651951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c0051c0 msgr2=0x7fc41c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.071+0000 7fc438a00640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c0051c0 0x7fc41c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.071+0000 7fc438a00640 1 -- 172.21.15.22:0/555651951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc41c0039b0 msgr2=0x7fc41c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.071+0000 7fc438a00640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc41c0039b0 0x7fc41c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.071+0000 7fc438a00640 1 -- 172.21.15.22:0/555651951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c003520 con 0x7fc41c004800 2024-04-16T16:17:17.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.071+0000 7fc439e00640 1 -- 172.21.15.22:0/555651951 reap_dead start 2024-04-16T16:17:17.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.072+0000 7fc438a00640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c004800 0x7fc41c004c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c210 tx=0x7fc41c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18444795745e8c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:17.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.072+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420007d30 con 0x7fc41c004800 2024-04-16T16:17:17.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.072+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc420030070 con 0x7fc41c004800 2024-04-16T16:17:17.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.072+0000 7fc433e00640 1 -- 172.21.15.22:0/555651951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420005d70 con 0x7fc41c004800 2024-04-16T16:17:17.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.073+0000 7fc43a800640 1 -- 172.21.15.22:0/555651951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c004800 msgr2=0x7fc41c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.073+0000 7fc43a800640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c004800 0x7fc41c004c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c210 tx=0x7fc41c005830 comp rx=0 tx=0).stop 2024-04-16T16:17:17.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.073+0000 7fc43a800640 1 -- 172.21.15.22:0/555651951 shutdown_connections 2024-04-16T16:17:17.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.073+0000 7fc43a800640 1 --2- 172.21.15.22:0/555651951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c004800 0x7fc41c004c80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.073+0000 7fc43a800640 1 -- 172.21.15.22:0/555651951 >> 172.21.15.22:0/555651951 conn(0x7fc434072430 msgr2=0x7fc434072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:17.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.073+0000 7fc43a800640 1 -- 172.21.15.22:0/555651951 shutdown_connections 2024-04-16T16:17:17.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.073+0000 7fc43a800640 1 -- 172.21.15.22:0/555651951 wait complete. 2024-04-16T16:17:17.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.075+0000 7fc43a800640 1 Processor -- start 2024-04-16T16:17:17.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.075+0000 7fc43a800640 1 -- start start 2024-04-16T16:17:17.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.076+0000 7fc43a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c004800 0x7fc434151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.076+0000 7fc43a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc43414f070 0x7fc4340ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.076+0000 7fc43a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4341f8420 0x7fc4340af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.076+0000 7fc43a800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340b86c0 con 0x7fc4341f8420 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.076+0000 7fc43a800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340b8540 con 0x7fc43414f070 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.076+0000 7fc43a800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc4340b79e0 con 0x7fc41c004800 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4341f8420 0x7fc4340af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4341f8420 0x7fc4340af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46206/0 (socket says 172.21.15.22:46206) 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 -- 172.21.15.22:0/3523558168 learned_addr learned my addr 172.21.15.22:0/3523558168 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 -- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c004800 msgr2=0x7fc434151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc438a00640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc43414f070 0x7fc4340ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439400640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c004800 0x7fc434151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c004800 0x7fc434151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 -- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc43414f070 msgr2=0x7fc4340ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc43414f070 0x7fc4340ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 -- 172.21.15.22:0/3523558168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43414bd20 con 0x7fc4341f8420 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439400640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c004800 0x7fc434151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc438a00640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc43414f070 0x7fc4340ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.077+0000 7fc439e00640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4341f8420 0x7fc4340af5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4340cf150 tx=0x7fc42c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.078+0000 7fc431600640 1 -- 172.21.15.22:0/3523558168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00bb10 con 0x7fc4341f8420 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.078+0000 7fc431600640 1 -- 172.21.15.22:0/3523558168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c01a070 con 0x7fc4341f8420 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.078+0000 7fc431600640 1 -- 172.21.15.22:0/3523558168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c014400 con 0x7fc4341f8420 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.078+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43414bfc0 con 0x7fc4341f8420 2024-04-16T16:17:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.078+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43414c580 con 0x7fc4341f8420 2024-04-16T16:17:17.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.079+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc434075f30 con 0x7fc4341f8420 2024-04-16T16:17:17.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.080+0000 7fc431600640 1 -- 172.21.15.22:0/3523558168 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc42c005d10 con 0x7fc4341f8420 2024-04-16T16:17:17.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.081+0000 7fc431600640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc41406c8f0 0x7fc41406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.081+0000 7fc431600640 1 -- 172.21.15.22:0/3523558168 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc42c08bcf0 con 0x7fc4341f8420 2024-04-16T16:17:17.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.081+0000 7fc439400640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc41406c8f0 0x7fc41406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.082+0000 7fc439400640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc41406c8f0 0x7fc41406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc428001670 tx=0x7fc428009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.085+0000 7fc431600640 1 -- 172.21.15.22:0/3523558168 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc42c05a080 con 0x7fc4341f8420 2024-04-16T16:17:17.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.293+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc43414c750 con 0x7fc4341f8420 2024-04-16T16:17:17.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.295+0000 7fc431600640 1 -- 172.21.15.22:0/3523558168 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7fc42c059980 con 0x7fc4341f8420 2024-04-16T16:17:17.295 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:17.295 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.297+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc41406c8f0 msgr2=0x7fc41406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.297+0000 7fc43a800640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc41406c8f0 0x7fc41406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc428001670 tx=0x7fc428009040 comp rx=0 tx=0).stop 2024-04-16T16:17:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.297+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4341f8420 msgr2=0x7fc4340af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.297+0000 7fc43a800640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4341f8420 0x7fc4340af5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4340cf150 tx=0x7fc42c00eec0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 shutdown_connections 2024-04-16T16:17:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc41406c8f0 0x7fc41406edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4341f8420 0x7fc4340af5c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc43414f070 0x7fc4340ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 --2- 172.21.15.22:0/3523558168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc41c004800 0x7fc434151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 >> 172.21.15.22:0/3523558168 conn(0x7fc434072430 msgr2=0x7fc4340cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 shutdown_connections 2024-04-16T16:17:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.298+0000 7fc43a800640 1 -- 172.21.15.22:0/3523558168 wait complete. 2024-04-16T16:17:17.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:17.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:17.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.541+0000 7fdd56600640 1 Processor -- start 2024-04-16T16:17:17.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.541+0000 7fdd56600640 1 -- start start 2024-04-16T16:17:17.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.542+0000 7fdd56600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdd5015eb40 0x7fdd500cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.542+0000 7fdd56600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdd500d35d0 0x7fdd500d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd56600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd500d3ed0 con 0x7fdd500d3a40 2024-04-16T16:17:17.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd56600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fdd500d41b0 con 0x7fdd5015eb40 2024-04-16T16:17:17.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd56600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fdd500d4490 con 0x7fdd500d35d0 2024-04-16T16:17:17.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd55200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdd5015eb40 0x7fdd500cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd55200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdd5015eb40 0x7fdd500cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46208/0 (socket says 172.21.15.22:46208) 2024-04-16T16:17:17.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd55200640 1 -- 172.21.15.22:0/1519467659 learned_addr learned my addr 172.21.15.22:0/1519467659 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:17.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd4fe00640 1 --2- 172.21.15.22:0/1519467659 >> v2:172.21.15.43:3300/0 conn(0x7fdd500d35d0 0x7fdd500d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd55200640 1 -- 172.21.15.22:0/1519467659 >> v2:172.21.15.43:3300/0 conn(0x7fdd500d35d0 msgr2=0x7fdd500d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:17.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd55200640 1 --2- 172.21.15.22:0/1519467659 >> v2:172.21.15.43:3300/0 conn(0x7fdd500d35d0 0x7fdd500d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd55200640 1 -- 172.21.15.22:0/1519467659 >> v1:172.21.15.43:6789/0 conn(0x7fdd500d3a40 legacy=0x7fdd500d47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:17.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.543+0000 7fdd55200640 1 -- 172.21.15.22:0/1519467659 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd500b7d90 con 0x7fdd5015eb40 2024-04-16T16:17:17.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.545+0000 7fdd55200640 1 --2- 172.21.15.22:0/1519467659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd500cfca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdd500d01e0 tx=0x7fdd4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646413313ac14e62 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:17.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.545+0000 7fdd4f400640 1 -- 172.21.15.22:0/1519467659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40035020 con 0x7fdd5015eb40 2024-04-16T16:17:17.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.545+0000 7fdd4f400640 1 -- 172.21.15.22:0/1519467659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd40031870 con 0x7fdd5015eb40 2024-04-16T16:17:17.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.545+0000 7fdd4f400640 1 -- 172.21.15.22:0/1519467659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40031c40 con 0x7fdd5015eb40 2024-04-16T16:17:17.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.545+0000 7fdd56600640 1 -- 172.21.15.22:0/1519467659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 msgr2=0x7fdd500cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.546+0000 7fdd56600640 1 --2- 172.21.15.22:0/1519467659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd500cfca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdd500d01e0 tx=0x7fdd4002b910 comp rx=0 tx=0).stop 2024-04-16T16:17:17.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.546+0000 7fdd56600640 1 -- 172.21.15.22:0/1519467659 shutdown_connections 2024-04-16T16:17:17.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.546+0000 7fdd56600640 1 --2- 172.21.15.22:0/1519467659 >> v2:172.21.15.43:3300/0 conn(0x7fdd500d35d0 0x7fdd500d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.546+0000 7fdd56600640 1 --2- 172.21.15.22:0/1519467659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd500cfca0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.546+0000 7fdd56600640 1 -- 172.21.15.22:0/1519467659 >> 172.21.15.22:0/1519467659 conn(0x7fdd50072460 msgr2=0x7fdd50072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:17.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.546+0000 7fdd56600640 1 -- 172.21.15.22:0/1519467659 shutdown_connections 2024-04-16T16:17:17.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.546+0000 7fdd56600640 1 -- 172.21.15.22:0/1519467659 wait complete. 2024-04-16T16:17:17.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.547+0000 7fdd56600640 1 Processor -- start 2024-04-16T16:17:17.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.548+0000 7fdd56600640 1 -- start start 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd56600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd500d35d0 0x7fdd501f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd56600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd50157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd56600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd501583f0 0x7fdd500c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd56600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500b9440 con 0x7fdd5015eb40 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd56600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500b92c0 con 0x7fdd500d35d0 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd56600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdd500b95c0 con 0x7fdd501583f0 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd50157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd50157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46220/0 (socket says 172.21.15.22:46220) 2024-04-16T16:17:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd4fe00640 1 -- 172.21.15.22:0/998909254 learned_addr learned my addr 172.21.15.22:0/998909254 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd55200640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd500d35d0 0x7fdd501f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd55c00640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd501583f0 0x7fdd500c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd4fe00640 1 -- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd501583f0 msgr2=0x7fdd500c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.549+0000 7fdd4fe00640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd501583f0 0x7fdd500c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd4fe00640 1 -- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd500d35d0 msgr2=0x7fdd501f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd4fe00640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd500d35d0 0x7fdd501f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd4fe00640 1 -- 172.21.15.22:0/998909254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5015ad10 con 0x7fdd5015eb40 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd55200640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd500d35d0 0x7fdd501f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd4fe00640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd50157eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00d5f0 tx=0x7fdd3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd4cc00640 1 -- 172.21.15.22:0/998909254 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0125f0 con 0x7fdd5015eb40 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd4cc00640 1 -- 172.21.15.22:0/998909254 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c019070 con 0x7fdd5015eb40 2024-04-16T16:17:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd4cc00640 1 -- 172.21.15.22:0/998909254 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0129d0 con 0x7fdd5015eb40 2024-04-16T16:17:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd50149280 con 0x7fdd5015eb40 2024-04-16T16:17:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.550+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd500c86e0 con 0x7fdd5015eb40 2024-04-16T16:17:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.551+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd50075f30 con 0x7fdd5015eb40 2024-04-16T16:17:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.552+0000 7fdd4cc00640 1 -- 172.21.15.22:0/998909254 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd3c012b70 con 0x7fdd5015eb40 2024-04-16T16:17:17.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.553+0000 7fdd4cc00640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd3006c8f0 0x7fdd3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:17.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.553+0000 7fdd4cc00640 1 -- 172.21.15.22:0/998909254 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdd3c08bf30 con 0x7fdd5015eb40 2024-04-16T16:17:17.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.554+0000 7fdd55200640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd3006c8f0 0x7fdd3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:17.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.554+0000 7fdd55200640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd3006c8f0 0x7fdd3006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd40036000 tx=0x7fdd40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:17.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.558+0000 7fdd4cc00640 1 -- 172.21.15.22:0/998909254 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd3c05a360 con 0x7fdd5015eb40 2024-04-16T16:17:17.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.766+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd50068f70 con 0x7fdd5015eb40 2024-04-16T16:17:17.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.767+0000 7fdd4cc00640 1 -- 172.21.15.22:0/998909254 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fdd3c059c60 con 0x7fdd5015eb40 2024-04-16T16:17:17.767 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd3006c8f0 msgr2=0x7fdd3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd3006c8f0 0x7fdd3006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd40036000 tx=0x7fdd40008030 comp rx=0 tx=0).stop 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 msgr2=0x7fdd50157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd50157eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00d5f0 tx=0x7fdd3c00dab0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 shutdown_connections 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd3006c8f0 0x7fdd3006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd501583f0 0x7fdd500c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5015eb40 0x7fdd50157eb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 --2- 172.21.15.22:0/998909254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd500d35d0 0x7fdd501f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:17.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 >> 172.21.15.22:0/998909254 conn(0x7fdd50072460 msgr2=0x7fdd500b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 shutdown_connections 2024-04-16T16:17:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:17.770+0000 7fdd56600640 1 -- 172.21.15.22:0/998909254 wait complete. 2024-04-16T16:17:17.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.017+0000 7f38fb200640 1 Processor -- start 2024-04-16T16:17:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.017+0000 7f38fb200640 1 -- start start 2024-04-16T16:17:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.019+0000 7f38fb200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f38fc0b33a0 0x7f38fc070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.019+0000 7f38fb200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38fc0715c0 con 0x7f38fc0b4fa0 2024-04-16T16:17:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.019+0000 7f38fb200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38fc0718a0 con 0x7f38fc15fe30 2024-04-16T16:17:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.019+0000 7f38fb200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f38fc071360 con 0x7f38fc0b33a0 2024-04-16T16:17:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.019+0000 7f38f9e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f38fc0b4fa0 0x7f38fc15f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38860/0 (socket says 172.21.15.22:38860) 2024-04-16T16:17:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.019+0000 7f38f9e00640 1 -- 172.21.15.22:0/2486139967 learned_addr learned my addr 172.21.15.22:0/2486139967 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.020+0000 7f38fa800640 1 --2- 172.21.15.22:0/2486139967 >> v2:172.21.15.22:3300/0 conn(0x7f38fc0b33a0 0x7f38fc070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.020+0000 7f38f9400640 1 -- 172.21.15.22:0/2486139967 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426998023 0 0) 0x7f38fc0715c0 con 0x7f38fc0b4fa0 2024-04-16T16:17:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.020+0000 7f38f9400640 1 -- 172.21.15.22:0/2486139967 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38e0003520 con 0x7f38fc0b4fa0 2024-04-16T16:17:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.020+0000 7f38fa800640 1 -- 172.21.15.22:0/2486139967 >> v1:172.21.15.43:6789/0 conn(0x7f38fc15fe30 legacy=0x7f38fc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.020+0000 7f38fa800640 1 -- 172.21.15.22:0/2486139967 >> v1:172.21.15.22:6789/0 conn(0x7f38fc0b4fa0 legacy=0x7f38fc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.020+0000 7f38fa800640 1 -- 172.21.15.22:0/2486139967 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc071b80 con 0x7f38fc0b33a0 2024-04-16T16:17:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.021+0000 7f38fa800640 1 --2- 172.21.15.22:0/2486139967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc0b33a0 0x7f38fc070e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009d90 tx=0x7f38f402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1000ec91995328a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.022+0000 7f38f9400640 1 -- 172.21.15.22:0/2486139967 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4039070 con 0x7f38fc0b33a0 2024-04-16T16:17:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.022+0000 7f38f9400640 1 -- 172.21.15.22:0/2486139967 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f402ccf0 con 0x7f38fc0b33a0 2024-04-16T16:17:18.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.022+0000 7f38f9400640 1 -- 172.21.15.22:0/2486139967 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4034640 con 0x7f38fc0b33a0 2024-04-16T16:17:18.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.022+0000 7f38fb200640 1 -- 172.21.15.22:0/2486139967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc0b33a0 msgr2=0x7f38fc070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.022+0000 7f38fb200640 1 --2- 172.21.15.22:0/2486139967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc0b33a0 0x7f38fc070e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009d90 tx=0x7f38f402bf40 comp rx=0 tx=0).stop 2024-04-16T16:17:18.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.022+0000 7f38fb200640 1 -- 172.21.15.22:0/2486139967 shutdown_connections 2024-04-16T16:17:18.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.022+0000 7f38fb200640 1 --2- 172.21.15.22:0/2486139967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc0b33a0 0x7f38fc070e20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.023+0000 7f38fb200640 1 -- 172.21.15.22:0/2486139967 >> 172.21.15.22:0/2486139967 conn(0x7f38fc075070 msgr2=0x7f38fc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:18.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.023+0000 7f38fb200640 1 -- 172.21.15.22:0/2486139967 shutdown_connections 2024-04-16T16:17:18.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.023+0000 7f38fb200640 1 -- 172.21.15.22:0/2486139967 wait complete. 2024-04-16T16:17:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.024+0000 7f38fb200640 1 Processor -- start 2024-04-16T16:17:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.024+0000 7f38fb200640 1 -- start start 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.025+0000 7f38fb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38fc0b33a0 0x7f38fc15aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.025+0000 7f38fb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38fc0b4fa0 0x7f38fc0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.025+0000 7f38fb200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc15fe30 0x7f38fc0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.025+0000 7f38fb200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc0b5380 con 0x7f38fc15fe30 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.025+0000 7f38fb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc0ce630 con 0x7f38fc0b4fa0 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.025+0000 7f38fb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc0b5500 con 0x7f38fc0b33a0 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc15fe30 0x7f38fc0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc15fe30 0x7f38fc0cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46244/0 (socket says 172.21.15.22:46244) 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 -- 172.21.15.22:0/3216387235 learned_addr learned my addr 172.21.15.22:0/3216387235 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38f3e00640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38fc0b4fa0 0x7f38fc0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38f9e00640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38fc0b33a0 0x7f38fc15aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 -- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38fc0b33a0 msgr2=0x7f38fc15aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38fc0b33a0 0x7f38fc15aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 -- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38fc0b4fa0 msgr2=0x7f38fc0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38fc0b4fa0 0x7f38fc0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38fa800640 1 -- 172.21.15.22:0/3216387235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc1e73b0 con 0x7f38fc15fe30 2024-04-16T16:17:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.026+0000 7f38f9e00640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38fc0b33a0 0x7f38fc15aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.027+0000 7f38fa800640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc15fe30 0x7f38fc0cffe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38f4037040 tx=0x7f38f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.027+0000 7f38f2000640 1 -- 172.21.15.22:0/3216387235 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4042030 con 0x7f38fc15fe30 2024-04-16T16:17:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.027+0000 7f38f2000640 1 -- 172.21.15.22:0/3216387235 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f403a040 con 0x7f38fc15fe30 2024-04-16T16:17:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.027+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc1e7690 con 0x7f38fc15fe30 2024-04-16T16:17:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.027+0000 7f38f2000640 1 -- 172.21.15.22:0/3216387235 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4039070 con 0x7f38fc15fe30 2024-04-16T16:17:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.027+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc1e7c50 con 0x7f38fc15fe30 2024-04-16T16:17:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.028+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38fc075f30 con 0x7f38fc15fe30 2024-04-16T16:17:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.030+0000 7f38f2000640 1 -- 172.21.15.22:0/3216387235 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38f4045070 con 0x7f38fc15fe30 2024-04-16T16:17:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.030+0000 7f38f2000640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f38d806c8f0 0x7f38d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.031+0000 7f38f2000640 1 -- 172.21.15.22:0/3216387235 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f38f40ada60 con 0x7f38fc15fe30 2024-04-16T16:17:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.031+0000 7f38f9e00640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f38d806c8f0 0x7f38d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.032+0000 7f38f9e00640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f38d806c8f0 0x7f38d806edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0011e0 tx=0x7f38ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.035+0000 7f38f2000640 1 -- 172.21.15.22:0/3216387235 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38f404c070 con 0x7f38fc15fe30 2024-04-16T16:17:18.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.237+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f38fc0b0a80 con 0x7f38fc15fe30 2024-04-16T16:17:18.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.239+0000 7f38f2000640 1 -- 172.21.15.22:0/3216387235 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f38f4045e40 con 0x7f38fc15fe30 2024-04-16T16:17:18.238 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:18.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f38d806c8f0 msgr2=0x7f38d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f38d806c8f0 0x7f38d806edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0011e0 tx=0x7f38ec009040 comp rx=0 tx=0).stop 2024-04-16T16:17:18.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc15fe30 msgr2=0x7f38fc0cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc15fe30 0x7f38fc0cffe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38f4037040 tx=0x7f38f4004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:18.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 shutdown_connections 2024-04-16T16:17:18.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f38d806c8f0 0x7f38d806edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc15fe30 0x7f38fc0cffe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38fc0b4fa0 0x7f38fc0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 --2- 172.21.15.22:0/3216387235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38fc0b33a0 0x7f38fc15aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 >> 172.21.15.22:0/3216387235 conn(0x7f38fc075070 msgr2=0x7f38fc0b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:18.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 shutdown_connections 2024-04-16T16:17:18.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.241+0000 7f38fb200640 1 -- 172.21.15.22:0/3216387235 wait complete. 2024-04-16T16:17:18.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:18.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.492+0000 7f4a94c00640 1 Processor -- start 2024-04-16T16:17:18.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.493+0000 7f4a94c00640 1 -- start start 2024-04-16T16:17:18.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.494+0000 7f4a94c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4a9015db60 0x7f4a900b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.494+0000 7f4a94c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a90073420 con 0x7f4a900b2960 2024-04-16T16:17:18.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.494+0000 7f4a94c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a90072eb0 con 0x7f4a9015c8d0 2024-04-16T16:17:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.494+0000 7f4a94c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4a900b2d90 con 0x7f4a9015db60 2024-04-16T16:17:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.495+0000 7f4a8d400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4a9015db60 0x7f4a900b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.495+0000 7f4a8d400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4a9015db60 0x7f4a900b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46254/0 (socket says 172.21.15.22:46254) 2024-04-16T16:17:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.495+0000 7f4a8d400640 1 -- 172.21.15.22:0/1512575941 learned_addr learned my addr 172.21.15.22:0/1512575941 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.495+0000 7f4a8d400640 1 -- 172.21.15.22:0/1512575941 >> v1:172.21.15.43:6789/0 conn(0x7f4a9015c8d0 legacy=0x7f4a900727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.495+0000 7f4a8d400640 1 -- 172.21.15.22:0/1512575941 >> v1:172.21.15.22:6789/0 conn(0x7f4a900b2960 legacy=0x7f4a90071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.495+0000 7f4a8d400640 1 -- 172.21.15.22:0/1512575941 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a90073140 con 0x7f4a9015db60 2024-04-16T16:17:18.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.496+0000 7f4a8d400640 1 --2- 172.21.15.22:0/1512575941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015db60 0x7f4a900b2420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009870 tx=0x7f4a7c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ac5f6c10aa9ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a8ca00640 1 -- 172.21.15.22:0/1512575941 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c034070 con 0x7f4a9015db60 2024-04-16T16:17:18.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a8ca00640 1 -- 172.21.15.22:0/1512575941 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c030860 con 0x7f4a9015db60 2024-04-16T16:17:18.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a8ca00640 1 -- 172.21.15.22:0/1512575941 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c030c30 con 0x7f4a9015db60 2024-04-16T16:17:18.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a94c00640 1 -- 172.21.15.22:0/1512575941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015db60 msgr2=0x7f4a900b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1512575941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015db60 0x7f4a900b2420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009870 tx=0x7f4a7c02b9a0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a94c00640 1 -- 172.21.15.22:0/1512575941 shutdown_connections 2024-04-16T16:17:18.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1512575941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015db60 0x7f4a900b2420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a94c00640 1 -- 172.21.15.22:0/1512575941 >> 172.21.15.22:0/1512575941 conn(0x7f4a90062440 msgr2=0x7f4a90062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:18.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a94c00640 1 -- 172.21.15.22:0/1512575941 shutdown_connections 2024-04-16T16:17:18.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.497+0000 7f4a94c00640 1 -- 172.21.15.22:0/1512575941 wait complete. 2024-04-16T16:17:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.499+0000 7f4a94c00640 1 Processor -- start 2024-04-16T16:17:18.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.499+0000 7f4a94c00640 1 -- start start 2024-04-16T16:17:18.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.500+0000 7f4a94c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a900b2960 0x7f4a90146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.500+0000 7f4a94c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015c8d0 0x7f4a900b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.500+0000 7f4a94c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a9015db60 0x7f4a900d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.500+0000 7f4a94c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9015d640 con 0x7f4a9015c8d0 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.500+0000 7f4a94c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9015d360 con 0x7f4a9015db60 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.500+0000 7f4a94c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9015ccb0 con 0x7f4a900b2960 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015c8d0 0x7f4a900b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015c8d0 0x7f4a900b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46270/0 (socket says 172.21.15.22:46270) 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 -- 172.21.15.22:0/1428690942 learned_addr learned my addr 172.21.15.22:0/1428690942 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8de00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a900b2960 0x7f4a90146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8e800640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a9015db60 0x7f4a900d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 -- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a900b2960 msgr2=0x7f4a90146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a900b2960 0x7f4a90146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 -- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a9015db60 msgr2=0x7f4a900d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a9015db60 0x7f4a900d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.501+0000 7f4a8d400640 1 -- 172.21.15.22:0/1428690942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a900cefd0 con 0x7f4a9015c8d0 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.502+0000 7f4a8d400640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015c8d0 0x7f4a900b19c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009870 tx=0x7f4a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.502+0000 7f4a86000640 1 -- 172.21.15.22:0/1428690942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c034040 con 0x7f4a9015c8d0 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.502+0000 7f4a86000640 1 -- 172.21.15.22:0/1428690942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c0433f0 con 0x7f4a9015c8d0 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.502+0000 7f4a86000640 1 -- 172.21.15.22:0/1428690942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0437e0 con 0x7f4a9015c8d0 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.502+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a900cf2b0 con 0x7f4a9015c8d0 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.502+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a900cf870 con 0x7f4a9015c8d0 2024-04-16T16:17:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.503+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9004fd90 con 0x7f4a9015c8d0 2024-04-16T16:17:18.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.504+0000 7f4a86000640 1 -- 172.21.15.22:0/1428690942 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a7c04a060 con 0x7f4a9015c8d0 2024-04-16T16:17:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.505+0000 7f4a86000640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4a7006c8f0 0x7f4a7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.505+0000 7f4a86000640 1 -- 172.21.15.22:0/1428690942 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a7c0ade00 con 0x7f4a9015c8d0 2024-04-16T16:17:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.506+0000 7f4a8de00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4a7006c8f0 0x7f4a7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.506+0000 7f4a8de00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4a7006c8f0 0x7f4a7006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a80004f60 tx=0x7f4a80007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.510+0000 7f4a86000640 1 -- 172.21.15.22:0/1428690942 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a7c03e070 con 0x7f4a9015c8d0 2024-04-16T16:17:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.713+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4a9015b120 con 0x7f4a9015c8d0 2024-04-16T16:17:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.714+0000 7f4a86000640 1 -- 172.21.15.22:0/1428690942 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f4a7c07c190 con 0x7f4a9015c8d0 2024-04-16T16:17:18.714 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4a7006c8f0 msgr2=0x7f4a7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4a7006c8f0 0x7f4a7006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a80004f60 tx=0x7f4a80007e30 comp rx=0 tx=0).stop 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015c8d0 msgr2=0x7f4a900b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015c8d0 0x7f4a900b19c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009870 tx=0x7f4a7c0046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 shutdown_connections 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4a7006c8f0 0x7f4a7006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a9015db60 0x7f4a900d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a9015c8d0 0x7f4a900b19c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 --2- 172.21.15.22:0/1428690942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a900b2960 0x7f4a90146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 >> 172.21.15.22:0/1428690942 conn(0x7f4a90062440 msgr2=0x7f4a9006e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:18.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 shutdown_connections 2024-04-16T16:17:18.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.717+0000 7f4a94c00640 1 -- 172.21.15.22:0/1428690942 wait complete. 2024-04-16T16:17:18.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.964+0000 7f3002c00640 1 Processor -- start 2024-04-16T16:17:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.965+0000 7f3002c00640 1 -- start start 2024-04-16T16:17:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.966+0000 7f3002c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0d3dd0 0x7f2ffc0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.966+0000 7f3002c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ffc0cfb70 0x7f2ffc0b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.966+0000 7f3002c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc0b9080 con 0x7f2ffc15ea50 2024-04-16T16:17:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.966+0000 7f3002c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2ffc0b9c90 con 0x7f2ffc0cfb70 2024-04-16T16:17:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.966+0000 7f3002c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2ffc0b9360 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3002200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ffc0cfb70 0x7f2ffc0b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3002200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ffc0cfb70 0x7f2ffc0b7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46280/0 (socket says 172.21.15.22:46280) 2024-04-16T16:17:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3002200640 1 -- 172.21.15.22:0/2557125574 learned_addr learned my addr 172.21.15.22:0/2557125574 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3000e00640 1 --2- 172.21.15.22:0/2557125574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0d3dd0 0x7f2ffc0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3002200640 1 -- 172.21.15.22:0/2557125574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0d3dd0 msgr2=0x7f2ffc0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3002200640 1 --2- 172.21.15.22:0/2557125574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0d3dd0 0x7f2ffc0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3002200640 1 -- 172.21.15.22:0/2557125574 >> v1:172.21.15.43:6789/0 conn(0x7f2ffc15ea50 legacy=0x7f2ffc0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.967+0000 7f3002200640 1 -- 172.21.15.22:0/2557125574 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc0b9640 con 0x7f2ffc0cfb70 2024-04-16T16:17:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.968+0000 7f3002200640 1 --2- 172.21.15.22:0/2557125574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0cfb70 0x7f2ffc0b7a90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009e80 tx=0x7f2ff402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58748e73b697eadd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f2ffbe00640 1 -- 172.21.15.22:0/2557125574 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff402c930 con 0x7f2ffc0cfb70 2024-04-16T16:17:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f2ffbe00640 1 -- 172.21.15.22:0/2557125574 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff402cad0 con 0x7f2ffc0cfb70 2024-04-16T16:17:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f2ffbe00640 1 -- 172.21.15.22:0/2557125574 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40343f0 con 0x7f2ffc0cfb70 2024-04-16T16:17:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f3002c00640 1 -- 172.21.15.22:0/2557125574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0cfb70 msgr2=0x7f2ffc0b7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f3002c00640 1 --2- 172.21.15.22:0/2557125574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0cfb70 0x7f2ffc0b7a90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009e80 tx=0x7f2ff402bd90 comp rx=0 tx=0).stop 2024-04-16T16:17:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f3002c00640 1 -- 172.21.15.22:0/2557125574 shutdown_connections 2024-04-16T16:17:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f3002c00640 1 --2- 172.21.15.22:0/2557125574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0cfb70 0x7f2ffc0b7a90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f3002c00640 1 --2- 172.21.15.22:0/2557125574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0d3dd0 0x7f2ffc0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.969+0000 7f3002c00640 1 -- 172.21.15.22:0/2557125574 >> 172.21.15.22:0/2557125574 conn(0x7f2ffc072430 msgr2=0x7f2ffc072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.970+0000 7f3002c00640 1 -- 172.21.15.22:0/2557125574 shutdown_connections 2024-04-16T16:17:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.970+0000 7f3002c00640 1 -- 172.21.15.22:0/2557125574 wait complete. 2024-04-16T16:17:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.971+0000 7f3002c00640 1 Processor -- start 2024-04-16T16:17:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.971+0000 7f3002c00640 1 -- start start 2024-04-16T16:17:18.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.972+0000 7f3002c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0cfb70 0x7f2ffc0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.972+0000 7f3002c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0d3dd0 0x7f2ffc148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.972+0000 7f3002c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ffc15ea50 0x7f2ffc0d4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.972+0000 7f3002c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc0b7fd0 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.972+0000 7f3002c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc15ee30 con 0x7f2ffc15ea50 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.972+0000 7f3002c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2ffc0b8150 con 0x7f2ffc0cfb70 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0d3dd0 0x7f2ffc148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0d3dd0 0x7f2ffc148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46288/0 (socket says 172.21.15.22:46288) 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 -- 172.21.15.22:0/2556765483 learned_addr learned my addr 172.21.15.22:0/2556765483 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3001800640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0cfb70 0x7f2ffc0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 -- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0cfb70 msgr2=0x7f2ffc0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0cfb70 0x7f2ffc0c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 -- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ffc15ea50 msgr2=0x7f2ffc0d4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3002200640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ffc15ea50 0x7f2ffc0d4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ffc15ea50 0x7f2ffc0d4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.973+0000 7f3000e00640 1 -- 172.21.15.22:0/2556765483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc156c50 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.974+0000 7f3000e00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0d3dd0 0x7f2ffc148b20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800d800 tx=0x7f2fe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.974+0000 7f2ff9600640 1 -- 172.21.15.22:0/2556765483 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800b6c0 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.974+0000 7f2ff9600640 1 -- 172.21.15.22:0/2556765483 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8019070 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.974+0000 7f2ff9600640 1 -- 172.21.15.22:0/2556765483 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800ba80 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.974+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ffc0c8970 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.974+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ffc0c8f20 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.975+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ffc075f30 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.976+0000 7f2ff9600640 1 -- 172.21.15.22:0/2556765483 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fe800bc20 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.977+0000 7f2ff9600640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:18.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.977+0000 7f2ff9600640 1 -- 172.21.15.22:0/2556765483 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2fe808c0e0 con 0x7f2ffc0d3dd0 2024-04-16T16:17:18.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.977+0000 7f3001800640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:18.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.978+0000 7f3001800640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0006fd0 tx=0x7f2ff0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:18.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:18.982+0000 7f2ff9600640 1 -- 172.21.15.22:0/2556765483 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2fe801c360 con 0x7f2ffc0d3dd0 2024-04-16T16:17:19.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.186+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ffc0b8910 con 0x7f2ffc0d3dd0 2024-04-16T16:17:19.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.190+0000 7f2ff9600640 1 -- 172.21.15.22:0/2556765483 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7f2fe805a470 con 0x7f2ffc0d3dd0 2024-04-16T16:17:19.190 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:19.190 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:19.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.192+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2fdc06c8f0 msgr2=0x7f2fdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.192+0000 7f3002c00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0006fd0 tx=0x7f2ff0008040 comp rx=0 tx=0).stop 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.192+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0d3dd0 msgr2=0x7f2ffc148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.192+0000 7f3002c00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0d3dd0 0x7f2ffc148b20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800d800 tx=0x7f2fe800dcc0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 shutdown_connections 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ffc15ea50 0x7f2ffc0d4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ffc0d3dd0 0x7f2ffc148b20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 --2- 172.21.15.22:0/2556765483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ffc0cfb70 0x7f2ffc0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 >> 172.21.15.22:0/2556765483 conn(0x7f2ffc072430 msgr2=0x7f2ffc15cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 shutdown_connections 2024-04-16T16:17:19.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.193+0000 7f3002c00640 1 -- 172.21.15.22:0/2556765483 wait complete. 2024-04-16T16:17:19.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:19.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:19.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.436+0000 7f30ffe00640 1 Processor -- start 2024-04-16T16:17:19.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.437+0000 7f30ffe00640 1 -- start start 2024-04-16T16:17:19.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.438+0000 7f30ffe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3100072680 0x7f310006df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.438+0000 7f30ffe00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3100163170 con 0x7f310015e850 2024-04-16T16:17:19.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.438+0000 7f30ffe00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f310006d4a0 con 0x7f31000b3dc0 2024-04-16T16:17:19.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.438+0000 7f30ffe00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f310006e4c0 con 0x7f3100072680 2024-04-16T16:17:19.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.439+0000 7f30fea00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f310015e850 0x7f31000b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38868/0 (socket says 172.21.15.22:38868) 2024-04-16T16:17:19.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.439+0000 7f30fea00640 1 -- 172.21.15.22:0/4042393091 learned_addr learned my addr 172.21.15.22:0/4042393091 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:19.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.439+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277535100 0 0) 0x7f3100163170 con 0x7f310015e850 2024-04-16T16:17:19.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.439+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e4003520 con 0x7f310015e850 2024-04-16T16:17:19.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30ff400640 1 --2- 172.21.15.22:0/4042393091 >> v2:172.21.15.43:3300/0 conn(0x7f3100072680 0x7f310006df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753935256 0 0) 0x7f30e4003520 con 0x7f310015e850 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 >> v2:172.21.15.43:3300/0 conn(0x7f3100072680 msgr2=0x7f310006df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 --2- 172.21.15.22:0/4042393091 >> v2:172.21.15.43:3300/0 conn(0x7f3100072680 0x7f310006df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 >> v1:172.21.15.43:6789/0 conn(0x7f31000b3dc0 legacy=0x7f3100070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310006d780 con 0x7f310015e850 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f30f0001670 con 0x7f310015e850 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 >> v1:172.21.15.22:6789/0 conn(0x7f310015e850 legacy=0x7f31000b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f30e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4004800 0x7f30e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e40052e0 0x7f30e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f310006e4c0 con 0x7f30e4003a00 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30e400c230 con 0x7f30e4004800 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f30e400c430 con 0x7f30e40052e0 2024-04-16T16:17:19.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30ff400640 1 --2- 172.21.15.22:0/4042393091 >> v2:172.21.15.43:3300/0 conn(0x7f3100072680 0x7f310006df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.440+0000 7f30fea00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f30e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30ff400640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e40052e0 0x7f30e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30fea00640 1 -- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e40052e0 msgr2=0x7f30e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30f7e00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4004800 0x7f30e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30fea00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e40052e0 0x7f30e400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30fea00640 1 -- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4004800 msgr2=0x7f30e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30fea00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4004800 0x7f30e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30ff400640 1 -- 172.21.15.22:0/4042393091 reap_dead start 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30fea00640 1 -- 172.21.15.22:0/4042393091 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e4003520 con 0x7f30e4003a00 2024-04-16T16:17:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.441+0000 7f30f7e00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4004800 0x7f30e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:19.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.442+0000 7f30fea00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f30e4003e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c0e0 tx=0x7f30e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57a1d26123a3a09 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:19.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.442+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0007c40 con 0x7f30e4003a00 2024-04-16T16:17:19.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.442+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0030070 con 0x7f30e4003a00 2024-04-16T16:17:19.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.442+0000 7f30fe000640 1 -- 172.21.15.22:0/4042393091 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0005d70 con 0x7f30e4003a00 2024-04-16T16:17:19.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.443+0000 7f30ffe00640 1 -- 172.21.15.22:0/4042393091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 msgr2=0x7f30e4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.443+0000 7f30ffe00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f30e4003e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c0e0 tx=0x7f30e4005830 comp rx=0 tx=0).stop 2024-04-16T16:17:19.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.443+0000 7f30ffe00640 1 -- 172.21.15.22:0/4042393091 shutdown_connections 2024-04-16T16:17:19.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.443+0000 7f30ffe00640 1 --2- 172.21.15.22:0/4042393091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f30e4003e00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.443+0000 7f30ffe00640 1 -- 172.21.15.22:0/4042393091 >> 172.21.15.22:0/4042393091 conn(0x7f3100062440 msgr2=0x7f3100062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:19.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.443+0000 7f30ffe00640 1 -- 172.21.15.22:0/4042393091 shutdown_connections 2024-04-16T16:17:19.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.443+0000 7f30ffe00640 1 -- 172.21.15.22:0/4042393091 wait complete. 2024-04-16T16:17:19.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.445+0000 7f30ffe00640 1 Processor -- start 2024-04-16T16:17:19.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.445+0000 7f30ffe00640 1 -- start start 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30ffe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f31001e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30ffe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3100154310 0x7f3100156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30ffe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31001439d0 0x7f3100143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30ffe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3100162e10 con 0x7f30e4003a00 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30ffe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f310015ec30 con 0x7f31001439d0 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30ffe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3100072d60 con 0x7f3100154310 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30fea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f31001e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30fea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f31001e8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46306/0 (socket says 172.21.15.22:46306) 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.446+0000 7f30fea00640 1 -- 172.21.15.22:0/3644742130 learned_addr learned my addr 172.21.15.22:0/3644742130 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30f7e00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3100154310 0x7f3100156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30fea00640 1 -- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3100154310 msgr2=0x7f3100156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30fea00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3100154310 0x7f3100156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30fea00640 1 -- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31001439d0 msgr2=0x7f3100143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30ff400640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31001439d0 0x7f3100143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30fea00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31001439d0 0x7f3100143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30fea00640 1 -- 172.21.15.22:0/3644742130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31001443c0 con 0x7f30e4003a00 2024-04-16T16:17:19.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.447+0000 7f30fea00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f31001e8270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f30f002c440 tx=0x7f310006d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.448+0000 7f30f7400640 1 -- 172.21.15.22:0/3644742130 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0046070 con 0x7f30e4003a00 2024-04-16T16:17:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.448+0000 7f30f7400640 1 -- 172.21.15.22:0/3644742130 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f002cbe0 con 0x7f30e4003a00 2024-04-16T16:17:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.448+0000 7f30f7400640 1 -- 172.21.15.22:0/3644742130 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0001b80 con 0x7f30e4003a00 2024-04-16T16:17:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.448+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31001e8bc0 con 0x7f30e4003a00 2024-04-16T16:17:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.448+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31001e9180 con 0x7f30e4003a00 2024-04-16T16:17:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.449+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3100075f30 con 0x7f30e4003a00 2024-04-16T16:17:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.450+0000 7f30f7400640 1 -- 172.21.15.22:0/3644742130 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30f0007070 con 0x7f30e4003a00 2024-04-16T16:17:19.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.451+0000 7f30f7400640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30dc06c8f0 0x7f30dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.451+0000 7f30f7400640 1 -- 172.21.15.22:0/3644742130 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f30f00ad1e0 con 0x7f30e4003a00 2024-04-16T16:17:19.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.451+0000 7f30f7e00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30dc06c8f0 0x7f30dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.452+0000 7f30f7e00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30dc06c8f0 0x7f30dc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f310015ddb0 tx=0x7f30e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:19.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.456+0000 7f30f7400640 1 -- 172.21.15.22:0/3644742130 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30f007b570 con 0x7f30e4003a00 2024-04-16T16:17:19.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.660+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3100072250 con 0x7f30e4003a00 2024-04-16T16:17:19.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.661+0000 7f30f7400640 1 -- 172.21.15.22:0/3644742130 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f30f007ae70 con 0x7f30e4003a00 2024-04-16T16:17:19.662 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:19.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30dc06c8f0 msgr2=0x7f30dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30dc06c8f0 0x7f30dc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f310015ddb0 tx=0x7f30e8009040 comp rx=0 tx=0).stop 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 msgr2=0x7f31001e8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f31001e8270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f30f002c440 tx=0x7f310006d670 comp rx=0 tx=0).stop 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 shutdown_connections 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30dc06c8f0 0x7f30dc06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31001439d0 0x7f3100143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3100154310 0x7f3100156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 --2- 172.21.15.22:0/3644742130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4003a00 0x7f31001e8270 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.664+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 >> 172.21.15.22:0/3644742130 conn(0x7f3100062440 msgr2=0x7f31000b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.665+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 shutdown_connections 2024-04-16T16:17:19.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.665+0000 7f30ffe00640 1 -- 172.21.15.22:0/3644742130 wait complete. 2024-04-16T16:17:19.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.911+0000 7fd5ff000640 1 Processor -- start 2024-04-16T16:17:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.911+0000 7fd5ff000640 1 -- start start 2024-04-16T16:17:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.913+0000 7fd5ff000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5f815db60 0x7fd5f80b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.913+0000 7fd5ff000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f8073420 con 0x7fd5f80b2960 2024-04-16T16:17:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.913+0000 7fd5ff000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f8072eb0 con 0x7fd5f815c8d0 2024-04-16T16:17:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.913+0000 7fd5ff000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f80b2d90 con 0x7fd5f815db60 2024-04-16T16:17:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.913+0000 7fd5f7400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5f815db60 0x7fd5f80b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.913+0000 7fd5f7400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5f815db60 0x7fd5f80b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35896/0 (socket says 172.21.15.22:35896) 2024-04-16T16:17:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.913+0000 7fd5f7400640 1 -- 172.21.15.22:0/2886919177 learned_addr learned my addr 172.21.15.22:0/2886919177 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.914+0000 7fd5f7400640 1 -- 172.21.15.22:0/2886919177 >> v1:172.21.15.43:6789/0 conn(0x7fd5f815c8d0 legacy=0x7fd5f80727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.914+0000 7fd5f7400640 1 -- 172.21.15.22:0/2886919177 >> v1:172.21.15.22:6789/0 conn(0x7fd5f80b2960 legacy=0x7fd5f8071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.914+0000 7fd5f7400640 1 -- 172.21.15.22:0/2886919177 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f8073140 con 0x7fd5f815db60 2024-04-16T16:17:19.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.915+0000 7fd5f7400640 1 --2- 172.21.15.22:0/2886919177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b2420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009870 tx=0x7fd5e402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbd2db75b190d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:19.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.915+0000 7fd5f6a00640 1 -- 172.21.15.22:0/2886919177 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e402f840 con 0x7fd5f815db60 2024-04-16T16:17:19.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5f6a00640 1 -- 172.21.15.22:0/2886919177 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e402f9e0 con 0x7fd5f815db60 2024-04-16T16:17:19.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5f6a00640 1 -- 172.21.15.22:0/2886919177 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e402fdb0 con 0x7fd5f815db60 2024-04-16T16:17:19.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5ff000640 1 -- 172.21.15.22:0/2886919177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 msgr2=0x7fd5f80b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5ff000640 1 --2- 172.21.15.22:0/2886919177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b2420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009870 tx=0x7fd5e402ba20 comp rx=0 tx=0).stop 2024-04-16T16:17:19.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5ff000640 1 -- 172.21.15.22:0/2886919177 shutdown_connections 2024-04-16T16:17:19.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5ff000640 1 --2- 172.21.15.22:0/2886919177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b2420 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5ff000640 1 -- 172.21.15.22:0/2886919177 >> 172.21.15.22:0/2886919177 conn(0x7fd5f8062440 msgr2=0x7fd5f8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:19.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5ff000640 1 -- 172.21.15.22:0/2886919177 shutdown_connections 2024-04-16T16:17:19.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.916+0000 7fd5ff000640 1 -- 172.21.15.22:0/2886919177 wait complete. 2024-04-16T16:17:19.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.918+0000 7fd5ff000640 1 Processor -- start 2024-04-16T16:17:19.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.918+0000 7fd5ff000640 1 -- start start 2024-04-16T16:17:19.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.919+0000 7fd5ff000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f80b2960 0x7fd5f80aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.919+0000 7fd5ff000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f815c8d0 0x7fd5f80b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.919+0000 7fd5ff000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.919+0000 7fd5ff000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f815d640 con 0x7fd5f815db60 2024-04-16T16:17:19.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.919+0000 7fd5ff000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f815d360 con 0x7fd5f80b2960 2024-04-16T16:17:19.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.919+0000 7fd5ff000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f815ccb0 con 0x7fd5f815c8d0 2024-04-16T16:17:19.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35912/0 (socket says 172.21.15.22:35912) 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 -- 172.21.15.22:0/3385393325 learned_addr learned my addr 172.21.15.22:0/3385393325 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5f7400640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f815c8d0 0x7fd5f80b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5f7e00640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f80b2960 0x7fd5f80aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 -- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f815c8d0 msgr2=0x7fd5f80b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f815c8d0 0x7fd5f80b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 -- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f80b2960 msgr2=0x7fd5f80aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f80b2960 0x7fd5f80aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.920+0000 7fd5fd000640 1 -- 172.21.15.22:0/3385393325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f814d3e0 con 0x7fd5f815db60 2024-04-16T16:17:19.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.921+0000 7fd5fd000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b40d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c7d0 tx=0x7fd5f000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:19.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.921+0000 7fd5efe00640 1 -- 172.21.15.22:0/3385393325 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0003b70 con 0x7fd5f815db60 2024-04-16T16:17:19.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.921+0000 7fd5efe00640 1 -- 172.21.15.22:0/3385393325 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0003d30 con 0x7fd5f815db60 2024-04-16T16:17:19.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.921+0000 7fd5efe00640 1 -- 172.21.15.22:0/3385393325 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000aa90 con 0x7fd5f815db60 2024-04-16T16:17:19.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.921+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f814d6c0 con 0x7fd5f815db60 2024-04-16T16:17:19.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.921+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f814dc80 con 0x7fd5f815db60 2024-04-16T16:17:19.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.923+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f804fd90 con 0x7fd5f815db60 2024-04-16T16:17:19.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.923+0000 7fd5efe00640 1 -- 172.21.15.22:0/3385393325 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5f000ac30 con 0x7fd5f815db60 2024-04-16T16:17:19.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.924+0000 7fd5efe00640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d806c8f0 0x7fd5d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:19.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.925+0000 7fd5efe00640 1 -- 172.21.15.22:0/3385393325 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5f008bb40 con 0x7fd5f815db60 2024-04-16T16:17:19.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.925+0000 7fd5f7e00640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d806c8f0 0x7fd5d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:19.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.925+0000 7fd5f7e00640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d806c8f0 0x7fd5d806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000f60 tx=0x7fd5e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:19.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:19.931+0000 7fd5efe00640 1 -- 172.21.15.22:0/3385393325 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5f0059ee0 con 0x7fd5f815db60 2024-04-16T16:17:20.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.136+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd5f80af480 con 0x7fd5f815db60 2024-04-16T16:17:20.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.137+0000 7fd5efe00640 1 -- 172.21.15.22:0/3385393325 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fd5f00597e0 con 0x7fd5f815db60 2024-04-16T16:17:20.137 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.139+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d806c8f0 msgr2=0x7fd5d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.139+0000 7fd5ff000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d806c8f0 0x7fd5d806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000f60 tx=0x7fd5e8009040 comp rx=0 tx=0).stop 2024-04-16T16:17:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.139+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 msgr2=0x7fd5f80b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.139+0000 7fd5ff000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b40d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c7d0 tx=0x7fd5f000cc90 comp rx=0 tx=0).stop 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 shutdown_connections 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd5d806c8f0 0x7fd5d806edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5f815db60 0x7fd5f80b40d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5f815c8d0 0x7fd5f80b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 --2- 172.21.15.22:0/3385393325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f80b2960 0x7fd5f80aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 >> 172.21.15.22:0/3385393325 conn(0x7fd5f8062440 msgr2=0x7fd5f806d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 shutdown_connections 2024-04-16T16:17:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.140+0000 7fd5ff000640 1 -- 172.21.15.22:0/3385393325 wait complete. 2024-04-16T16:17:20.160 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:20.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.372+0000 7feff3c00640 1 Processor -- start 2024-04-16T16:17:20.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.372+0000 7feff3c00640 1 -- start start 2024-04-16T16:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.373+0000 7feff3c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefec15db60 0x7fefec0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.373+0000 7feff3c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fefec0b2960 0x7fefec071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7feff3c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefec073420 con 0x7fefec15c8d0 2024-04-16T16:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7feff3c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fefec0b2db0 con 0x7fefec0b2960 2024-04-16T16:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7feff3c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fefec072eb0 con 0x7fefec15db60 2024-04-16T16:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7feff1200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fefec15c8d0 0x7fefec0727a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38642/0 (socket says 172.21.15.22:38642) 2024-04-16T16:17:20.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7feff1200640 1 -- 172.21.15.22:0/152387466 learned_addr learned my addr 172.21.15.22:0/152387466 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7fefebe00640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefec15db60 0x7fefec0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844972008 0 0) 0x7fefec073420 con 0x7fefec15c8d0 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7feff1c00640 1 --2- 172.21.15.22:0/152387466 >> v2:172.21.15.43:3300/0 conn(0x7fefec0b2960 0x7fefec071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.374+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd0003520 con 0x7fefec15c8d0 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1647397839 0 0) 0x7fefd0003520 con 0x7fefec15c8d0 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefec15db60 msgr2=0x7fefec0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefec15db60 0x7fefec0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 >> v2:172.21.15.43:3300/0 conn(0x7fefec0b2960 msgr2=0x7fefec071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 --2- 172.21.15.22:0/152387466 >> v2:172.21.15.43:3300/0 conn(0x7fefec0b2960 0x7fefec071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec073140 con 0x7fefec15c8d0 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fefdc001670 con 0x7fefec15c8d0 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 >> v1:172.21.15.22:6789/0 conn(0x7fefec15c8d0 legacy=0x7fefec0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefd00039b0 0x7fefd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0004800 0x7fefd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefec15db60 0x7fefd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fefec0b2db0 con 0x7fefd0004800 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fefec072eb0 con 0x7fefd00039b0 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fefd000baa0 con 0x7fefec15db60 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.375+0000 7fefebe00640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0004800 0x7fefd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.376+0000 7feff1200640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefd00039b0 0x7fefd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.376+0000 7fefebe00640 1 -- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefec15db60 msgr2=0x7fefd00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.376+0000 7fefebe00640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefec15db60 0x7fefd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.376+0000 7fefebe00640 1 -- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefd00039b0 msgr2=0x7fefd0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.376+0000 7fefebe00640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefd00039b0 0x7fefd0003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.376+0000 7fefebe00640 1 -- 172.21.15.22:0/152387466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd0003520 con 0x7fefd0004800 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.377+0000 7fefebe00640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0004800 0x7fefd0004c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fefd400ba00 tx=0x7fefd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365138994371a3e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.377+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd4036020 con 0x7fefd0004800 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.377+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd4032630 con 0x7fefd0004800 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.377+0000 7fefeb400640 1 -- 172.21.15.22:0/152387466 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd400b600 con 0x7fefd0004800 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.378+0000 7feff3c00640 1 -- 172.21.15.22:0/152387466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0004800 msgr2=0x7fefd0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.378+0000 7feff3c00640 1 --2- 172.21.15.22:0/152387466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0004800 0x7fefd0004c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fefd400ba00 tx=0x7fefd0005830 comp rx=0 tx=0).stop 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.378+0000 7feff1c00640 1 -- 172.21.15.22:0/152387466 reap_dead start 2024-04-16T16:17:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.378+0000 7feff3c00640 1 -- 172.21.15.22:0/152387466 shutdown_connections 2024-04-16T16:17:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.378+0000 7feff3c00640 1 -- 172.21.15.22:0/152387466 >> 172.21.15.22:0/152387466 conn(0x7fefec062440 msgr2=0x7fefec062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.378+0000 7feff3c00640 1 -- 172.21.15.22:0/152387466 shutdown_connections 2024-04-16T16:17:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.378+0000 7feff3c00640 1 -- 172.21.15.22:0/152387466 wait complete. 2024-04-16T16:17:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.380+0000 7feff3c00640 1 Processor -- start 2024-04-16T16:17:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.380+0000 7feff3c00640 1 -- start start 2024-04-16T16:17:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff3c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefd0004800 0x7fefec148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff3c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefec150fe0 0x7fefec14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff3c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefec14cce0 0x7fefec14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff3c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fefec15d640 con 0x7fefec14cce0 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff3c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fefec15d360 con 0x7fefec150fe0 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff3c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fefec15ccb0 con 0x7fefd0004800 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefec14cce0 0x7fefec14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefec14cce0 0x7fefec14e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35936/0 (socket says 172.21.15.22:35936) 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 -- 172.21.15.22:0/1122157892 learned_addr learned my addr 172.21.15.22:0/1122157892 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1200640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefd0004800 0x7fefec148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7fefebe00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefec150fe0 0x7fefec14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 -- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefd0004800 msgr2=0x7fefec148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefd0004800 0x7fefec148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 -- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefec150fe0 msgr2=0x7fefec14c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefec150fe0 0x7fefec14c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.381+0000 7feff1c00640 1 -- 172.21.15.22:0/1122157892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec14d160 con 0x7fefec14cce0 2024-04-16T16:17:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.382+0000 7feff1c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefec14cce0 0x7fefec14e200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefec0d0170 tx=0x7fefe400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.382+0000 7fefe8c00640 1 -- 172.21.15.22:0/1122157892 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe400ed90 con 0x7fefec14cce0 2024-04-16T16:17:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.382+0000 7fefe8c00640 1 -- 172.21.15.22:0/1122157892 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe4019070 con 0x7fefec14cce0 2024-04-16T16:17:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.382+0000 7fefe8c00640 1 -- 172.21.15.22:0/1122157892 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4014660 con 0x7fefec14cce0 2024-04-16T16:17:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.382+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec14d440 con 0x7fefec14cce0 2024-04-16T16:17:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.382+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec14da00 con 0x7fefec14cce0 2024-04-16T16:17:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.383+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefec069450 con 0x7fefec14cce0 2024-04-16T16:17:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.384+0000 7fefe8c00640 1 -- 172.21.15.22:0/1122157892 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefe4014800 con 0x7fefec14cce0 2024-04-16T16:17:20.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.385+0000 7fefe8c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fefc806c8f0 0x7fefc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.385+0000 7fefe8c00640 1 -- 172.21.15.22:0/1122157892 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fefe408c070 con 0x7fefec14cce0 2024-04-16T16:17:20.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.386+0000 7feff1200640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fefc806c8f0 0x7fefc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.386+0000 7feff1200640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fefc806c8f0 0x7fefc806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefec1f8030 tx=0x7fefdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.390+0000 7fefe8c00640 1 -- 172.21.15.22:0/1122157892 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fefec069450 con 0x7fefec14cce0 2024-04-16T16:17:20.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.595+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fefec04fd90 con 0x7fefec14cce0 2024-04-16T16:17:20.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.596+0000 7fefe8c00640 1 -- 172.21.15.22:0/1122157892 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fefe405a400 con 0x7fefec14cce0 2024-04-16T16:17:20.596 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fefc806c8f0 msgr2=0x7fefc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fefc806c8f0 0x7fefc806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefec1f8030 tx=0x7fefdc009040 comp rx=0 tx=0).stop 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefec14cce0 msgr2=0x7fefec14e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefec14cce0 0x7fefec14e200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefec0d0170 tx=0x7fefe400e4b0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 shutdown_connections 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fefc806c8f0 0x7fefc806edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefec14cce0 0x7fefec14e200 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefec150fe0 0x7fefec14c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 --2- 172.21.15.22:0/1122157892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefd0004800 0x7fefec148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 >> 172.21.15.22:0/1122157892 conn(0x7fefec062440 msgr2=0x7fefec14f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:20.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 shutdown_connections 2024-04-16T16:17:20.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.599+0000 7feff3c00640 1 -- 172.21.15.22:0/1122157892 wait complete. 2024-04-16T16:17:20.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.841+0000 7f4223e00640 1 Processor -- start 2024-04-16T16:17:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.842+0000 7f4223e00640 1 -- start start 2024-04-16T16:17:20.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.843+0000 7f4223e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f422406ee80 0x7f422415c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.843+0000 7f4223e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f422406d160 con 0x7f42240cc810 2024-04-16T16:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.844+0000 7f4223e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f422406d440 con 0x7f422406eaa0 2024-04-16T16:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.844+0000 7f4223e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f422406cf10 con 0x7f422406ee80 2024-04-16T16:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.844+0000 7f4222000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f42240cc810 0x7f422406df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38650/0 (socket says 172.21.15.22:38650) 2024-04-16T16:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.844+0000 7f4222000640 1 -- 172.21.15.22:0/1475008980 learned_addr learned my addr 172.21.15.22:0/1475008980 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:20.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.844+0000 7f4223400640 1 --2- 172.21.15.22:0/1475008980 >> v2:172.21.15.22:3300/0 conn(0x7f422406ee80 0x7f422415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.844+0000 7f4221600640 1 -- 172.21.15.22:0/1475008980 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390890438 0 0) 0x7f422406d160 con 0x7f42240cc810 2024-04-16T16:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.844+0000 7f4221600640 1 -- 172.21.15.22:0/1475008980 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4208003520 con 0x7f42240cc810 2024-04-16T16:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.845+0000 7f4223400640 1 -- 172.21.15.22:0/1475008980 >> v1:172.21.15.43:6789/0 conn(0x7f422406eaa0 legacy=0x7f42240b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.845+0000 7f4223400640 1 -- 172.21.15.22:0/1475008980 >> v1:172.21.15.22:6789/0 conn(0x7f42240cc810 legacy=0x7f422406df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.845+0000 7f4223400640 1 -- 172.21.15.22:0/1475008980 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422406d720 con 0x7f422406ee80 2024-04-16T16:17:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.846+0000 7f4223400640 1 --2- 172.21.15.22:0/1475008980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422406ee80 0x7f422415c200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f421c0097d0 tx=0x7f421c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e243f2182ca2dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.846+0000 7f4221600640 1 -- 172.21.15.22:0/1475008980 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c034070 con 0x7f422406ee80 2024-04-16T16:17:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.846+0000 7f4221600640 1 -- 172.21.15.22:0/1475008980 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c030800 con 0x7f422406ee80 2024-04-16T16:17:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.846+0000 7f4221600640 1 -- 172.21.15.22:0/1475008980 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c030bb0 con 0x7f422406ee80 2024-04-16T16:17:20.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.847+0000 7f4223e00640 1 -- 172.21.15.22:0/1475008980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422406ee80 msgr2=0x7f422415c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.847+0000 7f4223e00640 1 --2- 172.21.15.22:0/1475008980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422406ee80 0x7f422415c200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f421c0097d0 tx=0x7f421c02b940 comp rx=0 tx=0).stop 2024-04-16T16:17:20.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.847+0000 7f4223e00640 1 -- 172.21.15.22:0/1475008980 shutdown_connections 2024-04-16T16:17:20.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.847+0000 7f4223e00640 1 --2- 172.21.15.22:0/1475008980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f422406ee80 0x7f422415c200 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.847+0000 7f4223e00640 1 -- 172.21.15.22:0/1475008980 >> 172.21.15.22:0/1475008980 conn(0x7f4224062440 msgr2=0x7f4224062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:20.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.847+0000 7f4223e00640 1 -- 172.21.15.22:0/1475008980 shutdown_connections 2024-04-16T16:17:20.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.847+0000 7f4223e00640 1 -- 172.21.15.22:0/1475008980 wait complete. 2024-04-16T16:17:20.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.849+0000 7f4223e00640 1 Processor -- start 2024-04-16T16:17:20.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.850+0000 7f4223e00640 1 -- start start 2024-04-16T16:17:20.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f422406eaa0 0x7f42241519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f422406ee80 0x7f42240c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42240cc810 0x7f4224154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f422415c8c0 con 0x7f42240cc810 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f422415c740 con 0x7f422406ee80 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f422415ca40 con 0x7f422406eaa0 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42240cc810 0x7f4224154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42240cc810 0x7f4224154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35964/0 (socket says 172.21.15.22:35964) 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.851+0000 7f4223400640 1 -- 172.21.15.22:0/2757863077 learned_addr learned my addr 172.21.15.22:0/2757863077 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4222000640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f422406ee80 0x7f42240c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4222a00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f422406eaa0 0x7f42241519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4223400640 1 -- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f422406eaa0 msgr2=0x7f42241519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4223400640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f422406eaa0 0x7f42241519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4223400640 1 -- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f422406ee80 msgr2=0x7f42240c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4223400640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f422406ee80 0x7f42240c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:20.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4223400640 1 -- 172.21.15.22:0/2757863077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4224153c50 con 0x7f42240cc810 2024-04-16T16:17:20.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4222000640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f422406ee80 0x7f42240c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:20.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4222a00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f422406eaa0 0x7f42241519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:20.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.852+0000 7f4223400640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42240cc810 0x7f4224154130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f421c0097d0 tx=0x7f421c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:20.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.853+0000 7f421aa00640 1 -- 172.21.15.22:0/2757863077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c034040 con 0x7f42240cc810 2024-04-16T16:17:20.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.853+0000 7f421aa00640 1 -- 172.21.15.22:0/2757863077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c030600 con 0x7f42240cc810 2024-04-16T16:17:20.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.853+0000 7f421aa00640 1 -- 172.21.15.22:0/2757863077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c006e10 con 0x7f42240cc810 2024-04-16T16:17:20.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.853+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42240c7c50 con 0x7f42240cc810 2024-04-16T16:17:20.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.853+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42240c7690 con 0x7f42240cc810 2024-04-16T16:17:20.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.854+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4224075f30 con 0x7f42240cc810 2024-04-16T16:17:20.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.855+0000 7f421aa00640 1 -- 172.21.15.22:0/2757863077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f421c037070 con 0x7f42240cc810 2024-04-16T16:17:20.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.856+0000 7f421aa00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f420406c940 0x7f420406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.856+0000 7f421aa00640 1 -- 172.21.15.22:0/2757863077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f421c0ad740 con 0x7f42240cc810 2024-04-16T16:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.856+0000 7f4222a00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f420406c940 0x7f420406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:20.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.857+0000 7f4222a00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f420406c940 0x7f420406ee00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42241552b0 tx=0x7f4214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:20.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:20.860+0000 7f421aa00640 1 -- 172.21.15.22:0/2757863077 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f421c07bd00 con 0x7f42240cc810 2024-04-16T16:17:21.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.065+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42240b4b70 con 0x7f42240cc810 2024-04-16T16:17:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.068+0000 7f421aa00640 1 -- 172.21.15.22:0/2757863077 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7f421c07b600 con 0x7f42240cc810 2024-04-16T16:17:21.068 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:21.068 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f420406c940 msgr2=0x7f420406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f420406c940 0x7f420406ee00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42241552b0 tx=0x7f4214009040 comp rx=0 tx=0).stop 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42240cc810 msgr2=0x7f4224154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42240cc810 0x7f4224154130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f421c0097d0 tx=0x7f421c0046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 shutdown_connections 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f420406c940 0x7f420406ee00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42240cc810 0x7f4224154130 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f422406ee80 0x7f42240c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 --2- 172.21.15.22:0/2757863077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f422406eaa0 0x7f42241519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 >> 172.21.15.22:0/2757863077 conn(0x7f4224062440 msgr2=0x7f42240b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 shutdown_connections 2024-04-16T16:17:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.071+0000 7f4223e00640 1 -- 172.21.15.22:0/2757863077 wait complete. 2024-04-16T16:17:21.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:21.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.318+0000 7fadf8e00640 1 Processor -- start 2024-04-16T16:17:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.318+0000 7fadf8e00640 1 -- start start 2024-04-16T16:17:21.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.320+0000 7fadf8e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.320+0000 7fadf8e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fadf40d0a90 0x7fadf40722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.320+0000 7fadf8e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf4161160 con 0x7fadf406e740 2024-04-16T16:17:21.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.320+0000 7fadf8e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fadf40d0170 con 0x7fadf40d0a90 2024-04-16T16:17:21.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.320+0000 7fadf8e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fadf4160270 con 0x7fadf41538d0 2024-04-16T16:17:21.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.321+0000 7fadf3e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fadf40d0a90 0x7fadf40722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.321+0000 7fadf2a00640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fadf406e740 0x7fadf40d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:40624/0 (socket says 172.21.15.22:40624) 2024-04-16T16:17:21.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.321+0000 7fadf3400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.321+0000 7fadf2a00640 1 -- 172.21.15.22:0/3277983955 learned_addr learned my addr 172.21.15.22:0/3277983955 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:21.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.322+0000 7fadf2000640 1 -- 172.21.15.22:0/3277983955 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146976898 0 0) 0x7fadf4161160 con 0x7fadf406e740 2024-04-16T16:17:21.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.322+0000 7fadf2000640 1 -- 172.21.15.22:0/3277983955 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd4003520 con 0x7fadf406e740 2024-04-16T16:17:21.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.322+0000 7fadf3e00640 1 -- 172.21.15.22:0/3277983955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 msgr2=0x7fadf406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:21.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.322+0000 7fadf3e00640 1 --2- 172.21.15.22:0/3277983955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf406ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.322+0000 7fadf3e00640 1 -- 172.21.15.22:0/3277983955 >> v1:172.21.15.43:6789/0 conn(0x7fadf406e740 legacy=0x7fadf40d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.322+0000 7fadf3e00640 1 -- 172.21.15.22:0/3277983955 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf4160550 con 0x7fadf40d0a90 2024-04-16T16:17:21.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.324+0000 7fadf3e00640 1 --2- 172.21.15.22:0/3277983955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf40d0a90 0x7fadf40722b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadec0097a0 tx=0x7fadec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=860b356d7b96cf31 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:21.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.324+0000 7fadf2000640 1 -- 172.21.15.22:0/3277983955 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec035020 con 0x7fadf40d0a90 2024-04-16T16:17:21.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.324+0000 7fadf2000640 1 -- 172.21.15.22:0/3277983955 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec031830 con 0x7fadf40d0a90 2024-04-16T16:17:21.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.324+0000 7fadf2000640 1 -- 172.21.15.22:0/3277983955 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec031c00 con 0x7fadf40d0a90 2024-04-16T16:17:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 -- 172.21.15.22:0/3277983955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf40d0a90 msgr2=0x7fadf40722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 --2- 172.21.15.22:0/3277983955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf40d0a90 0x7fadf40722b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadec0097a0 tx=0x7fadec02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 -- 172.21.15.22:0/3277983955 shutdown_connections 2024-04-16T16:17:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 --2- 172.21.15.22:0/3277983955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf40d0a90 0x7fadf40722b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 --2- 172.21.15.22:0/3277983955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 -- 172.21.15.22:0/3277983955 >> 172.21.15.22:0/3277983955 conn(0x7fadf4062440 msgr2=0x7fadf4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 -- 172.21.15.22:0/3277983955 shutdown_connections 2024-04-16T16:17:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.325+0000 7fadf8e00640 1 -- 172.21.15.22:0/3277983955 wait complete. 2024-04-16T16:17:21.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.327+0000 7fadf8e00640 1 Processor -- start 2024-04-16T16:17:21.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.327+0000 7fadf8e00640 1 -- start start 2024-04-16T16:17:21.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.328+0000 7fadf8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf406e740 0x7fadf4152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.328+0000 7fadf8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf40d0a90 0x7fadf415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.328+0000 7fadf8e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf4149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.328+0000 7fadf8e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadf4160df0 con 0x7fadf40d0a90 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.328+0000 7fadf8e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fadf4160b10 con 0x7fadf406e740 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.328+0000 7fadf8e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fadf406eb80 con 0x7fadf41538d0 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf40d0a90 0x7fadf415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf40d0a90 0x7fadf415e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35976/0 (socket says 172.21.15.22:35976) 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 -- 172.21.15.22:0/271284779 learned_addr learned my addr 172.21.15.22:0/271284779 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf3400640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf406e740 0x7fadf4152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf3e00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf4149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 -- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 msgr2=0x7fadf4149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf4149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 -- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf406e740 msgr2=0x7fadf4152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf406e740 0x7fadf4152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 -- 172.21.15.22:0/271284779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf415eba0 con 0x7fadf40d0a90 2024-04-16T16:17:21.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.329+0000 7fadf2a00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf40d0a90 0x7fadf415e0e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faddc00cb40 tx=0x7faddc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.330+0000 7fadeb400640 1 -- 172.21.15.22:0/271284779 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc017070 con 0x7fadf40d0a90 2024-04-16T16:17:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.330+0000 7fadeb400640 1 -- 172.21.15.22:0/271284779 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc00aca0 con 0x7fadf40d0a90 2024-04-16T16:17:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.330+0000 7fadeb400640 1 -- 172.21.15.22:0/271284779 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc012620 con 0x7fadf40d0a90 2024-04-16T16:17:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.330+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf4151c30 con 0x7fadf40d0a90 2024-04-16T16:17:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.330+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf415ee80 con 0x7fadf40d0a90 2024-04-16T16:17:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.331+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf4075f30 con 0x7fadf40d0a90 2024-04-16T16:17:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.332+0000 7fadeb400640 1 -- 172.21.15.22:0/271284779 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faddc01a070 con 0x7fadf40d0a90 2024-04-16T16:17:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.333+0000 7fadeb400640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fadd006c8f0 0x7fadd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.333+0000 7fadeb400640 1 -- 172.21.15.22:0/271284779 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faddc08ba20 con 0x7fadf40d0a90 2024-04-16T16:17:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.334+0000 7fadf3400640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fadd006c8f0 0x7fadd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.334+0000 7fadf3400640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fadd006c8f0 0x7fadd006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fade4009a30 tx=0x7fade4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:21.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.338+0000 7fadeb400640 1 -- 172.21.15.22:0/271284779 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faddc059db0 con 0x7fadf40d0a90 2024-04-16T16:17:21.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.544+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fadf415d250 con 0x7fadf40d0a90 2024-04-16T16:17:21.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.546+0000 7fadeb400640 1 -- 172.21.15.22:0/271284779 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7faddc0596b0 con 0x7fadf40d0a90 2024-04-16T16:17:21.546 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fadd006c8f0 msgr2=0x7fadd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fadd006c8f0 0x7fadd006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fade4009a30 tx=0x7fade4008040 comp rx=0 tx=0).stop 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf40d0a90 msgr2=0x7fadf415e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf40d0a90 0x7fadf415e0e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faddc00cb40 tx=0x7faddc00a060 comp rx=0 tx=0).stop 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 shutdown_connections 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fadd006c8f0 0x7fadd006edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fadf41538d0 0x7fadf4149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf40d0a90 0x7fadf415e0e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.548+0000 7fadf8e00640 1 --2- 172.21.15.22:0/271284779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf406e740 0x7fadf4152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.549+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 >> 172.21.15.22:0/271284779 conn(0x7fadf4062440 msgr2=0x7fadf406d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.549+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 shutdown_connections 2024-04-16T16:17:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.549+0000 7fadf8e00640 1 -- 172.21.15.22:0/271284779 wait complete. 2024-04-16T16:17:21.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:21.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.790+0000 7fd9e9c00640 1 Processor -- start 2024-04-16T16:17:21.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.791+0000 7fd9e9c00640 1 -- start start 2024-04-16T16:17:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.792+0000 7fd9e9c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e415c8d0 0x7fd9e415db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.792+0000 7fd9e9c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9e40727a0 0x7fd9e40b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.792+0000 7fd9e9c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9e4073420 con 0x7fd9e4072c00 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.792+0000 7fd9e9c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd9e4073140 con 0x7fd9e40727a0 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.792+0000 7fd9e9c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e415d080 con 0x7fd9e415c8d0 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9dbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9e40727a0 0x7fd9e40b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9e3400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd9e4072c00 0x7fd9e4071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38654/0 (socket says 172.21.15.22:38654) 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9e3400640 1 -- 172.21.15.22:0/959318867 learned_addr learned my addr 172.21.15.22:0/959318867 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9e2a00640 1 --2- 172.21.15.22:0/959318867 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e415c8d0 0x7fd9e415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9dbe00640 1 -- 172.21.15.22:0/959318867 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e415c8d0 msgr2=0x7fd9e415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:21.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9dbe00640 1 --2- 172.21.15.22:0/959318867 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e415c8d0 0x7fd9e415db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9dbe00640 1 -- 172.21.15.22:0/959318867 >> v1:172.21.15.22:6789/0 conn(0x7fd9e4072c00 legacy=0x7fd9e4071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9dbe00640 1 -- 172.21.15.22:0/959318867 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e415d360 con 0x7fd9e40727a0 2024-04-16T16:17:21.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.793+0000 7fd9e2000640 1 -- 172.21.15.22:0/959318867 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810619841 0 0) 0x7fd9e4073420 con 0x7fd9e4072c00 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.795+0000 7fd9dbe00640 1 --2- 172.21.15.22:0/959318867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e40b2420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0097a0 tx=0x7fd9cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec62e37eef3cb3f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.795+0000 7fd9e2000640 1 -- 172.21.15.22:0/959318867 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc035020 con 0x7fd9e40727a0 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.795+0000 7fd9e2000640 1 -- 172.21.15.22:0/959318867 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9cc031830 con 0x7fd9e40727a0 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.795+0000 7fd9e2000640 1 -- 172.21.15.22:0/959318867 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc031c00 con 0x7fd9e40727a0 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 -- 172.21.15.22:0/959318867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 msgr2=0x7fd9e40b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/959318867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e40b2420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0097a0 tx=0x7fd9cc02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 -- 172.21.15.22:0/959318867 shutdown_connections 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/959318867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e40b2420 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/959318867 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e415c8d0 0x7fd9e415db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 -- 172.21.15.22:0/959318867 >> 172.21.15.22:0/959318867 conn(0x7fd9e4062440 msgr2=0x7fd9e4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 -- 172.21.15.22:0/959318867 shutdown_connections 2024-04-16T16:17:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.796+0000 7fd9e9c00640 1 -- 172.21.15.22:0/959318867 wait complete. 2024-04-16T16:17:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.798+0000 7fd9e9c00640 1 Processor -- start 2024-04-16T16:17:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.798+0000 7fd9e9c00640 1 -- start start 2024-04-16T16:17:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e9c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e9c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e4072c00 0x7fd9e40aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e9c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9e415c8d0 0x7fd9e40aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e9c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e415ce30 con 0x7fd9e40727a0 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e9c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e415ccb0 con 0x7fd9e415c8d0 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e9c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e40d0310 con 0x7fd9e4072c00 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e414b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35984/0 (socket says 172.21.15.22:35984) 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.799+0000 7fd9e2a00640 1 -- 172.21.15.22:0/2310904123 learned_addr learned my addr 172.21.15.22:0/2310904123 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9e2a00640 1 -- 172.21.15.22:0/2310904123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e4072c00 msgr2=0x7fd9e40aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9e2a00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e4072c00 0x7fd9e40aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9e2a00640 1 -- 172.21.15.22:0/2310904123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9e415c8d0 msgr2=0x7fd9e40aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9e2a00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9e415c8d0 0x7fd9e40aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9e2a00640 1 -- 172.21.15.22:0/2310904123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e40aafc0 con 0x7fd9e40727a0 2024-04-16T16:17:21.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9e2a00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e414b300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400d800 tx=0x7fd9d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:21.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9daa00640 1 -- 172.21.15.22:0/2310904123 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400b6c0 con 0x7fd9e40727a0 2024-04-16T16:17:21.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9daa00640 1 -- 172.21.15.22:0/2310904123 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d4019070 con 0x7fd9e40727a0 2024-04-16T16:17:21.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9daa00640 1 -- 172.21.15.22:0/2310904123 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400ba80 con 0x7fd9e40727a0 2024-04-16T16:17:21.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.800+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e40ab2a0 con 0x7fd9e40727a0 2024-04-16T16:17:21.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.801+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e40ac170 con 0x7fd9e40727a0 2024-04-16T16:17:21.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.802+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e404fd90 con 0x7fd9e40727a0 2024-04-16T16:17:21.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.803+0000 7fd9daa00640 1 -- 172.21.15.22:0/2310904123 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9d400bc20 con 0x7fd9e40727a0 2024-04-16T16:17:21.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.804+0000 7fd9daa00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd9c006c8f0 0x7fd9c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:21.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.804+0000 7fd9daa00640 1 -- 172.21.15.22:0/2310904123 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd9d408c0a0 con 0x7fd9e40727a0 2024-04-16T16:17:21.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.805+0000 7fd9dbe00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd9c006c8f0 0x7fd9c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:21.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.805+0000 7fd9dbe00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd9c006c8f0 0x7fd9c006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc036000 tx=0x7fd9cc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:21.809+0000 7fd9daa00640 1 -- 172.21.15.22:0/2310904123 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd9d4011340 con 0x7fd9e40727a0 2024-04-16T16:17:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.014+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd9e40b2cc0 con 0x7fd9e40727a0 2024-04-16T16:17:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.015+0000 7fd9daa00640 1 -- 172.21.15.22:0/2310904123 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fd9d405a430 con 0x7fd9e40727a0 2024-04-16T16:17:22.015 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.017+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd9c006c8f0 msgr2=0x7fd9c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.017+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd9c006c8f0 0x7fd9c006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc036000 tx=0x7fd9cc030000 comp rx=0 tx=0).stop 2024-04-16T16:17:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 msgr2=0x7fd9e414b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e414b300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400d800 tx=0x7fd9d400dcc0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 shutdown_connections 2024-04-16T16:17:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd9c006c8f0 0x7fd9c006edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9e415c8d0 0x7fd9e40aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9e4072c00 0x7fd9e40aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 --2- 172.21.15.22:0/2310904123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e40727a0 0x7fd9e414b300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 >> 172.21.15.22:0/2310904123 conn(0x7fd9e4062440 msgr2=0x7fd9e40ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 shutdown_connections 2024-04-16T16:17:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.018+0000 7fd9e9c00640 1 -- 172.21.15.22:0/2310904123 wait complete. 2024-04-16T16:17:22.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:22.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.258+0000 7ff603000640 1 Processor -- start 2024-04-16T16:17:22.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.259+0000 7ff603000640 1 -- start start 2024-04-16T16:17:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.260+0000 7ff603000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 0x7ff5fc0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.260+0000 7ff603000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff5fc15c8d0 0x7ff5fc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.260+0000 7ff603000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc160100 con 0x7ff5fc15f240 2024-04-16T16:17:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.260+0000 7ff603000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff5fc15c440 con 0x7ff5fc15c8d0 2024-04-16T16:17:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.260+0000 7ff603000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc0ccd70 con 0x7ff5fc155df0 2024-04-16T16:17:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.261+0000 7ff602600640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff5fc15f240 0x7ff5fc071f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38666/0 (socket says 172.21.15.22:38666) 2024-04-16T16:17:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.261+0000 7ff602600640 1 -- 172.21.15.22:0/3141593307 learned_addr learned my addr 172.21.15.22:0/3141593307 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.261+0000 7ff601200640 1 --2- 172.21.15.22:0/3141593307 >> v2:172.21.15.43:3300/0 conn(0x7ff5fc15c8d0 0x7ff5fc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.261+0000 7ff601c00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 0x7ff5fc0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.261+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453869833 0 0) 0x7ff5f4001490 con 0x7ff5fc15f240 2024-04-16T16:17:22.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.261+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e4003520 con 0x7ff5fc15f240 2024-04-16T16:17:22.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 731621863 0 0) 0x7ff5e4003520 con 0x7ff5fc15f240 2024-04-16T16:17:22.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 msgr2=0x7ff5fc0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:22.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 0x7ff5fc0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 >> v2:172.21.15.43:3300/0 conn(0x7ff5fc15c8d0 msgr2=0x7ff5fc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:22.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 --2- 172.21.15.22:0/3141593307 >> v2:172.21.15.43:3300/0 conn(0x7ff5fc15c8d0 0x7ff5fc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc15fe20 con 0x7ff5fc15f240 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7ff5f4001bc0 con 0x7ff5fc15f240 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 >> v1:172.21.15.22:6789/0 conn(0x7ff5fc15f240 legacy=0x7ff5fc071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5e40039b0 0x7ff5e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 0x7ff5e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5e4004d40 0x7ff5e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc15c440 con 0x7ff5e40039b0 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc0ccd70 con 0x7ff5e4004d40 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e400b9c0 con 0x7ff5fc155df0 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.262+0000 7ff601c00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5e40039b0 0x7ff5e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.263+0000 7ff601200640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 0x7ff5e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.263+0000 7ff602600640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5e4004d40 0x7ff5e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.263+0000 7ff601c00640 1 -- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 msgr2=0x7ff5e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.263+0000 7ff601c00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc155df0 0x7ff5e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.263+0000 7ff601c00640 1 -- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5e4004d40 msgr2=0x7ff5e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.263+0000 7ff601c00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5e4004d40 0x7ff5e40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.263+0000 7ff601c00640 1 -- 172.21.15.22:0/3141593307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e4003520 con 0x7ff5e40039b0 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.264+0000 7ff601c00640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5e40039b0 0x7ff5e4003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009ac0 tx=0x7ff5e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0a3eed0f29d4e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.265+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0039070 con 0x7ff5e40039b0 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.265+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f002c6b0 con 0x7ff5e40039b0 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.265+0000 7ff5fbe00640 1 -- 172.21.15.22:0/3141593307 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0009690 con 0x7ff5e40039b0 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.266+0000 7ff603000640 1 -- 172.21.15.22:0/3141593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5e40039b0 msgr2=0x7ff5e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.266+0000 7ff603000640 1 --2- 172.21.15.22:0/3141593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5e40039b0 0x7ff5e4003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009ac0 tx=0x7ff5e4005830 comp rx=0 tx=0).stop 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.266+0000 7ff602600640 1 -- 172.21.15.22:0/3141593307 reap_dead start 2024-04-16T16:17:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.266+0000 7ff603000640 1 -- 172.21.15.22:0/3141593307 shutdown_connections 2024-04-16T16:17:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.266+0000 7ff603000640 1 -- 172.21.15.22:0/3141593307 >> 172.21.15.22:0/3141593307 conn(0x7ff5fc075070 msgr2=0x7ff5fc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.266+0000 7ff603000640 1 -- 172.21.15.22:0/3141593307 shutdown_connections 2024-04-16T16:17:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.266+0000 7ff603000640 1 -- 172.21.15.22:0/3141593307 wait complete. 2024-04-16T16:17:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.268+0000 7ff603000640 1 Processor -- start 2024-04-16T16:17:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.268+0000 7ff603000640 1 -- start start 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff603000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5fc142a50 0x7ff5fc145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff603000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc1581e0 0x7ff5fc158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff603000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc153000 0x7ff5fc153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff603000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc0b3eb0 con 0x7ff5fc142a50 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff603000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc15c0d0 con 0x7ff5fc1581e0 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff603000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc0b4030 con 0x7ff5fc153000 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5fc142a50 0x7ff5fc145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5fc142a50 0x7ff5fc145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36010/0 (socket says 172.21.15.22:36010) 2024-04-16T16:17:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 -- 172.21.15.22:0/3451897650 learned_addr learned my addr 172.21.15.22:0/3451897650 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 -- 172.21.15.22:0/3451897650 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc153000 msgr2=0x7ff5fc153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc153000 0x7ff5fc153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 -- 172.21.15.22:0/3451897650 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc1581e0 msgr2=0x7ff5fc158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc1581e0 0x7ff5fc158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.269+0000 7ff601c00640 1 -- 172.21.15.22:0/3451897650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc146270 con 0x7ff5fc142a50 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.270+0000 7ff601c00640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5fc142a50 0x7ff5fc145d30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0037040 tx=0x7ff5f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.270+0000 7ff5f9600640 1 -- 172.21.15.22:0/3451897650 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0039050 con 0x7ff5fc142a50 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.270+0000 7ff5f9600640 1 -- 172.21.15.22:0/3451897650 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f0045070 con 0x7ff5fc142a50 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.270+0000 7ff5f9600640 1 -- 172.21.15.22:0/3451897650 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00044e0 con 0x7ff5fc142a50 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.270+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc1f8390 con 0x7ff5fc142a50 2024-04-16T16:17:22.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.270+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc1f8950 con 0x7ff5fc142a50 2024-04-16T16:17:22.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.272+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc075f30 con 0x7ff5fc142a50 2024-04-16T16:17:22.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.273+0000 7ff5f9600640 1 -- 172.21.15.22:0/3451897650 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5f0003810 con 0x7ff5fc142a50 2024-04-16T16:17:22.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.273+0000 7ff5f9600640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5dc06c920 0x7ff5dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.274+0000 7ff5f9600640 1 -- 172.21.15.22:0/3451897650 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f00ad540 con 0x7ff5fc142a50 2024-04-16T16:17:22.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.274+0000 7ff601200640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5dc06c920 0x7ff5dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.274+0000 7ff601200640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5dc06c920 0x7ff5dc06ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc154f80 tx=0x7ff5e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:22.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.278+0000 7ff5f9600640 1 -- 172.21.15.22:0/3451897650 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5f004e020 con 0x7ff5fc142a50 2024-04-16T16:17:22.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.482+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff5fc06f0e0 con 0x7ff5fc142a50 2024-04-16T16:17:22.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.483+0000 7ff5f9600640 1 -- 172.21.15.22:0/3451897650 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7ff5fc146270 con 0x7ff5fc142a50 2024-04-16T16:17:22.483 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:22.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5dc06c920 msgr2=0x7ff5dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5dc06c920 0x7ff5dc06ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc154f80 tx=0x7ff5e8008040 comp rx=0 tx=0).stop 2024-04-16T16:17:22.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5fc142a50 msgr2=0x7ff5fc145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5fc142a50 0x7ff5fc145d30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0037040 tx=0x7ff5f0004730 comp rx=0 tx=0).stop 2024-04-16T16:17:22.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 shutdown_connections 2024-04-16T16:17:22.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5dc06c920 0x7ff5dc06ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc153000 0x7ff5fc153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc1581e0 0x7ff5fc158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 --2- 172.21.15.22:0/3451897650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5fc142a50 0x7ff5fc145d30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 >> 172.21.15.22:0/3451897650 conn(0x7ff5fc075070 msgr2=0x7ff5fc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:22.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 shutdown_connections 2024-04-16T16:17:22.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.486+0000 7ff603000640 1 -- 172.21.15.22:0/3451897650 wait complete. 2024-04-16T16:17:22.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:22.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.725+0000 7f4dcb200640 1 Processor -- start 2024-04-16T16:17:22.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.725+0000 7f4dcb200640 1 -- start start 2024-04-16T16:17:22.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.727+0000 7f4dcb200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4dc415ea50 0x7f4dc40ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.727+0000 7f4dcb200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc40b9080 con 0x7f4dc40cf630 2024-04-16T16:17:22.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.727+0000 7f4dcb200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc40b9360 con 0x7f4dc40b8aa0 2024-04-16T16:17:22.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.727+0000 7f4dcb200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc40b9c90 con 0x7f4dc415ea50 2024-04-16T16:17:22.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.727+0000 7f4dc9400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4dc40cf630 0x7f4dc40d2dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38682/0 (socket says 172.21.15.22:38682) 2024-04-16T16:17:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.727+0000 7f4dc9400640 1 -- 172.21.15.22:0/2692498611 learned_addr learned my addr 172.21.15.22:0/2692498611 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc9e00640 1 --2- 172.21.15.22:0/2692498611 >> v2:172.21.15.43:3300/0 conn(0x7f4dc415ea50 0x7f4dc40ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360863001 0 0) 0x7f4dc40b9080 con 0x7f4dc40cf630 2024-04-16T16:17:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dac003520 con 0x7f4dc40cf630 2024-04-16T16:17:22.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3022992658 0 0) 0x7f4dac003520 con 0x7f4dc40cf630 2024-04-16T16:17:22.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 >> v2:172.21.15.43:3300/0 conn(0x7f4dc415ea50 msgr2=0x7f4dc40ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 --2- 172.21.15.22:0/2692498611 >> v2:172.21.15.43:3300/0 conn(0x7f4dc415ea50 0x7f4dc40ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 >> v1:172.21.15.43:6789/0 conn(0x7f4dc40b8aa0 legacy=0x7f4dc40d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc40b9640 con 0x7f4dc40cf630 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f4db4001670 con 0x7f4dc40cf630 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 >> v1:172.21.15.22:6789/0 conn(0x7f4dc40cf630 legacy=0x7f4dc40d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dac0039b0 0x7f4dac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dac004800 0x7f4dac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac0052e0 0x7f4dac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc40b9c90 con 0x7f4dac004800 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.728+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac00c1b0 con 0x7f4dac0052e0 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac00c3b0 con 0x7f4dac0039b0 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9400640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dac004800 0x7f4dac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9e00640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dac0039b0 0x7f4dac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9400640 1 -- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dac0039b0 msgr2=0x7f4dac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:22.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9400640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dac0039b0 0x7f4dac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9400640 1 -- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac0052e0 msgr2=0x7f4dac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:22.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9400640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac0052e0 0x7f4dac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9400640 1 -- 172.21.15.22:0/2692498611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac003520 con 0x7f4dac004800 2024-04-16T16:17:22.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dca800640 1 -- 172.21.15.22:0/2692498611 reap_dead start 2024-04-16T16:17:22.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.729+0000 7f4dc9e00640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dac0039b0 0x7f4dac003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.730+0000 7f4dc9400640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dac004800 0x7f4dac004c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c210 tx=0x7f4dac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd9d551d924763a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4007cf0 con 0x7f4dac004800 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db4030070 con 0x7f4dac004800 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dc8a00640 1 -- 172.21.15.22:0/2692498611 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4005d70 con 0x7f4dac004800 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dcb200640 1 -- 172.21.15.22:0/2692498611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dac004800 msgr2=0x7f4dac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dcb200640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dac004800 0x7f4dac004c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c210 tx=0x7f4dac005830 comp rx=0 tx=0).stop 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dcb200640 1 -- 172.21.15.22:0/2692498611 shutdown_connections 2024-04-16T16:17:22.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dcb200640 1 --2- 172.21.15.22:0/2692498611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dac004800 0x7f4dac004c80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dcb200640 1 -- 172.21.15.22:0/2692498611 >> 172.21.15.22:0/2692498611 conn(0x7f4dc4072430 msgr2=0x7f4dc4072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:22.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dcb200640 1 -- 172.21.15.22:0/2692498611 shutdown_connections 2024-04-16T16:17:22.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.731+0000 7f4dcb200640 1 -- 172.21.15.22:0/2692498611 wait complete. 2024-04-16T16:17:22.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.733+0000 7f4dcb200640 1 Processor -- start 2024-04-16T16:17:22.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.733+0000 7f4dcb200640 1 -- start start 2024-04-16T16:17:22.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.734+0000 7f4dcb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac004800 0x7f4dc41f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.734+0000 7f4dcb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dc40cca80 0x7f4dc40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.734+0000 7f4dcb200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc415efb0 0x7f4dc415f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.734+0000 7f4dcb200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc40cfaa0 con 0x7f4dc415efb0 2024-04-16T16:17:22.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.734+0000 7f4dcb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc415ee30 con 0x7f4dac004800 2024-04-16T16:17:22.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.734+0000 7f4dcb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc40cfc20 con 0x7f4dc40cca80 2024-04-16T16:17:22.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc415efb0 0x7f4dc415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc415efb0 0x7f4dc415f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36022/0 (socket says 172.21.15.22:36022) 2024-04-16T16:17:22.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 -- 172.21.15.22:0/349343831 learned_addr learned my addr 172.21.15.22:0/349343831 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:22.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dc9400640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dc40cca80 0x7f4dc40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dc9e00640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac004800 0x7f4dc41f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 -- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dc40cca80 msgr2=0x7f4dc40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dc40cca80 0x7f4dc40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 -- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac004800 msgr2=0x7f4dc41f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac004800 0x7f4dc41f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.735+0000 7f4dca800640 1 -- 172.21.15.22:0/349343831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc40ca160 con 0x7f4dc415efb0 2024-04-16T16:17:22.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.736+0000 7f4dca800640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc415efb0 0x7f4dc415f410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c700 tx=0x7f4dc000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:22.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.736+0000 7f4dbe000640 1 -- 172.21.15.22:0/349343831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0017070 con 0x7f4dc415efb0 2024-04-16T16:17:22.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.736+0000 7f4dbe000640 1 -- 172.21.15.22:0/349343831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc0005d40 con 0x7f4dc415efb0 2024-04-16T16:17:22.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.736+0000 7f4dbe000640 1 -- 172.21.15.22:0/349343831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000a880 con 0x7f4dc415efb0 2024-04-16T16:17:22.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.736+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc4160c30 con 0x7f4dc415efb0 2024-04-16T16:17:22.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.736+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc415fe70 con 0x7f4dc415efb0 2024-04-16T16:17:22.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.737+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc40cd440 con 0x7f4dc415efb0 2024-04-16T16:17:22.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.738+0000 7f4dbe000640 1 -- 172.21.15.22:0/349343831 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4dc001a070 con 0x7f4dc415efb0 2024-04-16T16:17:22.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.739+0000 7f4dbe000640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4da806c8f0 0x7f4da806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:22.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.739+0000 7f4dbe000640 1 -- 172.21.15.22:0/349343831 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4dc008aee0 con 0x7f4dc415efb0 2024-04-16T16:17:22.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.739+0000 7f4dc9e00640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4da806c8f0 0x7f4da806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:22.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.740+0000 7f4dc9e00640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4da806c8f0 0x7f4da806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4069190 tx=0x7f4db8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.744+0000 7f4dbe000640 1 -- 172.21.15.22:0/349343831 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4dc40ca160 con 0x7f4dc415efb0 2024-04-16T16:17:22.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.943+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dc40cb050 con 0x7f4dc415efb0 2024-04-16T16:17:22.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.949+0000 7f4dbe000640 1 -- 172.21.15.22:0/349343831 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7f4dc40cb050 con 0x7f4dc415efb0 2024-04-16T16:17:22.949 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:22.949 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:22.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4da806c8f0 msgr2=0x7f4da806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4da806c8f0 0x7f4da806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4069190 tx=0x7f4db8008040 comp rx=0 tx=0).stop 2024-04-16T16:17:22.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc415efb0 msgr2=0x7f4dc415f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc415efb0 0x7f4dc415f410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c700 tx=0x7f4dc000cbc0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 shutdown_connections 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4da806c8f0 0x7f4da806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc415efb0 0x7f4dc415f410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4dc40cca80 0x7f4dc40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 --2- 172.21.15.22:0/349343831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dac004800 0x7f4dc41f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.951+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 >> 172.21.15.22:0/349343831 conn(0x7f4dc4072430 msgr2=0x7f4dc40d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.952+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 shutdown_connections 2024-04-16T16:17:22.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:22.952+0000 7f4dcb200640 1 -- 172.21.15.22:0/349343831 wait complete. 2024-04-16T16:17:22.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:22.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:23.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.178+0000 7f542be00640 1 Processor -- start 2024-04-16T16:17:23.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.178+0000 7f542be00640 1 -- start start 2024-04-16T16:17:23.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.179+0000 7f542be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f542c0cfca0 0x7f542c0d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.179+0000 7f542be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542c0d20d0 con 0x7f542c0d1cc0 2024-04-16T16:17:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.179+0000 7f542be00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542c0d3ed0 con 0x7f542c15eb40 2024-04-16T16:17:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.179+0000 7f542be00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f542c0d41b0 con 0x7f542c0cfca0 2024-04-16T16:17:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f542b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f542c0d1cc0 0x7f542c0b82b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38696/0 (socket says 172.21.15.22:38696) 2024-04-16T16:17:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f542b400640 1 -- 172.21.15.22:0/1123091121 learned_addr learned my addr 172.21.15.22:0/1123091121 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f5423e00640 1 --2- 172.21.15.22:0/1123091121 >> v2:172.21.15.22:3300/0 conn(0x7f542c0cfca0 0x7f542c0d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f542a000640 1 -- 172.21.15.22:0/1123091121 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595089495 0 0) 0x7f5424001490 con 0x7f542c0d1cc0 2024-04-16T16:17:23.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f542a000640 1 -- 172.21.15.22:0/1123091121 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5410003520 con 0x7f542c0d1cc0 2024-04-16T16:17:23.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f5423e00640 1 -- 172.21.15.22:0/1123091121 >> v1:172.21.15.43:6789/0 conn(0x7f542c15eb40 legacy=0x7f542c0d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f5423e00640 1 -- 172.21.15.22:0/1123091121 >> v1:172.21.15.22:6789/0 conn(0x7f542c0d1cc0 legacy=0x7f542c0b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.180+0000 7f5423e00640 1 -- 172.21.15.22:0/1123091121 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c0d4490 con 0x7f542c0cfca0 2024-04-16T16:17:23.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.182+0000 7f5423e00640 1 --2- 172.21.15.22:0/1123091121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c0cfca0 0x7f542c0d1780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f54140097a0 tx=0x7f541402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a799814e7f8d454c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:23.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.182+0000 7f542a000640 1 -- 172.21.15.22:0/1123091121 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414034070 con 0x7f542c0cfca0 2024-04-16T16:17:23.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.182+0000 7f542a000640 1 -- 172.21.15.22:0/1123091121 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5414030610 con 0x7f542c0cfca0 2024-04-16T16:17:23.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.182+0000 7f542a000640 1 -- 172.21.15.22:0/1123091121 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54140309e0 con 0x7f542c0cfca0 2024-04-16T16:17:23.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.183+0000 7f542be00640 1 -- 172.21.15.22:0/1123091121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c0cfca0 msgr2=0x7f542c0d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.183+0000 7f542be00640 1 --2- 172.21.15.22:0/1123091121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c0cfca0 0x7f542c0d1780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f54140097a0 tx=0x7f541402b960 comp rx=0 tx=0).stop 2024-04-16T16:17:23.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.183+0000 7f542be00640 1 -- 172.21.15.22:0/1123091121 shutdown_connections 2024-04-16T16:17:23.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.183+0000 7f542be00640 1 --2- 172.21.15.22:0/1123091121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c0cfca0 0x7f542c0d1780 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.183+0000 7f542be00640 1 -- 172.21.15.22:0/1123091121 >> 172.21.15.22:0/1123091121 conn(0x7f542c072460 msgr2=0x7f542c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:23.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.183+0000 7f542be00640 1 -- 172.21.15.22:0/1123091121 shutdown_connections 2024-04-16T16:17:23.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.183+0000 7f542be00640 1 -- 172.21.15.22:0/1123091121 wait complete. 2024-04-16T16:17:23.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.184+0000 7f542be00640 1 Processor -- start 2024-04-16T16:17:23.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.185+0000 7f542be00640 1 -- start start 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f542c0cfca0 0x7f542c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c0d1cc0 0x7f542c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c15eb40 0x7f542c0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f542c0b7b50 con 0x7f542c15eb40 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f542c0b79d0 con 0x7f542c0d1cc0 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f542c0b89c0 con 0x7f542c0cfca0 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c15eb40 0x7f542c0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c15eb40 0x7f542c0cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36048/0 (socket says 172.21.15.22:36048) 2024-04-16T16:17:23.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 -- 172.21.15.22:0/1630179623 learned_addr learned my addr 172.21.15.22:0/1630179623 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:23.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 -- 172.21.15.22:0/1630179623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f542c0cfca0 msgr2=0x7f542c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f542c0cfca0 0x7f542c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 -- 172.21.15.22:0/1630179623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c0d1cc0 msgr2=0x7f542c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c0d1cc0 0x7f542c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.186+0000 7f542b400640 1 -- 172.21.15.22:0/1630179623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c0ca450 con 0x7f542c15eb40 2024-04-16T16:17:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.187+0000 7f542b400640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c15eb40 0x7f542c0cc1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f542400cb50 tx=0x7f542400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.187+0000 7f5423400640 1 -- 172.21.15.22:0/1630179623 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424017070 con 0x7f542c15eb40 2024-04-16T16:17:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.187+0000 7f5423400640 1 -- 172.21.15.22:0/1630179623 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f542400ad40 con 0x7f542c15eb40 2024-04-16T16:17:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.187+0000 7f5423400640 1 -- 172.21.15.22:0/1630179623 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424012620 con 0x7f542c15eb40 2024-04-16T16:17:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.187+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542c0ca730 con 0x7f542c15eb40 2024-04-16T16:17:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.187+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542c15ff80 con 0x7f542c15eb40 2024-04-16T16:17:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.188+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542c075f30 con 0x7f542c15eb40 2024-04-16T16:17:23.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.189+0000 7f5423400640 1 -- 172.21.15.22:0/1630179623 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f542401a070 con 0x7f542c15eb40 2024-04-16T16:17:23.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.190+0000 7f5423400640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f540806c8f0 0x7f540806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.191+0000 7f5423400640 1 -- 172.21.15.22:0/1630179623 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f542408ba50 con 0x7f542c15eb40 2024-04-16T16:17:23.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.191+0000 7f542aa00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f540806c8f0 0x7f540806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.191+0000 7f542aa00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f540806c8f0 0x7f540806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f541c000f60 tx=0x7f541c0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:23.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.194+0000 7f5423400640 1 -- 172.21.15.22:0/1630179623 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f542c0d20d0 con 0x7f542c15eb40 2024-04-16T16:17:23.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.396+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f542c068f70 con 0x7f542c15eb40 2024-04-16T16:17:23.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.397+0000 7f5423400640 1 -- 172.21.15.22:0/1630179623 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f5424059e70 con 0x7f542c15eb40 2024-04-16T16:17:23.396 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f540806c8f0 msgr2=0x7f540806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f540806c8f0 0x7f540806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f541c000f60 tx=0x7f541c0079b0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c15eb40 msgr2=0x7f542c0cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c15eb40 0x7f542c0cc1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f542400cb50 tx=0x7f542400a430 comp rx=0 tx=0).stop 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 shutdown_connections 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f540806c8f0 0x7f540806edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f542c15eb40 0x7f542c0cc1d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c0d1cc0 0x7f542c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.399+0000 7f542be00640 1 --2- 172.21.15.22:0/1630179623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f542c0cfca0 0x7f542c0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.400+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 >> 172.21.15.22:0/1630179623 conn(0x7f542c072460 msgr2=0x7f542c0cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.400+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 shutdown_connections 2024-04-16T16:17:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.400+0000 7f542be00640 1 -- 172.21.15.22:0/1630179623 wait complete. 2024-04-16T16:17:23.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.643+0000 7fed8a800640 1 Processor -- start 2024-04-16T16:17:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.643+0000 7fed8a800640 1 -- start start 2024-04-16T16:17:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.645+0000 7fed8a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 0x7fed840cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.645+0000 7fed8a800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fed840d35f0 0x7fed840d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.645+0000 7fed8a800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed840d3ef0 con 0x7fed840d3a30 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.645+0000 7fed8a800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fed840d41d0 con 0x7fed840d35f0 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.645+0000 7fed8a800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed840d44b0 con 0x7fed8415eb60 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.645+0000 7fed89e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fed840d3a30 0x7fed840d47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38712/0 (socket says 172.21.15.22:38712) 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.645+0000 7fed89e00640 1 -- 172.21.15.22:0/4061238433 learned_addr learned my addr 172.21.15.22:0/4061238433 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed88a00640 1 --2- 172.21.15.22:0/4061238433 >> v2:172.21.15.43:3300/0 conn(0x7fed840d35f0 0x7fed840d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed89400640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 0x7fed840cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980467780 0 0) 0x7fed840d3ef0 con 0x7fed840d3a30 2024-04-16T16:17:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed6c003520 con 0x7fed840d3a30 2024-04-16T16:17:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 242377115 0 0) 0x7fed6c003520 con 0x7fed840d3a30 2024-04-16T16:17:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 msgr2=0x7fed840cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 0x7fed840cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 >> v2:172.21.15.43:3300/0 conn(0x7fed840d35f0 msgr2=0x7fed840d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 --2- 172.21.15.22:0/4061238433 >> v2:172.21.15.43:3300/0 conn(0x7fed840d35f0 0x7fed840d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed840b7db0 con 0x7fed840d3a30 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fed7c0019f0 con 0x7fed840d3a30 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 >> v1:172.21.15.22:6789/0 conn(0x7fed840d3a30 legacy=0x7fed840d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed6c0039b0 0x7fed6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 0x7fed6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed840d41d0 con 0x7fed6c004d40 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed840d44b0 con 0x7fed6c0039b0 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.646+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed6c00b9c0 con 0x7fed8415eb60 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89400640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed6c0039b0 0x7fed6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed88a00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 0x7fed6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89e00640 1 -- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 msgr2=0x7fed6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed8415eb60 0x7fed6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89e00640 1 -- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed6c0039b0 msgr2=0x7fed6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed6c0039b0 0x7fed6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89e00640 1 -- 172.21.15.22:0/4061238433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c003520 con 0x7fed6c004d40 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.647+0000 7fed89400640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed6c0039b0 0x7fed6c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.648+0000 7fed89e00640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed840b7350 tx=0x7fed6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd3d373b0724963 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.649+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00a3f0 con 0x7fed6c004d40 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.649+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c034630 con 0x7fed6c004d40 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.649+0000 7fed83e00640 1 -- 172.21.15.22:0/4061238433 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c034a40 con 0x7fed6c004d40 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.649+0000 7fed8a800640 1 -- 172.21.15.22:0/4061238433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 msgr2=0x7fed6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.649+0000 7fed8a800640 1 --2- 172.21.15.22:0/4061238433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed840b7350 tx=0x7fed6c005830 comp rx=0 tx=0).stop 2024-04-16T16:17:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.649+0000 7fed89e00640 1 -- 172.21.15.22:0/4061238433 reap_dead start 2024-04-16T16:17:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.650+0000 7fed8a800640 1 -- 172.21.15.22:0/4061238433 shutdown_connections 2024-04-16T16:17:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.650+0000 7fed8a800640 1 -- 172.21.15.22:0/4061238433 >> 172.21.15.22:0/4061238433 conn(0x7fed84072460 msgr2=0x7fed84072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.650+0000 7fed8a800640 1 -- 172.21.15.22:0/4061238433 shutdown_connections 2024-04-16T16:17:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.650+0000 7fed8a800640 1 -- 172.21.15.22:0/4061238433 wait complete. 2024-04-16T16:17:23.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.651+0000 7fed8a800640 1 Processor -- start 2024-04-16T16:17:23.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.652+0000 7fed8a800640 1 -- start start 2024-04-16T16:17:23.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.652+0000 7fed8a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed841597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.652+0000 7fed8a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed8415b3c0 0x7fed84157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed8a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed840d4b30 0x7fed840d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed8a800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed840b9460 con 0x7fed6c004d40 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed8a800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed840b92e0 con 0x7fed8415b3c0 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed8a800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed840b95e0 con 0x7fed840d4b30 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed841597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed841597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36060/0 (socket says 172.21.15.22:36060) 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 -- 172.21.15.22:0/3352431331 learned_addr learned my addr 172.21.15.22:0/3352431331 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 -- 172.21.15.22:0/3352431331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed840d4b30 msgr2=0x7fed840d4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed840d4b30 0x7fed840d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 -- 172.21.15.22:0/3352431331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed8415b3c0 msgr2=0x7fed84157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed8415b3c0 0x7fed84157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.653+0000 7fed89400640 1 -- 172.21.15.22:0/3352431331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed84159e40 con 0x7fed6c004d40 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.654+0000 7fed89400640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed841597e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed78011600 tx=0x7fed78011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.654+0000 7fed81600640 1 -- 172.21.15.22:0/3352431331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78015870 con 0x7fed6c004d40 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.654+0000 7fed81600640 1 -- 172.21.15.22:0/3352431331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed78015a10 con 0x7fed6c004d40 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.654+0000 7fed81600640 1 -- 172.21.15.22:0/3352431331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78015de0 con 0x7fed6c004d40 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.654+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8415a120 con 0x7fed6c004d40 2024-04-16T16:17:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.654+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8415a6e0 con 0x7fed6c004d40 2024-04-16T16:17:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.655+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed84075f30 con 0x7fed6c004d40 2024-04-16T16:17:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.656+0000 7fed81600640 1 -- 172.21.15.22:0/3352431331 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed7800f490 con 0x7fed6c004d40 2024-04-16T16:17:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.657+0000 7fed81600640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed6406c920 0x7fed6406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.657+0000 7fed81600640 1 -- 172.21.15.22:0/3352431331 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fed7808c470 con 0x7fed6c004d40 2024-04-16T16:17:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.657+0000 7fed88a00640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed6406c920 0x7fed6406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.658+0000 7fed88a00640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed6406c920 0x7fed6406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed840ce9b0 tx=0x7fed70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:23.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.661+0000 7fed81600640 1 -- 172.21.15.22:0/3352431331 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed78019030 con 0x7fed6c004d40 2024-04-16T16:17:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.875+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed84068f70 con 0x7fed6c004d40 2024-04-16T16:17:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.876+0000 7fed81600640 1 -- 172.21.15.22:0/3352431331 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fed7805a890 con 0x7fed6c004d40 2024-04-16T16:17:23.876 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.878+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed6406c920 msgr2=0x7fed6406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.878+0000 7fed8a800640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed6406c920 0x7fed6406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed840ce9b0 tx=0x7fed70008040 comp rx=0 tx=0).stop 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.878+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 msgr2=0x7fed841597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.878+0000 7fed8a800640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed841597e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed78011600 tx=0x7fed78011ac0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.879+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 shutdown_connections 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.879+0000 7fed8a800640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed6406c920 0x7fed6406ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.879+0000 7fed8a800640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed840d4b30 0x7fed840d4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.879+0000 7fed8a800640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed8415b3c0 0x7fed84157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.879+0000 7fed8a800640 1 --2- 172.21.15.22:0/3352431331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed6c004d40 0x7fed841597e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.879+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 >> 172.21.15.22:0/3352431331 conn(0x7fed84072460 msgr2=0x7fed840b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:23.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.879+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 shutdown_connections 2024-04-16T16:17:23.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:23.880+0000 7fed8a800640 1 -- 172.21.15.22:0/3352431331 wait complete. 2024-04-16T16:17:23.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:24.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.120+0000 7f30ec200640 1 Processor -- start 2024-04-16T16:17:24.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.120+0000 7f30ec200640 1 -- start start 2024-04-16T16:17:24.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.122+0000 7f30ec200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30e415db60 0x7f30e40b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.122+0000 7f30ec200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e4073420 con 0x7f30e415c8d0 2024-04-16T16:17:24.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.122+0000 7f30ec200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e4072eb0 con 0x7f30e40b2960 2024-04-16T16:17:24.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.122+0000 7f30ec200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f30e40b2d90 con 0x7f30e415db60 2024-04-16T16:17:24.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.123+0000 7f30e9800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f30e415c8d0 0x7f30e40727a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38726/0 (socket says 172.21.15.22:38726) 2024-04-16T16:17:24.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.123+0000 7f30e9800640 1 -- 172.21.15.22:0/3036923209 learned_addr learned my addr 172.21.15.22:0/3036923209 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.123+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3036923209 >> v2:172.21.15.43:3300/0 conn(0x7f30e415db60 0x7f30e40b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.123+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 934864923 0 0) 0x7f30e4073420 con 0x7f30e415c8d0 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.123+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30cc003520 con 0x7f30e415c8d0 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 96248975 0 0) 0x7f30cc003520 con 0x7f30e415c8d0 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 >> v2:172.21.15.43:3300/0 conn(0x7f30e415db60 msgr2=0x7f30e40b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 --2- 172.21.15.22:0/3036923209 >> v2:172.21.15.43:3300/0 conn(0x7f30e415db60 0x7f30e40b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 >> v1:172.21.15.43:6789/0 conn(0x7f30e40b2960 legacy=0x7f30e4071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e4073140 con 0x7f30e415c8d0 2024-04-16T16:17:24.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f30d8001670 con 0x7f30e415c8d0 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 >> v1:172.21.15.22:6789/0 conn(0x7f30e415c8d0 legacy=0x7f30e40727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30cc003a00 0x7f30cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc0051c0 0x7f30cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30e40b2d90 con 0x7f30cc004800 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc00c0c0 con 0x7f30cc0051c0 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc00c2c0 con 0x7f30cc003a00 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30e9800640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30cc003a00 0x7f30cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.124+0000 7f30ea200640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc0051c0 0x7f30cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.125+0000 7f30e8e00640 1 -- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30cc003a00 msgr2=0x7f30cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:24.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.125+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30cc003a00 0x7f30cc003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.125+0000 7f30e8e00640 1 -- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc0051c0 msgr2=0x7f30cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:24.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.125+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30cc0051c0 0x7f30cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.125+0000 7f30ea200640 1 -- 172.21.15.22:0/3036923209 reap_dead start 2024-04-16T16:17:24.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.125+0000 7f30e8e00640 1 -- 172.21.15.22:0/3036923209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc003520 con 0x7f30cc004800 2024-04-16T16:17:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.126+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30cc004c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009ac0 tx=0x7f30cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35c41f7ae7010ec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.126+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0039070 con 0x7f30cc004800 2024-04-16T16:17:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.126+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d002c6b0 con 0x7f30cc004800 2024-04-16T16:17:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.126+0000 7f30e3e00640 1 -- 172.21.15.22:0/3036923209 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0009690 con 0x7f30cc004800 2024-04-16T16:17:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.127+0000 7f30ec200640 1 -- 172.21.15.22:0/3036923209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 msgr2=0x7f30cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.127+0000 7f30ec200640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30cc004c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009ac0 tx=0x7f30cc005830 comp rx=0 tx=0).stop 2024-04-16T16:17:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.127+0000 7f30ec200640 1 -- 172.21.15.22:0/3036923209 shutdown_connections 2024-04-16T16:17:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.127+0000 7f30ec200640 1 --2- 172.21.15.22:0/3036923209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30cc004c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.127+0000 7f30ec200640 1 -- 172.21.15.22:0/3036923209 >> 172.21.15.22:0/3036923209 conn(0x7f30e4062440 msgr2=0x7f30e4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.127+0000 7f30ec200640 1 -- 172.21.15.22:0/3036923209 shutdown_connections 2024-04-16T16:17:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.127+0000 7f30ec200640 1 -- 172.21.15.22:0/3036923209 wait complete. 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.129+0000 7f30ec200640 1 Processor -- start 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.129+0000 7f30ec200640 1 -- start start 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30ec200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30e40abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30ec200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e4148ce0 0x7f30e40aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30ec200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4149160 0x7f30e415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30ec200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30e415d640 con 0x7f30cc004800 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30ec200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30e415d360 con 0x7f30e4149160 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30ec200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f30e415ccb0 con 0x7f30e4148ce0 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30e9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30e40abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30e9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30e40abec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36084/0 (socket says 172.21.15.22:36084) 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.130+0000 7f30e9800640 1 -- 172.21.15.22:0/3331183662 learned_addr learned my addr 172.21.15.22:0/3331183662 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e4148ce0 0x7f30e40aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30ea200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4149160 0x7f30e415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30e9800640 1 -- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e4148ce0 msgr2=0x7f30e40aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30e9800640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e4148ce0 0x7f30e40aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30e9800640 1 -- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4149160 msgr2=0x7f30e415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30e9800640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4149160 0x7f30e415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30e9800640 1 -- 172.21.15.22:0/3331183662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e4149650 con 0x7f30cc004800 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30ea200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4149160 0x7f30e415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.131+0000 7f30e9800640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30e40abec0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30d800d7d0 tx=0x7f30d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.132+0000 7f30e1600640 1 -- 172.21.15.22:0/3331183662 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8019070 con 0x7f30cc004800 2024-04-16T16:17:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.132+0000 7f30e1600640 1 -- 172.21.15.22:0/3331183662 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d80072d0 con 0x7f30cc004800 2024-04-16T16:17:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.132+0000 7f30e1600640 1 -- 172.21.15.22:0/3331183662 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d80047e0 con 0x7f30cc004800 2024-04-16T16:17:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.132+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e4149930 con 0x7f30cc004800 2024-04-16T16:17:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.132+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e4149ef0 con 0x7f30cc004800 2024-04-16T16:17:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.133+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e404fd90 con 0x7f30cc004800 2024-04-16T16:17:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.134+0000 7f30e1600640 1 -- 172.21.15.22:0/3331183662 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30d8004980 con 0x7f30cc004800 2024-04-16T16:17:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.135+0000 7f30e1600640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30c406c8f0 0x7f30c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.135+0000 7f30e1600640 1 -- 172.21.15.22:0/3331183662 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f30d808b460 con 0x7f30cc004800 2024-04-16T16:17:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.135+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30c406c8f0 0x7f30c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.136+0000 7f30e8e00640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30c406c8f0 0x7f30c406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30d0036000 tx=0x7f30d0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.139+0000 7f30e1600640 1 -- 172.21.15.22:0/3331183662 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30d80591a0 con 0x7f30cc004800 2024-04-16T16:17:24.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.342+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f30e4072b70 con 0x7f30cc004800 2024-04-16T16:17:24.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.343+0000 7f30e1600640 1 -- 172.21.15.22:0/3331183662 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f30d805d4a0 con 0x7f30cc004800 2024-04-16T16:17:24.343 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.345+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30c406c8f0 msgr2=0x7f30c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.345+0000 7f30ec200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30c406c8f0 0x7f30c406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30d0036000 tx=0x7f30d0030000 comp rx=0 tx=0).stop 2024-04-16T16:17:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.345+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 msgr2=0x7f30e40abec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.345+0000 7f30ec200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30e40abec0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30d800d7d0 tx=0x7f30d800dc90 comp rx=0 tx=0).stop 2024-04-16T16:17:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 shutdown_connections 2024-04-16T16:17:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f30c406c8f0 0x7f30c406edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30e4149160 0x7f30e415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30e4148ce0 0x7f30e40aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 --2- 172.21.15.22:0/3331183662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30cc004800 0x7f30e40abec0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 >> 172.21.15.22:0/3331183662 conn(0x7f30e4062440 msgr2=0x7f30e40ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 shutdown_connections 2024-04-16T16:17:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.346+0000 7f30ec200640 1 -- 172.21.15.22:0/3331183662 wait complete. 2024-04-16T16:17:24.453 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is in failed state and validate the reason 2024-04-16T16:17:24.453 INFO:tasks.cephfs_test_runner:test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-16T16:17:24.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.684+0000 7f2c8a000640 1 Processor -- start 2024-04-16T16:17:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.684+0000 7f2c8a000640 1 -- start start 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c8a000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415cb70 0x7f2c8406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c8a000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c8406e690 0x7f2c84071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c8a000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c840afdc0 con 0x7f2c8415b7e0 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c8a000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8406eb00 con 0x7f2c8406e690 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c8a000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c840b45c0 con 0x7f2c8415cb70 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c83e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c8406e690 0x7f2c84071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c83400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2c8415b7e0 0x7f2c840af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38734/0 (socket says 172.21.15.22:38734) 2024-04-16T16:17:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.686+0000 7f2c83400640 1 -- 172.21.15.22:0/1235464827 learned_addr learned my addr 172.21.15.22:0/1235464827 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.687+0000 7f2c7aa00640 1 --2- 172.21.15.22:0/1235464827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415cb70 0x7f2c8406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.687+0000 7f2c83e00640 1 -- 172.21.15.22:0/1235464827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415cb70 msgr2=0x7f2c8406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.687+0000 7f2c83e00640 1 --2- 172.21.15.22:0/1235464827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415cb70 0x7f2c8406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.687+0000 7f2c83e00640 1 -- 172.21.15.22:0/1235464827 >> v1:172.21.15.22:6789/0 conn(0x7f2c8415b7e0 legacy=0x7f2c840af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.687+0000 7f2c83e00640 1 -- 172.21.15.22:0/1235464827 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c840b47f0 con 0x7f2c8406e690 2024-04-16T16:17:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.687+0000 7f2c82a00640 1 -- 172.21.15.22:0/1235464827 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705587202 0 0) 0x7f2c840afdc0 con 0x7f2c8415b7e0 2024-04-16T16:17:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.688+0000 7f2c83e00640 1 --2- 172.21.15.22:0/1235464827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8406e690 0x7f2c84071700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0097a0 tx=0x7f2c7c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373f5ed265d7dc51 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.689+0000 7f2c82a00640 1 -- 172.21.15.22:0/1235464827 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0315a0 con 0x7f2c8406e690 2024-04-16T16:17:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.689+0000 7f2c82a00640 1 -- 172.21.15.22:0/1235464827 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c037070 con 0x7f2c8406e690 2024-04-16T16:17:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.689+0000 7f2c82a00640 1 -- 172.21.15.22:0/1235464827 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c031960 con 0x7f2c8406e690 2024-04-16T16:17:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 -- 172.21.15.22:0/1235464827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8406e690 msgr2=0x7f2c84071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 --2- 172.21.15.22:0/1235464827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8406e690 0x7f2c84071700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0097a0 tx=0x7f2c7c02b840 comp rx=0 tx=0).stop 2024-04-16T16:17:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 -- 172.21.15.22:0/1235464827 shutdown_connections 2024-04-16T16:17:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 --2- 172.21.15.22:0/1235464827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8406e690 0x7f2c84071700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 --2- 172.21.15.22:0/1235464827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415cb70 0x7f2c8406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 -- 172.21.15.22:0/1235464827 >> 172.21.15.22:0/1235464827 conn(0x7f2c84062440 msgr2=0x7f2c84062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 -- 172.21.15.22:0/1235464827 shutdown_connections 2024-04-16T16:17:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.690+0000 7f2c8a000640 1 -- 172.21.15.22:0/1235464827 wait complete. 2024-04-16T16:17:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.691+0000 7f2c8a000640 1 Processor -- start 2024-04-16T16:17:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.692+0000 7f2c8a000640 1 -- start start 2024-04-16T16:17:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c8a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c8406e690 0x7f2c840c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c8a000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415b7e0 0x7f2c841515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c8a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8415cb70 0x7f2c840cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c8a000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2c840b5090 con 0x7f2c8415cb70 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c8a000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c840b4db0 con 0x7f2c8406e690 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c8a000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8415bbc0 con 0x7f2c8415b7e0 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8415cb70 0x7f2c840cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8415cb70 0x7f2c840cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36108/0 (socket says 172.21.15.22:36108) 2024-04-16T16:17:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 -- 172.21.15.22:0/4102468290 learned_addr learned my addr 172.21.15.22:0/4102468290 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 -- 172.21.15.22:0/4102468290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415b7e0 msgr2=0x7f2c841515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415b7e0 0x7f2c841515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 -- 172.21.15.22:0/4102468290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c8406e690 msgr2=0x7f2c840c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c8406e690 0x7f2c840c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.693+0000 7f2c83e00640 1 -- 172.21.15.22:0/4102468290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c840d00f0 con 0x7f2c8415cb70 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.694+0000 7f2c83e00640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8415cb70 0x7f2c840cfbb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c034040 tx=0x7f2c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.694+0000 7f2c7be00640 1 -- 172.21.15.22:0/4102468290 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c032630 con 0x7f2c8415cb70 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.694+0000 7f2c7be00640 1 -- 172.21.15.22:0/4102468290 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c0327f0 con 0x7f2c8415cb70 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.694+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c840c66d0 con 0x7f2c8415cb70 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.694+0000 7f2c7be00640 1 -- 172.21.15.22:0/4102468290 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c032be0 con 0x7f2c8415cb70 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.694+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c840cd8b0 con 0x7f2c8415cb70 2024-04-16T16:17:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.695+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8404fd90 con 0x7f2c8415cb70 2024-04-16T16:17:24.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.696+0000 7f2c7be00640 1 -- 172.21.15.22:0/4102468290 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c7c03b3f0 con 0x7f2c8415cb70 2024-04-16T16:17:24.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.697+0000 7f2c7be00640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:24.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.697+0000 7f2c7be00640 1 -- 172.21.15.22:0/4102468290 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2c7c02f030 con 0x7f2c8415cb70 2024-04-16T16:17:24.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.698+0000 7f2c83400640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:24.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.698+0000 7f2c83400640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c6006c8f0 0x7f2c6006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c74001560 tx=0x7f2c74007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:24.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.702+0000 7f2c7be00640 1 -- 172.21.15.22:0/4102468290 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c7c040070 con 0x7f2c8415cb70 2024-04-16T16:17:24.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.912+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c840d0320 con 0x7f2c8415cb70 2024-04-16T16:17:24.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.915+0000 7f2c7be00640 1 -- 172.21.15.22:0/4102468290 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7f2c7c07bb80 con 0x7f2c8415cb70 2024-04-16T16:17:24.916 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:24.916 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:24.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.918+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c6006c8f0 msgr2=0x7f2c6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.918+0000 7f2c8a000640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c6006c8f0 0x7f2c6006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c74001560 tx=0x7f2c74007ca0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.918+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8415cb70 msgr2=0x7f2c840cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:24.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.918+0000 7f2c8a000640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8415cb70 0x7f2c840cfbb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c034040 tx=0x7f2c7c0046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 shutdown_connections 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c8415cb70 0x7f2c840cfbb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8415b7e0 0x7f2c841515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 --2- 172.21.15.22:0/4102468290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c8406e690 0x7f2c840c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 >> 172.21.15.22:0/4102468290 conn(0x7f2c84062440 msgr2=0x7f2c8415a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 shutdown_connections 2024-04-16T16:17:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:24.919+0000 7f2c8a000640 1 -- 172.21.15.22:0/4102468290 wait complete. 2024-04-16T16:17:24.939 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:24.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:25.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.165+0000 7ff13fe00640 1 Processor -- start 2024-04-16T16:17:25.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.165+0000 7ff13fe00640 1 -- start start 2024-04-16T16:17:25.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.166+0000 7ff13fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff14015eb40 0x7ff1400cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.166+0000 7ff13fe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff1400d35d0 0x7ff1400d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.166+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1400d3a40 0x7ff1400d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.166+0000 7ff13fe00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff1400d3ed0 con 0x7ff14015eb40 2024-04-16T16:17:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.166+0000 7ff13fe00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff1400d41b0 con 0x7ff1400d35d0 2024-04-16T16:17:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.166+0000 7ff13fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff1400d4490 con 0x7ff1400d3a40 2024-04-16T16:17:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff14015eb40 0x7ff1400cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff14015eb40 0x7ff1400cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36112/0 (socket says 172.21.15.22:36112) 2024-04-16T16:17:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 -- 172.21.15.22:0/484959143 learned_addr learned my addr 172.21.15.22:0/484959143 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:25.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13f400640 1 --2- 172.21.15.22:0/484959143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1400d3a40 0x7ff1400d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 -- 172.21.15.22:0/484959143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1400d3a40 msgr2=0x7ff1400d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13e000640 1 --2- 172.21.15.22:0/484959143 >> v2:172.21.15.43:3300/0 conn(0x7ff1400d35d0 0x7ff1400d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 --2- 172.21.15.22:0/484959143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1400d3a40 0x7ff1400d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 -- 172.21.15.22:0/484959143 >> v2:172.21.15.43:3300/0 conn(0x7ff1400d35d0 msgr2=0x7ff1400d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 --2- 172.21.15.22:0/484959143 >> v2:172.21.15.43:3300/0 conn(0x7ff1400d35d0 0x7ff1400d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13ea00640 1 -- 172.21.15.22:0/484959143 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1400b7d90 con 0x7ff14015eb40 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13f400640 1 --2- 172.21.15.22:0/484959143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1400d3a40 0x7ff1400d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:25.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.167+0000 7ff13e000640 1 --2- 172.21.15.22:0/484959143 >> v2:172.21.15.43:3300/0 conn(0x7ff1400d35d0 0x7ff1400d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:25.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.168+0000 7ff13ea00640 1 --2- 172.21.15.22:0/484959143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14015eb40 0x7ff1400cfca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1400d01e0 tx=0x7ff13002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301069ef4af4e255 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:25.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.169+0000 7ff13d600640 1 -- 172.21.15.22:0/484959143 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130035020 con 0x7ff14015eb40 2024-04-16T16:17:25.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.169+0000 7ff13d600640 1 -- 172.21.15.22:0/484959143 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff130031870 con 0x7ff14015eb40 2024-04-16T16:17:25.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.169+0000 7ff13d600640 1 -- 172.21.15.22:0/484959143 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130031c40 con 0x7ff14015eb40 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.169+0000 7ff13fe00640 1 -- 172.21.15.22:0/484959143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14015eb40 msgr2=0x7ff1400cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.169+0000 7ff13fe00640 1 --2- 172.21.15.22:0/484959143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14015eb40 0x7ff1400cfca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1400d01e0 tx=0x7ff13002b910 comp rx=0 tx=0).stop 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.170+0000 7ff13fe00640 1 -- 172.21.15.22:0/484959143 shutdown_connections 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.170+0000 7ff13fe00640 1 --2- 172.21.15.22:0/484959143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1400d3a40 0x7ff1400d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.170+0000 7ff13fe00640 1 --2- 172.21.15.22:0/484959143 >> v2:172.21.15.43:3300/0 conn(0x7ff1400d35d0 0x7ff1400d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.170+0000 7ff13fe00640 1 --2- 172.21.15.22:0/484959143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14015eb40 0x7ff1400cfca0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.170+0000 7ff13fe00640 1 -- 172.21.15.22:0/484959143 >> 172.21.15.22:0/484959143 conn(0x7ff140072460 msgr2=0x7ff140072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.170+0000 7ff13fe00640 1 -- 172.21.15.22:0/484959143 shutdown_connections 2024-04-16T16:17:25.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.170+0000 7ff13fe00640 1 -- 172.21.15.22:0/484959143 wait complete. 2024-04-16T16:17:25.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.171+0000 7ff13fe00640 1 Processor -- start 2024-04-16T16:17:25.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.172+0000 7ff13fe00640 1 -- start start 2024-04-16T16:17:25.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.172+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1400d35d0 0x7ff1400cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.172+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff14015eb40 0x7ff1400cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.172+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1400cb900 0x7ff1401611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.172+0000 7ff13fe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1400d4940 con 0x7ff1400d35d0 2024-04-16T16:17:25.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.172+0000 7ff13fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1400d47c0 con 0x7ff1400cb900 2024-04-16T16:17:25.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.172+0000 7ff13fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff1400d4ac0 con 0x7ff14015eb40 2024-04-16T16:17:25.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1400d35d0 0x7ff1400cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1400d35d0 0x7ff1400cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36120/0 (socket says 172.21.15.22:36120) 2024-04-16T16:17:25.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 -- 172.21.15.22:0/1497857590 learned_addr learned my addr 172.21.15.22:0/1497857590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:25.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13f400640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1400cb900 0x7ff1401611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 -- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff14015eb40 msgr2=0x7ff1400cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13e000640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff14015eb40 0x7ff1400cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff14015eb40 0x7ff1400cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 -- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1400cb900 msgr2=0x7ff1401611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1400cb900 0x7ff1401611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13ea00640 1 -- 172.21.15.22:0/1497857590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1400cd6c0 con 0x7ff1400d35d0 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.173+0000 7ff13f400640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1400cb900 0x7ff1401611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.174+0000 7ff13ea00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1400d35d0 0x7ff1400cae10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff13002b950 tx=0x7ff1300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.174+0000 7ff137400640 1 -- 172.21.15.22:0/1497857590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130040070 con 0x7ff1400d35d0 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.174+0000 7ff137400640 1 -- 172.21.15.22:0/1497857590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13003a420 con 0x7ff1400d35d0 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.174+0000 7ff137400640 1 -- 172.21.15.22:0/1497857590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130035040 con 0x7ff1400d35d0 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.174+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1400cc0e0 con 0x7ff1400d35d0 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.174+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1400cc6a0 con 0x7ff1400d35d0 2024-04-16T16:17:25.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.175+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff140075f30 con 0x7ff1400d35d0 2024-04-16T16:17:25.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.176+0000 7ff137400640 1 -- 172.21.15.22:0/1497857590 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff13004b060 con 0x7ff1400d35d0 2024-04-16T16:17:25.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.177+0000 7ff137400640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff11c06c8f0 0x7ff11c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.177+0000 7ff137400640 1 -- 172.21.15.22:0/1497857590 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff1300ada20 con 0x7ff1400d35d0 2024-04-16T16:17:25.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.178+0000 7ff13e000640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff11c06c8f0 0x7ff11c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.178+0000 7ff13e000640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff11c06c8f0 0x7ff11c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff14015b7a0 tx=0x7ff1280084d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:25.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.182+0000 7ff137400640 1 -- 172.21.15.22:0/1497857590 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff13007bee0 con 0x7ff1400d35d0 2024-04-16T16:17:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.384+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff1400ba130 con 0x7ff1400d35d0 2024-04-16T16:17:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.385+0000 7ff137400640 1 -- 172.21.15.22:0/1497857590 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff13007b7e0 con 0x7ff1400d35d0 2024-04-16T16:17:25.385 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff11c06c8f0 msgr2=0x7ff11c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff11c06c8f0 0x7ff11c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff14015b7a0 tx=0x7ff1280084d0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1400d35d0 msgr2=0x7ff1400cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1400d35d0 0x7ff1400cae10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff13002b950 tx=0x7ff1300046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 shutdown_connections 2024-04-16T16:17:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff11c06c8f0 0x7ff11c06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1400cb900 0x7ff1401611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff14015eb40 0x7ff1400cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 --2- 172.21.15.22:0/1497857590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1400d35d0 0x7ff1400cae10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 >> 172.21.15.22:0/1497857590 conn(0x7ff140072460 msgr2=0x7ff1400cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 shutdown_connections 2024-04-16T16:17:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.388+0000 7ff13fe00640 1 -- 172.21.15.22:0/1497857590 wait complete. 2024-04-16T16:17:25.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.633+0000 7ff5dd600640 1 Processor -- start 2024-04-16T16:17:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.633+0000 7ff5dd600640 1 -- start start 2024-04-16T16:17:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.635+0000 7ff5dd600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff5d815eb60 0x7ff5d80cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.635+0000 7ff5dd600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5d80d3a60 0x7ff5d80b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.635+0000 7ff5dd600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d80d3ef0 con 0x7ff5d80d35f0 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.635+0000 7ff5dd600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d80d41d0 con 0x7ff5d80d3a60 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.635+0000 7ff5dd600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d80d44b0 con 0x7ff5d815eb60 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5dcc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5d80d3a60 0x7ff5d80b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5dcc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5d80d3a60 0x7ff5d80b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36124/0 (socket says 172.21.15.22:36124) 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5dcc00640 1 -- 172.21.15.22:0/2455725403 learned_addr learned my addr 172.21.15.22:0/2455725403 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5d7e00640 1 --2- 172.21.15.22:0/2455725403 >> v2:172.21.15.43:3300/0 conn(0x7ff5d815eb60 0x7ff5d80cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5dcc00640 1 -- 172.21.15.22:0/2455725403 >> v2:172.21.15.43:3300/0 conn(0x7ff5d815eb60 msgr2=0x7ff5d80cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:25.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5dcc00640 1 --2- 172.21.15.22:0/2455725403 >> v2:172.21.15.43:3300/0 conn(0x7ff5d815eb60 0x7ff5d80cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5dcc00640 1 -- 172.21.15.22:0/2455725403 >> v1:172.21.15.43:6789/0 conn(0x7ff5d80d35f0 legacy=0x7ff5d80d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.636+0000 7ff5dcc00640 1 -- 172.21.15.22:0/2455725403 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d80b7db0 con 0x7ff5d80d3a60 2024-04-16T16:17:25.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.637+0000 7ff5dcc00640 1 --2- 172.21.15.22:0/2455725403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d80d3a60 0x7ff5d80b82d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80d47b0 tx=0x7ff5d002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab2c0b3504b0f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:25.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.638+0000 7ff5d7400640 1 -- 172.21.15.22:0/2455725403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d002cb20 con 0x7ff5d80d3a60 2024-04-16T16:17:25.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.638+0000 7ff5d7400640 1 -- 172.21.15.22:0/2455725403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d002ccc0 con 0x7ff5d80d3a60 2024-04-16T16:17:25.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.638+0000 7ff5d7400640 1 -- 172.21.15.22:0/2455725403 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0034610 con 0x7ff5d80d3a60 2024-04-16T16:17:25.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.638+0000 7ff5dd600640 1 -- 172.21.15.22:0/2455725403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d80d3a60 msgr2=0x7ff5d80b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.638+0000 7ff5dd600640 1 --2- 172.21.15.22:0/2455725403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d80d3a60 0x7ff5d80b82d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80d47b0 tx=0x7ff5d002bf80 comp rx=0 tx=0).stop 2024-04-16T16:17:25.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.639+0000 7ff5dd600640 1 -- 172.21.15.22:0/2455725403 shutdown_connections 2024-04-16T16:17:25.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.639+0000 7ff5dd600640 1 --2- 172.21.15.22:0/2455725403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d80d3a60 0x7ff5d80b82d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.639+0000 7ff5dd600640 1 --2- 172.21.15.22:0/2455725403 >> v2:172.21.15.43:3300/0 conn(0x7ff5d815eb60 0x7ff5d80cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.639+0000 7ff5dd600640 1 -- 172.21.15.22:0/2455725403 >> 172.21.15.22:0/2455725403 conn(0x7ff5d8072460 msgr2=0x7ff5d8072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:25.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.639+0000 7ff5dd600640 1 -- 172.21.15.22:0/2455725403 shutdown_connections 2024-04-16T16:17:25.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.639+0000 7ff5dd600640 1 -- 172.21.15.22:0/2455725403 wait complete. 2024-04-16T16:17:25.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.641+0000 7ff5dd600640 1 Processor -- start 2024-04-16T16:17:25.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.641+0000 7ff5dd600640 1 -- start start 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.642+0000 7ff5dd600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d80d35f0 0x7ff5d80c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.642+0000 7ff5dd600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d815eb60 0x7ff5d815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.642+0000 7ff5dd600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d815bb00 0x7ff5d81e8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.642+0000 7ff5dd600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d80d2030 con 0x7ff5d815eb60 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.642+0000 7ff5dd600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d80d1eb0 con 0x7ff5d815bb00 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.642+0000 7ff5dd600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d80b8810 con 0x7ff5d80d35f0 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d815eb60 0x7ff5d815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d815eb60 0x7ff5d815b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36128/0 (socket says 172.21.15.22:36128) 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 -- 172.21.15.22:0/1670459477 learned_addr learned my addr 172.21.15.22:0/1670459477 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5dcc00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d815bb00 0x7ff5d81e8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5d7e00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d80d35f0 0x7ff5d80c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 -- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d80d35f0 msgr2=0x7ff5d80c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d80d35f0 0x7ff5d80c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 -- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d815bb00 msgr2=0x7ff5d81e8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d815bb00 0x7ff5d81e8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5cfe00640 1 -- 172.21.15.22:0/1670459477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d81e8060 con 0x7ff5d815eb60 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.643+0000 7ff5d7e00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d80d35f0 0x7ff5d80c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.644+0000 7ff5cfe00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d815eb60 0x7ff5d815b5c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c430 tx=0x7ff5c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.644+0000 7ff5d4c00640 1 -- 172.21.15.22:0/1670459477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00052d0 con 0x7ff5d815eb60 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.644+0000 7ff5d4c00640 1 -- 172.21.15.22:0/1670459477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c0005490 con 0x7ff5d815eb60 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.644+0000 7ff5d4c00640 1 -- 172.21.15.22:0/1670459477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0007260 con 0x7ff5d815eb60 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.644+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d81e8530 con 0x7ff5d815eb60 2024-04-16T16:17:25.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.644+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d815c480 con 0x7ff5d815eb60 2024-04-16T16:17:25.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.645+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d815bf10 con 0x7ff5d815eb60 2024-04-16T16:17:25.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.646+0000 7ff5d4c00640 1 -- 172.21.15.22:0/1670459477 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5c0007400 con 0x7ff5d815eb60 2024-04-16T16:17:25.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.647+0000 7ff5d4c00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5b406c8f0 0x7ff5b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:25.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.647+0000 7ff5d4c00640 1 -- 172.21.15.22:0/1670459477 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5c008b140 con 0x7ff5d815eb60 2024-04-16T16:17:25.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.648+0000 7ff5d7e00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5b406c8f0 0x7ff5b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:25.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.648+0000 7ff5d7e00640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5b406c8f0 0x7ff5b406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8006fd0 tx=0x7ff5c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:25.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.652+0000 7ff5d4c00640 1 -- 172.21.15.22:0/1670459477 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5c00594e0 con 0x7ff5d815eb60 2024-04-16T16:17:25.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.859+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff5d8075f30 con 0x7ff5d815eb60 2024-04-16T16:17:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.860+0000 7ff5d4c00640 1 -- 172.21.15.22:0/1670459477 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff5c0058de0 con 0x7ff5d815eb60 2024-04-16T16:17:25.860 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5b406c8f0 msgr2=0x7ff5b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5b406c8f0 0x7ff5b406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8006fd0 tx=0x7ff5c8008040 comp rx=0 tx=0).stop 2024-04-16T16:17:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d815eb60 msgr2=0x7ff5d815b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d815eb60 0x7ff5d815b5c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c430 tx=0x7ff5c000c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 shutdown_connections 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff5b406c8f0 0x7ff5b406edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d815bb00 0x7ff5d81e8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d815eb60 0x7ff5d815b5c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 --2- 172.21.15.22:0/1670459477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d80d35f0 0x7ff5d80c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 >> 172.21.15.22:0/1670459477 conn(0x7ff5d8072460 msgr2=0x7ff5d80d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 shutdown_connections 2024-04-16T16:17:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:25.862+0000 7ff5dd600640 1 -- 172.21.15.22:0/1670459477 wait complete. 2024-04-16T16:17:25.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:26.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.108+0000 7f332be00640 1 Processor -- start 2024-04-16T16:17:26.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.109+0000 7f332be00640 1 -- start start 2024-04-16T16:17:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.110+0000 7f332be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f332c0cfcc0 0x7f332c0d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.110+0000 7f332be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f332c0d1ce0 0x7f332c0b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.110+0000 7f332be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c0d20f0 con 0x7f332c15eb60 2024-04-16T16:17:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.110+0000 7f332be00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f332c0d3ef0 con 0x7f332c0d1ce0 2024-04-16T16:17:26.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.110+0000 7f332be00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f332c0d41d0 con 0x7f332c0cfcc0 2024-04-16T16:17:26.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332aa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f332c15eb60 0x7f332c0d35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38744/0 (socket says 172.21.15.22:38744) 2024-04-16T16:17:26.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332aa00640 1 -- 172.21.15.22:0/968511953 learned_addr learned my addr 172.21.15.22:0/968511953 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:26.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332b400640 1 --2- 172.21.15.22:0/968511953 >> v2:172.21.15.22:3300/0 conn(0x7f332c0d1ce0 0x7f332c0b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332a000640 1 --2- 172.21.15.22:0/968511953 >> v2:172.21.15.43:3300/0 conn(0x7f332c0cfcc0 0x7f332c0d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f3329600640 1 -- 172.21.15.22:0/968511953 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391680035 0 0) 0x7f331c001110 con 0x7f332c15eb60 2024-04-16T16:17:26.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332b400640 1 -- 172.21.15.22:0/968511953 >> v2:172.21.15.43:3300/0 conn(0x7f332c0cfcc0 msgr2=0x7f332c0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:26.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332b400640 1 --2- 172.21.15.22:0/968511953 >> v2:172.21.15.43:3300/0 conn(0x7f332c0cfcc0 0x7f332c0d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332b400640 1 -- 172.21.15.22:0/968511953 >> v1:172.21.15.22:6789/0 conn(0x7f332c15eb60 legacy=0x7f332c0d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.111+0000 7f332b400640 1 -- 172.21.15.22:0/968511953 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c0d44b0 con 0x7f332c0d1ce0 2024-04-16T16:17:26.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.112+0000 7f332b400640 1 --2- 172.21.15.22:0/968511953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c0b82d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f332c0b6910 tx=0x7f332402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc5ae1d973e7363 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:26.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f3329600640 1 -- 172.21.15.22:0/968511953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324039070 con 0x7f332c0d1ce0 2024-04-16T16:17:26.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f3329600640 1 -- 172.21.15.22:0/968511953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332402cc80 con 0x7f332c0d1ce0 2024-04-16T16:17:26.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f3329600640 1 -- 172.21.15.22:0/968511953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324034660 con 0x7f332c0d1ce0 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f332be00640 1 -- 172.21.15.22:0/968511953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 msgr2=0x7f332c0b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f332be00640 1 --2- 172.21.15.22:0/968511953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c0b82d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f332c0b6910 tx=0x7f332402bed0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f332be00640 1 -- 172.21.15.22:0/968511953 shutdown_connections 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f332be00640 1 --2- 172.21.15.22:0/968511953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c0b82d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f332be00640 1 --2- 172.21.15.22:0/968511953 >> v2:172.21.15.43:3300/0 conn(0x7f332c0cfcc0 0x7f332c0d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f332be00640 1 -- 172.21.15.22:0/968511953 >> 172.21.15.22:0/968511953 conn(0x7f332c072460 msgr2=0x7f332c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.113+0000 7f332be00640 1 -- 172.21.15.22:0/968511953 shutdown_connections 2024-04-16T16:17:26.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.114+0000 7f332be00640 1 -- 172.21.15.22:0/968511953 wait complete. 2024-04-16T16:17:26.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.115+0000 7f332be00640 1 Processor -- start 2024-04-16T16:17:26.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.115+0000 7f332be00640 1 -- start start 2024-04-16T16:17:26.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.116+0000 7f332be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0cfcc0 0x7f332c1e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.116+0000 7f332be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c1e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.116+0000 7f332be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c15eb60 0x7f332c14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.116+0000 7f332be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0b7b70 con 0x7f332c0d1ce0 2024-04-16T16:17:26.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.116+0000 7f332be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0b79f0 con 0x7f332c15eb60 2024-04-16T16:17:26.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.116+0000 7f332be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f332c0b8810 con 0x7f332c0cfcc0 2024-04-16T16:17:26.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c1e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c1e7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36146/0 (socket says 172.21.15.22:36146) 2024-04-16T16:17:26.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 -- 172.21.15.22:0/3785313482 learned_addr learned my addr 172.21.15.22:0/3785313482 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 -- 172.21.15.22:0/3785313482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0cfcc0 msgr2=0x7f332c1e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0cfcc0 0x7f332c1e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 -- 172.21.15.22:0/3785313482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c15eb60 msgr2=0x7f332c14cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c15eb60 0x7f332c14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 -- 172.21.15.22:0/3785313482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c15cf20 con 0x7f332c0d1ce0 2024-04-16T16:17:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.117+0000 7f332a000640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c1e7700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f331800d830 tx=0x7f331800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.118+0000 7f3322a00640 1 -- 172.21.15.22:0/3785313482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331800b6c0 con 0x7f332c0d1ce0 2024-04-16T16:17:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.118+0000 7f3322a00640 1 -- 172.21.15.22:0/3785313482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3318019070 con 0x7f332c0d1ce0 2024-04-16T16:17:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.118+0000 7f3322a00640 1 -- 172.21.15.22:0/3785313482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331800ba80 con 0x7f332c0d1ce0 2024-04-16T16:17:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.118+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c0ca440 con 0x7f332c0d1ce0 2024-04-16T16:17:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.118+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c14ada0 con 0x7f332c0d1ce0 2024-04-16T16:17:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.119+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332c075f30 con 0x7f332c0d1ce0 2024-04-16T16:17:26.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.120+0000 7f3322a00640 1 -- 172.21.15.22:0/3785313482 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f331801e460 con 0x7f332c0d1ce0 2024-04-16T16:17:26.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.121+0000 7f3322a00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f330c06c8f0 0x7f330c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.122+0000 7f3322a00640 1 -- 172.21.15.22:0/3785313482 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f331808c360 con 0x7f332c0d1ce0 2024-04-16T16:17:26.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.122+0000 7f332aa00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f330c06c8f0 0x7f330c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.123+0000 7f332aa00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f330c06c8f0 0x7f330c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f331c007fd0 tx=0x7f331c007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.126+0000 7f3322a00640 1 -- 172.21.15.22:0/3785313482 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f331805a660 con 0x7f332c0d1ce0 2024-04-16T16:17:26.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.331+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f332c068f70 con 0x7f332c0d1ce0 2024-04-16T16:17:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.331+0000 7f3322a00640 1 -- 172.21.15.22:0/3785313482 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3318059f60 con 0x7f332c0d1ce0 2024-04-16T16:17:26.332 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f330c06c8f0 msgr2=0x7f330c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f330c06c8f0 0x7f330c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f331c007fd0 tx=0x7f331c007960 comp rx=0 tx=0).stop 2024-04-16T16:17:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 msgr2=0x7f332c1e7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c1e7700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f331800d830 tx=0x7f331800dcf0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 shutdown_connections 2024-04-16T16:17:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f330c06c8f0 0x7f330c06edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c15eb60 0x7f332c14cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0d1ce0 0x7f332c1e7700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 --2- 172.21.15.22:0/3785313482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0cfcc0 0x7f332c1e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 >> 172.21.15.22:0/3785313482 conn(0x7f332c072460 msgr2=0x7f332c072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:26.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 shutdown_connections 2024-04-16T16:17:26.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.335+0000 7f332be00640 1 -- 172.21.15.22:0/3785313482 wait complete. 2024-04-16T16:17:26.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2024-04-16T16:17:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.585+0000 7f0f66e00640 1 Processor -- start 2024-04-16T16:17:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.586+0000 7f0f66e00640 1 -- start start 2024-04-16T16:17:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.587+0000 7f0f66e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0f6006eaa0 0x7f0f600b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.587+0000 7f0f66e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6006d160 con 0x7f0f6006ee80 2024-04-16T16:17:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.587+0000 7f0f66e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6006d440 con 0x7f0f600cc810 2024-04-16T16:17:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.587+0000 7f0f66e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f0f6006cf10 con 0x7f0f6006eaa0 2024-04-16T16:17:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.587+0000 7f0f66400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0f6006ee80 0x7f0f6015c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38752/0 (socket says 172.21.15.22:38752) 2024-04-16T16:17:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f66400640 1 -- 172.21.15.22:0/4049740589 learned_addr learned my addr 172.21.15.22:0/4049740589 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f65a00640 1 --2- 172.21.15.22:0/4049740589 >> v2:172.21.15.43:3300/0 conn(0x7f0f6006eaa0 0x7f0f600b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810919461 0 0) 0x7f0f6006d160 con 0x7f0f6006ee80 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f48003520 con 0x7f0f6006ee80 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1385852719 0 0) 0x7f0f48003520 con 0x7f0f6006ee80 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 >> v2:172.21.15.43:3300/0 conn(0x7f0f6006eaa0 msgr2=0x7f0f600b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f5fe00640 1 --2- 172.21.15.22:0/4049740589 >> v2:172.21.15.43:3300/0 conn(0x7f0f6006eaa0 0x7f0f600b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 >> v1:172.21.15.43:6789/0 conn(0x7f0f600cc810 legacy=0x7f0f6006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.588+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6006d720 con 0x7f0f6006ee80 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f0f580019f0 con 0x7f0f6006ee80 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 >> v1:172.21.15.22:6789/0 conn(0x7f0f6006ee80 legacy=0x7f0f6015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f48004800 0x7f0f48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f480051c0 0x7f0f4800fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6006cf10 con 0x7f0f480039b0 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48010470 con 0x7f0f480051c0 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0f48010670 con 0x7f0f48004800 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f65a00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f66400640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f480051c0 0x7f0f4800fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f65a00640 1 -- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f48004800 msgr2=0x7f0f48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.589+0000 7f0f65000640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f48004800 0x7f0f48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.590+0000 7f0f65a00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f48004800 0x7f0f48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.590+0000 7f0f65a00640 1 -- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f480051c0 msgr2=0x7f0f4800fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.590+0000 7f0f65a00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f480051c0 0x7f0f4800fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.590+0000 7f0f65a00640 1 -- 172.21.15.22:0/4049740589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f48003520 con 0x7f0f480039b0 2024-04-16T16:17:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.590+0000 7f0f65000640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f48004800 0x7f0f48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.590+0000 7f0f66400640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f480051c0 0x7f0f4800fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.590+0000 7f0f66400640 1 -- 172.21.15.22:0/4049740589 reap_dead start 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.591+0000 7f0f65a00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f48003dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009ac0 tx=0x7f0f48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e6ee8af4d46c20 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.591+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54039070 con 0x7f0f480039b0 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.591+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5402c6b0 con 0x7f0f480039b0 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.591+0000 7f0f5fe00640 1 -- 172.21.15.22:0/4049740589 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54009690 con 0x7f0f480039b0 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.592+0000 7f0f66e00640 1 -- 172.21.15.22:0/4049740589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 msgr2=0x7f0f48003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.592+0000 7f0f66e00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f48003dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009ac0 tx=0x7f0f48005830 comp rx=0 tx=0).stop 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.592+0000 7f0f66e00640 1 -- 172.21.15.22:0/4049740589 shutdown_connections 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.592+0000 7f0f66e00640 1 --2- 172.21.15.22:0/4049740589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f48003dd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.592+0000 7f0f66e00640 1 -- 172.21.15.22:0/4049740589 >> 172.21.15.22:0/4049740589 conn(0x7f0f60062440 msgr2=0x7f0f60062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.592+0000 7f0f66e00640 1 -- 172.21.15.22:0/4049740589 shutdown_connections 2024-04-16T16:17:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.592+0000 7f0f66e00640 1 -- 172.21.15.22:0/4049740589 wait complete. 2024-04-16T16:17:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.594+0000 7f0f66e00640 1 Processor -- start 2024-04-16T16:17:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.594+0000 7f0f66e00640 1 -- start start 2024-04-16T16:17:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f66e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f601e2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f66e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f601e3bc0 0x7f0f600ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f66e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6014bd50 0x7f0f6014c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f66e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f600b3fa0 con 0x7f0f480039b0 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f66e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f600b3e20 con 0x7f0f6014bd50 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f66e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0f600b4120 con 0x7f0f601e3bc0 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f601e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f601e2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36160/0 (socket says 172.21.15.22:36160) 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 -- 172.21.15.22:0/3296875627 learned_addr learned my addr 172.21.15.22:0/3296875627 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 -- 172.21.15.22:0/3296875627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f601e3bc0 msgr2=0x7f0f600ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f601e3bc0 0x7f0f600ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 -- 172.21.15.22:0/3296875627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6014bd50 msgr2=0x7f0f6014c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6014bd50 0x7f0f6014c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.595+0000 7f0f65a00640 1 -- 172.21.15.22:0/3296875627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f601e2b20 con 0x7f0f480039b0 2024-04-16T16:17:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.596+0000 7f0f65a00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f601e2460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009ac0 tx=0x7f0f54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.596+0000 7f0f5d600640 1 -- 172.21.15.22:0/3296875627 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54039050 con 0x7f0f480039b0 2024-04-16T16:17:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.596+0000 7f0f5d600640 1 -- 172.21.15.22:0/3296875627 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54045070 con 0x7f0f480039b0 2024-04-16T16:17:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.596+0000 7f0f5d600640 1 -- 172.21.15.22:0/3296875627 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540044e0 con 0x7f0f480039b0 2024-04-16T16:17:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.596+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f601e2e00 con 0x7f0f480039b0 2024-04-16T16:17:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.596+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f601e33c0 con 0x7f0f480039b0 2024-04-16T16:17:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.598+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f60075f30 con 0x7f0f480039b0 2024-04-16T16:17:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.599+0000 7f0f5d600640 1 -- 172.21.15.22:0/3296875627 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f54003a50 con 0x7f0f480039b0 2024-04-16T16:17:26.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.599+0000 7f0f5d600640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0f4006c8f0 0x7f0f4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:26.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.600+0000 7f0f5d600640 1 -- 172.21.15.22:0/3296875627 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f540ad160 con 0x7f0f480039b0 2024-04-16T16:17:26.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.600+0000 7f0f65000640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0f4006c8f0 0x7f0f4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.601+0000 7f0f65000640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0f4006c8f0 0x7f0f4006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007fd0 tx=0x7f0f4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.604+0000 7f0f5d600640 1 -- 172.21.15.22:0/3296875627 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f5407b590 con 0x7f0f480039b0 2024-04-16T16:17:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.886+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) -- 0x7f0f600b4b70 con 0x7f0f480039b0 2024-04-16T16:17:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.967+0000 7f0f5d600640 1 -- 172.21.15.22:0/3296875627 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v58) ==== 168+0+0 (secure 0 0 0) 0x7f0f5407ae90 con 0x7f0f480039b0 2024-04-16T16:17:26.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0f4006c8f0 msgr2=0x7f0f4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0f4006c8f0 0x7f0f4006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007fd0 tx=0x7f0f4c009040 comp rx=0 tx=0).stop 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 msgr2=0x7f0f601e2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f601e2460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009ac0 tx=0x7f0f54004730 comp rx=0 tx=0).stop 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 shutdown_connections 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0f4006c8f0 0x7f0f4006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6014bd50 0x7f0f6014c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f601e3bc0 0x7f0f600ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 --2- 172.21.15.22:0/3296875627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f480039b0 0x7f0f601e2460 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.971+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 >> 172.21.15.22:0/3296875627 conn(0x7f0f60062440 msgr2=0x7f0f600cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.972+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 shutdown_connections 2024-04-16T16:17:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:26.972+0000 7f0f66e00640 1 -- 172.21.15.22:0/3296875627 wait complete. 2024-04-16T16:17:26.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T16:17:27.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.220+0000 7fc915e00640 1 Processor -- start 2024-04-16T16:17:27.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.220+0000 7fc915e00640 1 -- start start 2024-04-16T16:17:27.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc915e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc91015fe30 0x7fc910070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc915e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc9100b33a0 0x7fc9100ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc915e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9100715c0 con 0x7fc9100b4fa0 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc915e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc910071360 con 0x7fc91015fe30 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc915e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc9100718a0 con 0x7fc9100b33a0 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc914a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc9100b4fa0 0x7fc91015f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38758/0 (socket says 172.21.15.22:38758) 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc914a00640 1 -- 172.21.15.22:0/2924598454 learned_addr learned my addr 172.21.15.22:0/2924598454 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.222+0000 7fc90fe00640 1 --2- 172.21.15.22:0/2924598454 >> v2:172.21.15.22:3300/0 conn(0x7fc91015fe30 0x7fc910070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.223+0000 7fc915400640 1 --2- 172.21.15.22:0/2924598454 >> v2:172.21.15.43:3300/0 conn(0x7fc9100b33a0 0x7fc9100ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.223+0000 7fc90f400640 1 -- 172.21.15.22:0/2924598454 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721897515 0 0) 0x7fc9100715c0 con 0x7fc9100b4fa0 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.223+0000 7fc90f400640 1 -- 172.21.15.22:0/2924598454 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f8003520 con 0x7fc9100b4fa0 2024-04-16T16:17:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.223+0000 7fc90fe00640 1 -- 172.21.15.22:0/2924598454 >> v2:172.21.15.43:3300/0 conn(0x7fc9100b33a0 msgr2=0x7fc9100ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.223+0000 7fc90fe00640 1 --2- 172.21.15.22:0/2924598454 >> v2:172.21.15.43:3300/0 conn(0x7fc9100b33a0 0x7fc9100ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.223+0000 7fc90fe00640 1 -- 172.21.15.22:0/2924598454 >> v1:172.21.15.22:6789/0 conn(0x7fc9100b4fa0 legacy=0x7fc91015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.223+0000 7fc90fe00640 1 -- 172.21.15.22:0/2924598454 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc910071b80 con 0x7fc91015fe30 2024-04-16T16:17:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.224+0000 7fc90fe00640 1 --2- 172.21.15.22:0/2924598454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910070e20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc9100cdd10 tx=0x7fc90002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853f4765e5d564d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc90f400640 1 -- 172.21.15.22:0/2924598454 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900035020 con 0x7fc91015fe30 2024-04-16T16:17:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc90f400640 1 -- 172.21.15.22:0/2924598454 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc900031830 con 0x7fc91015fe30 2024-04-16T16:17:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc90f400640 1 -- 172.21.15.22:0/2924598454 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900031c00 con 0x7fc91015fe30 2024-04-16T16:17:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 -- 172.21.15.22:0/2924598454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 msgr2=0x7fc910070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 --2- 172.21.15.22:0/2924598454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910070e20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc9100cdd10 tx=0x7fc90002b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 -- 172.21.15.22:0/2924598454 shutdown_connections 2024-04-16T16:17:27.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 --2- 172.21.15.22:0/2924598454 >> v2:172.21.15.43:3300/0 conn(0x7fc9100b33a0 0x7fc9100ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 --2- 172.21.15.22:0/2924598454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910070e20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 -- 172.21.15.22:0/2924598454 >> 172.21.15.22:0/2924598454 conn(0x7fc910075070 msgr2=0x7fc910062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:27.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 -- 172.21.15.22:0/2924598454 shutdown_connections 2024-04-16T16:17:27.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.225+0000 7fc915e00640 1 -- 172.21.15.22:0/2924598454 wait complete. 2024-04-16T16:17:27.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.227+0000 7fc915e00640 1 Processor -- start 2024-04-16T16:17:27.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.227+0000 7fc915e00640 1 -- start start 2024-04-16T16:17:27.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.228+0000 7fc915e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9100b33a0 0x7fc910151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:27.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.228+0000 7fc915e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9100b4fa0 0x7fc9101f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:27.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.228+0000 7fc915e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.228+0000 7fc915e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9100b5380 con 0x7fc91015fe30 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.228+0000 7fc915e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9100ce630 con 0x7fc9100b4fa0 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.228+0000 7fc915e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9100b5500 con 0x7fc9100b33a0 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36176/0 (socket says 172.21.15.22:36176) 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 -- 172.21.15.22:0/3943915596 learned_addr learned my addr 172.21.15.22:0/3943915596 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc914a00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9100b33a0 0x7fc910151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc90fe00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9100b4fa0 0x7fc9101f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 -- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9100b33a0 msgr2=0x7fc910151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9100b33a0 0x7fc910151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 -- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9100b4fa0 msgr2=0x7fc9101f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9100b4fa0 0x7fc9101f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc915400640 1 -- 172.21.15.22:0/3943915596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc910153980 con 0x7fc91015fe30 2024-04-16T16:17:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.229+0000 7fc90fe00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9100b4fa0 0x7fc9101f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.230+0000 7fc915400640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910153440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc908007e40 tx=0x7fc90800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.230+0000 7fc90cc00640 1 -- 172.21.15.22:0/3943915596 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908014620 con 0x7fc91015fe30 2024-04-16T16:17:27.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.230+0000 7fc90cc00640 1 -- 172.21.15.22:0/3943915596 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc908019070 con 0x7fc91015fe30 2024-04-16T16:17:27.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.230+0000 7fc90cc00640 1 -- 172.21.15.22:0/3943915596 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908014a20 con 0x7fc91015fe30 2024-04-16T16:17:27.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.230+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9101f4c50 con 0x7fc91015fe30 2024-04-16T16:17:27.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.230+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9101f5210 con 0x7fc91015fe30 2024-04-16T16:17:27.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.231+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc910075f30 con 0x7fc91015fe30 2024-04-16T16:17:27.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.232+0000 7fc90cc00640 1 -- 172.21.15.22:0/3943915596 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc908014bc0 con 0x7fc91015fe30 2024-04-16T16:17:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.234+0000 7fc90cc00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc8f406c8f0 0x7fc8f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.234+0000 7fc90cc00640 1 -- 172.21.15.22:0/3943915596 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc90808c500 con 0x7fc91015fe30 2024-04-16T16:17:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.234+0000 7fc914a00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc8f406c8f0 0x7fc8f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.235+0000 7fc914a00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc8f406c8f0 0x7fc8f406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc904005880 tx=0x7fc904009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:27.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.238+0000 7fc90cc00640 1 -- 172.21.15.22:0/3943915596 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc90805a890 con 0x7fc91015fe30 2024-04-16T16:17:27.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.444+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc910072560 con 0x7fc91015fe30 2024-04-16T16:17:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.450+0000 7fc90cc00640 1 -- 172.21.15.22:0/3943915596 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc90805a190 con 0x7fc91015fe30 2024-04-16T16:17:27.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc8f406c8f0 msgr2=0x7fc8f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:27.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc8f406c8f0 0x7fc8f406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc904005880 tx=0x7fc904009040 comp rx=0 tx=0).stop 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 msgr2=0x7fc910153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910153440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc908007e40 tx=0x7fc90800e4b0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 shutdown_connections 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc8f406c8f0 0x7fc8f406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc91015fe30 0x7fc910153440 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9100b4fa0 0x7fc9101f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 --2- 172.21.15.22:0/3943915596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9100b33a0 0x7fc910151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 >> 172.21.15.22:0/3943915596 conn(0x7fc910075070 msgr2=0x7fc91015c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 shutdown_connections 2024-04-16T16:17:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:27.453+0000 7fc915e00640 1 -- 172.21.15.22:0/3943915596 wait complete. 2024-04-16T16:17:27.475 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T16:17:27.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:17:27.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:17:27.733 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T16:17:27.733 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:27.734 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:27.795 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:27.795 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:27.850 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:27.850 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:27.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:28.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.127+0000 7f2971600640 1 Processor -- start 2024-04-16T16:17:28.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.128+0000 7f2971600640 1 -- start start 2024-04-16T16:17:28.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.129+0000 7f2971600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f296c15ea50 0x7f296c0ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.129+0000 7f2971600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f296c0cf630 0x7f296c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.129+0000 7f2971600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c0d2dc0 0x7f296c0d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.129+0000 7f2971600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f296c0cffe0 con 0x7f296c0cf630 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.129+0000 7f2971600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f296c0b9c90 con 0x7f296c15ea50 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.129+0000 7f2971600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f296c0b9080 con 0x7f296c0d2dc0 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f296c0cf630 0x7f296c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f296c0cf630 0x7f296c0cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36182/0 (socket says 172.21.15.22:36182) 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 -- 172.21.15.22:0/929259444 learned_addr learned my addr 172.21.15.22:0/929259444 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f2970c00640 1 --2- 172.21.15.22:0/929259444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c0d2dc0 0x7f296c0d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296be00640 1 --2- 172.21.15.22:0/929259444 >> v2:172.21.15.43:3300/0 conn(0x7f296c15ea50 0x7f296c0ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 -- 172.21.15.22:0/929259444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c0d2dc0 msgr2=0x7f296c0d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 --2- 172.21.15.22:0/929259444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c0d2dc0 0x7f296c0d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 -- 172.21.15.22:0/929259444 >> v2:172.21.15.43:3300/0 conn(0x7f296c15ea50 msgr2=0x7f296c0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 --2- 172.21.15.22:0/929259444 >> v2:172.21.15.43:3300/0 conn(0x7f296c15ea50 0x7f296c0ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296b400640 1 -- 172.21.15.22:0/929259444 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c0b9360 con 0x7f296c0cf630 2024-04-16T16:17:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.130+0000 7f296be00640 1 --2- 172.21.15.22:0/929259444 >> v2:172.21.15.43:3300/0 conn(0x7f296c15ea50 0x7f296c0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.131+0000 7f296b400640 1 --2- 172.21.15.22:0/929259444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0cf630 0x7f296c0cfaa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f296c0d1340 tx=0x7f295402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763bdbcb4ec86cd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.132+0000 7f296aa00640 1 -- 172.21.15.22:0/929259444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954038070 con 0x7f296c0cf630 2024-04-16T16:17:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.132+0000 7f296aa00640 1 -- 172.21.15.22:0/929259444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2954031740 con 0x7f296c0cf630 2024-04-16T16:17:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.132+0000 7f296aa00640 1 -- 172.21.15.22:0/929259444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295402f050 con 0x7f296c0cf630 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.132+0000 7f2971600640 1 -- 172.21.15.22:0/929259444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0cf630 msgr2=0x7f296c0cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.132+0000 7f2971600640 1 --2- 172.21.15.22:0/929259444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0cf630 0x7f296c0cfaa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f296c0d1340 tx=0x7f295402b7e0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.133+0000 7f2971600640 1 -- 172.21.15.22:0/929259444 shutdown_connections 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.133+0000 7f2971600640 1 --2- 172.21.15.22:0/929259444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c0d2dc0 0x7f296c0d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.133+0000 7f2971600640 1 --2- 172.21.15.22:0/929259444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0cf630 0x7f296c0cfaa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.133+0000 7f2971600640 1 --2- 172.21.15.22:0/929259444 >> v2:172.21.15.43:3300/0 conn(0x7f296c15ea50 0x7f296c0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.133+0000 7f2971600640 1 -- 172.21.15.22:0/929259444 >> 172.21.15.22:0/929259444 conn(0x7f296c072430 msgr2=0x7f296c072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.133+0000 7f2971600640 1 -- 172.21.15.22:0/929259444 shutdown_connections 2024-04-16T16:17:28.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.133+0000 7f2971600640 1 -- 172.21.15.22:0/929259444 wait complete. 2024-04-16T16:17:28.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.134+0000 7f2971600640 1 Processor -- start 2024-04-16T16:17:28.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.135+0000 7f2971600640 1 -- start start 2024-04-16T16:17:28.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.135+0000 7f2971600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cf630 0x7f296c14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.135+0000 7f2971600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0d2dc0 0x7f296c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f2971600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c15ea50 0x7f296c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f2971600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f296c15ee30 con 0x7f296c0d2dc0 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f2971600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f296c0b9920 con 0x7f296c0cf630 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f2971600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f296c0ba7c0 con 0x7f296c15ea50 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0d2dc0 0x7f296c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0d2dc0 0x7f296c0cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36192/0 (socket says 172.21.15.22:36192) 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 -- 172.21.15.22:0/1846024508 learned_addr learned my addr 172.21.15.22:0/1846024508 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 -- 172.21.15.22:0/1846024508 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c15ea50 msgr2=0x7f296c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c15ea50 0x7f296c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 -- 172.21.15.22:0/1846024508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cf630 msgr2=0x7f296c14faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cf630 0x7f296c14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.136+0000 7f296b400640 1 -- 172.21.15.22:0/1846024508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c0ccdc0 con 0x7f296c0d2dc0 2024-04-16T16:17:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.137+0000 7f296b400640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0d2dc0 0x7f296c0cabc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f295402b820 tx=0x7f29540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.137+0000 7f2963e00640 1 -- 172.21.15.22:0/1846024508 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954042070 con 0x7f296c0d2dc0 2024-04-16T16:17:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.137+0000 7f2963e00640 1 -- 172.21.15.22:0/1846024508 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2954031e80 con 0x7f296c0d2dc0 2024-04-16T16:17:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.137+0000 7f2963e00640 1 -- 172.21.15.22:0/1846024508 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954038040 con 0x7f296c0d2dc0 2024-04-16T16:17:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.137+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296c0cd0a0 con 0x7f296c0d2dc0 2024-04-16T16:17:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.137+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296c0cd660 con 0x7f296c0d2dc0 2024-04-16T16:17:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.138+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f296c0cdb50 con 0x7f296c0d2dc0 2024-04-16T16:17:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.140+0000 7f2963e00640 1 -- 172.21.15.22:0/1846024508 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2954045070 con 0x7f296c0d2dc0 2024-04-16T16:17:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.141+0000 7f2963e00640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f294806c920 0x7f294806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.141+0000 7f2963e00640 1 -- 172.21.15.22:0/1846024508 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29540ad770 con 0x7f296c0d2dc0 2024-04-16T16:17:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.141+0000 7f296be00640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f294806c920 0x7f294806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.142+0000 7f296be00640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f294806c920 0x7f294806ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f295c00a8b0 tx=0x7f295c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:28.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.146+0000 7f2963e00640 1 -- 172.21.15.22:0/1846024508 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f295404c030 con 0x7f296c0d2dc0 2024-04-16T16:17:28.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.350+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f296c075f30 con 0x7f296c0d2dc0 2024-04-16T16:17:28.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.353+0000 7f2963e00640 1 -- 172.21.15.22:0/1846024508 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16485 (secure 0 0 0) 0x7f2954045e40 con 0x7f296c0d2dc0 2024-04-16T16:17:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:28.354 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:16:43.528754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f294806c920 msgr2=0x7f294806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f294806c920 0x7f294806ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f295c00a8b0 tx=0x7f295c008040 comp rx=0 tx=0).stop 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0d2dc0 msgr2=0x7f296c0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0d2dc0 0x7f296c0cabc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f295402b820 tx=0x7f29540046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 shutdown_connections 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f294806c920 0x7f294806ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f296c15ea50 0x7f296c1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f296c0d2dc0 0x7f296c0cabc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 --2- 172.21.15.22:0/1846024508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cf630 0x7f296c14faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 >> 172.21.15.22:0/1846024508 conn(0x7f296c072430 msgr2=0x7f296c0d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:28.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 shutdown_connections 2024-04-16T16:17:28.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.356+0000 7f2971600640 1 -- 172.21.15.22:0/1846024508 wait complete. 2024-04-16T16:17:28.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:28.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:28.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.608+0000 7f2f9ae00640 1 Processor -- start 2024-04-16T16:17:28.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.608+0000 7f2f9ae00640 1 -- start start 2024-04-16T16:17:28.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.609+0000 7f2f9ae00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2f9406d020 0x7f2f941491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.609+0000 7f2f9ae00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9406d550 con 0x7f2f940cd760 2024-04-16T16:17:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.609+0000 7f2f9ae00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9406d830 con 0x7f2f940cd380 2024-04-16T16:17:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.609+0000 7f2f9ae00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2f94149720 con 0x7f2f9406d020 2024-04-16T16:17:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.610+0000 7f2f98e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2f940cd760 0x7f2f9406e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38774/0 (socket says 172.21.15.22:38774) 2024-04-16T16:17:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.610+0000 7f2f98e00640 1 -- 172.21.15.22:0/4197282083 learned_addr learned my addr 172.21.15.22:0/4197282083 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:28.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.610+0000 7f2f8be00640 1 --2- 172.21.15.22:0/4197282083 >> v2:172.21.15.43:3300/0 conn(0x7f2f9406d020 0x7f2f941491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.610+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255293725 0 0) 0x7f2f9406d550 con 0x7f2f940cd760 2024-04-16T16:17:28.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f78003520 con 0x7f2f940cd760 2024-04-16T16:17:28.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2306033053 0 0) 0x7f2f78003520 con 0x7f2f940cd760 2024-04-16T16:17:28.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 >> v2:172.21.15.43:3300/0 conn(0x7f2f9406d020 msgr2=0x7f2f941491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 --2- 172.21.15.22:0/4197282083 >> v2:172.21.15.43:3300/0 conn(0x7f2f9406d020 0x7f2f941491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 >> v1:172.21.15.43:6789/0 conn(0x7f2f940cd380 legacy=0x7f2f940b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9406db10 con 0x7f2f940cd760 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f2f8c0019f0 con 0x7f2f940cd760 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 >> v1:172.21.15.22:6789/0 conn(0x7f2f940cd760 legacy=0x7f2f9406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f78004800 0x7f2f78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f780051c0 0x7f2f7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94149720 con 0x7f2f780039b0 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7800c070 con 0x7f2f78004800 2024-04-16T16:17:28.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7800c270 con 0x7f2f780051c0 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.611+0000 7f2f93e00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f8be00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f78004800 0x7f2f78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f98e00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f780051c0 0x7f2f7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f93e00640 1 -- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f780051c0 msgr2=0x7f2f7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f93e00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f780051c0 0x7f2f7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f93e00640 1 -- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f78004800 msgr2=0x7f2f78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f93e00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f78004800 0x7f2f78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f93e00640 1 -- 172.21.15.22:0/4197282083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f78003520 con 0x7f2f780039b0 2024-04-16T16:17:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.612+0000 7f2f98e00640 1 -- 172.21.15.22:0/4197282083 reap_dead start 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.613+0000 7f2f93e00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2f84001750 tx=0x7f2f78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9651207af714ba49 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84001370 con 0x7f2f780039b0 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f840052d0 con 0x7f2f780039b0 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f93400640 1 -- 172.21.15.22:0/4197282083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84003830 con 0x7f2f780039b0 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f9ae00640 1 -- 172.21.15.22:0/4197282083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f780039b0 msgr2=0x7f2f78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2f84001750 tx=0x7f2f78005830 comp rx=0 tx=0).stop 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f9ae00640 1 -- 172.21.15.22:0/4197282083 shutdown_connections 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/4197282083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.614+0000 7f2f9ae00640 1 -- 172.21.15.22:0/4197282083 >> 172.21.15.22:0/4197282083 conn(0x7f2f940b37e0 msgr2=0x7f2f940b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.615+0000 7f2f9ae00640 1 -- 172.21.15.22:0/4197282083 shutdown_connections 2024-04-16T16:17:28.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.615+0000 7f2f9ae00640 1 -- 172.21.15.22:0/4197282083 wait complete. 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.616+0000 7f2f9ae00640 1 Processor -- start 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.617+0000 7f2f9ae00640 1 -- start start 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.617+0000 7f2f9ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f780039b0 0x7f2f9414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.617+0000 7f2f9ae00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f94160870 0x7f2f940cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.617+0000 7f2f9ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f941655a0 0x7f2f94165a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.617+0000 7f2f9ae00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f940b50b0 con 0x7f2f94160870 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f9ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9406e0d0 con 0x7f2f780039b0 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f9ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f940b5230 con 0x7f2f941655a0 2024-04-16T16:17:28.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f94160870 0x7f2f940cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f94160870 0x7f2f940cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36202/0 (socket says 172.21.15.22:36202) 2024-04-16T16:17:28.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 -- 172.21.15.22:0/766644478 learned_addr learned my addr 172.21.15.22:0/766644478 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:28.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f93e00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f780039b0 0x7f2f9414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 -- 172.21.15.22:0/766644478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f941655a0 msgr2=0x7f2f94165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f941655a0 0x7f2f94165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 -- 172.21.15.22:0/766644478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f780039b0 msgr2=0x7f2f9414c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f780039b0 0x7f2f9414c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.618+0000 7f2f8be00640 1 -- 172.21.15.22:0/766644478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f94160cf0 con 0x7f2f94160870 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.619+0000 7f2f8be00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f94160870 0x7f2f940cfc50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c011620 tx=0x7f2f7c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.619+0000 7f2f90c00640 1 -- 172.21.15.22:0/766644478 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00f920 con 0x7f2f94160870 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.619+0000 7f2f90c00640 1 -- 172.21.15.22:0/766644478 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00fac0 con 0x7f2f94160870 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.619+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f940d0490 con 0x7f2f94160870 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.619+0000 7f2f90c00640 1 -- 172.21.15.22:0/766644478 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00fe90 con 0x7f2f94160870 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.619+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f940d0a50 con 0x7f2f94160870 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.620+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9404fd90 con 0x7f2f94160870 2024-04-16T16:17:28.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.622+0000 7f2f90c00640 1 -- 172.21.15.22:0/766644478 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f7c015460 con 0x7f2f94160870 2024-04-16T16:17:28.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.623+0000 7f2f90c00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2f7006ca90 0x7f2f7006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:28.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.623+0000 7f2f90c00640 1 -- 172.21.15.22:0/766644478 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2f7c08c480 con 0x7f2f94160870 2024-04-16T16:17:28.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.623+0000 7f2f93e00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2f7006ca90 0x7f2f7006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:28.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.624+0000 7f2f93e00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2f7006ca90 0x7f2f7006ef50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f84033000 tx=0x7f2f84009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:28.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.627+0000 7f2f90c00640 1 -- 172.21.15.22:0/766644478 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f7c019030 con 0x7f2f94160870 2024-04-16T16:17:28.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.830+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f940716f0 con 0x7f2f94160870 2024-04-16T16:17:28.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.831+0000 7f2f90c00640 1 -- 172.21.15.22:0/766644478 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f2f7c05a820 con 0x7f2f94160870 2024-04-16T16:17:28.831 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2f7006ca90 msgr2=0x7f2f7006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2f7006ca90 0x7f2f7006ef50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f84033000 tx=0x7f2f84009030 comp rx=0 tx=0).stop 2024-04-16T16:17:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f94160870 msgr2=0x7f2f940cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f94160870 0x7f2f940cfc50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c011620 tx=0x7f2f7c011ae0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 shutdown_connections 2024-04-16T16:17:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2f7006ca90 0x7f2f7006ef50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f941655a0 0x7f2f94165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f94160870 0x7f2f940cfc50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 --2- 172.21.15.22:0/766644478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f780039b0 0x7f2f9414c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:28.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 >> 172.21.15.22:0/766644478 conn(0x7f2f940b37e0 msgr2=0x7f2f94147160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:28.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 shutdown_connections 2024-04-16T16:17:28.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:28.834+0000 7f2f9ae00640 1 -- 172.21.15.22:0/766644478 wait complete. 2024-04-16T16:17:28.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:29.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.081+0000 7fdd99200640 1 Processor -- start 2024-04-16T16:17:29.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.081+0000 7fdd99200640 1 -- start start 2024-04-16T16:17:29.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd99200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 0x7fdd940d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd99200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdd940d1ce0 0x7fdd940b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd99200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd940d3ef0 con 0x7fdd9415eb60 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd99200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fdd940d2150 con 0x7fdd940d1ce0 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd99200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdd940d41d0 con 0x7fdd940cfcc0 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd93400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdd9415eb60 0x7fdd940d35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38778/0 (socket says 172.21.15.22:38778) 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd93400640 1 -- 172.21.15.22:0/1565293930 learned_addr learned my addr 172.21.15.22:0/1565293930 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.083+0000 7fdd92a00640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 0x7fdd940d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd93e00640 1 --2- 172.21.15.22:0/1565293930 >> v2:172.21.15.43:3300/0 conn(0x7fdd940d1ce0 0x7fdd940b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291137761 0 0) 0x7fdd940d3ef0 con 0x7fdd9415eb60 2024-04-16T16:17:29.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd78003520 con 0x7fdd9415eb60 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 609858217 0 0) 0x7fdd78003520 con 0x7fdd9415eb60 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 msgr2=0x7fdd940d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 0x7fdd940d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 >> v2:172.21.15.43:3300/0 conn(0x7fdd940d1ce0 msgr2=0x7fdd940b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 --2- 172.21.15.22:0/1565293930 >> v2:172.21.15.43:3300/0 conn(0x7fdd940d1ce0 0x7fdd940b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd940d44b0 con 0x7fdd9415eb60 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fdd84001670 con 0x7fdd9415eb60 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 >> v1:172.21.15.22:6789/0 conn(0x7fdd9415eb60 legacy=0x7fdd940d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 0x7fdd780039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd78003f80 0x7fdd78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd78004d40 0x7fdd780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdd940d2150 con 0x7fdd78004d40 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd940d41d0 con 0x7fdd78003f80 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.084+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7800b9c0 con 0x7fdd940cfcc0 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd93e00640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd78004d40 0x7fdd780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd93400640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 0x7fdd780039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd92a00640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd78003f80 0x7fdd78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd93e00640 1 -- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 msgr2=0x7fdd780039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd93e00640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd940cfcc0 0x7fdd780039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd93e00640 1 -- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd78003f80 msgr2=0x7fdd78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd93e00640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd78003f80 0x7fdd78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.085+0000 7fdd93e00640 1 -- 172.21.15.22:0/1565293930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd78003520 con 0x7fdd78004d40 2024-04-16T16:17:29.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.087+0000 7fdd93e00640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd78004d40 0x7fdd780051c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e170 tx=0x7fdd78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e6f0fdc4171ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:29.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.087+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c039070 con 0x7fdd78004d40 2024-04-16T16:17:29.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.087+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8c02cc20 con 0x7fdd78004d40 2024-04-16T16:17:29.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.087+0000 7fdd92000640 1 -- 172.21.15.22:0/1565293930 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c009c10 con 0x7fdd78004d40 2024-04-16T16:17:29.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.087+0000 7fdd99200640 1 -- 172.21.15.22:0/1565293930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd78004d40 msgr2=0x7fdd780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.087+0000 7fdd99200640 1 --2- 172.21.15.22:0/1565293930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd78004d40 0x7fdd780051c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e170 tx=0x7fdd78005830 comp rx=0 tx=0).stop 2024-04-16T16:17:29.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.088+0000 7fdd93e00640 1 -- 172.21.15.22:0/1565293930 reap_dead start 2024-04-16T16:17:29.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.088+0000 7fdd99200640 1 -- 172.21.15.22:0/1565293930 shutdown_connections 2024-04-16T16:17:29.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.088+0000 7fdd99200640 1 -- 172.21.15.22:0/1565293930 >> 172.21.15.22:0/1565293930 conn(0x7fdd94072460 msgr2=0x7fdd94072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:29.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.088+0000 7fdd99200640 1 -- 172.21.15.22:0/1565293930 shutdown_connections 2024-04-16T16:17:29.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.088+0000 7fdd99200640 1 -- 172.21.15.22:0/1565293930 wait complete. 2024-04-16T16:17:29.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.090+0000 7fdd99200640 1 Processor -- start 2024-04-16T16:17:29.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.090+0000 7fdd99200640 1 -- start start 2024-04-16T16:17:29.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd99200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd94155410 0x7fdd940cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd99200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd941557f0 0x7fdd940cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd99200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd940ce1f0 0x7fdd940cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd99200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdd940b7b70 con 0x7fdd941557f0 2024-04-16T16:17:29.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd99200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd940b79f0 con 0x7fdd940ce1f0 2024-04-16T16:17:29.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd99200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdd940d17a0 con 0x7fdd94155410 2024-04-16T16:17:29.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd92a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd941557f0 0x7fdd940cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd92a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd941557f0 0x7fdd940cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36222/0 (socket says 172.21.15.22:36222) 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd92a00640 1 -- 172.21.15.22:0/1565741670 learned_addr learned my addr 172.21.15.22:0/1565741670 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.091+0000 7fdd93400640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd94155410 0x7fdd940cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd93e00640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd940ce1f0 0x7fdd940cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd92a00640 1 -- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd94155410 msgr2=0x7fdd940cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd92a00640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd94155410 0x7fdd940cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd92a00640 1 -- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd940ce1f0 msgr2=0x7fdd940cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd92a00640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd940ce1f0 0x7fdd940cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd92a00640 1 -- 172.21.15.22:0/1565741670 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd940c8d60 con 0x7fdd941557f0 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd93e00640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd940ce1f0 0x7fdd940cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:29.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd92a00640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd941557f0 0x7fdd940cdcb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd80011540 tx=0x7fdd80011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:29.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd8b400640 1 -- 172.21.15.22:0/1565741670 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80015930 con 0x7fdd941557f0 2024-04-16T16:17:29.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd8b400640 1 -- 172.21.15.22:0/1565741670 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd80015ad0 con 0x7fdd941557f0 2024-04-16T16:17:29.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd8b400640 1 -- 172.21.15.22:0/1565741670 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000f460 con 0x7fdd941557f0 2024-04-16T16:17:29.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd940c8fe0 con 0x7fdd941557f0 2024-04-16T16:17:29.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.092+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd940c95a0 con 0x7fdd941557f0 2024-04-16T16:17:29.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.094+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd94075f30 con 0x7fdd941557f0 2024-04-16T16:17:29.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.095+0000 7fdd8b400640 1 -- 172.21.15.22:0/1565741670 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd8000f600 con 0x7fdd941557f0 2024-04-16T16:17:29.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.096+0000 7fdd8b400640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd7406c8f0 0x7fdd7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.096+0000 7fdd8b400640 1 -- 172.21.15.22:0/1565741670 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fdd8008c4a0 con 0x7fdd941557f0 2024-04-16T16:17:29.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.096+0000 7fdd93400640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd7406c8f0 0x7fdd7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.097+0000 7fdd93400640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd7406c8f0 0x7fdd7406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd84004840 tx=0x7fdd84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:29.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.100+0000 7fdd8b400640 1 -- 172.21.15.22:0/1565741670 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd940c8d60 con 0x7fdd941557f0 2024-04-16T16:17:29.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.303+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdd940ceae0 con 0x7fdd941557f0 2024-04-16T16:17:29.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.304+0000 7fdd8b400640 1 -- 172.21.15.22:0/1565741670 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fdd80019030 con 0x7fdd941557f0 2024-04-16T16:17:29.304 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:29.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd7406c8f0 msgr2=0x7fdd7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd7406c8f0 0x7fdd7406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd84004840 tx=0x7fdd84009040 comp rx=0 tx=0).stop 2024-04-16T16:17:29.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd941557f0 msgr2=0x7fdd940cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd941557f0 0x7fdd940cdcb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd80011540 tx=0x7fdd80011a00 comp rx=0 tx=0).stop 2024-04-16T16:17:29.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 shutdown_connections 2024-04-16T16:17:29.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdd7406c8f0 0x7fdd7406edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd940ce1f0 0x7fdd940cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd941557f0 0x7fdd940cdcb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 --2- 172.21.15.22:0/1565741670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd94155410 0x7fdd940cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.307+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 >> 172.21.15.22:0/1565741670 conn(0x7fdd94072460 msgr2=0x7fdd940b8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:29.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.308+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 shutdown_connections 2024-04-16T16:17:29.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.308+0000 7fdd99200640 1 -- 172.21.15.22:0/1565741670 wait complete. 2024-04-16T16:17:29.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:29.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.561+0000 7fbcf6c00640 1 Processor -- start 2024-04-16T16:17:29.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.561+0000 7fbcf6c00640 1 -- start start 2024-04-16T16:17:29.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcf6c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf0164030 0x7fbcf00711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcf6c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbcf00b2b30 0x7fbcf0160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcf6c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf00b5a70 con 0x7fbcf00b41a0 2024-04-16T16:17:29.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcf6c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf0071700 con 0x7fbcf00b2b30 2024-04-16T16:17:29.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcf6c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf0072b00 con 0x7fbcf0164030 2024-04-16T16:17:29.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcf4c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbcf00b2b30 0x7fbcf0160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf0164030 0x7fbcf00711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcef400640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbcf00b41a0 0x7fbcf00b2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:40690/0 (socket says 172.21.15.22:40690) 2024-04-16T16:17:29.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.563+0000 7fbcef400640 1 -- 172.21.15.22:0/484119299 learned_addr learned my addr 172.21.15.22:0/484119299 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:29.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.564+0000 7fbcf4c00640 1 -- 172.21.15.22:0/484119299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf0164030 msgr2=0x7fbcf00711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.564+0000 7fbcf4c00640 1 --2- 172.21.15.22:0/484119299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf0164030 0x7fbcf00711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.564+0000 7fbcf4c00640 1 -- 172.21.15.22:0/484119299 >> v1:172.21.15.43:6789/0 conn(0x7fbcf00b41a0 legacy=0x7fbcf00b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.564+0000 7fbcf4c00640 1 -- 172.21.15.22:0/484119299 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf0164410 con 0x7fbcf00b2b30 2024-04-16T16:17:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.566+0000 7fbcf4c00640 1 --2- 172.21.15.22:0/484119299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf0160160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097a0 tx=0x7fbce802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214c3cb7a31c18ff server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.566+0000 7fbceea00640 1 -- 172.21.15.22:0/484119299 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8035020 con 0x7fbcf00b2b30 2024-04-16T16:17:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.566+0000 7fbceea00640 1 -- 172.21.15.22:0/484119299 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce8031830 con 0x7fbcf00b2b30 2024-04-16T16:17:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.566+0000 7fbceea00640 1 -- 172.21.15.22:0/484119299 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8031c00 con 0x7fbcf00b2b30 2024-04-16T16:17:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.566+0000 7fbcf6c00640 1 -- 172.21.15.22:0/484119299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 msgr2=0x7fbcf0160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.566+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/484119299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf0160160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097a0 tx=0x7fbce802b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.567+0000 7fbcf6c00640 1 -- 172.21.15.22:0/484119299 shutdown_connections 2024-04-16T16:17:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.567+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/484119299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf0160160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.567+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/484119299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf0164030 0x7fbcf00711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.567+0000 7fbcf6c00640 1 -- 172.21.15.22:0/484119299 >> 172.21.15.22:0/484119299 conn(0x7fbcf0062440 msgr2=0x7fbcf0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.567+0000 7fbcf6c00640 1 -- 172.21.15.22:0/484119299 shutdown_connections 2024-04-16T16:17:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.567+0000 7fbcf6c00640 1 -- 172.21.15.22:0/484119299 wait complete. 2024-04-16T16:17:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.569+0000 7fbcf6c00640 1 Processor -- start 2024-04-16T16:17:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.569+0000 7fbcf6c00640 1 -- start start 2024-04-16T16:17:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcf6c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf00af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcf6c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf00b41a0 0x7fbcf01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcf6c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf0164030 0x7fbcf0151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcf6c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0072d30 con 0x7fbcf00b2b30 2024-04-16T16:17:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcf6c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf00b5290 con 0x7fbcf0164030 2024-04-16T16:17:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcf6c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf0073010 con 0x7fbcf00b41a0 2024-04-16T16:17:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf00af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf00af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36234/0 (socket says 172.21.15.22:36234) 2024-04-16T16:17:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.570+0000 7fbcefe00640 1 -- 172.21.15.22:0/1315315206 learned_addr learned my addr 172.21.15.22:0/1315315206 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcef400640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf00b41a0 0x7fbcf01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcf4c00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf0164030 0x7fbcf0151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcefe00640 1 -- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf00b41a0 msgr2=0x7fbcf01516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcefe00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf00b41a0 0x7fbcf01516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcefe00640 1 -- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf0164030 msgr2=0x7fbcf0151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcefe00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf0164030 0x7fbcf0151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcefe00640 1 -- 172.21.15.22:0/1315315206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf00aaf90 con 0x7fbcf00b2b30 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcef400640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf00b41a0 0x7fbcf01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcefe00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf00af890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800e9b0 tx=0x7fbcd800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbce7e00640 1 -- 172.21.15.22:0/1315315206 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8017070 con 0x7fbcf00b2b30 2024-04-16T16:17:29.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbce7e00640 1 -- 172.21.15.22:0/1315315206 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd800c9a0 con 0x7fbcf00b2b30 2024-04-16T16:17:29.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbce7e00640 1 -- 172.21.15.22:0/1315315206 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800cd90 con 0x7fbcf00b2b30 2024-04-16T16:17:29.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf00c5950 con 0x7fbcf00b2b30 2024-04-16T16:17:29.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.571+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf00c5c30 con 0x7fbcf00b2b30 2024-04-16T16:17:29.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.573+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf004fd90 con 0x7fbcf00b2b30 2024-04-16T16:17:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.574+0000 7fbce7e00640 1 -- 172.21.15.22:0/1315315206 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcd801a070 con 0x7fbcf00b2b30 2024-04-16T16:17:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.575+0000 7fbce7e00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbccc06c920 0x7fbccc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.575+0000 7fbce7e00640 1 -- 172.21.15.22:0/1315315206 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fbcd808bed0 con 0x7fbcf00b2b30 2024-04-16T16:17:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.575+0000 7fbcef400640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbccc06c920 0x7fbccc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.576+0000 7fbcef400640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbccc06c920 0x7fbccc06ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00cc9e0 tx=0x7fbce0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:29.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.580+0000 7fbce7e00640 1 -- 172.21.15.22:0/1315315206 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbcd805a310 con 0x7fbcf00b2b30 2024-04-16T16:17:29.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.784+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbcf006c0f0 con 0x7fbcf00b2b30 2024-04-16T16:17:29.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.785+0000 7fbce7e00640 1 -- 172.21.15.22:0/1315315206 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fbcd8059c10 con 0x7fbcf00b2b30 2024-04-16T16:17:29.785 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbccc06c920 msgr2=0x7fbccc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbccc06c920 0x7fbccc06ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00cc9e0 tx=0x7fbce0009040 comp rx=0 tx=0).stop 2024-04-16T16:17:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 msgr2=0x7fbcf00af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf00af890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800e9b0 tx=0x7fbcd800ee70 comp rx=0 tx=0).stop 2024-04-16T16:17:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 shutdown_connections 2024-04-16T16:17:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbccc06c920 0x7fbccc06ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf0164030 0x7fbcf0151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf00b41a0 0x7fbcf01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 --2- 172.21.15.22:0/1315315206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf00b2b30 0x7fbcf00af890 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.788+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 >> 172.21.15.22:0/1315315206 conn(0x7fbcf0062440 msgr2=0x7fbcf01658a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.789+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 shutdown_connections 2024-04-16T16:17:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:29.789+0000 7fbcf6c00640 1 -- 172.21.15.22:0/1315315206 wait complete. 2024-04-16T16:17:29.809 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:17:30.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.038+0000 7fc545a00640 1 Processor -- start 2024-04-16T16:17:30.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.039+0000 7fc545a00640 1 -- start start 2024-04-16T16:17:30.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.040+0000 7fc545a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5400afe40 0x7fc54015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.040+0000 7fc545a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc540160140 0x7fc5400b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.040+0000 7fc545a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc54015c6a0 con 0x7fc5400afa60 2024-04-16T16:17:30.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.040+0000 7fc545a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc54015c980 con 0x7fc540160140 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.040+0000 7fc545a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc54015cc60 con 0x7fc5400afe40 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc540160140 0x7fc5400b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53ea00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc5400afa60 0x7fc54015be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35884/0 (socket says 172.21.15.22:35884) 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53ea00640 1 -- 172.21.15.22:0/2137280643 learned_addr learned my addr 172.21.15.22:0/2137280643 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53e000640 1 --2- 172.21.15.22:0/2137280643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5400afe40 0x7fc54015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53f400640 1 -- 172.21.15.22:0/2137280643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5400afe40 msgr2=0x7fc54015fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53f400640 1 --2- 172.21.15.22:0/2137280643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5400afe40 0x7fc54015fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53f400640 1 -- 172.21.15.22:0/2137280643 >> v1:172.21.15.22:6789/0 conn(0x7fc5400afa60 legacy=0x7fc54015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.041+0000 7fc53f400640 1 -- 172.21.15.22:0/2137280643 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54015f6e0 con 0x7fc540160140 2024-04-16T16:17:30.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.042+0000 7fc53f400640 1 --2- 172.21.15.22:0/2137280643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc540160140 0x7fc5400b4230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc53800ba40 tx=0x7fc53802e080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc4c1fb8a27dd49 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:30.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.043+0000 7fc53d600640 1 -- 172.21.15.22:0/2137280643 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53803b070 con 0x7fc540160140 2024-04-16T16:17:30.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.043+0000 7fc53d600640 1 -- 172.21.15.22:0/2137280643 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53802ee30 con 0x7fc540160140 2024-04-16T16:17:30.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.043+0000 7fc53d600640 1 -- 172.21.15.22:0/2137280643 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538036640 con 0x7fc540160140 2024-04-16T16:17:30.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.043+0000 7fc545a00640 1 -- 172.21.15.22:0/2137280643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc540160140 msgr2=0x7fc5400b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.043+0000 7fc545a00640 1 --2- 172.21.15.22:0/2137280643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc540160140 0x7fc5400b4230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc53800ba40 tx=0x7fc53802e080 comp rx=0 tx=0).stop 2024-04-16T16:17:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.044+0000 7fc545a00640 1 -- 172.21.15.22:0/2137280643 shutdown_connections 2024-04-16T16:17:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.044+0000 7fc545a00640 1 --2- 172.21.15.22:0/2137280643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc540160140 0x7fc5400b4230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.044+0000 7fc545a00640 1 --2- 172.21.15.22:0/2137280643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5400afe40 0x7fc54015fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.044+0000 7fc545a00640 1 -- 172.21.15.22:0/2137280643 >> 172.21.15.22:0/2137280643 conn(0x7fc540062440 msgr2=0x7fc540062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.044+0000 7fc545a00640 1 -- 172.21.15.22:0/2137280643 shutdown_connections 2024-04-16T16:17:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.044+0000 7fc545a00640 1 -- 172.21.15.22:0/2137280643 wait complete. 2024-04-16T16:17:30.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.045+0000 7fc545a00640 1 Processor -- start 2024-04-16T16:17:30.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.046+0000 7fc545a00640 1 -- start start 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc545a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5400afa60 0x7fc5400ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc545a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5400afe40 0x7fc5401f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc545a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc54015b070 0x7fc540156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc545a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc5400b4770 con 0x7fc5400afe40 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc545a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc54006e380 con 0x7fc5400afa60 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc545a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc5400b48f0 con 0x7fc54015b070 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc53e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5400afe40 0x7fc5401f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc53e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5400afe40 0x7fc5401f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52422/0 (socket says 172.21.15.22:52422) 2024-04-16T16:17:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc53e000640 1 -- 172.21.15.22:0/2832895071 learned_addr learned my addr 172.21.15.22:0/2832895071 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc53f400640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc54015b070 0x7fc540156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc53e000640 1 -- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc54015b070 msgr2=0x7fc540156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc53ea00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5400afa60 0x7fc5400ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.047+0000 7fc53e000640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc54015b070 0x7fc540156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc53e000640 1 -- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5400afa60 msgr2=0x7fc5400ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc53e000640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5400afa60 0x7fc5400ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc53e000640 1 -- 172.21.15.22:0/2832895071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5400ce9e0 con 0x7fc5400afe40 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc53e000640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5400afe40 0x7fc5401f78f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc528007ec0 tx=0x7fc52800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc536a00640 1 -- 172.21.15.22:0/2832895071 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528014620 con 0x7fc5400afe40 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc536a00640 1 -- 172.21.15.22:0/2832895071 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc528019070 con 0x7fc5400afe40 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc536a00640 1 -- 172.21.15.22:0/2832895071 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528014a00 con 0x7fc5400afe40 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5400cecc0 con 0x7fc5400afe40 2024-04-16T16:17:30.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.048+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5400cf280 con 0x7fc5400afe40 2024-04-16T16:17:30.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.049+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54015fc00 con 0x7fc5400afe40 2024-04-16T16:17:30.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.050+0000 7fc536a00640 1 -- 172.21.15.22:0/2832895071 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc528014ba0 con 0x7fc5400afe40 2024-04-16T16:17:30.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.051+0000 7fc536a00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc51c06c920 0x7fc51c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.051+0000 7fc536a00640 1 -- 172.21.15.22:0/2832895071 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc52808c4e0 con 0x7fc5400afe40 2024-04-16T16:17:30.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.052+0000 7fc53ea00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc51c06c920 0x7fc51c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.052+0000 7fc53ea00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc51c06c920 0x7fc51c06ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc530000f60 tx=0x7fc530009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:30.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.056+0000 7fc536a00640 1 -- 172.21.15.22:0/2832895071 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc54015fc00 con 0x7fc5400afe40 2024-04-16T16:17:30.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.271+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc54004fd90 con 0x7fc5400afe40 2024-04-16T16:17:30.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.272+0000 7fc536a00640 1 -- 172.21.15.22:0/2832895071 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fc52805a7f0 con 0x7fc5400afe40 2024-04-16T16:17:30.272 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc51c06c920 msgr2=0x7fc51c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc51c06c920 0x7fc51c06ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc530000f60 tx=0x7fc530009040 comp rx=0 tx=0).stop 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5400afe40 msgr2=0x7fc5401f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5400afe40 0x7fc5401f78f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc528007ec0 tx=0x7fc52800e4b0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 shutdown_connections 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc51c06c920 0x7fc51c06ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc54015b070 0x7fc540156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5400afe40 0x7fc5401f78f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 --2- 172.21.15.22:0/2832895071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5400afa60 0x7fc5400ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 >> 172.21.15.22:0/2832895071 conn(0x7fc540062440 msgr2=0x7fc54015e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:30.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 shutdown_connections 2024-04-16T16:17:30.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.275+0000 7fc545a00640 1 -- 172.21.15.22:0/2832895071 wait complete. 2024-04-16T16:17:30.295 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-16T16:17:30.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:30.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-16T16:17:30.403 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:17:30.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:30.403 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T16:17:30.464 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:30.464 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:30.526 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:30.526 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:30.584 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:30.584 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:30.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:30.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.864+0000 7f9c3d000640 1 Processor -- start 2024-04-16T16:17:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.865+0000 7f9c3d000640 1 -- start start 2024-04-16T16:17:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.866+0000 7f9c3d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 0x7f9c380b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.866+0000 7f9c3d000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c3815ee50 con 0x7f9c380b7ea0 2024-04-16T16:17:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.866+0000 7f9c3d000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c380b8320 con 0x7f9c380ba5e0 2024-04-16T16:17:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.866+0000 7f9c3d000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9c380b8600 con 0x7f9c3815ea70 2024-04-16T16:17:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.867+0000 7f9c36a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9c380b7ea0 0x7f9c380d2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35894/0 (socket says 172.21.15.22:35894) 2024-04-16T16:17:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.867+0000 7f9c36a00640 1 -- 172.21.15.22:0/3940268250 learned_addr learned my addr 172.21.15.22:0/3940268250 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.867+0000 7f9c37400640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 0x7f9c380b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.867+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156193902 0 0) 0x7f9c3815ee50 con 0x7f9c380b7ea0 2024-04-16T16:17:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.867+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c1c003520 con 0x7f9c380b7ea0 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 465001460 0 0) 0x7f9c1c003520 con 0x7f9c380b7ea0 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 msgr2=0x7f9c380b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 0x7f9c380b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 >> v1:172.21.15.43:6789/0 conn(0x7f9c380ba5e0 legacy=0x7f9c380b93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c380b88e0 con 0x7f9c380b7ea0 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f9c24001690 con 0x7f9c380b7ea0 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 >> v1:172.21.15.22:6789/0 conn(0x7f9c380b7ea0 legacy=0x7f9c380d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1c0039e0 0x7f9c1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c1c004390 0x7f9c1c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 0x7f9c1c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380b8600 con 0x7f9c1c004390 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c00b9c0 con 0x7f9c1c0039e0 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c00bbc0 con 0x7f9c3815ea70 2024-04-16T16:17:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.868+0000 7f9c36a00640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c1c004390 0x7f9c1c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c37e00640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 0x7f9c1c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c36a00640 1 -- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 msgr2=0x7f9c1c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c36a00640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 0x7f9c1c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c36a00640 1 -- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1c0039e0 msgr2=0x7f9c1c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c37400640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1c0039e0 0x7f9c1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c36a00640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1c0039e0 0x7f9c1c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c36a00640 1 -- 172.21.15.22:0/3940268250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c003520 con 0x7f9c1c004390 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c37e00640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c3815ea70 0x7f9c1c0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.869+0000 7f9c37400640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1c0039e0 0x7f9c1c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.870+0000 7f9c36a00640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c1c004390 0x7f9c1c004860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c210 tx=0x7f9c1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c879479802b4d810 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.870+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24007d30 con 0x7f9c1c004390 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.870+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24030070 con 0x7f9c1c004390 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.870+0000 7f9c36000640 1 -- 172.21.15.22:0/3940268250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24005cd0 con 0x7f9c1c004390 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.871+0000 7f9c3d000640 1 -- 172.21.15.22:0/3940268250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c1c004390 msgr2=0x7f9c1c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.871+0000 7f9c3d000640 1 --2- 172.21.15.22:0/3940268250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c1c004390 0x7f9c1c004860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c210 tx=0x7f9c1c005830 comp rx=0 tx=0).stop 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.871+0000 7f9c37e00640 1 -- 172.21.15.22:0/3940268250 reap_dead start 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.871+0000 7f9c3d000640 1 -- 172.21.15.22:0/3940268250 shutdown_connections 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.871+0000 7f9c3d000640 1 -- 172.21.15.22:0/3940268250 >> 172.21.15.22:0/3940268250 conn(0x7f9c38072430 msgr2=0x7f9c38072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.871+0000 7f9c3d000640 1 -- 172.21.15.22:0/3940268250 shutdown_connections 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.871+0000 7f9c3d000640 1 -- 172.21.15.22:0/3940268250 wait complete. 2024-04-16T16:17:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.873+0000 7f9c3d000640 1 Processor -- start 2024-04-16T16:17:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.873+0000 7f9c3d000640 1 -- start start 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c3d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c1c004390 0x7f9c3814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c3d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c380ca150 0x7f9c380ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c3d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c38150b10 0x7f9c38150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c3d000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380d3040 con 0x7f9c380ca150 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c3d000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380b8ea0 con 0x7f9c38150b10 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c3d000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9c380b9ad0 con 0x7f9c1c004390 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c36a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c380ca150 0x7f9c380ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c36a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c380ca150 0x7f9c380ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52442/0 (socket says 172.21.15.22:52442) 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.874+0000 7f9c36a00640 1 -- 172.21.15.22:0/519755266 learned_addr learned my addr 172.21.15.22:0/519755266 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c37400640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c1c004390 0x7f9c3814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c37e00640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c38150b10 0x7f9c38150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c36a00640 1 -- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c1c004390 msgr2=0x7f9c3814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c36a00640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c1c004390 0x7f9c3814df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c36a00640 1 -- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c38150b10 msgr2=0x7f9c38150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c36a00640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c38150b10 0x7f9c38150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c36a00640 1 -- 172.21.15.22:0/519755266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3814e480 con 0x7f9c380ca150 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c37e00640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c38150b10 0x7f9c38150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.875+0000 7f9c36a00640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c380ca150 0x7f9c380ca5d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9c24001990 tx=0x7f9c380b84f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.876+0000 7f9c2f400640 1 -- 172.21.15.22:0/519755266 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24001c70 con 0x7f9c380ca150 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.876+0000 7f9c2f400640 1 -- 172.21.15.22:0/519755266 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24004bf0 con 0x7f9c380ca150 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.876+0000 7f9c2f400640 1 -- 172.21.15.22:0/519755266 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24007070 con 0x7f9c380ca150 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.876+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c380cbb60 con 0x7f9c380ca150 2024-04-16T16:17:30.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.876+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c380cc120 con 0x7f9c380ca150 2024-04-16T16:17:30.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.877+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c380cab10 con 0x7f9c380ca150 2024-04-16T16:17:30.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.878+0000 7f9c2f400640 1 -- 172.21.15.22:0/519755266 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c24007210 con 0x7f9c380ca150 2024-04-16T16:17:30.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.879+0000 7f9c2f400640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:30.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.879+0000 7f9c2f400640 1 -- 172.21.15.22:0/519755266 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9c240ad2d0 con 0x7f9c380ca150 2024-04-16T16:17:30.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.879+0000 7f9c37400640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:30.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.880+0000 7f9c37400640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c381f7ae0 tx=0x7f9c28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:30.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:30.883+0000 7f9c2f400640 1 -- 172.21.15.22:0/519755266 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c2407b670 con 0x7f9c380ca150 2024-04-16T16:17:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.092+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c38075f30 con 0x7f9c380ca150 2024-04-16T16:17:31.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.095+0000 7f9c2f400640 1 -- 172.21.15.22:0/519755266 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16733 (secure 0 0 0) 0x7f9c24034e80 con 0x7f9c380ca150 2024-04-16T16:17:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:31.095 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:29.459450+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:31.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c1806c8f0 msgr2=0x7f9c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c381f7ae0 tx=0x7f9c28008040 comp rx=0 tx=0).stop 2024-04-16T16:17:31.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c380ca150 msgr2=0x7f9c380ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c380ca150 0x7f9c380ca5d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9c24001990 tx=0x7f9c380b84f0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 shutdown_connections 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c38150b10 0x7f9c38150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c380ca150 0x7f9c380ca5d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 --2- 172.21.15.22:0/519755266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c1c004390 0x7f9c3814df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 >> 172.21.15.22:0/519755266 conn(0x7f9c38072430 msgr2=0x7f9c380b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 shutdown_connections 2024-04-16T16:17:31.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.098+0000 7f9c3d000640 1 -- 172.21.15.22:0/519755266 wait complete. 2024-04-16T16:17:31.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:31.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:31.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.336+0000 7ff5b3200640 1 Processor -- start 2024-04-16T16:17:31.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.336+0000 7ff5b3200640 1 -- start start 2024-04-16T16:17:31.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.338+0000 7ff5b3200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff5ac1527b0 0x7ff5ac15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.338+0000 7ff5b3200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ac071640 con 0x7ff5ac06e610 2024-04-16T16:17:31.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.338+0000 7ff5b3200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ac071920 con 0x7ff5ac070df0 2024-04-16T16:17:31.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.338+0000 7ff5b3200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff5ac15cd90 con 0x7ff5ac1527b0 2024-04-16T16:17:31.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.338+0000 7ff5b2800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff5ac06e610 0x7ff5ac0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35908/0 (socket says 172.21.15.22:35908) 2024-04-16T16:17:31.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.338+0000 7ff5b2800640 1 -- 172.21.15.22:0/1425709557 learned_addr learned my addr 172.21.15.22:0/1425709557 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.338+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/1425709557 >> v2:172.21.15.43:3300/0 conn(0x7ff5ac1527b0 0x7ff5ac15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2301370181 0 0) 0x7ff5ac071640 con 0x7ff5ac06e610 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff594003520 con 0x7ff5ac06e610 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1318184064 0 0) 0x7ff594003520 con 0x7ff5ac06e610 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 >> v2:172.21.15.43:3300/0 conn(0x7ff5ac1527b0 msgr2=0x7ff5ac15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 --2- 172.21.15.22:0/1425709557 >> v2:172.21.15.43:3300/0 conn(0x7ff5ac1527b0 0x7ff5ac15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 >> v1:172.21.15.43:6789/0 conn(0x7ff5ac070df0 legacy=0x7ff5ac06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ac071c00 con 0x7ff5ac06e610 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7ff5a80019f0 con 0x7ff5ac06e610 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 >> v1:172.21.15.22:6789/0 conn(0x7ff5ac06e610 legacy=0x7ff5ac0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff594003a00 0x7ff594003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff594004800 0x7ff594004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5940051c0 0x7ff59400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff59400c090 con 0x7ff594003a00 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff59400c240 con 0x7ff5940051c0 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.339+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff59400c440 con 0x7ff594004800 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff594003a00 0x7ff594003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b1400640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff594004800 0x7ff594004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b1e00640 1 -- 172.21.15.22:0/1425709557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff594004800 msgr2=0x7ff594004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff594004800 0x7ff594004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b1e00640 1 -- 172.21.15.22:0/1425709557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5940051c0 msgr2=0x7ff59400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:31.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5940051c0 0x7ff59400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b1e00640 1 -- 172.21.15.22:0/1425709557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff594003520 con 0x7ff594003a00 2024-04-16T16:17:31.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.340+0000 7ff5b2800640 1 -- 172.21.15.22:0/1425709557 reap_dead start 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.341+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff594003a00 0x7ff594003e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009ac0 tx=0x7ff594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0319465ad72ddf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.341+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0039070 con 0x7ff594003a00 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.341+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a002c710 con 0x7ff594003a00 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.341+0000 7ff5b0a00640 1 -- 172.21.15.22:0/1425709557 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0009690 con 0x7ff594003a00 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.342+0000 7ff5b3200640 1 -- 172.21.15.22:0/1425709557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff594003a00 msgr2=0x7ff594003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.342+0000 7ff5b3200640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff594003a00 0x7ff594003e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009ac0 tx=0x7ff594005830 comp rx=0 tx=0).stop 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.342+0000 7ff5b3200640 1 -- 172.21.15.22:0/1425709557 shutdown_connections 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.342+0000 7ff5b3200640 1 --2- 172.21.15.22:0/1425709557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff594003a00 0x7ff594003e20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.342+0000 7ff5b3200640 1 -- 172.21.15.22:0/1425709557 >> 172.21.15.22:0/1425709557 conn(0x7ff5ac062440 msgr2=0x7ff5ac062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.342+0000 7ff5b3200640 1 -- 172.21.15.22:0/1425709557 shutdown_connections 2024-04-16T16:17:31.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.342+0000 7ff5b3200640 1 -- 172.21.15.22:0/1425709557 wait complete. 2024-04-16T16:17:31.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.344+0000 7ff5b3200640 1 Processor -- start 2024-04-16T16:17:31.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.344+0000 7ff5b3200640 1 -- start start 2024-04-16T16:17:31.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.345+0000 7ff5b3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff594003a00 0x7ff5ac13a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.345+0000 7ff5b3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5ac1f1750 0x7ff5ac15e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.345+0000 7ff5b3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5ac1f4820 0x7ff5ac1f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.345+0000 7ff5b3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac071400 con 0x7ff5ac1f4820 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.345+0000 7ff5b3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac071280 con 0x7ff594003a00 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.345+0000 7ff5b3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff5ac15bbd0 con 0x7ff5ac1f1750 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5ac1f4820 0x7ff5ac1f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5ac1f4820 0x7ff5ac1f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52470/0 (socket says 172.21.15.22:52470) 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 -- 172.21.15.22:0/3950174329 learned_addr learned my addr 172.21.15.22:0/3950174329 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b1400640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5ac1f1750 0x7ff5ac15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff594003a00 0x7ff5ac13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 -- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5ac1f1750 msgr2=0x7ff5ac15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5ac1f1750 0x7ff5ac15e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 -- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff594003a00 msgr2=0x7ff5ac13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff594003a00 0x7ff5ac13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.346+0000 7ff5b2800640 1 -- 172.21.15.22:0/3950174329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ac1f51e0 con 0x7ff5ac1f4820 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.347+0000 7ff5b2800640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5ac1f4820 0x7ff5ac1f4ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8001370 tx=0x7ff5a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.347+0000 7ff5a6000640 1 -- 172.21.15.22:0/3950174329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800a5b0 con 0x7ff5ac1f4820 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.347+0000 7ff5a6000640 1 -- 172.21.15.22:0/3950174329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a800a750 con 0x7ff5ac1f4820 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.347+0000 7ff5a6000640 1 -- 172.21.15.22:0/3950174329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800ab40 con 0x7ff5ac1f4820 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.347+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ac13acd0 con 0x7ff5ac1f4820 2024-04-16T16:17:31.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.347+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ac13b290 con 0x7ff5ac1f4820 2024-04-16T16:17:31.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.349+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ac075f30 con 0x7ff5ac1f4820 2024-04-16T16:17:31.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.350+0000 7ff5a6000640 1 -- 172.21.15.22:0/3950174329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5a8011070 con 0x7ff5ac1f4820 2024-04-16T16:17:31.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.350+0000 7ff5a6000640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff59006c920 0x7ff59006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.351+0000 7ff5a6000640 1 -- 172.21.15.22:0/3950174329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff5a808b0d0 con 0x7ff5ac1f4820 2024-04-16T16:17:31.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.351+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff59006c920 0x7ff59006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.352+0000 7ff5b1e00640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff59006c920 0x7ff59006ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0036000 tx=0x7ff5a0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:31.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.355+0000 7ff5a6000640 1 -- 172.21.15.22:0/3950174329 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5a8059480 con 0x7ff5ac1f4820 2024-04-16T16:17:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.558+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5ac0b3870 con 0x7ff5ac1f4820 2024-04-16T16:17:31.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.558+0000 7ff5a6000640 1 -- 172.21.15.22:0/3950174329 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7ff5a8058d80 con 0x7ff5ac1f4820 2024-04-16T16:17:31.558 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff59006c920 msgr2=0x7ff59006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff59006c920 0x7ff59006ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0036000 tx=0x7ff5a0030000 comp rx=0 tx=0).stop 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5ac1f4820 msgr2=0x7ff5ac1f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5ac1f4820 0x7ff5ac1f4ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8001370 tx=0x7ff5a800cc60 comp rx=0 tx=0).stop 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 shutdown_connections 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff59006c920 0x7ff59006ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5ac1f4820 0x7ff5ac1f4ca0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5ac1f1750 0x7ff5ac15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 --2- 172.21.15.22:0/3950174329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff594003a00 0x7ff5ac13a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 >> 172.21.15.22:0/3950174329 conn(0x7ff5ac062440 msgr2=0x7ff5ac14c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:31.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 shutdown_connections 2024-04-16T16:17:31.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.561+0000 7ff5b3200640 1 -- 172.21.15.22:0/3950174329 wait complete. 2024-04-16T16:17:31.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:31.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.802+0000 7fb091600640 1 Processor -- start 2024-04-16T16:17:31.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.802+0000 7fb091600640 1 -- start start 2024-04-16T16:17:31.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.804+0000 7fb091600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb08c15ebb0 0x7fb08c0d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.804+0000 7fb091600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb08c0d1840 0x7fb08c0d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.804+0000 7fb091600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c0d2eb0 0x7fb08c0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.804+0000 7fb091600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb08c0ba4c0 con 0x7fb08c0d1840 2024-04-16T16:17:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.804+0000 7fb091600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb08c0d3320 con 0x7fb08c15ebb0 2024-04-16T16:17:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.804+0000 7fb091600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb08c15ef90 con 0x7fb08c0d2eb0 2024-04-16T16:17:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.804+0000 7fb083e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb08c0d1840 0x7fb08c0d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb083e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb08c0d1840 0x7fb08c0d2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52484/0 (socket says 172.21.15.22:52484) 2024-04-16T16:17:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb083e00640 1 -- 172.21.15.22:0/2825393453 learned_addr learned my addr 172.21.15.22:0/2825393453 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb090c00640 1 --2- 172.21.15.22:0/2825393453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c0d2eb0 0x7fb08c0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb08be00640 1 --2- 172.21.15.22:0/2825393453 >> v2:172.21.15.43:3300/0 conn(0x7fb08c15ebb0 0x7fb08c0d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb083e00640 1 -- 172.21.15.22:0/2825393453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c0d2eb0 msgr2=0x7fb08c0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb083e00640 1 --2- 172.21.15.22:0/2825393453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c0d2eb0 0x7fb08c0b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb083e00640 1 -- 172.21.15.22:0/2825393453 >> v2:172.21.15.43:3300/0 conn(0x7fb08c15ebb0 msgr2=0x7fb08c0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb083e00640 1 --2- 172.21.15.22:0/2825393453 >> v2:172.21.15.43:3300/0 conn(0x7fb08c15ebb0 0x7fb08c0d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.805+0000 7fb083e00640 1 -- 172.21.15.22:0/2825393453 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c0d3550 con 0x7fb08c0d1840 2024-04-16T16:17:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.806+0000 7fb083e00640 1 --2- 172.21.15.22:0/2825393453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c0d2970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0d5780 tx=0x7fb07402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98730b77f022209b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:31.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb08b400640 1 -- 172.21.15.22:0/2825393453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074034070 con 0x7fb08c0d1840 2024-04-16T16:17:31.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb08b400640 1 -- 172.21.15.22:0/2825393453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb074030860 con 0x7fb08c0d1840 2024-04-16T16:17:31.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb08b400640 1 -- 172.21.15.22:0/2825393453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074030c30 con 0x7fb08c0d1840 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb091600640 1 -- 172.21.15.22:0/2825393453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 msgr2=0x7fb08c0d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb091600640 1 --2- 172.21.15.22:0/2825393453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c0d2970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0d5780 tx=0x7fb07402b9a0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb091600640 1 -- 172.21.15.22:0/2825393453 shutdown_connections 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb091600640 1 --2- 172.21.15.22:0/2825393453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c0d2eb0 0x7fb08c0b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb091600640 1 --2- 172.21.15.22:0/2825393453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c0d2970 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb091600640 1 --2- 172.21.15.22:0/2825393453 >> v2:172.21.15.43:3300/0 conn(0x7fb08c15ebb0 0x7fb08c0d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.807+0000 7fb091600640 1 -- 172.21.15.22:0/2825393453 >> 172.21.15.22:0/2825393453 conn(0x7fb08c072460 msgr2=0x7fb08c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.808+0000 7fb091600640 1 -- 172.21.15.22:0/2825393453 shutdown_connections 2024-04-16T16:17:31.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.808+0000 7fb091600640 1 -- 172.21.15.22:0/2825393453 wait complete. 2024-04-16T16:17:31.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.809+0000 7fb091600640 1 Processor -- start 2024-04-16T16:17:31.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.809+0000 7fb091600640 1 -- start start 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.810+0000 7fb091600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c1f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.810+0000 7fb091600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb08c0d2eb0 0x7fb08c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.810+0000 7fb091600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c15ebb0 0x7fb08c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.810+0000 7fb091600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c0d3df0 con 0x7fb08c0d1840 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.810+0000 7fb091600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c0d3b10 con 0x7fb08c0d2eb0 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.810+0000 7fb091600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb08c0d40d0 con 0x7fb08c15ebb0 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c1f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c1f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52492/0 (socket says 172.21.15.22:52492) 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 -- 172.21.15.22:0/1821432359 learned_addr learned my addr 172.21.15.22:0/1821432359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb090c00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c15ebb0 0x7fb08c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb083e00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb08c0d2eb0 0x7fb08c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 -- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c15ebb0 msgr2=0x7fb08c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c15ebb0 0x7fb08c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 -- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb08c0d2eb0 msgr2=0x7fb08c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb08c0d2eb0 0x7fb08c0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb08be00640 1 -- 172.21.15.22:0/1821432359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c161df0 con 0x7fb08c0d1840 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.811+0000 7fb083e00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb08c0d2eb0 0x7fb08c0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.812+0000 7fb08be00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c1f79d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00d800 tx=0x7fb07c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.812+0000 7fb088c00640 1 -- 172.21.15.22:0/1821432359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00b6c0 con 0x7fb08c0d1840 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.812+0000 7fb088c00640 1 -- 172.21.15.22:0/1821432359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07c019070 con 0x7fb08c0d1840 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.812+0000 7fb088c00640 1 -- 172.21.15.22:0/1821432359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00ba80 con 0x7fb08c0d1840 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.812+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08c0ced90 con 0x7fb08c0d1840 2024-04-16T16:17:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.812+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08c0ceab0 con 0x7fb08c0d1840 2024-04-16T16:17:31.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.813+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08c0d5790 con 0x7fb08c0d1840 2024-04-16T16:17:31.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.814+0000 7fb088c00640 1 -- 172.21.15.22:0/1821432359 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb07c00bc20 con 0x7fb08c0d1840 2024-04-16T16:17:31.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.815+0000 7fb088c00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb06806c920 0x7fb06806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:31.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.815+0000 7fb088c00640 1 -- 172.21.15.22:0/1821432359 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb07c08c100 con 0x7fb08c0d1840 2024-04-16T16:17:31.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.816+0000 7fb083e00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb06806c920 0x7fb06806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:31.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.816+0000 7fb083e00640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb06806c920 0x7fb06806ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb074036000 tx=0x7fb07403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:31.820+0000 7fb088c00640 1 -- 172.21.15.22:0/1821432359 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb07c01c360 con 0x7fb08c0d1840 2024-04-16T16:17:32.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.026+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb08c072d60 con 0x7fb08c0d1840 2024-04-16T16:17:32.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.027+0000 7fb088c00640 1 -- 172.21.15.22:0/1821432359 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb07c05a410 con 0x7fb08c0d1840 2024-04-16T16:17:32.026 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:32.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb06806c920 msgr2=0x7fb06806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb06806c920 0x7fb06806ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb074036000 tx=0x7fb07403b040 comp rx=0 tx=0).stop 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 msgr2=0x7fb08c1f79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c1f79d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00d800 tx=0x7fb07c00dcc0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 shutdown_connections 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb06806c920 0x7fb06806ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb08c15ebb0 0x7fb08c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb08c0d2eb0 0x7fb08c0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 --2- 172.21.15.22:0/1821432359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb08c0d1840 0x7fb08c1f79d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.029+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 >> 172.21.15.22:0/1821432359 conn(0x7fb08c072460 msgr2=0x7fb08c0b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.030+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 shutdown_connections 2024-04-16T16:17:32.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.030+0000 7fb091600640 1 -- 172.21.15.22:0/1821432359 wait complete. 2024-04-16T16:17:32.050 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.271+0000 7fb713e00640 1 Processor -- start 2024-04-16T16:17:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.272+0000 7fb713e00640 1 -- start start 2024-04-16T16:17:32.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.272+0000 7fb713e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb71415eb60 0x7fb7140cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.272+0000 7fb713e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140d3a60 0x7fb7140b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.272+0000 7fb713e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7140d3ef0 con 0x7fb7140d35f0 2024-04-16T16:17:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.272+0000 7fb713e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb7140d41d0 con 0x7fb71415eb60 2024-04-16T16:17:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.272+0000 7fb713e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb7140d44b0 con 0x7fb7140d3a60 2024-04-16T16:17:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.273+0000 7fb712a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb71415eb60 0x7fb7140cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.273+0000 7fb712a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb71415eb60 0x7fb7140cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52508/0 (socket says 172.21.15.22:52508) 2024-04-16T16:17:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.273+0000 7fb712a00640 1 -- 172.21.15.22:0/3629806190 learned_addr learned my addr 172.21.15.22:0/3629806190 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:32.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.273+0000 7fb713400640 1 --2- 172.21.15.22:0/3629806190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140d3a60 0x7fb7140b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.274+0000 7fb712a00640 1 -- 172.21.15.22:0/3629806190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140d3a60 msgr2=0x7fb7140b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:32.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.274+0000 7fb712a00640 1 --2- 172.21.15.22:0/3629806190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140d3a60 0x7fb7140b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.274+0000 7fb712a00640 1 -- 172.21.15.22:0/3629806190 >> v1:172.21.15.43:6789/0 conn(0x7fb7140d35f0 legacy=0x7fb7140d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.274+0000 7fb712a00640 1 -- 172.21.15.22:0/3629806190 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7140b7db0 con 0x7fb71415eb60 2024-04-16T16:17:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.275+0000 7fb712a00640 1 --2- 172.21.15.22:0/3629806190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb7140cfcc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb704009870 tx=0x7fb70402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d6c6daa3dab471 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb712000640 1 -- 172.21.15.22:0/3629806190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704034070 con 0x7fb71415eb60 2024-04-16T16:17:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb712000640 1 -- 172.21.15.22:0/3629806190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb704030840 con 0x7fb71415eb60 2024-04-16T16:17:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb712000640 1 -- 172.21.15.22:0/3629806190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704030c10 con 0x7fb71415eb60 2024-04-16T16:17:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb713e00640 1 -- 172.21.15.22:0/3629806190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 msgr2=0x7fb7140cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb713e00640 1 --2- 172.21.15.22:0/3629806190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb7140cfcc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb704009870 tx=0x7fb70402b980 comp rx=0 tx=0).stop 2024-04-16T16:17:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb713e00640 1 -- 172.21.15.22:0/3629806190 shutdown_connections 2024-04-16T16:17:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb713e00640 1 --2- 172.21.15.22:0/3629806190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140d3a60 0x7fb7140b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb713e00640 1 --2- 172.21.15.22:0/3629806190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb7140cfcc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.276+0000 7fb713e00640 1 -- 172.21.15.22:0/3629806190 >> 172.21.15.22:0/3629806190 conn(0x7fb714072460 msgr2=0x7fb714072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.277+0000 7fb713e00640 1 -- 172.21.15.22:0/3629806190 shutdown_connections 2024-04-16T16:17:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.277+0000 7fb713e00640 1 -- 172.21.15.22:0/3629806190 wait complete. 2024-04-16T16:17:32.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.278+0000 7fb713e00640 1 Processor -- start 2024-04-16T16:17:32.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.278+0000 7fb713e00640 1 -- start start 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.279+0000 7fb713e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7140d35f0 0x7fb714150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.279+0000 7fb713e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb71415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.279+0000 7fb713e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140c9d80 0x7fb7140cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.279+0000 7fb713e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7140d2030 con 0x7fb71415eb60 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.279+0000 7fb713e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7140d1eb0 con 0x7fb7140d35f0 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.279+0000 7fb713e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb7140b8810 con 0x7fb7140c9d80 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb71415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb71415ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52514/0 (socket says 172.21.15.22:52514) 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 -- 172.21.15.22:0/1266134257 learned_addr learned my addr 172.21.15.22:0/1266134257 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:32.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb713400640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140c9d80 0x7fb7140cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb712a00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7140d35f0 0x7fb714150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 -- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140c9d80 msgr2=0x7fb7140cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140c9d80 0x7fb7140cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 -- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7140d35f0 msgr2=0x7fb714150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7140d35f0 0x7fb714150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.280+0000 7fb70be00640 1 -- 172.21.15.22:0/1266134257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7140ca210 con 0x7fb71415eb60 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.281+0000 7fb70be00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb71415ad60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c400 tx=0x7fb6fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.281+0000 7fb70aa00640 1 -- 172.21.15.22:0/1266134257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0052d0 con 0x7fb71415eb60 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.281+0000 7fb70aa00640 1 -- 172.21.15.22:0/1266134257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6fc005490 con 0x7fb71415eb60 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.281+0000 7fb70aa00640 1 -- 172.21.15.22:0/1266134257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc007260 con 0x7fb71415eb60 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.281+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7140cc4d0 con 0x7fb71415eb60 2024-04-16T16:17:32.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.281+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7140cca50 con 0x7fb71415eb60 2024-04-16T16:17:32.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.282+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb714075f30 con 0x7fb71415eb60 2024-04-16T16:17:32.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.283+0000 7fb70aa00640 1 -- 172.21.15.22:0/1266134257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6fc007400 con 0x7fb71415eb60 2024-04-16T16:17:32.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.284+0000 7fb70aa00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb6f006c8f0 0x7fb6f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.284+0000 7fb70aa00640 1 -- 172.21.15.22:0/1266134257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb6fc08b170 con 0x7fb71415eb60 2024-04-16T16:17:32.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.285+0000 7fb712a00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb6f006c8f0 0x7fb6f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.285+0000 7fb712a00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb6f006c8f0 0x7fb6f006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb704036000 tx=0x7fb70403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:32.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.289+0000 7fb70aa00640 1 -- 172.21.15.22:0/1266134257 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb6fc059510 con 0x7fb71415eb60 2024-04-16T16:17:32.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.493+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb714068f70 con 0x7fb71415eb60 2024-04-16T16:17:32.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.493+0000 7fb70aa00640 1 -- 172.21.15.22:0/1266134257 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fb6fc058e10 con 0x7fb71415eb60 2024-04-16T16:17:32.493 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:32.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb6f006c8f0 msgr2=0x7fb6f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb6f006c8f0 0x7fb6f006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb704036000 tx=0x7fb70403b040 comp rx=0 tx=0).stop 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 msgr2=0x7fb71415ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb71415ad60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c400 tx=0x7fb6fc00c8c0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 shutdown_connections 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb6f006c8f0 0x7fb6f006edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7140c9d80 0x7fb7140cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb71415eb60 0x7fb71415ad60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 --2- 172.21.15.22:0/1266134257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7140d35f0 0x7fb714150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 >> 172.21.15.22:0/1266134257 conn(0x7fb714072460 msgr2=0x7fb714072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 shutdown_connections 2024-04-16T16:17:32.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.496+0000 7fb713e00640 1 -- 172.21.15.22:0/1266134257 wait complete. 2024-04-16T16:17:32.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:17:32.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.737+0000 7fc2a3200640 1 Processor -- start 2024-04-16T16:17:32.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.737+0000 7fc2a3200640 1 -- start start 2024-04-16T16:17:32.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.739+0000 7fc2a3200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2a40afa70 0x7fc2a40b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.739+0000 7fc2a3200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a40ce780 con 0x7fc2a40b2920 2024-04-16T16:17:32.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.739+0000 7fc2a3200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a40cea40 con 0x7fc2a415eb40 2024-04-16T16:17:32.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.739+0000 7fc2a3200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a40ced20 con 0x7fc2a40afa70 2024-04-16T16:17:32.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.739+0000 7fc2a2800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc2a40b2920 0x7fc2a4071610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35924/0 (socket says 172.21.15.22:35924) 2024-04-16T16:17:32.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.739+0000 7fc2a2800640 1 -- 172.21.15.22:0/1253857181 learned_addr learned my addr 172.21.15.22:0/1253857181 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.739+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751794275 0 0) 0x7fc2a40ce780 con 0x7fc2a40b2920 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc288003520 con 0x7fc2a40b2920 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc299400640 1 --2- 172.21.15.22:0/1253857181 >> v2:172.21.15.43:3300/0 conn(0x7fc2a40afa70 0x7fc2a40b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4030323734 0 0) 0x7fc288003520 con 0x7fc2a40b2920 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 >> v2:172.21.15.43:3300/0 conn(0x7fc2a40afa70 msgr2=0x7fc2a40b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 --2- 172.21.15.22:0/1253857181 >> v2:172.21.15.43:3300/0 conn(0x7fc2a40afa70 0x7fc2a40b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 >> v1:172.21.15.43:6789/0 conn(0x7fc2a415eb40 legacy=0x7fc2a40d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a40af270 con 0x7fc2a40b2920 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fc29c0019f0 con 0x7fc2a40b2920 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 >> v1:172.21.15.22:6789/0 conn(0x7fc2a40b2920 legacy=0x7fc2a4071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc288003a70 0x7fc288003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288004800 0x7fc288004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2880053c0 0x7fc28800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a40ced20 con 0x7fc2880053c0 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc28800c260 con 0x7fc288004800 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc28800c460 con 0x7fc288003a70 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.740+0000 7fc2a2800640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2880053c0 0x7fc28800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc299400640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288004800 0x7fc288004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc2a1e00640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc288003a70 0x7fc288003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc2a2800640 1 -- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc288003a70 msgr2=0x7fc288003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc2a2800640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc288003a70 0x7fc288003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc2a2800640 1 -- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288004800 msgr2=0x7fc288004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc2a2800640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288004800 0x7fc288004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc2a2800640 1 -- 172.21.15.22:0/1253857181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc288003520 con 0x7fc2880053c0 2024-04-16T16:17:32.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.741+0000 7fc2a1e00640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc288003a70 0x7fc288003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a2800640 1 -- 172.21.15.22:0/1253857181 reap_dead start 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a2800640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2880053c0 0x7fc28800b9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00a7b0 tx=0x7fc288005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978fabd85479dd17 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00a3d0 con 0x7fc2880053c0 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc29c034650 con 0x7fc2880053c0 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a1400640 1 -- 172.21.15.22:0/1253857181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c034a40 con 0x7fc2880053c0 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a3200640 1 -- 172.21.15.22:0/1253857181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2880053c0 msgr2=0x7fc28800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a3200640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2880053c0 0x7fc28800b9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00a7b0 tx=0x7fc288005830 comp rx=0 tx=0).stop 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a3200640 1 -- 172.21.15.22:0/1253857181 shutdown_connections 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a3200640 1 --2- 172.21.15.22:0/1253857181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2880053c0 0x7fc28800b9c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a3200640 1 -- 172.21.15.22:0/1253857181 >> 172.21.15.22:0/1253857181 conn(0x7fc2a40cd6e0 msgr2=0x7fc2a40cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a3200640 1 -- 172.21.15.22:0/1253857181 shutdown_connections 2024-04-16T16:17:32.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.743+0000 7fc2a3200640 1 -- 172.21.15.22:0/1253857181 wait complete. 2024-04-16T16:17:32.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 Processor -- start 2024-04-16T16:17:32.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 -- start start 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2880053c0 0x7fc2a4140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a40b4280 0x7fc2a41617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2a4142a50 0x7fc2a4142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a40b0390 con 0x7fc2a4142a50 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a40b0210 con 0x7fc2a40b4280 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.746+0000 7fc2a3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a40b0510 con 0x7fc2880053c0 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2a4142a50 0x7fc2a4142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2a4142a50 0x7fc2a4142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52538/0 (socket says 172.21.15.22:52538) 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 -- 172.21.15.22:0/3559640098 learned_addr learned my addr 172.21.15.22:0/3559640098 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a1e00640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2880053c0 0x7fc2a4140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 -- 172.21.15.22:0/3559640098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2880053c0 msgr2=0x7fc2a4140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2880053c0 0x7fc2a4140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 -- 172.21.15.22:0/3559640098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a40b4280 msgr2=0x7fc2a41617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a40b4280 0x7fc2a41617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 -- 172.21.15.22:0/3559640098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a4140b40 con 0x7fc2a4142a50 2024-04-16T16:17:32.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.747+0000 7fc2a2800640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2a4142a50 0x7fc2a4142ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02cbd0 tx=0x7fc29c001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.748+0000 7fc29aa00640 1 -- 172.21.15.22:0/3559640098 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c043070 con 0x7fc2a4142a50 2024-04-16T16:17:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.748+0000 7fc29aa00640 1 -- 172.21.15.22:0/3559640098 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc29c001930 con 0x7fc2a4142a50 2024-04-16T16:17:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.748+0000 7fc29aa00640 1 -- 172.21.15.22:0/3559640098 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c039040 con 0x7fc2a4142a50 2024-04-16T16:17:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.748+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a4140e20 con 0x7fc2a4142a50 2024-04-16T16:17:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.748+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a41413e0 con 0x7fc2a4142a50 2024-04-16T16:17:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.749+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a4075250 con 0x7fc2a4142a50 2024-04-16T16:17:32.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.750+0000 7fc29aa00640 1 -- 172.21.15.22:0/3559640098 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc29c046070 con 0x7fc2a4142a50 2024-04-16T16:17:32.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.752+0000 7fc29aa00640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc28006c8f0 0x7fc28006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:32.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.752+0000 7fc29aa00640 1 -- 172.21.15.22:0/3559640098 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc29c0acee0 con 0x7fc2a4142a50 2024-04-16T16:17:32.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.752+0000 7fc2a1e00640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc28006c8f0 0x7fc28006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:32.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.752+0000 7fc2a1e00640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc28006c8f0 0x7fc28006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc294001750 tx=0x7fc294009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.757+0000 7fc29aa00640 1 -- 172.21.15.22:0/3559640098 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc29c07b320 con 0x7fc2a4142a50 2024-04-16T16:17:32.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.971+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2a4075f30 con 0x7fc2a4142a50 2024-04-16T16:17:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.972+0000 7fc29aa00640 1 -- 172.21.15.22:0/3559640098 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fc29c07ac20 con 0x7fc2a4142a50 2024-04-16T16:17:32.972 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:17:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc28006c8f0 msgr2=0x7fc28006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc28006c8f0 0x7fc28006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc294001750 tx=0x7fc294009040 comp rx=0 tx=0).stop 2024-04-16T16:17:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2a4142a50 msgr2=0x7fc2a4142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2a4142a50 0x7fc2a4142ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02cbd0 tx=0x7fc29c001cf0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 shutdown_connections 2024-04-16T16:17:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc28006c8f0 0x7fc28006edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2a4142a50 0x7fc2a4142ed0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a40b4280 0x7fc2a41617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 --2- 172.21.15.22:0/3559640098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2880053c0 0x7fc2a4140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 >> 172.21.15.22:0/3559640098 conn(0x7fc2a40cd6e0 msgr2=0x7fc2a415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 shutdown_connections 2024-04-16T16:17:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:32.975+0000 7fc2a3200640 1 -- 172.21.15.22:0/3559640098 wait complete. 2024-04-16T16:17:32.996 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-16T16:17:32.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:32.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-16T16:17:33.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:17:33.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:33.112 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T16:17:33.175 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:33.175 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:33.232 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:33.232 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:33.286 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:17:33.287 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:33.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.565+0000 7f6291600640 1 Processor -- start 2024-04-16T16:17:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.565+0000 7f6291600640 1 -- start start 2024-04-16T16:17:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f6291600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f628c06eaa0 0x7f628c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f6291600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f628c06ee80 0x7f628c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f6291600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c06d160 con 0x7f628c0cc810 2024-04-16T16:17:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f6291600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f628c06cf10 con 0x7f628c06eaa0 2024-04-16T16:17:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f6291600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f628c06d440 con 0x7f628c06ee80 2024-04-16T16:17:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f628be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f628c06eaa0 0x7f628c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f6283400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f628c0cc810 0x7f628c06df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35938/0 (socket says 172.21.15.22:35938) 2024-04-16T16:17:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.566+0000 7f6283400640 1 -- 172.21.15.22:0/1060975234 learned_addr learned my addr 172.21.15.22:0/1060975234 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.567+0000 7f6290c00640 1 --2- 172.21.15.22:0/1060975234 >> v2:172.21.15.43:3300/0 conn(0x7f628c06ee80 0x7f628c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.567+0000 7f628be00640 1 -- 172.21.15.22:0/1060975234 >> v2:172.21.15.43:3300/0 conn(0x7f628c06ee80 msgr2=0x7f628c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.567+0000 7f628be00640 1 --2- 172.21.15.22:0/1060975234 >> v2:172.21.15.43:3300/0 conn(0x7f628c06ee80 0x7f628c15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.567+0000 7f628be00640 1 -- 172.21.15.22:0/1060975234 >> v1:172.21.15.22:6789/0 conn(0x7f628c0cc810 legacy=0x7f628c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.567+0000 7f628be00640 1 -- 172.21.15.22:0/1060975234 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c06d720 con 0x7f628c06eaa0 2024-04-16T16:17:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.567+0000 7f628b400640 1 -- 172.21.15.22:0/1060975234 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 999852991 0 0) 0x7f628c06d160 con 0x7f628c0cc810 2024-04-16T16:17:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.567+0000 7f6290c00640 1 --2- 172.21.15.22:0/1060975234 >> v2:172.21.15.43:3300/0 conn(0x7f628c06ee80 0x7f628c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.570+0000 7f628be00640 1 --2- 172.21.15.22:0/1060975234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06eaa0 0x7f628c0b3e20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f627c0097a0 tx=0x7f627c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54852ab5935a9642 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.570+0000 7f628b400640 1 -- 172.21.15.22:0/1060975234 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c035020 con 0x7f628c06eaa0 2024-04-16T16:17:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.570+0000 7f628b400640 1 -- 172.21.15.22:0/1060975234 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c031830 con 0x7f628c06eaa0 2024-04-16T16:17:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.570+0000 7f628b400640 1 -- 172.21.15.22:0/1060975234 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c031c00 con 0x7f628c06eaa0 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 -- 172.21.15.22:0/1060975234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06eaa0 msgr2=0x7f628c0b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 --2- 172.21.15.22:0/1060975234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06eaa0 0x7f628c0b3e20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f627c0097a0 tx=0x7f627c02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 -- 172.21.15.22:0/1060975234 shutdown_connections 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 --2- 172.21.15.22:0/1060975234 >> v2:172.21.15.43:3300/0 conn(0x7f628c06ee80 0x7f628c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 --2- 172.21.15.22:0/1060975234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06eaa0 0x7f628c0b3e20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 -- 172.21.15.22:0/1060975234 >> 172.21.15.22:0/1060975234 conn(0x7f628c062440 msgr2=0x7f628c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 -- 172.21.15.22:0/1060975234 shutdown_connections 2024-04-16T16:17:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.571+0000 7f6291600640 1 -- 172.21.15.22:0/1060975234 wait complete. 2024-04-16T16:17:33.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.572+0000 7f6291600640 1 Processor -- start 2024-04-16T16:17:33.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.572+0000 7f6291600640 1 -- start start 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6291600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06eaa0 0x7f628c14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6291600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06ee80 0x7f628c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6291600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f628c0cc810 0x7f628c1f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6291600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f628c15c740 con 0x7f628c06ee80 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6291600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f628c0b4360 con 0x7f628c06eaa0 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6291600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f628c15c8c0 con 0x7f628c0cc810 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6283400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06ee80 0x7f628c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6283400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06ee80 0x7f628c14c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52566/0 (socket says 172.21.15.22:52566) 2024-04-16T16:17:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f6283400640 1 -- 172.21.15.22:0/3687387501 learned_addr learned my addr 172.21.15.22:0/3687387501 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.574+0000 7f628be00640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06eaa0 0x7f628c14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6283400640 1 -- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f628c0cc810 msgr2=0x7f628c1f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6283400640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f628c0cc810 0x7f628c1f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6283400640 1 -- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06eaa0 msgr2=0x7f628c14cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6283400640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06eaa0 0x7f628c14cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6283400640 1 -- 172.21.15.22:0/3687387501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c1f5490 con 0x7f628c06ee80 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f628be00640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06eaa0 0x7f628c14cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6283400640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06ee80 0x7f628c14c2e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f627400c430 tx=0x7f627400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6288c00640 1 -- 172.21.15.22:0/3687387501 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62740074e0 con 0x7f628c06ee80 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6288c00640 1 -- 172.21.15.22:0/3687387501 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62740047e0 con 0x7f628c06ee80 2024-04-16T16:17:33.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c14d410 con 0x7f628c06ee80 2024-04-16T16:17:33.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.575+0000 7f6288c00640 1 -- 172.21.15.22:0/3687387501 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274004bd0 con 0x7f628c06ee80 2024-04-16T16:17:33.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.576+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c14ee00 con 0x7f628c06ee80 2024-04-16T16:17:33.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.577+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628c075f30 con 0x7f628c06ee80 2024-04-16T16:17:33.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.578+0000 7f6288c00640 1 -- 172.21.15.22:0/3687387501 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6274011070 con 0x7f628c06ee80 2024-04-16T16:17:33.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.578+0000 7f6288c00640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f626806c8f0 0x7f626806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:33.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.578+0000 7f6288c00640 1 -- 172.21.15.22:0/3687387501 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f627408b810 con 0x7f628c06ee80 2024-04-16T16:17:33.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.578+0000 7f628be00640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f626806c8f0 0x7f626806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:33.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.580+0000 7f628be00640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f626806c8f0 0x7f626806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f627c036000 tx=0x7f627c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:33.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.583+0000 7f6288c00640 1 -- 172.21.15.22:0/3687387501 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f628c1f5490 con 0x7f628c06ee80 2024-04-16T16:17:33.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.789+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f628c071010 con 0x7f628c06ee80 2024-04-16T16:17:33.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.791+0000 7f6288c00640 1 -- 172.21.15.22:0/3687387501 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16733 (secure 0 0 0) 0x7f627400e280 con 0x7f628c06ee80 2024-04-16T16:17:33.791 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:33.791 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:29.459450+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f626806c8f0 msgr2=0x7f626806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f626806c8f0 0x7f626806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f627c036000 tx=0x7f627c008030 comp rx=0 tx=0).stop 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06ee80 msgr2=0x7f628c14c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06ee80 0x7f628c14c2e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f627400c430 tx=0x7f627400c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 shutdown_connections 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f626806c8f0 0x7f626806edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f628c0cc810 0x7f628c1f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f628c06ee80 0x7f628c14c2e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.794+0000 7f6291600640 1 --2- 172.21.15.22:0/3687387501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06eaa0 0x7f628c14cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.795+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 >> 172.21.15.22:0/3687387501 conn(0x7f628c062440 msgr2=0x7f628c0728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.795+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 shutdown_connections 2024-04-16T16:17:33.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:33.795+0000 7f6291600640 1 -- 172.21.15.22:0/3687387501 wait complete. 2024-04-16T16:17:33.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:33.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:34.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.033+0000 7fb8de800640 1 Processor -- start 2024-04-16T16:17:34.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.034+0000 7fb8de800640 1 -- start start 2024-04-16T16:17:34.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8de800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8d80cfca0 0x7fb8d80d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8de800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb8d80d1cc0 0x7fb8d80b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8de800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d80d20d0 con 0x7fb8d815eb40 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8de800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80d3ed0 con 0x7fb8d80cfca0 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8de800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80d41b0 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8dca00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8d80cfca0 0x7fb8d80d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8dca00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8d80cfca0 0x7fb8d80d1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52574/0 (socket says 172.21.15.22:52574) 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.035+0000 7fb8dca00640 1 -- 172.21.15.22:0/1351109183 learned_addr learned my addr 172.21.15.22:0/1351109183 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.036+0000 7fb8dde00640 1 --2- 172.21.15.22:0/1351109183 >> v2:172.21.15.43:3300/0 conn(0x7fb8d80d1cc0 0x7fb8d80b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.036+0000 7fb8dca00640 1 -- 172.21.15.22:0/1351109183 >> v2:172.21.15.43:3300/0 conn(0x7fb8d80d1cc0 msgr2=0x7fb8d80b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.036+0000 7fb8dca00640 1 --2- 172.21.15.22:0/1351109183 >> v2:172.21.15.43:3300/0 conn(0x7fb8d80d1cc0 0x7fb8d80b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.036+0000 7fb8dca00640 1 -- 172.21.15.22:0/1351109183 >> v1:172.21.15.43:6789/0 conn(0x7fb8d815eb40 legacy=0x7fb8d80d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:34.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.036+0000 7fb8dca00640 1 -- 172.21.15.22:0/1351109183 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d80d4490 con 0x7fb8d80cfca0 2024-04-16T16:17:34.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.037+0000 7fb8dca00640 1 --2- 172.21.15.22:0/1351109183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80cfca0 0x7fb8d80d1780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80b6a80 tx=0x7fb8c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe32e2a384de9ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.037+0000 7fb8d7e00640 1 -- 172.21.15.22:0/1351109183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4035020 con 0x7fb8d80cfca0 2024-04-16T16:17:34.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.037+0000 7fb8d7e00640 1 -- 172.21.15.22:0/1351109183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c4031870 con 0x7fb8d80cfca0 2024-04-16T16:17:34.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.037+0000 7fb8d7e00640 1 -- 172.21.15.22:0/1351109183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4031c40 con 0x7fb8d80cfca0 2024-04-16T16:17:34.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 -- 172.21.15.22:0/1351109183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80cfca0 msgr2=0x7fb8d80d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 --2- 172.21.15.22:0/1351109183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80cfca0 0x7fb8d80d1780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80b6a80 tx=0x7fb8c402b910 comp rx=0 tx=0).stop 2024-04-16T16:17:34.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 -- 172.21.15.22:0/1351109183 shutdown_connections 2024-04-16T16:17:34.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 --2- 172.21.15.22:0/1351109183 >> v2:172.21.15.43:3300/0 conn(0x7fb8d80d1cc0 0x7fb8d80b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 --2- 172.21.15.22:0/1351109183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80cfca0 0x7fb8d80d1780 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 -- 172.21.15.22:0/1351109183 >> 172.21.15.22:0/1351109183 conn(0x7fb8d8072460 msgr2=0x7fb8d8072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:34.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 -- 172.21.15.22:0/1351109183 shutdown_connections 2024-04-16T16:17:34.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.038+0000 7fb8de800640 1 -- 172.21.15.22:0/1351109183 wait complete. 2024-04-16T16:17:34.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.040+0000 7fb8de800640 1 Processor -- start 2024-04-16T16:17:34.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.040+0000 7fb8de800640 1 -- start start 2024-04-16T16:17:34.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.041+0000 7fb8de800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8d80cfca0 0x7fb8d8154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.041+0000 7fb8de800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80d1cc0 0x7fb8d815f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.041+0000 7fb8de800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8d815eb40 0x7fb8d81590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.041+0000 7fb8de800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80b7b50 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.041+0000 7fb8de800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80b79d0 con 0x7fb8d815eb40 2024-04-16T16:17:34.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.041+0000 7fb8de800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d80b87f0 con 0x7fb8d80cfca0 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80d1cc0 0x7fb8d815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80d1cc0 0x7fb8d815f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52582/0 (socket says 172.21.15.22:52582) 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 -- 172.21.15.22:0/2067830486 learned_addr learned my addr 172.21.15.22:0/2067830486 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dde00640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8d815eb40 0x7fb8d81590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dd400640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8d80cfca0 0x7fb8d8154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 -- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8d80cfca0 msgr2=0x7fb8d8154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8d80cfca0 0x7fb8d8154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 -- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8d815eb40 msgr2=0x7fb8d81590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8d815eb40 0x7fb8d81590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dca00640 1 -- 172.21.15.22:0/2067830486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d8160260 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dde00640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8d815eb40 0x7fb8d81590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.042+0000 7fb8dd400640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8d80cfca0 0x7fb8d8154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.043+0000 7fb8dca00640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80d1cc0 0x7fb8d815f930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000c00 tx=0x7fb8c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.043+0000 7fb8d5600640 1 -- 172.21.15.22:0/2067830486 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4040070 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.043+0000 7fb8d5600640 1 -- 172.21.15.22:0/2067830486 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c4030d00 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.043+0000 7fb8d5600640 1 -- 172.21.15.22:0/2067830486 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4035040 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.043+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d8160540 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.043+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d8160b00 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.045+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d8075f30 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.045+0000 7fb8d5600640 1 -- 172.21.15.22:0/2067830486 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8c404b060 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.046+0000 7fb8d5600640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb8b806c920 0x7fb8b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.047+0000 7fb8d5600640 1 -- 172.21.15.22:0/2067830486 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb8c40ada60 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.047+0000 7fb8dd400640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb8b806c920 0x7fb8b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.048+0000 7fb8dd400640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb8b806c920 0x7fb8b806ede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800a810 tx=0x7fb8c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.051+0000 7fb8d5600640 1 -- 172.21.15.22:0/2067830486 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8d80d20d0 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.254+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb8d8068f70 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.255+0000 7fb8d5600640 1 -- 172.21.15.22:0/2067830486 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fb8c407bd70 con 0x7fb8d80d1cc0 2024-04-16T16:17:34.254 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.257+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb8b806c920 msgr2=0x7fb8b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.257+0000 7fb8de800640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb8b806c920 0x7fb8b806ede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800a810 tx=0x7fb8c8008040 comp rx=0 tx=0).stop 2024-04-16T16:17:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.257+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80d1cc0 msgr2=0x7fb8d815f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.257+0000 7fb8de800640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80d1cc0 0x7fb8d815f930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000c00 tx=0x7fb8c40046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 shutdown_connections 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb8b806c920 0x7fb8b806ede0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8d815eb40 0x7fb8d81590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d80d1cc0 0x7fb8d815f930 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 --2- 172.21.15.22:0/2067830486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8d80cfca0 0x7fb8d8154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 >> 172.21.15.22:0/2067830486 conn(0x7fb8d8072460 msgr2=0x7fb8d8072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 shutdown_connections 2024-04-16T16:17:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.258+0000 7fb8de800640 1 -- 172.21.15.22:0/2067830486 wait complete. 2024-04-16T16:17:34.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:34.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.486+0000 7f912f200640 1 Processor -- start 2024-04-16T16:17:34.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.487+0000 7f912f200640 1 -- start start 2024-04-16T16:17:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.488+0000 7f912f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913015eb60 0x7f91300cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.488+0000 7f912f200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91300d1eb0 0x7f91300b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.488+0000 7f912f200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91300d3ef0 con 0x7f91300d35f0 2024-04-16T16:17:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.488+0000 7f912f200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f91300d41d0 con 0x7f91300d1eb0 2024-04-16T16:17:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.488+0000 7f912f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91300d44b0 con 0x7f913015eb60 2024-04-16T16:17:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.489+0000 7f912de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913015eb60 0x7f91300cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.489+0000 7f912e800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91300d1eb0 0x7f91300b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.489+0000 7f912e800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91300d1eb0 0x7f91300b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:52952/0 (socket says 172.21.15.22:52952) 2024-04-16T16:17:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.489+0000 7f912e800640 1 -- 172.21.15.22:0/3975153817 learned_addr learned my addr 172.21.15.22:0/3975153817 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.490+0000 7f912de00640 1 -- 172.21.15.22:0/3975153817 >> v2:172.21.15.43:3300/0 conn(0x7f91300d1eb0 msgr2=0x7f91300b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.490+0000 7f912de00640 1 --2- 172.21.15.22:0/3975153817 >> v2:172.21.15.43:3300/0 conn(0x7f91300d1eb0 0x7f91300b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.490+0000 7f912de00640 1 -- 172.21.15.22:0/3975153817 >> v1:172.21.15.43:6789/0 conn(0x7f91300d35f0 legacy=0x7f91300d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.490+0000 7f912de00640 1 -- 172.21.15.22:0/3975153817 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300b7db0 con 0x7f913015eb60 2024-04-16T16:17:34.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.492+0000 7f912de00640 1 --2- 172.21.15.22:0/3975153817 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913015eb60 0x7f91300cfcc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91200097a0 tx=0x7f912002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=510abdbeec34eff0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.493+0000 7f912d400640 1 -- 172.21.15.22:0/3975153817 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120035020 con 0x7f913015eb60 2024-04-16T16:17:34.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.493+0000 7f912d400640 1 -- 172.21.15.22:0/3975153817 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9120031830 con 0x7f913015eb60 2024-04-16T16:17:34.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.493+0000 7f912d400640 1 -- 172.21.15.22:0/3975153817 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120031c00 con 0x7f913015eb60 2024-04-16T16:17:34.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 -- 172.21.15.22:0/3975153817 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913015eb60 msgr2=0x7f91300cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 --2- 172.21.15.22:0/3975153817 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913015eb60 0x7f91300cfcc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91200097a0 tx=0x7f912002b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 -- 172.21.15.22:0/3975153817 shutdown_connections 2024-04-16T16:17:34.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 --2- 172.21.15.22:0/3975153817 >> v2:172.21.15.43:3300/0 conn(0x7f91300d1eb0 0x7f91300b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 --2- 172.21.15.22:0/3975153817 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913015eb60 0x7f91300cfcc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 -- 172.21.15.22:0/3975153817 >> 172.21.15.22:0/3975153817 conn(0x7f9130072460 msgr2=0x7f9130072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:34.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 -- 172.21.15.22:0/3975153817 shutdown_connections 2024-04-16T16:17:34.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.494+0000 7f912f200640 1 -- 172.21.15.22:0/3975153817 wait complete. 2024-04-16T16:17:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.496+0000 7f912f200640 1 Processor -- start 2024-04-16T16:17:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.497+0000 7f912f200640 1 -- start start 2024-04-16T16:17:34.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f912f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91300d1eb0 0x7f91300ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f912f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91300d35f0 0x7f91300b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f912f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913015eb60 0x7f91300b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f912f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91300d3bb0 con 0x7f91300d35f0 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f912f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91300d3a30 con 0x7f913015eb60 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f912f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91300b8810 con 0x7f91300d1eb0 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f9127e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91300d35f0 0x7f91300b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f9127e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91300d35f0 0x7f91300b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52594/0 (socket says 172.21.15.22:52594) 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.498+0000 7f9127e00640 1 -- 172.21.15.22:0/2963235158 learned_addr learned my addr 172.21.15.22:0/2963235158 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f912de00640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91300d1eb0 0x7f91300ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f912e800640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913015eb60 0x7f91300b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f9127e00640 1 -- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91300d1eb0 msgr2=0x7f91300ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f9127e00640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91300d1eb0 0x7f91300ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f9127e00640 1 -- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913015eb60 msgr2=0x7f91300b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f9127e00640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913015eb60 0x7f91300b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f9127e00640 1 -- 172.21.15.22:0/2963235158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300cadb0 con 0x7f91300d35f0 2024-04-16T16:17:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.499+0000 7f9127e00640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91300d35f0 0x7f91300b57b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f911800c400 tx=0x7f911800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.500+0000 7f9126000640 1 -- 172.21.15.22:0/2963235158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91180052d0 con 0x7f91300d35f0 2024-04-16T16:17:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.500+0000 7f9126000640 1 -- 172.21.15.22:0/2963235158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9118005490 con 0x7f91300d35f0 2024-04-16T16:17:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.500+0000 7f9126000640 1 -- 172.21.15.22:0/2963235158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118007260 con 0x7f91300d35f0 2024-04-16T16:17:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.500+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91300cb090 con 0x7f91300d35f0 2024-04-16T16:17:34.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.500+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913014dc50 con 0x7f91300d35f0 2024-04-16T16:17:34.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.501+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9130075f30 con 0x7f91300d35f0 2024-04-16T16:17:34.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.502+0000 7f9126000640 1 -- 172.21.15.22:0/2963235158 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9118007400 con 0x7f91300d35f0 2024-04-16T16:17:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.503+0000 7f9126000640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f910c06c920 0x7f910c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.503+0000 7f9126000640 1 -- 172.21.15.22:0/2963235158 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f911808b180 con 0x7f91300d35f0 2024-04-16T16:17:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.503+0000 7f912de00640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f910c06c920 0x7f910c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.504+0000 7f912de00640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f910c06c920 0x7f910c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9120036000 tx=0x7f912003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.508+0000 7f9126000640 1 -- 172.21.15.22:0/2963235158 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9118059490 con 0x7f91300d35f0 2024-04-16T16:17:34.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.710+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9130068f70 con 0x7f91300d35f0 2024-04-16T16:17:34.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.710+0000 7f9126000640 1 -- 172.21.15.22:0/2963235158 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f9118058d90 con 0x7f91300d35f0 2024-04-16T16:17:34.709 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.713+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f910c06c920 msgr2=0x7f910c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.713+0000 7f912f200640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f910c06c920 0x7f910c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9120036000 tx=0x7f912003c040 comp rx=0 tx=0).stop 2024-04-16T16:17:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.713+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91300d35f0 msgr2=0x7f91300b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.713+0000 7f912f200640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91300d35f0 0x7f91300b57b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f911800c400 tx=0x7f911800c8c0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 shutdown_connections 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f910c06c920 0x7f910c06ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913015eb60 0x7f91300b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91300d35f0 0x7f91300b57b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 --2- 172.21.15.22:0/2963235158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91300d1eb0 0x7f91300ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 >> 172.21.15.22:0/2963235158 conn(0x7f9130072460 msgr2=0x7f913015acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 shutdown_connections 2024-04-16T16:17:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.714+0000 7f912f200640 1 -- 172.21.15.22:0/2963235158 wait complete. 2024-04-16T16:17:34.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:34.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.959+0000 7faac5000640 1 Processor -- start 2024-04-16T16:17:34.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.959+0000 7faac5000640 1 -- start start 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faac5000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faac015cd50 0x7faac00d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faac5000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faac00d11f0 0x7faac0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faac5000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac00cfe20 con 0x7faac015c970 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faac5000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7faac00af440 con 0x7faac00d11f0 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faac5000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7faac00d1640 con 0x7faac015cd50 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faabfe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faac00d11f0 0x7faac0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faabfe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faac00d11f0 0x7faac0070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52610/0 (socket says 172.21.15.22:52610) 2024-04-16T16:17:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.960+0000 7faabfe00640 1 -- 172.21.15.22:0/2356518965 learned_addr learned my addr 172.21.15.22:0/2356518965 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.961+0000 7faabea00640 1 --2- 172.21.15.22:0/2356518965 >> v2:172.21.15.43:3300/0 conn(0x7faac015cd50 0x7faac00d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.961+0000 7faabfe00640 1 -- 172.21.15.22:0/2356518965 >> v2:172.21.15.43:3300/0 conn(0x7faac015cd50 msgr2=0x7faac00d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.961+0000 7faabfe00640 1 --2- 172.21.15.22:0/2356518965 >> v2:172.21.15.43:3300/0 conn(0x7faac015cd50 0x7faac00d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.961+0000 7faabfe00640 1 -- 172.21.15.22:0/2356518965 >> v1:172.21.15.43:6789/0 conn(0x7faac015c970 legacy=0x7faac00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.961+0000 7faabfe00640 1 -- 172.21.15.22:0/2356518965 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac006f2c0 con 0x7faac00d11f0 2024-04-16T16:17:34.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.962+0000 7faabfe00640 1 --2- 172.21.15.22:0/2356518965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d11f0 0x7faac0070080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faac00b52c0 tx=0x7faab802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8967f912ec8510fb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faabe000640 1 -- 172.21.15.22:0/2356518965 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8035020 con 0x7faac00d11f0 2024-04-16T16:17:34.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faabe000640 1 -- 172.21.15.22:0/2356518965 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8031870 con 0x7faac00d11f0 2024-04-16T16:17:34.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faabe000640 1 -- 172.21.15.22:0/2356518965 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8031c40 con 0x7faac00d11f0 2024-04-16T16:17:34.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 -- 172.21.15.22:0/2356518965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d11f0 msgr2=0x7faac0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 --2- 172.21.15.22:0/2356518965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d11f0 0x7faac0070080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faac00b52c0 tx=0x7faab802b910 comp rx=0 tx=0).stop 2024-04-16T16:17:34.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 -- 172.21.15.22:0/2356518965 shutdown_connections 2024-04-16T16:17:34.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 --2- 172.21.15.22:0/2356518965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac00d11f0 0x7faac0070080 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 --2- 172.21.15.22:0/2356518965 >> v2:172.21.15.43:3300/0 conn(0x7faac015cd50 0x7faac00d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 -- 172.21.15.22:0/2356518965 >> 172.21.15.22:0/2356518965 conn(0x7faac00d26d0 msgr2=0x7faac00d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:34.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 -- 172.21.15.22:0/2356518965 shutdown_connections 2024-04-16T16:17:34.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.963+0000 7faac5000640 1 -- 172.21.15.22:0/2356518965 wait complete. 2024-04-16T16:17:34.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.965+0000 7faac5000640 1 Processor -- start 2024-04-16T16:17:34.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.965+0000 7faac5000640 1 -- start start 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faac5000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac00d11f0 0x7faac014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faac5000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac015c970 0x7faac00b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faac5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac015cd50 0x7faac00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faac5000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faac006fb60 con 0x7faac015c970 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faac5000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faac006f880 con 0x7faac015cd50 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faac5000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faac00d0600 con 0x7faac00d11f0 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faabea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac015c970 0x7faac00b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faabea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac015c970 0x7faac00b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52618/0 (socket says 172.21.15.22:52618) 2024-04-16T16:17:34.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.966+0000 7faabea00640 1 -- 172.21.15.22:0/3212362132 learned_addr learned my addr 172.21.15.22:0/3212362132 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabfe00640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac015cd50 0x7faac00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabf400640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac00d11f0 0x7faac014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabea00640 1 -- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac00d11f0 msgr2=0x7faac014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabea00640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac00d11f0 0x7faac014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabea00640 1 -- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac015cd50 msgr2=0x7faac00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabea00640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac015cd50 0x7faac00b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabea00640 1 -- 172.21.15.22:0/3212362132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac006bd60 con 0x7faac015c970 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabf400640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac00d11f0 0x7faac014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabfe00640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac015cd50 0x7faac00b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.967+0000 7faabea00640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac015c970 0x7faac00b71d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faaa8007ef0 tx=0x7faaa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.968+0000 7faab7400640 1 -- 172.21.15.22:0/3212362132 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8014620 con 0x7faac015c970 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.968+0000 7faab7400640 1 -- 172.21.15.22:0/3212362132 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa8019070 con 0x7faac015c970 2024-04-16T16:17:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.968+0000 7faab7400640 1 -- 172.21.15.22:0/3212362132 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8014a00 con 0x7faac015c970 2024-04-16T16:17:34.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.968+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac00b7710 con 0x7faac015c970 2024-04-16T16:17:34.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.968+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac00b7c90 con 0x7faac015c970 2024-04-16T16:17:34.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.969+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac0075f30 con 0x7faac015c970 2024-04-16T16:17:34.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.970+0000 7faab7400640 1 -- 172.21.15.22:0/3212362132 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faaa8014ba0 con 0x7faac015c970 2024-04-16T16:17:34.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.971+0000 7faab7400640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa9c06c8f0 0x7faa9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:34.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.972+0000 7faab7400640 1 -- 172.21.15.22:0/3212362132 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7faaa808c5e0 con 0x7faac015c970 2024-04-16T16:17:34.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.972+0000 7faabf400640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa9c06c8f0 0x7faa9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:34.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.973+0000 7faabf400640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa9c06c8f0 0x7faa9c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faab0003eb0 tx=0x7faab0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:34.976+0000 7faab7400640 1 -- 172.21.15.22:0/3212362132 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faaa805a8f0 con 0x7faac015c970 2024-04-16T16:17:35.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.178+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faac006ed80 con 0x7faac015c970 2024-04-16T16:17:35.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.179+0000 7faab7400640 1 -- 172.21.15.22:0/3212362132 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7faaa805a1f0 con 0x7faac015c970 2024-04-16T16:17:35.177 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa9c06c8f0 msgr2=0x7faa9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa9c06c8f0 0x7faa9c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faab0003eb0 tx=0x7faab0009040 comp rx=0 tx=0).stop 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac015c970 msgr2=0x7faac00b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac015c970 0x7faac00b71d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faaa8007ef0 tx=0x7faaa800e4b0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 shutdown_connections 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa9c06c8f0 0x7faa9c06edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac015cd50 0x7faac00b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faac015c970 0x7faac00b71d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 --2- 172.21.15.22:0/3212362132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac00d11f0 0x7faac014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 >> 172.21.15.22:0/3212362132 conn(0x7faac00d26d0 msgr2=0x7faac0070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.181+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 shutdown_connections 2024-04-16T16:17:35.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.182+0000 7faac5000640 1 -- 172.21.15.22:0/3212362132 wait complete. 2024-04-16T16:17:35.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:17:35.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.415+0000 7f6bf2800640 1 Processor -- start 2024-04-16T16:17:35.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.415+0000 7f6bf2800640 1 -- start start 2024-04-16T16:17:35.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.417+0000 7f6bf2800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6bec0b56b0 0x7f6bec0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:35.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.417+0000 7f6bf2800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6bec0d05f0 0x7f6bec0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:35.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.417+0000 7f6bf2800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bec06d060 con 0x7f6bec15e8b0 2024-04-16T16:17:35.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.417+0000 7f6bf2800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec06dc70 con 0x7f6bec0d05f0 2024-04-16T16:17:35.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.417+0000 7f6bf2800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec06e100 con 0x7f6bec0b56b0 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf1e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6bec0d05f0 0x7f6bec0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf1e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6bec0d05f0 0x7f6bec0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52626/0 (socket says 172.21.15.22:52626) 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf1e00640 1 -- 172.21.15.22:0/3809534112 learned_addr learned my addr 172.21.15.22:0/3809534112 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf0a00640 1 --2- 172.21.15.22:0/3809534112 >> v2:172.21.15.43:3300/0 conn(0x7f6bec0b56b0 0x7f6bec0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf1e00640 1 -- 172.21.15.22:0/3809534112 >> v2:172.21.15.43:3300/0 conn(0x7f6bec0b56b0 msgr2=0x7f6bec0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf1e00640 1 --2- 172.21.15.22:0/3809534112 >> v2:172.21.15.43:3300/0 conn(0x7f6bec0b56b0 0x7f6bec0d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf1e00640 1 -- 172.21.15.22:0/3809534112 >> v1:172.21.15.43:6789/0 conn(0x7f6bec15e8b0 legacy=0x7f6bec162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.418+0000 7f6bf1e00640 1 -- 172.21.15.22:0/3809534112 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec06d340 con 0x7f6bec0d05f0 2024-04-16T16:17:35.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.420+0000 7f6bf1e00640 1 --2- 172.21.15.22:0/3809534112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0b3680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bec06efd0 tx=0x7f6be402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4910a94ea5b1b12 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:35.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.420+0000 7f6bebe00640 1 -- 172.21.15.22:0/3809534112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be402cb20 con 0x7f6bec0d05f0 2024-04-16T16:17:35.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.420+0000 7f6bebe00640 1 -- 172.21.15.22:0/3809534112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be402ccc0 con 0x7f6bec0d05f0 2024-04-16T16:17:35.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.420+0000 7f6bebe00640 1 -- 172.21.15.22:0/3809534112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4034610 con 0x7f6bec0d05f0 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 -- 172.21.15.22:0/3809534112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec0d05f0 msgr2=0x7f6bec0b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 --2- 172.21.15.22:0/3809534112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0b3680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bec06efd0 tx=0x7f6be402bf80 comp rx=0 tx=0).stop 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 -- 172.21.15.22:0/3809534112 shutdown_connections 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 --2- 172.21.15.22:0/3809534112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0b3680 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 --2- 172.21.15.22:0/3809534112 >> v2:172.21.15.43:3300/0 conn(0x7f6bec0b56b0 0x7f6bec0d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 -- 172.21.15.22:0/3809534112 >> 172.21.15.22:0/3809534112 conn(0x7f6bec075070 msgr2=0x7f6bec062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 -- 172.21.15.22:0/3809534112 shutdown_connections 2024-04-16T16:17:35.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.421+0000 7f6bf2800640 1 -- 172.21.15.22:0/3809534112 wait complete. 2024-04-16T16:17:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.423+0000 7f6bf2800640 1 Processor -- start 2024-04-16T16:17:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.423+0000 7f6bf2800640 1 -- start start 2024-04-16T16:17:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.424+0000 7f6bf2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bec0b56b0 0x7f6bec154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.424+0000 7f6bf2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.424+0000 7f6bf2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec15e8b0 0x7f6bec156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.424+0000 7f6bf2800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec06d900 con 0x7f6bec15e8b0 2024-04-16T16:17:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.424+0000 7f6bf2800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec0d0a20 con 0x7f6bec0d05f0 2024-04-16T16:17:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.424+0000 7f6bf2800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec15ec90 con 0x7f6bec0b56b0 2024-04-16T16:17:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec15e8b0 0x7f6bec156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec15e8b0 0x7f6bec156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52638/0 (socket says 172.21.15.22:52638) 2024-04-16T16:17:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 -- 172.21.15.22:0/4183922192 learned_addr learned my addr 172.21.15.22:0/4183922192 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:35.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1400640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bec0b56b0 0x7f6bec154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:35.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf0a00640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:35.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 -- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bec0b56b0 msgr2=0x7f6bec154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bec0b56b0 0x7f6bec154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 -- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bec0d05f0 msgr2=0x7f6bec0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1e00640 1 -- 172.21.15.22:0/4183922192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec155cd0 con 0x7f6bec15e8b0 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf1400640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bec0b56b0 0x7f6bec154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.425+0000 7f6bf0a00640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.426+0000 7f6bf1e00640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec15e8b0 0x7f6bec156d70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6be4036040 tx=0x7f6be4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.426+0000 7f6be9600640 1 -- 172.21.15.22:0/4183922192 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4043020 con 0x7f6bec15e8b0 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.426+0000 7f6be9600640 1 -- 172.21.15.22:0/4183922192 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be403e450 con 0x7f6bec15e8b0 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.426+0000 7f6be9600640 1 -- 172.21.15.22:0/4183922192 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4009510 con 0x7f6bec15e8b0 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.426+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec155fb0 con 0x7f6bec15e8b0 2024-04-16T16:17:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.426+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec156570 con 0x7f6bec15e8b0 2024-04-16T16:17:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.427+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec075f30 con 0x7f6bec15e8b0 2024-04-16T16:17:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.428+0000 7f6be9600640 1 -- 172.21.15.22:0/4183922192 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6be4046020 con 0x7f6bec15e8b0 2024-04-16T16:17:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.429+0000 7f6be9600640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.430+0000 7f6be9600640 1 -- 172.21.15.22:0/4183922192 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6be40ae340 con 0x7f6bec15e8b0 2024-04-16T16:17:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.430+0000 7f6bf1400640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.431+0000 7f6bf1400640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6be00015e0 tx=0x7f6be0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:35.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.434+0000 7f6be9600640 1 -- 172.21.15.22:0/4183922192 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6be404d030 con 0x7f6bec15e8b0 2024-04-16T16:17:35.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.646+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6bec0d0d00 con 0x7f6bec15e8b0 2024-04-16T16:17:35.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.647+0000 7f6be9600640 1 -- 172.21.15.22:0/4183922192 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f6be407c6e0 con 0x7f6bec15e8b0 2024-04-16T16:17:35.645 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:17:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6bcc06c8f0 msgr2=0x7f6bcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6be00015e0 tx=0x7f6be0009040 comp rx=0 tx=0).stop 2024-04-16T16:17:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec15e8b0 msgr2=0x7f6bec156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:35.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec15e8b0 0x7f6bec156d70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6be4036040 tx=0x7f6be4004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 shutdown_connections 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bec15e8b0 0x7f6bec156d70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bec0d05f0 0x7f6bec0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 --2- 172.21.15.22:0/4183922192 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bec0b56b0 0x7f6bec154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 >> 172.21.15.22:0/4183922192 conn(0x7f6bec075070 msgr2=0x7f6bec0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.649+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 shutdown_connections 2024-04-16T16:17:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:35.650+0000 7f6bf2800640 1 -- 172.21.15.22:0/4183922192 wait complete. 2024-04-16T16:17:35.666 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-16T16:17:35.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:35.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-16T16:17:35.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:17:35.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:35.756 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-16T16:17:35.800 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:35.800 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:35.863 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:35.863 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:35.918 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:17:35.918 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:17:35.973 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:36.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.206+0000 7f1f7d200640 1 Processor -- start 2024-04-16T16:17:36.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.206+0000 7f1f7d200640 1 -- start start 2024-04-16T16:17:36.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.207+0000 7f1f7d200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1f781623b0 0x7f1f780d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.207+0000 7f1f7d200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f780cfee0 0x7f1f780b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.207+0000 7f1f7d200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f780d28b0 con 0x7f1f780ba4b0 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.207+0000 7f1f7d200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1f780d3660 con 0x7f1f780cfee0 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.207+0000 7f1f7d200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1f780d3940 con 0x7f1f781623b0 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f76800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f780cfee0 0x7f1f780b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f75400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1f780ba4b0 0x7f1f780cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35940/0 (socket says 172.21.15.22:35940) 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f75400640 1 -- 172.21.15.22:0/4066309037 learned_addr learned my addr 172.21.15.22:0/4066309037 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f75e00640 1 --2- 172.21.15.22:0/4066309037 >> v2:172.21.15.43:3300/0 conn(0x7f1f781623b0 0x7f1f780d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f76800640 1 -- 172.21.15.22:0/4066309037 >> v2:172.21.15.43:3300/0 conn(0x7f1f781623b0 msgr2=0x7f1f780d2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f76800640 1 --2- 172.21.15.22:0/4066309037 >> v2:172.21.15.43:3300/0 conn(0x7f1f781623b0 0x7f1f780d2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f76800640 1 -- 172.21.15.22:0/4066309037 >> v1:172.21.15.22:6789/0 conn(0x7f1f780ba4b0 legacy=0x7f1f780cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f76800640 1 -- 172.21.15.22:0/4066309037 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f780d3c20 con 0x7f1f780cfee0 2024-04-16T16:17:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.208+0000 7f1f75e00640 1 --2- 172.21.15.22:0/4066309037 >> v2:172.21.15.43:3300/0 conn(0x7f1f781623b0 0x7f1f780d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.209+0000 7f1f76800640 1 --2- 172.21.15.22:0/4066309037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f780cfee0 0x7f1f780b7c30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1f780cf300 tx=0x7f1f7002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4831f4726e889140 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f74a00640 1 -- 172.21.15.22:0/4066309037 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70039070 con 0x7f1f780cfee0 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f74a00640 1 -- 172.21.15.22:0/4066309037 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7002cd00 con 0x7f1f780cfee0 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f74a00640 1 -- 172.21.15.22:0/4066309037 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70034660 con 0x7f1f780cfee0 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 -- 172.21.15.22:0/4066309037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f780cfee0 msgr2=0x7f1f780b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 --2- 172.21.15.22:0/4066309037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f780cfee0 0x7f1f780b7c30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1f780cf300 tx=0x7f1f7002bf50 comp rx=0 tx=0).stop 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 -- 172.21.15.22:0/4066309037 shutdown_connections 2024-04-16T16:17:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 --2- 172.21.15.22:0/4066309037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f780cfee0 0x7f1f780b7c30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 --2- 172.21.15.22:0/4066309037 >> v2:172.21.15.43:3300/0 conn(0x7f1f781623b0 0x7f1f780d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 -- 172.21.15.22:0/4066309037 >> 172.21.15.22:0/4066309037 conn(0x7f1f78072460 msgr2=0x7f1f78072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:36.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 -- 172.21.15.22:0/4066309037 shutdown_connections 2024-04-16T16:17:36.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.210+0000 7f1f7d200640 1 -- 172.21.15.22:0/4066309037 wait complete. 2024-04-16T16:17:36.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.212+0000 7f1f7d200640 1 Processor -- start 2024-04-16T16:17:36.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.212+0000 7f1f7d200640 1 -- start start 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.213+0000 7f1f7d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f780ba4b0 0x7f1f781509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.213+0000 7f1f7d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f780cfee0 0x7f1f780b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.213+0000 7f1f7d200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f781623b0 0x7f1f781f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.213+0000 7f1f7d200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1f780d4700 con 0x7f1f781623b0 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.213+0000 7f1f7d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f780d41e0 con 0x7f1f780cfee0 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.213+0000 7f1f7d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1f781f8080 con 0x7f1f780ba4b0 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f781623b0 0x7f1f781f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f781623b0 0x7f1f781f5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52658/0 (socket says 172.21.15.22:52658) 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 -- 172.21.15.22:0/2055732704 learned_addr learned my addr 172.21.15.22:0/2055732704 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f75400640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f780cfee0 0x7f1f780b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f75e00640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f780ba4b0 0x7f1f781509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 -- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f780ba4b0 msgr2=0x7f1f781509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f780ba4b0 0x7f1f781509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 -- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f780cfee0 msgr2=0x7f1f780b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f780cfee0 0x7f1f780b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 -- 172.21.15.22:0/2055732704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f781f8320 con 0x7f1f781623b0 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.214+0000 7f1f76800640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f781623b0 0x7f1f781f5c50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009e80 tx=0x7f1f70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.215+0000 7f1f6e000640 1 -- 172.21.15.22:0/2055732704 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70039050 con 0x7f1f781623b0 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.215+0000 7f1f6e000640 1 -- 172.21.15.22:0/2055732704 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f70045070 con 0x7f1f781623b0 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.215+0000 7f1f6e000640 1 -- 172.21.15.22:0/2055732704 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7003e830 con 0x7f1f781623b0 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.215+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f781f8600 con 0x7f1f781623b0 2024-04-16T16:17:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.215+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f781f8bc0 con 0x7f1f781623b0 2024-04-16T16:17:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.216+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7804fd90 con 0x7f1f781623b0 2024-04-16T16:17:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.217+0000 7f1f6e000640 1 -- 172.21.15.22:0/2055732704 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f7003e9d0 con 0x7f1f781623b0 2024-04-16T16:17:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.218+0000 7f1f6e000640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1f5806c920 0x7f1f5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.218+0000 7f1f6e000640 1 -- 172.21.15.22:0/2055732704 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1f700ae970 con 0x7f1f781623b0 2024-04-16T16:17:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.218+0000 7f1f75e00640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1f5806c920 0x7f1f5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.219+0000 7f1f75e00640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1f5806c920 0x7f1f5806ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800b840 tx=0x7f1f68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:36.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.222+0000 7f1f6e000640 1 -- 172.21.15.22:0/2055732704 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1f7007cdb0 con 0x7f1f781623b0 2024-04-16T16:17:36.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:17:36.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:17:36.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.429+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f78161b60 con 0x7f1f781623b0 2024-04-16T16:17:36.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.431+0000 7f1f6e000640 1 -- 172.21.15.22:0/2055732704 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16733 (secure 0 0 0) 0x7f1f7007c6b0 con 0x7f1f781623b0 2024-04-16T16:17:36.430 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:36.430 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:29.459450+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:36.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1f5806c920 msgr2=0x7f1f5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1f5806c920 0x7f1f5806ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800b840 tx=0x7f1f68008040 comp rx=0 tx=0).stop 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f781623b0 msgr2=0x7f1f781f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f781623b0 0x7f1f781f5c50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009e80 tx=0x7f1f70004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 shutdown_connections 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1f5806c920 0x7f1f5806ede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f781623b0 0x7f1f781f5c50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f780cfee0 0x7f1f780b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 --2- 172.21.15.22:0/2055732704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f780ba4b0 0x7f1f781509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.434+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 >> 172.21.15.22:0/2055732704 conn(0x7f1f78072460 msgr2=0x7f1f780b8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.435+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 shutdown_connections 2024-04-16T16:17:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.435+0000 7f1f7d200640 1 -- 172.21.15.22:0/2055732704 wait complete. 2024-04-16T16:17:36.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:36.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:36.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.676+0000 7fca35400640 1 Processor -- start 2024-04-16T16:17:36.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.677+0000 7fca35400640 1 -- start start 2024-04-16T16:17:36.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.678+0000 7fca35400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca300cc530 0x7fca300d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.678+0000 7fca35400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3006ed90 con 0x7fca300cff80 2024-04-16T16:17:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.678+0000 7fca35400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3006d690 con 0x7fca3015f0a0 2024-04-16T16:17:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.678+0000 7fca35400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fca300d11a0 con 0x7fca300cc530 2024-04-16T16:17:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.679+0000 7fca2e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fca300cc530 0x7fca300d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.679+0000 7fca2f200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fca300cff80 0x7fca301626e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35948/0 (socket says 172.21.15.22:35948) 2024-04-16T16:17:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.679+0000 7fca2f200640 1 -- 172.21.15.22:0/2729478094 learned_addr learned my addr 172.21.15.22:0/2729478094 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.679+0000 7fca2e800640 1 -- 172.21.15.22:0/2729478094 >> v1:172.21.15.43:6789/0 conn(0x7fca3015f0a0 legacy=0x7fca300cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.679+0000 7fca2e800640 1 -- 172.21.15.22:0/2729478094 >> v1:172.21.15.22:6789/0 conn(0x7fca300cff80 legacy=0x7fca301626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.679+0000 7fca2e800640 1 -- 172.21.15.22:0/2729478094 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3006d970 con 0x7fca300cc530 2024-04-16T16:17:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.679+0000 7fca2d400640 1 -- 172.21.15.22:0/2729478094 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671687499 0 0) 0x7fca3006ed90 con 0x7fca300cff80 2024-04-16T16:17:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.681+0000 7fca2e800640 1 --2- 172.21.15.22:0/2729478094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cc530 0x7fca300d0630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca200097a0 tx=0x7fca2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be15f7482fee57c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.681+0000 7fca2d400640 1 -- 172.21.15.22:0/2729478094 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20035020 con 0x7fca300cc530 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.681+0000 7fca2d400640 1 -- 172.21.15.22:0/2729478094 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca20031830 con 0x7fca300cc530 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.681+0000 7fca2d400640 1 -- 172.21.15.22:0/2729478094 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20031c00 con 0x7fca300cc530 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.681+0000 7fca35400640 1 -- 172.21.15.22:0/2729478094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cc530 msgr2=0x7fca300d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.681+0000 7fca35400640 1 --2- 172.21.15.22:0/2729478094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cc530 0x7fca300d0630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca200097a0 tx=0x7fca2002b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.682+0000 7fca35400640 1 -- 172.21.15.22:0/2729478094 shutdown_connections 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.682+0000 7fca35400640 1 --2- 172.21.15.22:0/2729478094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cc530 0x7fca300d0630 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.682+0000 7fca35400640 1 -- 172.21.15.22:0/2729478094 >> 172.21.15.22:0/2729478094 conn(0x7fca300b37e0 msgr2=0x7fca300b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.682+0000 7fca35400640 1 -- 172.21.15.22:0/2729478094 shutdown_connections 2024-04-16T16:17:36.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.682+0000 7fca35400640 1 -- 172.21.15.22:0/2729478094 wait complete. 2024-04-16T16:17:36.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.683+0000 7fca35400640 1 Processor -- start 2024-04-16T16:17:36.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.684+0000 7fca35400640 1 -- start start 2024-04-16T16:17:36.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.684+0000 7fca35400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300cc530 0x7fca301f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca35400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cff80 0x7fca30154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca35400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca301521e0 0x7fca300c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca35400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca3006dfc0 con 0x7fca300cff80 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca35400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca300cc910 con 0x7fca300cc530 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca35400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fca300d0b70 con 0x7fca301521e0 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cff80 0x7fca30154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cff80 0x7fca30154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52674/0 (socket says 172.21.15.22:52674) 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 -- 172.21.15.22:0/1558868216 learned_addr learned my addr 172.21.15.22:0/1558868216 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2e800640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300cc530 0x7fca301f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2f200640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca301521e0 0x7fca300c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 -- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca301521e0 msgr2=0x7fca300c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca301521e0 0x7fca300c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 -- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300cc530 msgr2=0x7fca301f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300cc530 0x7fca301f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.685+0000 7fca2de00640 1 -- 172.21.15.22:0/1558868216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca30154a90 con 0x7fca300cff80 2024-04-16T16:17:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.686+0000 7fca2de00640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cff80 0x7fca30154d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c430 tx=0x7fca1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:36.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.686+0000 7fca26a00640 1 -- 172.21.15.22:0/1558868216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c011790 con 0x7fca300cff80 2024-04-16T16:17:36.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.686+0000 7fca26a00640 1 -- 172.21.15.22:0/1558868216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c017070 con 0x7fca300cff80 2024-04-16T16:17:36.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.686+0000 7fca26a00640 1 -- 172.21.15.22:0/1558868216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c011bb0 con 0x7fca300cff80 2024-04-16T16:17:36.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.686+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca301552d0 con 0x7fca300cff80 2024-04-16T16:17:36.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.686+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca301f4e80 con 0x7fca300cff80 2024-04-16T16:17:36.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.687+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3004fd90 con 0x7fca300cff80 2024-04-16T16:17:36.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.688+0000 7fca26a00640 1 -- 172.21.15.22:0/1558868216 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca1c01c460 con 0x7fca300cff80 2024-04-16T16:17:36.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.689+0000 7fca26a00640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fca1006c8f0 0x7fca1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:36.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.689+0000 7fca26a00640 1 -- 172.21.15.22:0/1558868216 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fca1c08ba60 con 0x7fca300cff80 2024-04-16T16:17:36.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.689+0000 7fca2e800640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fca1006c8f0 0x7fca1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:36.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.690+0000 7fca2e800640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fca1006c8f0 0x7fca1006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca20036000 tx=0x7fca2003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:36.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.694+0000 7fca26a00640 1 -- 172.21.15.22:0/1558868216 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca30154a90 con 0x7fca300cff80 2024-04-16T16:17:36.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.895+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fca30072ca0 con 0x7fca300cff80 2024-04-16T16:17:36.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.896+0000 7fca26a00640 1 -- 172.21.15.22:0/1558868216 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fca1c059ea0 con 0x7fca300cff80 2024-04-16T16:17:36.895 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fca1006c8f0 msgr2=0x7fca1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fca1006c8f0 0x7fca1006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca20036000 tx=0x7fca2003c040 comp rx=0 tx=0).stop 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cff80 msgr2=0x7fca30154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cff80 0x7fca30154d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c430 tx=0x7fca1c00c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 shutdown_connections 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fca1006c8f0 0x7fca1006edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca301521e0 0x7fca300c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca300cff80 0x7fca30154d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 --2- 172.21.15.22:0/1558868216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300cc530 0x7fca301f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 >> 172.21.15.22:0/1558868216 conn(0x7fca300b37e0 msgr2=0x7fca300715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 shutdown_connections 2024-04-16T16:17:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:36.899+0000 7fca35400640 1 -- 172.21.15.22:0/1558868216 wait complete. 2024-04-16T16:17:36.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:37.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.148+0000 7fb8b6600640 1 Processor -- start 2024-04-16T16:17:37.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.148+0000 7fb8b6600640 1 -- start start 2024-04-16T16:17:37.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8b6600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8b00d0110 0x7fb8b00d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8b6600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb8b00b3780 0x7fb8b00b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8b6600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b006ce50 con 0x7fb8b015e9c0 2024-04-16T16:17:37.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8b6600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b00d0ab0 con 0x7fb8b00d0110 2024-04-16T16:17:37.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8b6600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b006d0f0 con 0x7fb8b00b3780 2024-04-16T16:17:37.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8b5200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb8b015e9c0 0x7fb8b0162fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35950/0 (socket says 172.21.15.22:35950) 2024-04-16T16:17:37.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8b5200640 1 -- 172.21.15.22:0/1309322804 learned_addr learned my addr 172.21.15.22:0/1309322804 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.150+0000 7fb8afe00640 1 --2- 172.21.15.22:0/1309322804 >> v2:172.21.15.22:3300/0 conn(0x7fb8b00d0110 0x7fb8b00d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8af400640 1 -- 172.21.15.22:0/1309322804 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399671446 0 0) 0x7fb8b006ce50 con 0x7fb8b015e9c0 2024-04-16T16:17:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8b5c00640 1 --2- 172.21.15.22:0/1309322804 >> v2:172.21.15.43:3300/0 conn(0x7fb8b00b3780 0x7fb8b00b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8af400640 1 -- 172.21.15.22:0/1309322804 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb894003520 con 0x7fb8b015e9c0 2024-04-16T16:17:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8afe00640 1 -- 172.21.15.22:0/1309322804 >> v2:172.21.15.43:3300/0 conn(0x7fb8b00b3780 msgr2=0x7fb8b00b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8afe00640 1 --2- 172.21.15.22:0/1309322804 >> v2:172.21.15.43:3300/0 conn(0x7fb8b00b3780 0x7fb8b00b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8afe00640 1 -- 172.21.15.22:0/1309322804 >> v1:172.21.15.22:6789/0 conn(0x7fb8b015e9c0 legacy=0x7fb8b0162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8afe00640 1 -- 172.21.15.22:0/1309322804 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b006d3d0 con 0x7fb8b00d0110 2024-04-16T16:17:37.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.151+0000 7fb8b5c00640 1 --2- 172.21.15.22:0/1309322804 >> v2:172.21.15.43:3300/0 conn(0x7fb8b00b3780 0x7fb8b00b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:37.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.152+0000 7fb8afe00640 1 --2- 172.21.15.22:0/1309322804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b00d0110 0x7fb8b00d0570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0063210 tx=0x7fb89802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebb2242a4bf9a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:37.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.152+0000 7fb8af400640 1 -- 172.21.15.22:0/1309322804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898035020 con 0x7fb8b00d0110 2024-04-16T16:17:37.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8af400640 1 -- 172.21.15.22:0/1309322804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb898031830 con 0x7fb8b00d0110 2024-04-16T16:17:37.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8af400640 1 -- 172.21.15.22:0/1309322804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898031c00 con 0x7fb8b00d0110 2024-04-16T16:17:37.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 -- 172.21.15.22:0/1309322804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b00d0110 msgr2=0x7fb8b00d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1309322804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b00d0110 0x7fb8b00d0570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0063210 tx=0x7fb89802b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 -- 172.21.15.22:0/1309322804 shutdown_connections 2024-04-16T16:17:37.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1309322804 >> v2:172.21.15.43:3300/0 conn(0x7fb8b00b3780 0x7fb8b00b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1309322804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b00d0110 0x7fb8b00d0570 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 -- 172.21.15.22:0/1309322804 >> 172.21.15.22:0/1309322804 conn(0x7fb8b0075070 msgr2=0x7fb8b0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:37.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 -- 172.21.15.22:0/1309322804 shutdown_connections 2024-04-16T16:17:37.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.153+0000 7fb8b6600640 1 -- 172.21.15.22:0/1309322804 wait complete. 2024-04-16T16:17:37.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.155+0000 7fb8b6600640 1 Processor -- start 2024-04-16T16:17:37.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.155+0000 7fb8b6600640 1 -- start start 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.156+0000 7fb8b6600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8b00b3780 0x7fb8b0145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.156+0000 7fb8b6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b00d0110 0x7fb8b0152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.156+0000 7fb8b6600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b015e9c0 0x7fb8b0071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.156+0000 7fb8b6600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b006dc70 con 0x7fb8b015e9c0 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.156+0000 7fb8b6600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b006d990 con 0x7fb8b00d0110 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.156+0000 7fb8b6600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b015eda0 con 0x7fb8b00b3780 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.156+0000 7fb8b5c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b015e9c0 0x7fb8b0071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b015e9c0 0x7fb8b0071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52692/0 (socket says 172.21.15.22:52692) 2024-04-16T16:17:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5c00640 1 -- 172.21.15.22:0/1374587987 learned_addr learned my addr 172.21.15.22:0/1374587987 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8afe00640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b00d0110 0x7fb8b0152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5200640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8b00b3780 0x7fb8b0145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5c00640 1 -- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8b00b3780 msgr2=0x7fb8b0145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5c00640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8b00b3780 0x7fb8b0145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5c00640 1 -- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b00d0110 msgr2=0x7fb8b0152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5c00640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b00d0110 0x7fb8b0152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5c00640 1 -- 172.21.15.22:0/1374587987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b0154d70 con 0x7fb8b015e9c0 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8b5200640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8b00b3780 0x7fb8b0145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:37.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.157+0000 7fb8afe00640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b00d0110 0x7fb8b0152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:37.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.158+0000 7fb8b5c00640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b015e9c0 0x7fb8b0071ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e7e0 tx=0x7fb8a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:37.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.158+0000 7fb8acc00640 1 -- 172.21.15.22:0/1374587987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800f040 con 0x7fb8b015e9c0 2024-04-16T16:17:37.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.158+0000 7fb8acc00640 1 -- 172.21.15.22:0/1374587987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8004030 con 0x7fb8b015e9c0 2024-04-16T16:17:37.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.158+0000 7fb8acc00640 1 -- 172.21.15.22:0/1374587987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80043e0 con 0x7fb8b015e9c0 2024-04-16T16:17:37.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.158+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b0155050 con 0x7fb8b015e9c0 2024-04-16T16:17:37.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.158+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b0155610 con 0x7fb8b015e9c0 2024-04-16T16:17:37.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.159+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b0075f30 con 0x7fb8b015e9c0 2024-04-16T16:17:37.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.160+0000 7fb8acc00640 1 -- 172.21.15.22:0/1374587987 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8a800c6d0 con 0x7fb8b015e9c0 2024-04-16T16:17:37.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.161+0000 7fb8acc00640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb88c06c8f0 0x7fb88c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.161+0000 7fb8acc00640 1 -- 172.21.15.22:0/1374587987 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb8a808b980 con 0x7fb8b015e9c0 2024-04-16T16:17:37.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.161+0000 7fb8b5200640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb88c06c8f0 0x7fb88c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.162+0000 7fb8b5200640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb88c06c8f0 0x7fb88c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0152b00 tx=0x7fb8a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:37.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.165+0000 7fb8acc00640 1 -- 172.21.15.22:0/1374587987 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8a8017020 con 0x7fb8b015e9c0 2024-04-16T16:17:37.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.372+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb8b00b0060 con 0x7fb8b015e9c0 2024-04-16T16:17:37.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.373+0000 7fb8acc00640 1 -- 172.21.15.22:0/1374587987 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb8a808b020 con 0x7fb8b015e9c0 2024-04-16T16:17:37.372 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:37.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb88c06c8f0 msgr2=0x7fb88c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb88c06c8f0 0x7fb88c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0152b00 tx=0x7fb8a0009040 comp rx=0 tx=0).stop 2024-04-16T16:17:37.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b015e9c0 msgr2=0x7fb8b0071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b015e9c0 0x7fb8b0071ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e7e0 tx=0x7fb8a800eca0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 shutdown_connections 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb88c06c8f0 0x7fb88c06edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8b015e9c0 0x7fb8b0071ac0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b00d0110 0x7fb8b0152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 --2- 172.21.15.22:0/1374587987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8b00b3780 0x7fb8b0145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 >> 172.21.15.22:0/1374587987 conn(0x7fb8b0075070 msgr2=0x7fb8b01580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 shutdown_connections 2024-04-16T16:17:37.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.376+0000 7fb8b6600640 1 -- 172.21.15.22:0/1374587987 wait complete. 2024-04-16T16:17:37.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:37.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.625+0000 7fd862600640 1 Processor -- start 2024-04-16T16:17:37.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.626+0000 7fd862600640 1 -- start start 2024-04-16T16:17:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.627+0000 7fd862600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 0x7fd85c169560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.627+0000 7fd862600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd85c0d3ef0 con 0x7fd85c15eb60 2024-04-16T16:17:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.627+0000 7fd862600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd85c0d41d0 con 0x7fd85c0cfcc0 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.627+0000 7fd862600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0d44b0 con 0x7fd85c0d1eb0 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd861200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd85c15eb60 0x7fd85c0d35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35954/0 (socket says 172.21.15.22:35954) 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd861200640 1 -- 172.21.15.22:0/3053252424 learned_addr learned my addr 172.21.15.22:0/3053252424 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd861c00640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 0x7fd85c169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341631677 0 0) 0x7fd85c0d3ef0 con 0x7fd85c15eb60 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd840003520 con 0x7fd85c15eb60 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1090498906 0 0) 0x7fd840003520 con 0x7fd85c15eb60 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 msgr2=0x7fd85c169560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd85b400640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 0x7fd85c169560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.628+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 >> v1:172.21.15.43:6789/0 conn(0x7fd85c0cfcc0 legacy=0x7fd85c0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c0b7db0 con 0x7fd85c15eb60 2024-04-16T16:17:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fd844001670 con 0x7fd85c15eb60 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 >> v1:172.21.15.22:6789/0 conn(0x7fd85c15eb60 legacy=0x7fd85c0d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8400039e0 0x7fd840003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd840004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 0x7fd840005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0d44b0 con 0x7fd840004800 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd84000bb20 con 0x7fd8400039e0 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd84000bd20 con 0x7fd85c0d1eb0 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85be00640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd840004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd861200640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8400039e0 0x7fd840003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd85be00640 1 -- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 msgr2=0x7fd840005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.629+0000 7fd861c00640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 0x7fd840005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.630+0000 7fd85be00640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c0d1eb0 0x7fd840005200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.630+0000 7fd85be00640 1 -- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8400039e0 msgr2=0x7fd840003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.630+0000 7fd85be00640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8400039e0 0x7fd840003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.630+0000 7fd85be00640 1 -- 172.21.15.22:0/3053252424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd840003520 con 0x7fd840004800 2024-04-16T16:17:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.631+0000 7fd85be00640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd840004c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd84c001750 tx=0x7fd840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c80db3ecd72131b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.631+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c001370 con 0x7fd840004800 2024-04-16T16:17:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.631+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84c0052d0 con 0x7fd840004800 2024-04-16T16:17:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.631+0000 7fd85b400640 1 -- 172.21.15.22:0/3053252424 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c003830 con 0x7fd840004800 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.631+0000 7fd862600640 1 -- 172.21.15.22:0/3053252424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 msgr2=0x7fd840004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.632+0000 7fd862600640 1 --2- 172.21.15.22:0/3053252424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd840004c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd84c001750 tx=0x7fd840005830 comp rx=0 tx=0).stop 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.632+0000 7fd861c00640 1 -- 172.21.15.22:0/3053252424 reap_dead start 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.632+0000 7fd862600640 1 -- 172.21.15.22:0/3053252424 shutdown_connections 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.632+0000 7fd862600640 1 -- 172.21.15.22:0/3053252424 >> 172.21.15.22:0/3053252424 conn(0x7fd85c072460 msgr2=0x7fd85c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.632+0000 7fd862600640 1 -- 172.21.15.22:0/3053252424 shutdown_connections 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.632+0000 7fd862600640 1 -- 172.21.15.22:0/3053252424 wait complete. 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.634+0000 7fd862600640 1 Processor -- start 2024-04-16T16:17:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.634+0000 7fd862600640 1 -- start start 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd862600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd85c1e9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd862600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c15ac00 0x7fd85c0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd862600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd85c0ca8d0 0x7fd85c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd862600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0b9460 con 0x7fd840004800 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd862600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0b92e0 con 0x7fd85c0ca8d0 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd862600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0b95e0 con 0x7fd85c15ac00 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd861200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd85c1e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd861200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd85c1e9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52700/0 (socket says 172.21.15.22:52700) 2024-04-16T16:17:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd861200640 1 -- 172.21.15.22:0/2128058996 learned_addr learned my addr 172.21.15.22:0/2128058996 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd85be00640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c15ac00 0x7fd85c0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd861200640 1 -- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c15ac00 msgr2=0x7fd85c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.635+0000 7fd861200640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c15ac00 0x7fd85c0ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd861200640 1 -- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd85c0ca8d0 msgr2=0x7fd85c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd861c00640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd85c0ca8d0 0x7fd85c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd861200640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd85c0ca8d0 0x7fd85c0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd861200640 1 -- 172.21.15.22:0/2128058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c1e8790 con 0x7fd840004800 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd861200640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd85c1e9830 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e870 tx=0x7fd84400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd858c00640 1 -- 172.21.15.22:0/2128058996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84400c850 con 0x7fd840004800 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd858c00640 1 -- 172.21.15.22:0/2128058996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd844018070 con 0x7fd840004800 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd858c00640 1 -- 172.21.15.22:0/2128058996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84400cc50 con 0x7fd840004800 2024-04-16T16:17:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c1e8a70 con 0x7fd840004800 2024-04-16T16:17:37.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.636+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c1e9030 con 0x7fd840004800 2024-04-16T16:17:37.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.637+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85c075f30 con 0x7fd840004800 2024-04-16T16:17:37.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.638+0000 7fd858c00640 1 -- 172.21.15.22:0/2128058996 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd84401d460 con 0x7fd840004800 2024-04-16T16:17:37.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.639+0000 7fd858c00640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:37.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.639+0000 7fd858c00640 1 -- 172.21.15.22:0/2128058996 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd84408bbc0 con 0x7fd840004800 2024-04-16T16:17:37.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.640+0000 7fd85be00640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:37.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.640+0000 7fd85be00640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd83806c8f0 0x7fd83806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd84c033000 tx=0x7fd84c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.644+0000 7fd858c00640 1 -- 172.21.15.22:0/2128058996 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd844059f60 con 0x7fd840004800 2024-04-16T16:17:37.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.849+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd85c068f70 con 0x7fd840004800 2024-04-16T16:17:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.851+0000 7fd858c00640 1 -- 172.21.15.22:0/2128058996 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fd844059860 con 0x7fd840004800 2024-04-16T16:17:37.850 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.853+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd83806c8f0 msgr2=0x7fd83806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.853+0000 7fd862600640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd83806c8f0 0x7fd83806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd84c033000 tx=0x7fd84c009030 comp rx=0 tx=0).stop 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.853+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 msgr2=0x7fd85c1e9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.853+0000 7fd862600640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd85c1e9830 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e870 tx=0x7fd84400ed30 comp rx=0 tx=0).stop 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 shutdown_connections 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd85c0ca8d0 0x7fd85c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd85c15ac00 0x7fd85c0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 --2- 172.21.15.22:0/2128058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd840004800 0x7fd85c1e9830 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 >> 172.21.15.22:0/2128058996 conn(0x7fd85c072460 msgr2=0x7fd85c0d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 shutdown_connections 2024-04-16T16:17:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:37.854+0000 7fd862600640 1 -- 172.21.15.22:0/2128058996 wait complete. 2024-04-16T16:17:37.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:17:38.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.103+0000 7fcdce800640 1 Processor -- start 2024-04-16T16:17:38.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.103+0000 7fcdce800640 1 -- start start 2024-04-16T16:17:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.104+0000 7fcdce800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcdc815b5f0 0x7fcdc806e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdce800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdce800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc80b36d0 con 0x7fcdc806d9e0 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdce800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fcdc80b42e0 con 0x7fcdc815b5f0 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdce800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc80b39b0 con 0x7fcdc8072640 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdcd400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcdc815b5f0 0x7fcdc806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdcd400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcdc815b5f0 0x7fcdc806e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52710/0 (socket says 172.21.15.22:52710) 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdcd400640 1 -- 172.21.15.22:0/3944687320 learned_addr learned my addr 172.21.15.22:0/3944687320 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.105+0000 7fcdcde00640 1 --2- 172.21.15.22:0/3944687320 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.106+0000 7fcdcd400640 1 -- 172.21.15.22:0/3944687320 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 msgr2=0x7fcdc815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.106+0000 7fcdcd400640 1 --2- 172.21.15.22:0/3944687320 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.106+0000 7fcdcd400640 1 -- 172.21.15.22:0/3944687320 >> v1:172.21.15.43:6789/0 conn(0x7fcdc806d9e0 legacy=0x7fcdc8071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.106+0000 7fcdcd400640 1 -- 172.21.15.22:0/3944687320 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc80b3c90 con 0x7fcdc815b5f0 2024-04-16T16:17:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.107+0000 7fcdcd400640 1 --2- 172.21.15.22:0/3944687320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc815b5f0 0x7fcdc806e860 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00bb10 tx=0x7fcdbc02e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974a410f3ac423b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.107+0000 7fcdc7e00640 1 -- 172.21.15.22:0/3944687320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc03b070 con 0x7fcdc815b5f0 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.107+0000 7fcdc7e00640 1 -- 172.21.15.22:0/3944687320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc02ede0 con 0x7fcdc815b5f0 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.107+0000 7fcdc7e00640 1 -- 172.21.15.22:0/3944687320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc036660 con 0x7fcdc815b5f0 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 -- 172.21.15.22:0/3944687320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc815b5f0 msgr2=0x7fcdc806e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 --2- 172.21.15.22:0/3944687320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc815b5f0 0x7fcdc806e860 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00bb10 tx=0x7fcdbc02e030 comp rx=0 tx=0).stop 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 -- 172.21.15.22:0/3944687320 shutdown_connections 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 --2- 172.21.15.22:0/3944687320 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 --2- 172.21.15.22:0/3944687320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc815b5f0 0x7fcdc806e860 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 -- 172.21.15.22:0/3944687320 >> 172.21.15.22:0/3944687320 conn(0x7fcdc8075070 msgr2=0x7fcdc8062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 -- 172.21.15.22:0/3944687320 shutdown_connections 2024-04-16T16:17:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.108+0000 7fcdce800640 1 -- 172.21.15.22:0/3944687320 wait complete. 2024-04-16T16:17:38.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.110+0000 7fcdce800640 1 Processor -- start 2024-04-16T16:17:38.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.111+0000 7fcdce800640 1 -- start start 2024-04-16T16:17:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.112+0000 7fcdce800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc806d9e0 0x7fcdc8147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.112+0000 7fcdce800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.112+0000 7fcdce800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc815b5f0 0x7fcdc814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.112+0000 7fcdce800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc80b4770 con 0x7fcdc806d9e0 2024-04-16T16:17:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.112+0000 7fcdce800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc80b33a0 con 0x7fcdc815b5f0 2024-04-16T16:17:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.112+0000 7fcdce800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc8148e30 con 0x7fcdc8072640 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc806d9e0 0x7fcdc8147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc806d9e0 0x7fcdc8147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52726/0 (socket says 172.21.15.22:52726) 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 -- 172.21.15.22:0/735340420 learned_addr learned my addr 172.21.15.22:0/735340420 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcde00640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc815b5f0 0x7fcdc814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcca00640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 -- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 msgr2=0x7fcdc814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc814a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 -- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc815b5f0 msgr2=0x7fcdc814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc815b5f0 0x7fcdc814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 -- 172.21.15.22:0/735340420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc814b3e0 con 0x7fcdc806d9e0 2024-04-16T16:17:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.113+0000 7fcdcd400640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc806d9e0 0x7fcdc8147ee0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00b2c0 tx=0x7fcdbc030070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:38.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.114+0000 7fcdc5600640 1 -- 172.21.15.22:0/735340420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc046070 con 0x7fcdc806d9e0 2024-04-16T16:17:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.114+0000 7fcdc5600640 1 -- 172.21.15.22:0/735340420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc03f770 con 0x7fcdc806d9e0 2024-04-16T16:17:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.114+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc814b6c0 con 0x7fcdc806d9e0 2024-04-16T16:17:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.114+0000 7fcdc5600640 1 -- 172.21.15.22:0/735340420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc03b070 con 0x7fcdc806d9e0 2024-04-16T16:17:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.114+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc8148ac0 con 0x7fcdc806d9e0 2024-04-16T16:17:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.115+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc8062970 con 0x7fcdc806d9e0 2024-04-16T16:17:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.116+0000 7fcdc5600640 1 -- 172.21.15.22:0/735340420 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcdbc049070 con 0x7fcdc806d9e0 2024-04-16T16:17:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.117+0000 7fcdc5600640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcda806c8f0 0x7fcda806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.117+0000 7fcdc5600640 1 -- 172.21.15.22:0/735340420 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fcdbc0ada40 con 0x7fcdc806d9e0 2024-04-16T16:17:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.118+0000 7fcdcca00640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcda806c8f0 0x7fcda806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.118+0000 7fcdcca00640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcda806c8f0 0x7fcda806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cc9a0 tx=0x7fcdb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:38.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.122+0000 7fcdc5600640 1 -- 172.21.15.22:0/735340420 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcdc8062970 con 0x7fcdc806d9e0 2024-04-16T16:17:38.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.340+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcdc8155b80 con 0x7fcdc806d9e0 2024-04-16T16:17:38.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.341+0000 7fcdc5600640 1 -- 172.21.15.22:0/735340420 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fcdbc07bdd0 con 0x7fcdc806d9e0 2024-04-16T16:17:38.339 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:17:38.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcda806c8f0 msgr2=0x7fcda806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcda806c8f0 0x7fcda806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cc9a0 tx=0x7fcdb4009040 comp rx=0 tx=0).stop 2024-04-16T16:17:38.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc806d9e0 msgr2=0x7fcdc8147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc806d9e0 0x7fcdc8147ee0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00b2c0 tx=0x7fcdbc030070 comp rx=0 tx=0).stop 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 shutdown_connections 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcda806c8f0 0x7fcda806edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc815b5f0 0x7fcdc814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdc8072640 0x7fcdc814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 --2- 172.21.15.22:0/735340420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc806d9e0 0x7fcdc8147ee0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.343+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 >> 172.21.15.22:0/735340420 conn(0x7fcdc8075070 msgr2=0x7fcdc815e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.344+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 shutdown_connections 2024-04-16T16:17:38.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.344+0000 7fcdce800640 1 -- 172.21.15.22:0/735340420 wait complete. 2024-04-16T16:17:38.362 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-16T16:17:38.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:38.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-16T16:17:38.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:17:38.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:17:38.479 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-16T16:17:38.524 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-16T16:17:38.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:17:38.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.751+0000 7fa273000640 1 Processor -- start 2024-04-16T16:17:38.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.752+0000 7fa273000640 1 -- start start 2024-04-16T16:17:38.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.753+0000 7fa273000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa26c0afd90 0x7fa26c072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.753+0000 7fa273000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa26c073050 0x7fa26c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.753+0000 7fa273000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26c1606d0 con 0x7fa26c06dc80 2024-04-16T16:17:38.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.753+0000 7fa273000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c160480 con 0x7fa26c0afd90 2024-04-16T16:17:38.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.753+0000 7fa273000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c1609b0 con 0x7fa26c073050 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa26c0afd90 0x7fa26c072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa26c06dc80 0x7fa26c0d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35960/0 (socket says 172.21.15.22:35960) 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26b400640 1 -- 172.21.15.22:0/1576383956 learned_addr learned my addr 172.21.15.22:0/1576383956 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26be00640 1 --2- 172.21.15.22:0/1576383956 >> v2:172.21.15.22:3300/0 conn(0x7fa26c0afd90 0x7fa26c072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52734/0 (socket says 172.21.15.22:52734) 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa271000640 1 --2- 172.21.15.22:0/1576383956 >> v2:172.21.15.43:3300/0 conn(0x7fa26c073050 0x7fa26c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26be00640 1 -- 172.21.15.22:0/1576383956 >> v2:172.21.15.43:3300/0 conn(0x7fa26c073050 msgr2=0x7fa26c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26be00640 1 --2- 172.21.15.22:0/1576383956 >> v2:172.21.15.43:3300/0 conn(0x7fa26c073050 0x7fa26c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26be00640 1 -- 172.21.15.22:0/1576383956 >> v1:172.21.15.22:6789/0 conn(0x7fa26c06dc80 legacy=0x7fa26c0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26be00640 1 -- 172.21.15.22:0/1576383956 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c160c90 con 0x7fa26c0afd90 2024-04-16T16:17:38.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.754+0000 7fa26aa00640 1 -- 172.21.15.22:0/1576383956 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773537270 0 0) 0x7fa26c1606d0 con 0x7fa26c06dc80 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.755+0000 7fa26be00640 1 --2- 172.21.15.22:0/1576383956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c0afd90 0x7fa26c072b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0ce100 tx=0x7fa25c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d114fe3aae2cd35d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.756+0000 7fa26aa00640 1 -- 172.21.15.22:0/1576383956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0317c0 con 0x7fa26c0afd90 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.756+0000 7fa26aa00640 1 -- 172.21.15.22:0/1576383956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c037070 con 0x7fa26c0afd90 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.756+0000 7fa26aa00640 1 -- 172.21.15.22:0/1576383956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c031b80 con 0x7fa26c0afd90 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.756+0000 7fa273000640 1 -- 172.21.15.22:0/1576383956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c0afd90 msgr2=0x7fa26c072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.756+0000 7fa273000640 1 --2- 172.21.15.22:0/1576383956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c0afd90 0x7fa26c072b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0ce100 tx=0x7fa25c02b860 comp rx=0 tx=0).stop 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.757+0000 7fa273000640 1 -- 172.21.15.22:0/1576383956 shutdown_connections 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.757+0000 7fa273000640 1 --2- 172.21.15.22:0/1576383956 >> v2:172.21.15.43:3300/0 conn(0x7fa26c073050 0x7fa26c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.757+0000 7fa273000640 1 --2- 172.21.15.22:0/1576383956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c0afd90 0x7fa26c072b10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.757+0000 7fa273000640 1 -- 172.21.15.22:0/1576383956 >> 172.21.15.22:0/1576383956 conn(0x7fa26c062440 msgr2=0x7fa26c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:38.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.757+0000 7fa273000640 1 -- 172.21.15.22:0/1576383956 shutdown_connections 2024-04-16T16:17:38.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.757+0000 7fa273000640 1 -- 172.21.15.22:0/1576383956 wait complete. 2024-04-16T16:17:38.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.759+0000 7fa273000640 1 Processor -- start 2024-04-16T16:17:38.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.759+0000 7fa273000640 1 -- start start 2024-04-16T16:17:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa273000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa26c06dc80 0x7fa26c156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa273000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c073050 0x7fa26c15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa273000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa26c0afd90 0x7fa26c14d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa273000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c0ce8a0 con 0x7fa26c073050 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa273000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c0b0170 con 0x7fa26c0afd90 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa273000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa26c0cea20 con 0x7fa26c06dc80 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa26b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c073050 0x7fa26c15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa26b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c073050 0x7fa26c15f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52750/0 (socket says 172.21.15.22:52750) 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa26b400640 1 -- 172.21.15.22:0/1603463221 learned_addr learned my addr 172.21.15.22:0/1603463221 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa271000640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa26c0afd90 0x7fa26c14d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.760+0000 7fa26be00640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa26c06dc80 0x7fa26c156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa26b400640 1 -- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa26c06dc80 msgr2=0x7fa26c156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa26b400640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa26c06dc80 0x7fa26c156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa26b400640 1 -- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa26c0afd90 msgr2=0x7fa26c14d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa26b400640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa26c0afd90 0x7fa26c14d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa26b400640 1 -- 172.21.15.22:0/1603463221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c157a50 con 0x7fa26c073050 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa26b400640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c073050 0x7fa26c15f840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c480 tx=0x7fa25800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa263e00640 1 -- 172.21.15.22:0/1603463221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258018070 con 0x7fa26c073050 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa263e00640 1 -- 172.21.15.22:0/1603463221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa258007500 con 0x7fa26c073050 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa263e00640 1 -- 172.21.15.22:0/1603463221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258004a20 con 0x7fa26c073050 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26c14d7f0 con 0x7fa26c073050 2024-04-16T16:17:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.761+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26c157770 con 0x7fa26c073050 2024-04-16T16:17:38.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.762+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa26c0b2220 con 0x7fa26c073050 2024-04-16T16:17:38.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.763+0000 7fa263e00640 1 -- 172.21.15.22:0/1603463221 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa25801b070 con 0x7fa26c073050 2024-04-16T16:17:38.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.764+0000 7fa263e00640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa24c06c920 0x7fa24c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:38.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.765+0000 7fa263e00640 1 -- 172.21.15.22:0/1603463221 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa25808ae00 con 0x7fa26c073050 2024-04-16T16:17:38.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.765+0000 7fa26be00640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa24c06c920 0x7fa24c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:38.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.766+0000 7fa26be00640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa24c06c920 0x7fa24c06ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa25c036000 tx=0x7fa25c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:38.769+0000 7fa263e00640 1 -- 172.21.15.22:0/1603463221 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa26c14d7f0 con 0x7fa26c073050 2024-04-16T16:17:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.015+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa26c158d90 con 0x7fa26c073050 2024-04-16T16:17:39.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.016+0000 7fa263e00640 1 -- 172.21.15.22:0/1603463221 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fa26c157a50 con 0x7fa26c073050 2024-04-16T16:17:39.015 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:39.015 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:17:39.016 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:17:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa24c06c920 msgr2=0x7fa24c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa24c06c920 0x7fa24c06ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa25c036000 tx=0x7fa25c03d040 comp rx=0 tx=0).stop 2024-04-16T16:17:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c073050 msgr2=0x7fa26c15f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c073050 0x7fa26c15f840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c480 tx=0x7fa25800c940 comp rx=0 tx=0).stop 2024-04-16T16:17:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 shutdown_connections 2024-04-16T16:17:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa24c06c920 0x7fa24c06ede0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa26c0afd90 0x7fa26c14d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa26c073050 0x7fa26c15f840 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 --2- 172.21.15.22:0/1603463221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa26c06dc80 0x7fa26c156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 >> 172.21.15.22:0/1603463221 conn(0x7fa26c062440 msgr2=0x7fa26c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:39.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 shutdown_connections 2024-04-16T16:17:39.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.019+0000 7fa273000640 1 -- 172.21.15.22:0/1603463221 wait complete. 2024-04-16T16:17:39.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.261+0000 7fed4aa00640 1 Processor -- start 2024-04-16T16:17:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.261+0000 7fed4aa00640 1 -- start start 2024-04-16T16:17:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.263+0000 7fed4aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 0x7fed4415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.263+0000 7fed4aa00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed44071b00 con 0x7fed440d0b80 2024-04-16T16:17:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.263+0000 7fed4aa00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed44071de0 con 0x7fed4415b790 2024-04-16T16:17:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.263+0000 7fed4aa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed44072430 con 0x7fed440728c0 2024-04-16T16:17:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.263+0000 7fed48c00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fed440d0b80 0x7fed4406cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35964/0 (socket says 172.21.15.22:35964) 2024-04-16T16:17:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.263+0000 7fed48c00640 1 -- 172.21.15.22:0/674250717 learned_addr learned my addr 172.21.15.22:0/674250717 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed4a000640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 0x7fed4415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380495930 0 0) 0x7fed44071b00 con 0x7fed440d0b80 2024-04-16T16:17:39.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed2c003520 con 0x7fed440d0b80 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802580918 0 0) 0x7fed44071de0 con 0x7fed4415b790 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed44071b00 con 0x7fed4415b790 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 957728588 0 0) 0x7fed2c003520 con 0x7fed440d0b80 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 msgr2=0x7fed4415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 0x7fed4415fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 >> v1:172.21.15.43:6789/0 conn(0x7fed4415b790 legacy=0x7fed440d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed440720c0 con 0x7fed440d0b80 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fed380019f0 con 0x7fed440d0b80 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 >> v1:172.21.15.22:6789/0 conn(0x7fed440d0b80 legacy=0x7fed4406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed2c003b70 0x7fed2c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c004800 0x7fed2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 0x7fed2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed44072430 con 0x7fed2c003b70 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c00baa0 con 0x7fed2c004800 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.264+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c00bca0 con 0x7fed440728c0 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed49600640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed2c003b70 0x7fed2c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed48c00640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c004800 0x7fed2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed4a000640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 0x7fed2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed49600640 1 -- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 msgr2=0x7fed2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed49600640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed440728c0 0x7fed2c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed49600640 1 -- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c004800 msgr2=0x7fed2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed49600640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c004800 0x7fed2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed49600640 1 -- 172.21.15.22:0/674250717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c003520 con 0x7fed2c003b70 2024-04-16T16:17:39.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.265+0000 7fed48c00640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c004800 0x7fed2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:39.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.266+0000 7fed49600640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed2c003b70 0x7fed2c003f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fed340018d0 tx=0x7fed2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf7105a6ccccedd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:39.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.266+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34037070 con 0x7fed2c003b70 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed340052d0 con 0x7fed2c003b70 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed43e00640 1 -- 172.21.15.22:0/674250717 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340014f0 con 0x7fed2c003b70 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed4aa00640 1 -- 172.21.15.22:0/674250717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed2c003b70 msgr2=0x7fed2c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed4aa00640 1 --2- 172.21.15.22:0/674250717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed2c003b70 0x7fed2c003f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fed340018d0 tx=0x7fed2c005830 comp rx=0 tx=0).stop 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed4a000640 1 -- 172.21.15.22:0/674250717 reap_dead start 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed4aa00640 1 -- 172.21.15.22:0/674250717 shutdown_connections 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed4aa00640 1 -- 172.21.15.22:0/674250717 >> 172.21.15.22:0/674250717 conn(0x7fed44062440 msgr2=0x7fed44062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed4aa00640 1 -- 172.21.15.22:0/674250717 shutdown_connections 2024-04-16T16:17:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.267+0000 7fed4aa00640 1 -- 172.21.15.22:0/674250717 wait complete. 2024-04-16T16:17:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.269+0000 7fed4aa00640 1 Processor -- start 2024-04-16T16:17:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.269+0000 7fed4aa00640 1 -- start start 2024-04-16T16:17:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.270+0000 7fed4aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c003b70 0x7fed4414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.270+0000 7fed4aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed44150860 0x7fed440b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.270+0000 7fed4aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed44150ce0 0x7fed440b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.270+0000 7fed4aa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed440cc7c0 con 0x7fed44150ce0 2024-04-16T16:17:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.270+0000 7fed4aa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed440afde0 con 0x7fed2c003b70 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.270+0000 7fed4aa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed440cc940 con 0x7fed44150860 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed44150ce0 0x7fed440b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed44150ce0 0x7fed440b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52762/0 (socket says 172.21.15.22:52762) 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 -- 172.21.15.22:0/4133771458 learned_addr learned my addr 172.21.15.22:0/4133771458 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed49600640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c003b70 0x7fed4414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed48c00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed44150860 0x7fed440b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 -- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed44150860 msgr2=0x7fed440b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed44150860 0x7fed440b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 -- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c003b70 msgr2=0x7fed4414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c003b70 0x7fed4414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed4a000640 1 -- 172.21.15.22:0/4133771458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed44151240 con 0x7fed44150ce0 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed49600640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c003b70 0x7fed4414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:39.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.271+0000 7fed48c00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed44150860 0x7fed440b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:39.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.272+0000 7fed4a000640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed44150ce0 0x7fed440b2670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fed44072d10 tx=0x7fed3c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:39.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.272+0000 7fed41600640 1 -- 172.21.15.22:0/4133771458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00f040 con 0x7fed44150ce0 2024-04-16T16:17:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.272+0000 7fed41600640 1 -- 172.21.15.22:0/4133771458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c00e8f0 con 0x7fed44150ce0 2024-04-16T16:17:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.272+0000 7fed41600640 1 -- 172.21.15.22:0/4133771458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00ece0 con 0x7fed44150ce0 2024-04-16T16:17:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.272+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed440cd5b0 con 0x7fed44150ce0 2024-04-16T16:17:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.272+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4414d610 con 0x7fed44150ce0 2024-04-16T16:17:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.273+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed44075f30 con 0x7fed44150ce0 2024-04-16T16:17:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.275+0000 7fed41600640 1 -- 172.21.15.22:0/4133771458 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed3c0253f0 con 0x7fed44150ce0 2024-04-16T16:17:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.276+0000 7fed41600640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed2806c920 0x7fed2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.276+0000 7fed41600640 1 -- 172.21.15.22:0/4133771458 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fed3c08bf00 con 0x7fed44150ce0 2024-04-16T16:17:39.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.276+0000 7fed49600640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed2806c920 0x7fed2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.277+0000 7fed49600640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed2806c920 0x7fed2806ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed34034000 tx=0x7fed34031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:39.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.280+0000 7fed41600640 1 -- 172.21.15.22:0/4133771458 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed3c018030 con 0x7fed44150ce0 2024-04-16T16:17:39.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.487+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed44071530 con 0x7fed44150ce0 2024-04-16T16:17:39.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.489+0000 7fed41600640 1 -- 172.21.15.22:0/4133771458 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16733 (secure 0 0 0) 0x7fed3c05a2a0 con 0x7fed44150ce0 2024-04-16T16:17:39.489 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:39.489 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:29.459450+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.492+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed2806c920 msgr2=0x7fed2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.492+0000 7fed4aa00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed2806c920 0x7fed2806ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed34034000 tx=0x7fed34031000 comp rx=0 tx=0).stop 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.492+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed44150ce0 msgr2=0x7fed440b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.492+0000 7fed4aa00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed44150ce0 0x7fed440b2670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fed44072d10 tx=0x7fed3c010c20 comp rx=0 tx=0).stop 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.492+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 shutdown_connections 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.493+0000 7fed4aa00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fed2806c920 0x7fed2806ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.493+0000 7fed4aa00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed44150ce0 0x7fed440b2670 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.493+0000 7fed4aa00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed44150860 0x7fed440b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.493+0000 7fed4aa00640 1 --2- 172.21.15.22:0/4133771458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2c003b70 0x7fed4414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.493+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 >> 172.21.15.22:0/4133771458 conn(0x7fed44062440 msgr2=0x7fed4415ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.493+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 shutdown_connections 2024-04-16T16:17:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.493+0000 7fed4aa00640 1 -- 172.21.15.22:0/4133771458 wait complete. 2024-04-16T16:17:39.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:16:39.969199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:16:40.940279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:39.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:39.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.744+0000 7f7e32000640 1 Processor -- start 2024-04-16T16:17:39.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.744+0000 7f7e32000640 1 -- start start 2024-04-16T16:17:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e32000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e2c0d0a10 0x7f7e2c0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e32000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7e2c0cc830 0x7f7e2c0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e32000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c15cc20 con 0x7f7e2c15c840 2024-04-16T16:17:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e32000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c0ce390 con 0x7f7e2c0d0a10 2024-04-16T16:17:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e32000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c06dda0 con 0x7f7e2c0cc830 2024-04-16T16:17:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e2be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e2c0d0a10 0x7f7e2c0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e2be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e2c0d0a10 0x7f7e2c0cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52778/0 (socket says 172.21.15.22:52778) 2024-04-16T16:17:39.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e2be00640 1 -- 172.21.15.22:0/951206546 learned_addr learned my addr 172.21.15.22:0/951206546 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:39.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e2be00640 1 -- 172.21.15.22:0/951206546 >> v2:172.21.15.43:3300/0 conn(0x7f7e2c0cc830 msgr2=0x7f7e2c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:39.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e2be00640 1 --2- 172.21.15.22:0/951206546 >> v2:172.21.15.43:3300/0 conn(0x7f7e2c0cc830 0x7f7e2c0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.746+0000 7f7e2be00640 1 -- 172.21.15.22:0/951206546 >> v1:172.21.15.22:6789/0 conn(0x7f7e2c15c840 legacy=0x7f7e2c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.747+0000 7f7e2be00640 1 -- 172.21.15.22:0/951206546 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c06d800 con 0x7f7e2c0d0a10 2024-04-16T16:17:39.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.748+0000 7f7e2be00640 1 --2- 172.21.15.22:0/951206546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c0cf0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0d1320 tx=0x7f7e1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d511f4d1477b641b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:39.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e2b400640 1 -- 172.21.15.22:0/951206546 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18034070 con 0x7f7e2c0d0a10 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e2b400640 1 -- 172.21.15.22:0/951206546 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e18030860 con 0x7f7e2c0d0a10 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e2b400640 1 -- 172.21.15.22:0/951206546 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18030c30 con 0x7f7e2c0d0a10 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e32000640 1 -- 172.21.15.22:0/951206546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0d0a10 msgr2=0x7f7e2c0cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e32000640 1 --2- 172.21.15.22:0/951206546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c0cf0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0d1320 tx=0x7f7e1802b9a0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e32000640 1 -- 172.21.15.22:0/951206546 shutdown_connections 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e32000640 1 --2- 172.21.15.22:0/951206546 >> v2:172.21.15.43:3300/0 conn(0x7f7e2c0cc830 0x7f7e2c0cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e32000640 1 --2- 172.21.15.22:0/951206546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c0cf0a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.749+0000 7f7e32000640 1 -- 172.21.15.22:0/951206546 >> 172.21.15.22:0/951206546 conn(0x7f7e2c062440 msgr2=0x7f7e2c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.750+0000 7f7e32000640 1 -- 172.21.15.22:0/951206546 shutdown_connections 2024-04-16T16:17:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.750+0000 7f7e32000640 1 -- 172.21.15.22:0/951206546 wait complete. 2024-04-16T16:17:39.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.751+0000 7f7e32000640 1 Processor -- start 2024-04-16T16:17:39.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.751+0000 7f7e32000640 1 -- start start 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.752+0000 7f7e32000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0cc830 0x7f7e2c153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.752+0000 7f7e32000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.752+0000 7f7e32000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2c15c840 0x7f7e2c15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.752+0000 7f7e32000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0ce8a0 con 0x7f7e2c0cc830 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.752+0000 7f7e32000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0ce5c0 con 0x7f7e2c0d0a10 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.752+0000 7f7e32000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c0ceb80 con 0x7f7e2c15c840 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0cc830 0x7f7e2c153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0cc830 0x7f7e2c153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52788/0 (socket says 172.21.15.22:52788) 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 -- 172.21.15.22:0/3273168894 learned_addr learned my addr 172.21.15.22:0/3273168894 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:39.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e2be00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 -- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2c15c840 msgr2=0x7f7e2c15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e31600640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2c15c840 0x7f7e2c15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2c15c840 0x7f7e2c15ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 -- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0d0a10 msgr2=0x7f7e2c145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e30c00640 1 -- 172.21.15.22:0/3273168894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c071a70 con 0x7f7e2c0cc830 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e2be00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.753+0000 7f7e31600640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2c15c840 0x7f7e2c15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.754+0000 7f7e30c00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0cc830 0x7f7e2c153fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c790 tx=0x7f7e1c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.754+0000 7f7e28c00640 1 -- 172.21.15.22:0/3273168894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c016020 con 0x7f7e2c0cc830 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.754+0000 7f7e28c00640 1 -- 172.21.15.22:0/3273168894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c006d50 con 0x7f7e2c0cc830 2024-04-16T16:17:39.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.754+0000 7f7e28c00640 1 -- 172.21.15.22:0/3273168894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c003bb0 con 0x7f7e2c0cc830 2024-04-16T16:17:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.754+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c1534d0 con 0x7f7e2c0cc830 2024-04-16T16:17:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.754+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c153a90 con 0x7f7e2c0cc830 2024-04-16T16:17:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.755+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e2c075f30 con 0x7f7e2c0cc830 2024-04-16T16:17:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.756+0000 7f7e28c00640 1 -- 172.21.15.22:0/3273168894 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e1c00a850 con 0x7f7e2c0cc830 2024-04-16T16:17:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.757+0000 7f7e28c00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e0c06c8f0 0x7f7e0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.757+0000 7f7e28c00640 1 -- 172.21.15.22:0/3273168894 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7e1c08b930 con 0x7f7e2c0cc830 2024-04-16T16:17:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.757+0000 7f7e2be00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e0c06c8f0 0x7f7e0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:39.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.758+0000 7f7e2be00640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e0c06c8f0 0x7f7e0c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e18036000 tx=0x7f7e1803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:39.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.762+0000 7f7e28c00640 1 -- 172.21.15.22:0/3273168894 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e1c020020 con 0x7f7e2c0cc830 2024-04-16T16:17:39.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.966+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7e2c06dfb0 con 0x7f7e2c0cc830 2024-04-16T16:17:39.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.967+0000 7f7e28c00640 1 -- 172.21.15.22:0/3273168894 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f7e2c15cc20 con 0x7f7e2c0cc830 2024-04-16T16:17:39.967 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:39.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e0c06c8f0 msgr2=0x7f7e0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e0c06c8f0 0x7f7e0c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e18036000 tx=0x7f7e1803b040 comp rx=0 tx=0).stop 2024-04-16T16:17:39.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0cc830 msgr2=0x7f7e2c153fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:39.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0cc830 0x7f7e2c153fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c790 tx=0x7f7e1c00cc50 comp rx=0 tx=0).stop 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 shutdown_connections 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e0c06c8f0 0x7f7e0c06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2c15c840 0x7f7e2c15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0d0a10 0x7f7e2c145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 --2- 172.21.15.22:0/3273168894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e2c0cc830 0x7f7e2c153fb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 >> 172.21.15.22:0/3273168894 conn(0x7f7e2c062440 msgr2=0x7f7e2c0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 shutdown_connections 2024-04-16T16:17:39.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:39.971+0000 7f7e32000640 1 -- 172.21.15.22:0/3273168894 wait complete. 2024-04-16T16:17:39.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:17:40.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.212+0000 7fe202400640 1 Processor -- start 2024-04-16T16:17:40.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.212+0000 7fe202400640 1 -- start start 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe202400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe1fc15b750 0x7fe1fc0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe202400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc160060 con 0x7fe1fc06e150 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe202400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc0b4490 con 0x7fe1fc15fab0 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe202400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe1fc0b4ae0 con 0x7fe1fc15b750 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe1fb400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe1fc15b750 0x7fe1fc0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe1fb400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe1fc15b750 0x7fe1fc0b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39948/0 (socket says 172.21.15.22:39948) 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe1faa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe1fc06e150 0x7fe1fc15f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46800/0 (socket says 172.21.15.22:46800) 2024-04-16T16:17:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.214+0000 7fe1fb400640 1 -- 172.21.15.22:0/2459953053 learned_addr learned my addr 172.21.15.22:0/2459953053 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.215+0000 7fe1fb400640 1 -- 172.21.15.22:0/2459953053 >> v1:172.21.15.43:6789/0 conn(0x7fe1fc15fab0 legacy=0x7fe1fc0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.215+0000 7fe1fb400640 1 -- 172.21.15.22:0/2459953053 >> v1:172.21.15.22:6789/0 conn(0x7fe1fc06e150 legacy=0x7fe1fc15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.215+0000 7fe1fb400640 1 -- 172.21.15.22:0/2459953053 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc0b4770 con 0x7fe1fc15b750 2024-04-16T16:17:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.216+0000 7fe1fb400640 1 --2- 172.21.15.22:0/2459953053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15b750 0x7fe1fc0b4f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009e50 tx=0x7fe1ec02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61e4784435c93dd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.216+0000 7fe1fa000640 1 -- 172.21.15.22:0/2459953053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec02cb10 con 0x7fe1fc15b750 2024-04-16T16:17:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.216+0000 7fe1fa000640 1 -- 172.21.15.22:0/2459953053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec02ccb0 con 0x7fe1fc15b750 2024-04-16T16:17:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.216+0000 7fe1fa000640 1 -- 172.21.15.22:0/2459953053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec02ce60 con 0x7fe1fc15b750 2024-04-16T16:17:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.217+0000 7fe202400640 1 -- 172.21.15.22:0/2459953053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15b750 msgr2=0x7fe1fc0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.217+0000 7fe202400640 1 --2- 172.21.15.22:0/2459953053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15b750 0x7fe1fc0b4f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009e50 tx=0x7fe1ec02bf70 comp rx=0 tx=0).stop 2024-04-16T16:17:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.217+0000 7fe202400640 1 -- 172.21.15.22:0/2459953053 shutdown_connections 2024-04-16T16:17:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.217+0000 7fe202400640 1 --2- 172.21.15.22:0/2459953053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15b750 0x7fe1fc0b4f70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.217+0000 7fe202400640 1 -- 172.21.15.22:0/2459953053 >> 172.21.15.22:0/2459953053 conn(0x7fe1fc062440 msgr2=0x7fe1fc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.217+0000 7fe202400640 1 -- 172.21.15.22:0/2459953053 shutdown_connections 2024-04-16T16:17:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.217+0000 7fe202400640 1 -- 172.21.15.22:0/2459953053 wait complete. 2024-04-16T16:17:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.219+0000 7fe202400640 1 Processor -- start 2024-04-16T16:17:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.219+0000 7fe202400640 1 -- start start 2024-04-16T16:17:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe202400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1fc06e150 0x7fe1fc158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe202400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc15b750 0x7fe1fc15e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe202400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15fab0 0x7fe1fc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe202400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc15bcb0 con 0x7fe1fc15fab0 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe202400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc15bb30 con 0x7fe1fc15b750 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe202400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1fc06e5b0 con 0x7fe1fc06e150 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe1fbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15fab0 0x7fe1fc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe1fbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15fab0 0x7fe1fc0b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39960/0 (socket says 172.21.15.22:39960) 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.220+0000 7fe1fbe00640 1 -- 172.21.15.22:0/3619605179 learned_addr learned my addr 172.21.15.22:0/3619605179 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1faa00640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc15b750 0x7fe1fc15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1fb400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1fc06e150 0x7fe1fc158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1fbe00640 1 -- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1fc06e150 msgr2=0x7fe1fc158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1fbe00640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1fc06e150 0x7fe1fc158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1fbe00640 1 -- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc15b750 msgr2=0x7fe1fc15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1fbe00640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc15b750 0x7fe1fc15e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1fbe00640 1 -- 172.21.15.22:0/3619605179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc150950 con 0x7fe1fc15fab0 2024-04-16T16:17:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1fbe00640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15fab0 0x7fe1fc0b2170 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400b410 tx=0x7fe1f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.221+0000 7fe1f3400640 1 -- 172.21.15.22:0/3619605179 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4015030 con 0x7fe1fc15fab0 2024-04-16T16:17:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.222+0000 7fe1f3400640 1 -- 172.21.15.22:0/3619605179 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4004020 con 0x7fe1fc15fab0 2024-04-16T16:17:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.222+0000 7fe1f3400640 1 -- 172.21.15.22:0/3619605179 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4004410 con 0x7fe1fc15fab0 2024-04-16T16:17:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.222+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1fc150c70 con 0x7fe1fc15fab0 2024-04-16T16:17:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.222+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1fc1514b0 con 0x7fe1fc15fab0 2024-04-16T16:17:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.223+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1fc04fd90 con 0x7fe1fc15fab0 2024-04-16T16:17:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.224+0000 7fe1f3400640 1 -- 172.21.15.22:0/3619605179 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1f4018070 con 0x7fe1fc15fab0 2024-04-16T16:17:40.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.225+0000 7fe1f3400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe1d806c8f0 0x7fe1d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.225+0000 7fe1f3400640 1 -- 172.21.15.22:0/3619605179 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe1f408b690 con 0x7fe1fc15fab0 2024-04-16T16:17:40.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.225+0000 7fe1fb400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe1d806c8f0 0x7fe1d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.226+0000 7fe1fb400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe1d806c8f0 0x7fe1d806edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec035000 tx=0x7fe1ec030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.230+0000 7fe1f3400640 1 -- 172.21.15.22:0/3619605179 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1fc150c70 con 0x7fe1fc15fab0 2024-04-16T16:17:40.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.431+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe1fc156900 con 0x7fe1fc15fab0 2024-04-16T16:17:40.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.433+0000 7fe1f3400640 1 -- 172.21.15.22:0/3619605179 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fe1f4059a40 con 0x7fe1fc15fab0 2024-04-16T16:17:40.432 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:17:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe1d806c8f0 msgr2=0x7fe1d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe1d806c8f0 0x7fe1d806edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec035000 tx=0x7fe1ec030000 comp rx=0 tx=0).stop 2024-04-16T16:17:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15fab0 msgr2=0x7fe1fc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15fab0 0x7fe1fc0b2170 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400b410 tx=0x7fe1f400b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 shutdown_connections 2024-04-16T16:17:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe1d806c8f0 0x7fe1d806edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc15fab0 0x7fe1fc0b2170 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc15b750 0x7fe1fc15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 --2- 172.21.15.22:0/3619605179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1fc06e150 0x7fe1fc158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.435+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 >> 172.21.15.22:0/3619605179 conn(0x7fe1fc062440 msgr2=0x7fe1fc15a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.436+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 shutdown_connections 2024-04-16T16:17:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.436+0000 7fe202400640 1 -- 172.21.15.22:0/3619605179 wait complete. 2024-04-16T16:17:40.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:17:40.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.685+0000 7fe80b200640 1 Processor -- start 2024-04-16T16:17:40.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.685+0000 7fe80b200640 1 -- start start 2024-04-16T16:17:40.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.686+0000 7fe80b200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe80c0cfcc0 0x7fe80c0d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.686+0000 7fe80b200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0d20f0 con 0x7fe80c0d1ce0 2024-04-16T16:17:40.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.686+0000 7fe80b200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0d3ef0 con 0x7fe80c15eb60 2024-04-16T16:17:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.686+0000 7fe80b200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe80c0d41d0 con 0x7fe80c0cfcc0 2024-04-16T16:17:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.687+0000 7fe809400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe80c0cfcc0 0x7fe80c0d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.687+0000 7fe80a800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe80c0d1ce0 0x7fe80c0b82d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46802/0 (socket says 172.21.15.22:46802) 2024-04-16T16:17:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.687+0000 7fe80a800640 1 -- 172.21.15.22:0/798951008 learned_addr learned my addr 172.21.15.22:0/798951008 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.687+0000 7fe809400640 1 -- 172.21.15.22:0/798951008 >> v1:172.21.15.43:6789/0 conn(0x7fe80c15eb60 legacy=0x7fe80c0d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.687+0000 7fe808a00640 1 -- 172.21.15.22:0/798951008 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513339508 0 0) 0x7fe804001490 con 0x7fe80c0d1ce0 2024-04-16T16:17:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.687+0000 7fe809400640 1 -- 172.21.15.22:0/798951008 >> v1:172.21.15.22:6789/0 conn(0x7fe80c0d1ce0 legacy=0x7fe80c0b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.687+0000 7fe809400640 1 -- 172.21.15.22:0/798951008 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c0d44b0 con 0x7fe80c0cfcc0 2024-04-16T16:17:40.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.689+0000 7fe809400640 1 --2- 172.21.15.22:0/798951008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c0cfcc0 0x7fe80c0d17a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0097a0 tx=0x7fe7fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdfda34e35fed52 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:40.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.689+0000 7fe808a00640 1 -- 172.21.15.22:0/798951008 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc035020 con 0x7fe80c0cfcc0 2024-04-16T16:17:40.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.689+0000 7fe808a00640 1 -- 172.21.15.22:0/798951008 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc031830 con 0x7fe80c0cfcc0 2024-04-16T16:17:40.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.689+0000 7fe808a00640 1 -- 172.21.15.22:0/798951008 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc031c00 con 0x7fe80c0cfcc0 2024-04-16T16:17:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.690+0000 7fe80b200640 1 -- 172.21.15.22:0/798951008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c0cfcc0 msgr2=0x7fe80c0d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.690+0000 7fe80b200640 1 --2- 172.21.15.22:0/798951008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c0cfcc0 0x7fe80c0d17a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0097a0 tx=0x7fe7fc02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.690+0000 7fe80b200640 1 -- 172.21.15.22:0/798951008 shutdown_connections 2024-04-16T16:17:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.690+0000 7fe80b200640 1 --2- 172.21.15.22:0/798951008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c0cfcc0 0x7fe80c0d17a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.690+0000 7fe80b200640 1 -- 172.21.15.22:0/798951008 >> 172.21.15.22:0/798951008 conn(0x7fe80c072460 msgr2=0x7fe80c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.690+0000 7fe80b200640 1 -- 172.21.15.22:0/798951008 shutdown_connections 2024-04-16T16:17:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.690+0000 7fe80b200640 1 -- 172.21.15.22:0/798951008 wait complete. 2024-04-16T16:17:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.692+0000 7fe80b200640 1 Processor -- start 2024-04-16T16:17:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.692+0000 7fe80b200640 1 -- start start 2024-04-16T16:17:40.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe80c0cfcc0 0x7fe80c150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe80c0d1ce0 0x7fe80c0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80b200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c15eb60 0x7fe80c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80b200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c0b7b70 con 0x7fe80c15eb60 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c0b79f0 con 0x7fe80c0d1ce0 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe80c0b89e0 con 0x7fe80c0cfcc0 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c15eb60 0x7fe80c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c15eb60 0x7fe80c0cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39974/0 (socket says 172.21.15.22:39974) 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.693+0000 7fe80a800640 1 -- 172.21.15.22:0/1038967058 learned_addr learned my addr 172.21.15.22:0/1038967058 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe809400640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe80c0d1ce0 0x7fe80c0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe809e00640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe80c0cfcc0 0x7fe80c150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe80a800640 1 -- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe80c0cfcc0 msgr2=0x7fe80c150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe80a800640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe80c0cfcc0 0x7fe80c150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe80a800640 1 -- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe80c0d1ce0 msgr2=0x7fe80c0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe80a800640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe80c0d1ce0 0x7fe80c0ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe80a800640 1 -- 172.21.15.22:0/1038967058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c15d3c0 con 0x7fe80c15eb60 2024-04-16T16:17:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe80a800640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c15eb60 0x7fe80c0cd450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c820 tx=0x7fe80400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe802000640 1 -- 172.21.15.22:0/1038967058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804018070 con 0x7fe80c15eb60 2024-04-16T16:17:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe802000640 1 -- 172.21.15.22:0/1038967058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80400a5e0 con 0x7fe80c15eb60 2024-04-16T16:17:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.694+0000 7fe802000640 1 -- 172.21.15.22:0/1038967058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80400a9d0 con 0x7fe80c15eb60 2024-04-16T16:17:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.695+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c15d0e0 con 0x7fe80c15eb60 2024-04-16T16:17:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.695+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80c15f330 con 0x7fe80c15eb60 2024-04-16T16:17:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.696+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe80c075f30 con 0x7fe80c15eb60 2024-04-16T16:17:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.697+0000 7fe802000640 1 -- 172.21.15.22:0/1038967058 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe80400ab70 con 0x7fe80c15eb60 2024-04-16T16:17:40.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.698+0000 7fe802000640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7e806c8f0 0x7fe7e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:40.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.698+0000 7fe802000640 1 -- 172.21.15.22:0/1038967058 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe80408b280 con 0x7fe80c15eb60 2024-04-16T16:17:40.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.698+0000 7fe809e00640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7e806c8f0 0x7fe7e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:40.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.699+0000 7fe809e00640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7e806c8f0 0x7fe7e806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4006fd0 tx=0x7fe7f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:40.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.703+0000 7fe802000640 1 -- 172.21.15.22:0/1038967058 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe80c0d20f0 con 0x7fe80c15eb60 2024-04-16T16:17:40.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.910+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe80c15e0f0 con 0x7fe80c15eb60 2024-04-16T16:17:40.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.911+0000 7fe802000640 1 -- 172.21.15.22:0/1038967058 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fe804059500 con 0x7fe80c15eb60 2024-04-16T16:17:40.910 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:17:40.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.913+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7e806c8f0 msgr2=0x7fe7e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.913+0000 7fe80b200640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7e806c8f0 0x7fe7e806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4006fd0 tx=0x7fe7f4008040 comp rx=0 tx=0).stop 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.913+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c15eb60 msgr2=0x7fe80c0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.913+0000 7fe80b200640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c15eb60 0x7fe80c0cd450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c820 tx=0x7fe80400cce0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 shutdown_connections 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe7e806c8f0 0x7fe7e806edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe80c15eb60 0x7fe80c0cd450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe80c0d1ce0 0x7fe80c0ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 --2- 172.21.15.22:0/1038967058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe80c0cfcc0 0x7fe80c150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 >> 172.21.15.22:0/1038967058 conn(0x7fe80c072460 msgr2=0x7fe80c0d47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 shutdown_connections 2024-04-16T16:17:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:40.914+0000 7fe80b200640 1 -- 172.21.15.22:0/1038967058 wait complete. 2024-04-16T16:17:40.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:17:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.157+0000 7f02c4a00640 1 Processor -- start 2024-04-16T16:17:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.157+0000 7f02c4a00640 1 -- start start 2024-04-16T16:17:41.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.158+0000 7f02c4a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02c015e8d0 0x7f02c00d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.158+0000 7f02c4a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c006fe60 con 0x7f02c006f8a0 2024-04-16T16:17:41.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.158+0000 7f02c4a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c00b0620 con 0x7f02c00b5ff0 2024-04-16T16:17:41.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.158+0000 7f02c4a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f02c00b0900 con 0x7f02c015e8d0 2024-04-16T16:17:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.159+0000 7f02bf400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02c015e8d0 0x7f02c00d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.159+0000 7f02bea00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f02c006f8a0 0x7f02c0072d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46812/0 (socket says 172.21.15.22:46812) 2024-04-16T16:17:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.159+0000 7f02bea00640 1 -- 172.21.15.22:0/2625437808 learned_addr learned my addr 172.21.15.22:0/2625437808 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.159+0000 7f02bf400640 1 -- 172.21.15.22:0/2625437808 >> v1:172.21.15.43:6789/0 conn(0x7f02c00b5ff0 legacy=0x7f02c00b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.159+0000 7f02bf400640 1 -- 172.21.15.22:0/2625437808 >> v1:172.21.15.22:6789/0 conn(0x7f02c006f8a0 legacy=0x7f02c0072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.159+0000 7f02bf400640 1 -- 172.21.15.22:0/2625437808 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c00b0be0 con 0x7f02c015e8d0 2024-04-16T16:17:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.159+0000 7f02be000640 1 -- 172.21.15.22:0/2625437808 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243432438 0 0) 0x7f02c006fe60 con 0x7f02c006f8a0 2024-04-16T16:17:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.160+0000 7f02bf400640 1 --2- 172.21.15.22:0/2625437808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c00d12a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f02b00097a0 tx=0x7f02b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f4dd276ff58a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02be000640 1 -- 172.21.15.22:0/2625437808 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b00315a0 con 0x7f02c015e8d0 2024-04-16T16:17:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02be000640 1 -- 172.21.15.22:0/2625437808 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b0037070 con 0x7f02c015e8d0 2024-04-16T16:17:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02be000640 1 -- 172.21.15.22:0/2625437808 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0031960 con 0x7f02c015e8d0 2024-04-16T16:17:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02c4a00640 1 -- 172.21.15.22:0/2625437808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 msgr2=0x7f02c00d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2625437808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c00d12a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f02b00097a0 tx=0x7f02b002b840 comp rx=0 tx=0).stop 2024-04-16T16:17:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02c4a00640 1 -- 172.21.15.22:0/2625437808 shutdown_connections 2024-04-16T16:17:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2625437808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c00d12a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02c4a00640 1 -- 172.21.15.22:0/2625437808 >> 172.21.15.22:0/2625437808 conn(0x7f02c0074e60 msgr2=0x7f02c006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02c4a00640 1 -- 172.21.15.22:0/2625437808 shutdown_connections 2024-04-16T16:17:41.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.161+0000 7f02c4a00640 1 -- 172.21.15.22:0/2625437808 wait complete. 2024-04-16T16:17:41.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.163+0000 7f02c4a00640 1 Processor -- start 2024-04-16T16:17:41.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.163+0000 7f02c4a00640 1 -- start start 2024-04-16T16:17:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.164+0000 7f02c4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c006f8a0 0x7f02c00cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.164+0000 7f02c4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02c00b5ff0 0x7f02c0153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.164+0000 7f02c4a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c01f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.164+0000 7f02c4a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f02c015ee30 con 0x7f02c015e8d0 2024-04-16T16:17:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.164+0000 7f02c4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f02c015ecb0 con 0x7f02c006f8a0 2024-04-16T16:17:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.164+0000 7f02c4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f02c015f2a0 con 0x7f02c00b5ff0 2024-04-16T16:17:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c01f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c01f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39988/0 (socket says 172.21.15.22:39988) 2024-04-16T16:17:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 -- 172.21.15.22:0/2654827712 learned_addr learned my addr 172.21.15.22:0/2654827712 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bea00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02c00b5ff0 0x7f02c0153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bf400640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c006f8a0 0x7f02c00cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 -- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02c00b5ff0 msgr2=0x7f02c0153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02c00b5ff0 0x7f02c0153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 -- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c006f8a0 msgr2=0x7f02c00cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c006f8a0 0x7f02c00cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 -- 172.21.15.22:0/2654827712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c00b1100 con 0x7f02c015e8d0 2024-04-16T16:17:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.165+0000 7f02bfe00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c01f4230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c780 tx=0x7f02b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.166+0000 7f02b7400640 1 -- 172.21.15.22:0/2654827712 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8004b60 con 0x7f02c015e8d0 2024-04-16T16:17:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.166+0000 7f02b7400640 1 -- 172.21.15.22:0/2654827712 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b8004d00 con 0x7f02c015e8d0 2024-04-16T16:17:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.166+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c01f4c50 con 0x7f02c015e8d0 2024-04-16T16:17:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.166+0000 7f02b7400640 1 -- 172.21.15.22:0/2654827712 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b800aa90 con 0x7f02c015e8d0 2024-04-16T16:17:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.166+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c01f5210 con 0x7f02c015e8d0 2024-04-16T16:17:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.167+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c0154030 con 0x7f02c015e8d0 2024-04-16T16:17:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.168+0000 7f02b7400640 1 -- 172.21.15.22:0/2654827712 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02b800ac30 con 0x7f02c015e8d0 2024-04-16T16:17:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.169+0000 7f02b7400640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02a006c940 0x7f02a006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.169+0000 7f02b7400640 1 -- 172.21.15.22:0/2654827712 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f02b808be80 con 0x7f02c015e8d0 2024-04-16T16:17:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.169+0000 7f02bf400640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02a006c940 0x7f02a006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.170+0000 7f02bf400640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02a006c940 0x7f02a006ee00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f02b0036000 tx=0x7f02b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.174+0000 7f02b7400640 1 -- 172.21.15.22:0/2654827712 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02c0154030 con 0x7f02c015e8d0 2024-04-16T16:17:41.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.420+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02c0075f30 con 0x7f02c015e8d0 2024-04-16T16:17:41.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.421+0000 7f02b7400640 1 -- 172.21.15.22:0/2654827712 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f02b8020070 con 0x7f02c015e8d0 2024-04-16T16:17:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:41.420 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:17:41.420 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:17:41.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02a006c940 msgr2=0x7f02a006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02a006c940 0x7f02a006ee00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f02b0036000 tx=0x7f02b0008030 comp rx=0 tx=0).stop 2024-04-16T16:17:41.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 msgr2=0x7f02c01f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c01f4230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c780 tx=0x7f02b800cc40 comp rx=0 tx=0).stop 2024-04-16T16:17:41.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 shutdown_connections 2024-04-16T16:17:41.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f02a006c940 0x7f02a006ee00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02c015e8d0 0x7f02c01f4230 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02c00b5ff0 0x7f02c0153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 --2- 172.21.15.22:0/2654827712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c006f8a0 0x7f02c00cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 >> 172.21.15.22:0/2654827712 conn(0x7f02c0074e60 msgr2=0x7f02c015cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 shutdown_connections 2024-04-16T16:17:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.424+0000 7f02c4a00640 1 -- 172.21.15.22:0/2654827712 wait complete. 2024-04-16T16:17:41.444 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.665+0000 7fad51e00640 1 Processor -- start 2024-04-16T16:17:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.665+0000 7fad51e00640 1 -- start start 2024-04-16T16:17:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.667+0000 7fad51e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c15cb70 0x7fad4c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.667+0000 7fad51e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4c0afdc0 con 0x7fad4c15b7e0 2024-04-16T16:17:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.667+0000 7fad51e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4c0b47f0 con 0x7fad4c06e690 2024-04-16T16:17:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.667+0000 7fad51e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fad4c06eb00 con 0x7fad4c15cb70 2024-04-16T16:17:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.667+0000 7fad4aa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fad4c15b7e0 0x7fad4c0af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46828/0 (socket says 172.21.15.22:46828) 2024-04-16T16:17:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.667+0000 7fad4aa00640 1 -- 172.21.15.22:0/3338789555 learned_addr learned my addr 172.21.15.22:0/3338789555 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad43e00640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c15cb70 0x7fad4c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561970548 0 0) 0x7fad4c0afdc0 con 0x7fad4c15b7e0 2024-04-16T16:17:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2c003520 con 0x7fad4c15b7e0 2024-04-16T16:17:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2996067374 0 0) 0x7fad2c003520 con 0x7fad4c15b7e0 2024-04-16T16:17:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c15cb70 msgr2=0x7fad4c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c15cb70 0x7fad4c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 >> v1:172.21.15.43:6789/0 conn(0x7fad4c06e690 legacy=0x7fad4c071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c0b4ad0 con 0x7fad4c15b7e0 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fad3c001670 con 0x7fad4c15b7e0 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 >> v1:172.21.15.22:6789/0 conn(0x7fad4c15b7e0 legacy=0x7fad4c0af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.668+0000 7fad4a000640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad2c0039e0 0x7fad2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4a000640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c15cb70 0x7fad2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4a000640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c004d40 0x7fad2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c06eb00 con 0x7fad2c0039e0 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c00bb80 con 0x7fad2c004d40 2024-04-16T16:17:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fad2c00bd80 con 0x7fad4c15cb70 2024-04-16T16:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4aa00640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad2c0039e0 0x7fad2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4aa00640 1 -- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c15cb70 msgr2=0x7fad2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4aa00640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c15cb70 0x7fad2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4aa00640 1 -- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c004d40 msgr2=0x7fad2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4aa00640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c004d40 0x7fad2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.669+0000 7fad4aa00640 1 -- 172.21.15.22:0/3338789555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c003520 con 0x7fad2c0039e0 2024-04-16T16:17:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.670+0000 7fad4aa00640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad2c0039e0 0x7fad2c003e00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c110 tx=0x7fad2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e507fccf4b32c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.671+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c007c40 con 0x7fad2c0039e0 2024-04-16T16:17:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.671+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3c030070 con 0x7fad2c0039e0 2024-04-16T16:17:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.671+0000 7fad4a000640 1 -- 172.21.15.22:0/3338789555 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c005d30 con 0x7fad2c0039e0 2024-04-16T16:17:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.671+0000 7fad51e00640 1 -- 172.21.15.22:0/3338789555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad2c0039e0 msgr2=0x7fad2c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.671+0000 7fad51e00640 1 --2- 172.21.15.22:0/3338789555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad2c0039e0 0x7fad2c003e00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c110 tx=0x7fad2c005830 comp rx=0 tx=0).stop 2024-04-16T16:17:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.672+0000 7fad4b400640 1 -- 172.21.15.22:0/3338789555 reap_dead start 2024-04-16T16:17:41.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.672+0000 7fad51e00640 1 -- 172.21.15.22:0/3338789555 shutdown_connections 2024-04-16T16:17:41.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.672+0000 7fad51e00640 1 -- 172.21.15.22:0/3338789555 >> 172.21.15.22:0/3338789555 conn(0x7fad4c062440 msgr2=0x7fad4c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:41.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.672+0000 7fad51e00640 1 -- 172.21.15.22:0/3338789555 shutdown_connections 2024-04-16T16:17:41.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.672+0000 7fad51e00640 1 -- 172.21.15.22:0/3338789555 wait complete. 2024-04-16T16:17:41.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.673+0000 7fad51e00640 1 Processor -- start 2024-04-16T16:17:41.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.674+0000 7fad51e00640 1 -- start start 2024-04-16T16:17:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad51e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c0039e0 0x7fad4c1f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad51e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c1514a0 0x7fad4c1f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad51e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad4c1f4800 0x7fad4c071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad51e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c0b5090 con 0x7fad4c1f4800 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad51e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c15bbc0 con 0x7fad2c0039e0 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad51e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fad4c15bd40 con 0x7fad4c1514a0 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad4c1f4800 0x7fad4c071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad4c1f4800 0x7fad4c071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40004/0 (socket says 172.21.15.22:40004) 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4b400640 1 -- 172.21.15.22:0/1138683183 learned_addr learned my addr 172.21.15.22:0/1138683183 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad43e00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c1514a0 0x7fad4c1f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4aa00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c0039e0 0x7fad4c1f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4b400640 1 -- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c1514a0 msgr2=0x7fad4c1f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4b400640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c1514a0 0x7fad4c1f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4b400640 1 -- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c0039e0 msgr2=0x7fad4c1f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.675+0000 7fad4b400640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c0039e0 0x7fad4c1f17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.676+0000 7fad4b400640 1 -- 172.21.15.22:0/1138683183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c1f4d60 con 0x7fad4c1f4800 2024-04-16T16:17:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.676+0000 7fad4b400640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad4c1f4800 0x7fad4c071c20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fad4c072c50 tx=0x7fad4400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.676+0000 7fad43400640 1 -- 172.21.15.22:0/1138683183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44005d40 con 0x7fad4c1f4800 2024-04-16T16:17:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.676+0000 7fad43400640 1 -- 172.21.15.22:0/1138683183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad44003970 con 0x7fad4c1f4800 2024-04-16T16:17:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.676+0000 7fad43400640 1 -- 172.21.15.22:0/1138683183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44003d60 con 0x7fad4c1f4800 2024-04-16T16:17:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.676+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4c1f5040 con 0x7fad4c1f4800 2024-04-16T16:17:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.676+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4c1f12c0 con 0x7fad4c1f4800 2024-04-16T16:17:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.678+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad4c1f14c0 con 0x7fad4c1f4800 2024-04-16T16:17:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.679+0000 7fad43400640 1 -- 172.21.15.22:0/1138683183 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad4400a640 con 0x7fad4c1f4800 2024-04-16T16:17:41.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.679+0000 7fad43400640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fad2806c920 0x7fad2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:41.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.680+0000 7fad43400640 1 -- 172.21.15.22:0/1138683183 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fad4408afe0 con 0x7fad4c1f4800 2024-04-16T16:17:41.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.680+0000 7fad4aa00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fad2806c920 0x7fad2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:41.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.681+0000 7fad4aa00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fad2806c920 0x7fad2806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad3c034000 tx=0x7fad3c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.684+0000 7fad43400640 1 -- 172.21.15.22:0/1138683183 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad4c1f14c0 con 0x7fad4c1f4800 2024-04-16T16:17:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.885+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad4c04fd90 con 0x7fad4c1f4800 2024-04-16T16:17:41.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.887+0000 7fad43400640 1 -- 172.21.15.22:0/1138683183 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16733 (secure 0 0 0) 0x7fad44059390 con 0x7fad4c1f4800 2024-04-16T16:17:41.887 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:41.887 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:29.459450+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fad2806c920 msgr2=0x7fad2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fad2806c920 0x7fad2806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad3c034000 tx=0x7fad3c009030 comp rx=0 tx=0).stop 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad4c1f4800 msgr2=0x7fad4c071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad4c1f4800 0x7fad4c071c20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fad4c072c50 tx=0x7fad4400cb90 comp rx=0 tx=0).stop 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 shutdown_connections 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fad2806c920 0x7fad2806ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad4c1f4800 0x7fad4c071c20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad4c1514a0 0x7fad4c1f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 --2- 172.21.15.22:0/1138683183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad2c0039e0 0x7fad4c1f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 >> 172.21.15.22:0/1138683183 conn(0x7fad4c062440 msgr2=0x7fad4c15a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 shutdown_connections 2024-04-16T16:17:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:41.890+0000 7fad51e00640 1 -- 172.21.15.22:0/1138683183 wait complete. 2024-04-16T16:17:41.908 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T16:17:41.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:17:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.126+0000 7f91c9400640 1 Processor -- start 2024-04-16T16:17:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.126+0000 7f91c9400640 1 -- start start 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c9400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91c40cc810 0x7f91c406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c9400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91c406ee80 0x7f91c415c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c9400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c406d160 con 0x7f91c406eaa0 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c9400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f91c406cf10 con 0x7f91c40cc810 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c9400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f91c406d440 con 0x7f91c406ee80 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c3400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91c40cc810 0x7f91c406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c3400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91c40cc810 0x7f91c406df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40016/0 (socket says 172.21.15.22:40016) 2024-04-16T16:17:42.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.128+0000 7f91c3400640 1 -- 172.21.15.22:0/2511786308 learned_addr learned my addr 172.21.15.22:0/2511786308 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:42.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.129+0000 7f91c8a00640 1 --2- 172.21.15.22:0/2511786308 >> v2:172.21.15.43:3300/0 conn(0x7f91c406ee80 0x7f91c415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.129+0000 7f91c3400640 1 -- 172.21.15.22:0/2511786308 >> v2:172.21.15.43:3300/0 conn(0x7f91c406ee80 msgr2=0x7f91c415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:42.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.129+0000 7f91c3400640 1 --2- 172.21.15.22:0/2511786308 >> v2:172.21.15.43:3300/0 conn(0x7f91c406ee80 0x7f91c415c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.129+0000 7f91c3400640 1 -- 172.21.15.22:0/2511786308 >> v1:172.21.15.43:6789/0 conn(0x7f91c406eaa0 legacy=0x7f91c40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:42.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.129+0000 7f91c3400640 1 -- 172.21.15.22:0/2511786308 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c406d720 con 0x7f91c40cc810 2024-04-16T16:17:42.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.130+0000 7f91c3400640 1 --2- 172.21.15.22:0/2511786308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c406df00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009870 tx=0x7f91b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8235badfa22ab436 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:42.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.130+0000 7f91c2a00640 1 -- 172.21.15.22:0/2511786308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0035020 con 0x7f91c40cc810 2024-04-16T16:17:42.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.130+0000 7f91c2a00640 1 -- 172.21.15.22:0/2511786308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b0031870 con 0x7f91c40cc810 2024-04-16T16:17:42.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.130+0000 7f91c2a00640 1 -- 172.21.15.22:0/2511786308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0031c40 con 0x7f91c40cc810 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 -- 172.21.15.22:0/2511786308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 msgr2=0x7f91c406df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 --2- 172.21.15.22:0/2511786308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c406df00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009870 tx=0x7f91b002b910 comp rx=0 tx=0).stop 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 -- 172.21.15.22:0/2511786308 shutdown_connections 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 --2- 172.21.15.22:0/2511786308 >> v2:172.21.15.43:3300/0 conn(0x7f91c406ee80 0x7f91c415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 --2- 172.21.15.22:0/2511786308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c406df00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 -- 172.21.15.22:0/2511786308 >> 172.21.15.22:0/2511786308 conn(0x7f91c4062440 msgr2=0x7f91c4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 -- 172.21.15.22:0/2511786308 shutdown_connections 2024-04-16T16:17:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.131+0000 7f91c9400640 1 -- 172.21.15.22:0/2511786308 wait complete. 2024-04-16T16:17:42.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.133+0000 7f91c9400640 1 Processor -- start 2024-04-16T16:17:42.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.133+0000 7f91c9400640 1 -- start start 2024-04-16T16:17:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.134+0000 7f91c9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91c406eaa0 0x7f91c414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c9400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91c406ee80 0x7f91c4072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c4154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c9400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91c415c740 con 0x7f91c40cc810 2024-04-16T16:17:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c9400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91c406e440 con 0x7f91c406eaa0 2024-04-16T16:17:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c9400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91c415c8c0 con 0x7f91c406ee80 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c4154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c4154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40018/0 (socket says 172.21.15.22:40018) 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 -- 172.21.15.22:0/1671970232 learned_addr learned my addr 172.21.15.22:0/1671970232 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c3400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91c406ee80 0x7f91c4072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c3e00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91c406eaa0 0x7f91c414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 -- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91c406ee80 msgr2=0x7f91c4072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91c406ee80 0x7f91c4072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 -- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91c406eaa0 msgr2=0x7f91c414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91c406eaa0 0x7f91c414f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c8a00640 1 -- 172.21.15.22:0/1671970232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c414f950 con 0x7f91c40cc810 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c3400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91c406ee80 0x7f91c4072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.135+0000 7f91c3e00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91c406eaa0 0x7f91c414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.136+0000 7f91c8a00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c4154800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00cd70 tx=0x7f91bc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.136+0000 7f91bbe00640 1 -- 172.21.15.22:0/1671970232 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc003b90 con 0x7f91c40cc810 2024-04-16T16:17:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.136+0000 7f91bbe00640 1 -- 172.21.15.22:0/1671970232 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91bc003d30 con 0x7f91c40cc810 2024-04-16T16:17:42.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.136+0000 7f91bbe00640 1 -- 172.21.15.22:0/1671970232 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc004240 con 0x7f91c40cc810 2024-04-16T16:17:42.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.136+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c4070f80 con 0x7f91c40cc810 2024-04-16T16:17:42.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.136+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c4071540 con 0x7f91c40cc810 2024-04-16T16:17:42.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.137+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c40b4070 con 0x7f91c40cc810 2024-04-16T16:17:42.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.138+0000 7f91bbe00640 1 -- 172.21.15.22:0/1671970232 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91bc0043e0 con 0x7f91c40cc810 2024-04-16T16:17:42.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.139+0000 7f91bbe00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f91a406c920 0x7f91a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.139+0000 7f91bbe00640 1 -- 172.21.15.22:0/1671970232 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f91bc08c720 con 0x7f91c40cc810 2024-04-16T16:17:42.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.140+0000 7f91c3e00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f91a406c920 0x7f91a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.140+0000 7f91c3e00640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f91a406c920 0x7f91a406ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91b4007fd0 tx=0x7f91b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.144+0000 7f91bbe00640 1 -- 172.21.15.22:0/1671970232 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91c40b4070 con 0x7f91c40cc810 2024-04-16T16:17:42.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.379+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91c40d0650 con 0x7f91c40cc810 2024-04-16T16:17:42.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.380+0000 7f91bbe00640 1 -- 172.21.15.22:0/1671970232 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f91bc05aa30 con 0x7f91c40cc810 2024-04-16T16:17:42.379 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:42.379 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:17:42.380 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:17:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.382+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f91a406c920 msgr2=0x7f91a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.382+0000 7f91c9400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f91a406c920 0x7f91a406ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91b4007fd0 tx=0x7f91b4009040 comp rx=0 tx=0).stop 2024-04-16T16:17:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.382+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 msgr2=0x7f91c4154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.382+0000 7f91c9400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c4154800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00cd70 tx=0x7f91bc00a660 comp rx=0 tx=0).stop 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.382+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 shutdown_connections 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.382+0000 7f91c9400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f91a406c920 0x7f91a406ede0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.382+0000 7f91c9400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91c40cc810 0x7f91c4154800 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.383+0000 7f91c9400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91c406ee80 0x7f91c4072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.383+0000 7f91c9400640 1 --2- 172.21.15.22:0/1671970232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91c406eaa0 0x7f91c414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.383+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 >> 172.21.15.22:0/1671970232 conn(0x7f91c4062440 msgr2=0x7f91c40cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.383+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 shutdown_connections 2024-04-16T16:17:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.383+0000 7f91c9400640 1 -- 172.21.15.22:0/1671970232 wait complete. 2024-04-16T16:17:42.399 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:17:42.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.607+0000 7f1948e00640 1 Processor -- start 2024-04-16T16:17:42.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.608+0000 7f1948e00640 1 -- start start 2024-04-16T16:17:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1948e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f194415ea50 0x7f19440ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1948e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19440cf630 0x7f19440cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1948e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19440b9080 con 0x7f19440d2dc0 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1948e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f19440b9c90 con 0x7f194415ea50 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1948e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f19440cffb0 con 0x7f19440cf630 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1943400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f194415ea50 0x7f19440ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1943400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f194415ea50 0x7f19440ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40032/0 (socket says 172.21.15.22:40032) 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.609+0000 7f1943400640 1 -- 172.21.15.22:0/1874067120 learned_addr learned my addr 172.21.15.22:0/1874067120 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.610+0000 7f1943400640 1 -- 172.21.15.22:0/1874067120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19440cf630 msgr2=0x7f19440cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.610+0000 7f1943400640 1 --2- 172.21.15.22:0/1874067120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19440cf630 0x7f19440cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.610+0000 7f1943400640 1 -- 172.21.15.22:0/1874067120 >> v1:172.21.15.43:6789/0 conn(0x7f19440d2dc0 legacy=0x7f19440d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.610+0000 7f1943400640 1 -- 172.21.15.22:0/1874067120 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19440b9360 con 0x7f194415ea50 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.611+0000 7f1943400640 1 --2- 172.21.15.22:0/1874067120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f194415ea50 0x7f19440ba280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19340098a0 tx=0x7f193402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80484530904e20a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.611+0000 7f1942000640 1 -- 172.21.15.22:0/1874067120 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934038070 con 0x7f194415ea50 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.611+0000 7f1942000640 1 -- 172.21.15.22:0/1874067120 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1934031520 con 0x7f194415ea50 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.611+0000 7f1942000640 1 -- 172.21.15.22:0/1874067120 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19340318f0 con 0x7f194415ea50 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 -- 172.21.15.22:0/1874067120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f194415ea50 msgr2=0x7f19440ba280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 --2- 172.21.15.22:0/1874067120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f194415ea50 0x7f19440ba280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19340098a0 tx=0x7f193402b7c0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 -- 172.21.15.22:0/1874067120 shutdown_connections 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 --2- 172.21.15.22:0/1874067120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19440cf630 0x7f19440cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 --2- 172.21.15.22:0/1874067120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f194415ea50 0x7f19440ba280 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 -- 172.21.15.22:0/1874067120 >> 172.21.15.22:0/1874067120 conn(0x7f1944072430 msgr2=0x7f1944072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 -- 172.21.15.22:0/1874067120 shutdown_connections 2024-04-16T16:17:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.612+0000 7f1948e00640 1 -- 172.21.15.22:0/1874067120 wait complete. 2024-04-16T16:17:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.614+0000 7f1948e00640 1 Processor -- start 2024-04-16T16:17:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.614+0000 7f1948e00640 1 -- start start 2024-04-16T16:17:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1948e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19440cf630 0x7f19441f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1948e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19440d2dc0 0x7f19440ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1948e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f194415ea50 0x7f19440c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1948e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f194415ee30 con 0x7f19440cf630 2024-04-16T16:17:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1948e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f19440b9920 con 0x7f19440d2dc0 2024-04-16T16:17:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1948e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f19440ba7c0 con 0x7f194415ea50 2024-04-16T16:17:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19440cf630 0x7f19441f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19440cf630 0x7f19441f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40040/0 (socket says 172.21.15.22:40040) 2024-04-16T16:17:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 -- 172.21.15.22:0/3245937328 learned_addr learned my addr 172.21.15.22:0/3245937328 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 -- 172.21.15.22:0/3245937328 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f194415ea50 msgr2=0x7f19440c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f194415ea50 0x7f19440c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 -- 172.21.15.22:0/3245937328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19440d2dc0 msgr2=0x7f19440ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19440d2dc0 0x7f19440ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.615+0000 7f1943400640 1 -- 172.21.15.22:0/3245937328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1944161b90 con 0x7f19440cf630 2024-04-16T16:17:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.616+0000 7f1943400640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19440cf630 0x7f19441f47d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19340098a0 tx=0x7f19340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.616+0000 7f193b400640 1 -- 172.21.15.22:0/3245937328 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934043070 con 0x7f19440cf630 2024-04-16T16:17:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.616+0000 7f193b400640 1 -- 172.21.15.22:0/3245937328 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193403f890 con 0x7f19440cf630 2024-04-16T16:17:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.616+0000 7f193b400640 1 -- 172.21.15.22:0/3245937328 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934038040 con 0x7f19440cf630 2024-04-16T16:17:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.616+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1944161e70 con 0x7f19440cf630 2024-04-16T16:17:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.616+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19440c99c0 con 0x7f19440cf630 2024-04-16T16:17:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.617+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1944075f30 con 0x7f19440cf630 2024-04-16T16:17:42.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.618+0000 7f193b400640 1 -- 172.21.15.22:0/3245937328 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1934046070 con 0x7f19440cf630 2024-04-16T16:17:42.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.619+0000 7f193b400640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f192006c8f0 0x7f192006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:42.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.619+0000 7f193b400640 1 -- 172.21.15.22:0/3245937328 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f19340ad8a0 con 0x7f19440cf630 2024-04-16T16:17:42.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.619+0000 7f1942a00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f192006c8f0 0x7f192006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:42.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.620+0000 7f1942a00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f192006c8f0 0x7f192006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f194414d670 tx=0x7f192c006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:42.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.624+0000 7f193b400640 1 -- 172.21.15.22:0/3245937328 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f193407bd70 con 0x7f19440cf630 2024-04-16T16:17:42.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.860+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f194415c7b0 con 0x7f19440cf630 2024-04-16T16:17:42.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.861+0000 7f193b400640 1 -- 172.21.15.22:0/3245937328 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f193407b670 con 0x7f19440cf630 2024-04-16T16:17:42.860 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:42.860 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2152396554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2152396554},{"type":"v1","addr":"172.21.15.22:6835","nonce":2152396554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3110365278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3110365278},{"type":"v1","addr":"172.21.15.22:6837","nonce":3110365278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4110476758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4110476758},{"type":"v1","addr":"172.21.15.43:6835","nonce":4110476758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:16:41.978381+0000","modified":"2024-04-16T16:16:45.073330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6833/3889023021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3889023021},{"type":"v1","addr":"172.21.15.43:6833","nonce":3889023021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-16T16:17:42.860 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.863+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f192006c8f0 msgr2=0x7f192006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.863+0000 7f1948e00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f192006c8f0 0x7f192006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f194414d670 tx=0x7f192c006bf0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.863+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19440cf630 msgr2=0x7f19441f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.863+0000 7f1948e00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19440cf630 0x7f19441f47d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19340098a0 tx=0x7f19340046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 shutdown_connections 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f192006c8f0 0x7f192006edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f194415ea50 0x7f19440c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19440d2dc0 0x7f19440ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 --2- 172.21.15.22:0/3245937328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19440cf630 0x7f19441f47d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:42.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 >> 172.21.15.22:0/3245937328 conn(0x7f1944072430 msgr2=0x7f194415ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:42.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 shutdown_connections 2024-04-16T16:17:42.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:42.864+0000 7f1948e00640 1 -- 172.21.15.22:0/3245937328 wait complete. 2024-04-16T16:17:42.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:43.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.099+0000 7f5566e00640 1 Processor -- start 2024-04-16T16:17:43.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.100+0000 7f5566e00640 1 -- start start 2024-04-16T16:17:43.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.101+0000 7f5566e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55601623b0 0x7f55600d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.101+0000 7f5566e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f55600ba4b0 0x7f55600cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.101+0000 7f5566e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55600d28b0 con 0x7f55600cfd10 2024-04-16T16:17:43.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.101+0000 7f5566e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f55600d0150 con 0x7f55601623b0 2024-04-16T16:17:43.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.101+0000 7f5566e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f55600d3660 con 0x7f55600ba4b0 2024-04-16T16:17:43.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.101+0000 7f555fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55601623b0 0x7f55600d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f555fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55601623b0 0x7f55600d2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40048/0 (socket says 172.21.15.22:40048) 2024-04-16T16:17:43.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f5564e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f55600cfd10 0x7f55600b65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46834/0 (socket says 172.21.15.22:46834) 2024-04-16T16:17:43.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f555fe00640 1 -- 172.21.15.22:0/1017049300 learned_addr learned my addr 172.21.15.22:0/1017049300 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:43.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f555f400640 1 --2- 172.21.15.22:0/1017049300 >> v2:172.21.15.43:3300/0 conn(0x7f55600ba4b0 0x7f55600cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f555fe00640 1 -- 172.21.15.22:0/1017049300 >> v2:172.21.15.43:3300/0 conn(0x7f55600ba4b0 msgr2=0x7f55600cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:43.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f555fe00640 1 --2- 172.21.15.22:0/1017049300 >> v2:172.21.15.43:3300/0 conn(0x7f55600ba4b0 0x7f55600cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f555fe00640 1 -- 172.21.15.22:0/1017049300 >> v1:172.21.15.22:6789/0 conn(0x7f55600cfd10 legacy=0x7f55600b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.102+0000 7f555fe00640 1 -- 172.21.15.22:0/1017049300 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55600d3940 con 0x7f55601623b0 2024-04-16T16:17:43.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.103+0000 7f555fe00640 1 --2- 172.21.15.22:0/1017049300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55601623b0 0x7f55600d2fd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f55600d21b0 tx=0x7f555002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5c8dee99631654 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:43.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.103+0000 7f555ea00640 1 -- 172.21.15.22:0/1017049300 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555002cbb0 con 0x7f55601623b0 2024-04-16T16:17:43.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f555ea00640 1 -- 172.21.15.22:0/1017049300 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555002cd50 con 0x7f55601623b0 2024-04-16T16:17:43.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f555ea00640 1 -- 172.21.15.22:0/1017049300 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550034610 con 0x7f55601623b0 2024-04-16T16:17:43.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 -- 172.21.15.22:0/1017049300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55601623b0 msgr2=0x7f55600d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 --2- 172.21.15.22:0/1017049300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55601623b0 0x7f55600d2fd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f55600d21b0 tx=0x7f555002c010 comp rx=0 tx=0).stop 2024-04-16T16:17:43.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 -- 172.21.15.22:0/1017049300 shutdown_connections 2024-04-16T16:17:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 --2- 172.21.15.22:0/1017049300 >> v2:172.21.15.43:3300/0 conn(0x7f55600ba4b0 0x7f55600cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 --2- 172.21.15.22:0/1017049300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55601623b0 0x7f55600d2fd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 -- 172.21.15.22:0/1017049300 >> 172.21.15.22:0/1017049300 conn(0x7f5560072460 msgr2=0x7f5560072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 -- 172.21.15.22:0/1017049300 shutdown_connections 2024-04-16T16:17:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.104+0000 7f5566e00640 1 -- 172.21.15.22:0/1017049300 wait complete. 2024-04-16T16:17:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.106+0000 7f5566e00640 1 Processor -- start 2024-04-16T16:17:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.106+0000 7f5566e00640 1 -- start start 2024-04-16T16:17:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.107+0000 7f5566e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600ba4b0 0x7f556014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.107+0000 7f5566e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55600cfd10 0x7f55600c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.107+0000 7f5566e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55601623b0 0x7f55600d1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.107+0000 7f5566e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f55600d41e0 con 0x7f55600ba4b0 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.107+0000 7f5566e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f55600d3f00 con 0x7f55600cfd10 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.107+0000 7f5566e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f55600d4700 con 0x7f55601623b0 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.107+0000 7f555fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600ba4b0 0x7f556014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600ba4b0 0x7f556014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40062/0 (socket says 172.21.15.22:40062) 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 -- 172.21.15.22:0/936857997 learned_addr learned my addr 172.21.15.22:0/936857997 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555f400640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55600cfd10 0x7f55600c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f5564e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55601623b0 0x7f55600d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 -- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55601623b0 msgr2=0x7f55600d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55601623b0 0x7f55600d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 -- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55600cfd10 msgr2=0x7f55600c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55600cfd10 0x7f55600c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 -- 172.21.15.22:0/936857997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556014e740 con 0x7f55600ba4b0 2024-04-16T16:17:43.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.108+0000 7f555fe00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600ba4b0 0x7f556014e200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5550009f40 tx=0x7f5550004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:43.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.109+0000 7f5557e00640 1 -- 172.21.15.22:0/936857997 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550043020 con 0x7f55600ba4b0 2024-04-16T16:17:43.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.109+0000 7f5557e00640 1 -- 172.21.15.22:0/936857997 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555003e450 con 0x7f55600ba4b0 2024-04-16T16:17:43.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.109+0000 7f5557e00640 1 -- 172.21.15.22:0/936857997 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550009510 con 0x7f55600ba4b0 2024-04-16T16:17:43.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.109+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55600ca890 con 0x7f55600ba4b0 2024-04-16T16:17:43.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.109+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55600cae50 con 0x7f55600ba4b0 2024-04-16T16:17:43.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.110+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556004fd90 con 0x7f55600ba4b0 2024-04-16T16:17:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.111+0000 7f5557e00640 1 -- 172.21.15.22:0/936857997 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5550046020 con 0x7f55600ba4b0 2024-04-16T16:17:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.112+0000 7f5557e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f553c06c8f0 0x7f553c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.112+0000 7f5557e00640 1 -- 172.21.15.22:0/936857997 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f55500ae3e0 con 0x7f55600ba4b0 2024-04-16T16:17:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.113+0000 7f555f400640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f553c06c8f0 0x7f553c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.113+0000 7f555f400640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f553c06c8f0 0x7f553c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5548006fd0 tx=0x7f5548008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:43.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.117+0000 7f5557e00640 1 -- 172.21.15.22:0/936857997 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f555004d030 con 0x7f55600ba4b0 2024-04-16T16:17:43.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.319+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f556006c100 con 0x7f55600ba4b0 2024-04-16T16:17:43.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.322+0000 7f5557e00640 1 -- 172.21.15.22:0/936857997 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16733 (secure 0 0 0) 0x7f556014e740 con 0x7f55600ba4b0 2024-04-16T16:17:43.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:43.322 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:29.459450+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:16:39.969199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T16:16:40.940279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f553c06c8f0 msgr2=0x7f553c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f553c06c8f0 0x7f553c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5548006fd0 tx=0x7f5548008040 comp rx=0 tx=0).stop 2024-04-16T16:17:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600ba4b0 msgr2=0x7f556014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600ba4b0 0x7f556014e200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5550009f40 tx=0x7f5550004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 shutdown_connections 2024-04-16T16:17:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f553c06c8f0 0x7f553c06edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55601623b0 0x7f55600d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55600cfd10 0x7f55600c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 --2- 172.21.15.22:0/936857997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600ba4b0 0x7f556014e200 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 >> 172.21.15.22:0/936857997 conn(0x7f5560072460 msgr2=0x7f55600d5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.325+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 shutdown_connections 2024-04-16T16:17:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.326+0000 7f5566e00640 1 -- 172.21.15.22:0/936857997 wait complete. 2024-04-16T16:17:43.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T16:17:43.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.563+0000 7f87f4e00640 1 Processor -- start 2024-04-16T16:17:43.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.564+0000 7f87f4e00640 1 -- start start 2024-04-16T16:17:43.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.565+0000 7f87f4e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f01620a0 0x7f87f00d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.565+0000 7f87f4e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87f0162480 0x7f87f00d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.565+0000 7f87f4e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f00d37f0 con 0x7f87f00cf420 2024-04-16T16:17:43.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.565+0000 7f87f4e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f87f00d3ad0 con 0x7f87f0162480 2024-04-16T16:17:43.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.565+0000 7f87f4e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f87f00d3db0 con 0x7f87f01620a0 2024-04-16T16:17:43.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ee800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f87f00cf420 0x7f87f00b6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46840/0 (socket says 172.21.15.22:46840) 2024-04-16T16:17:43.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ee800640 1 -- 172.21.15.22:0/839672042 learned_addr learned my addr 172.21.15.22:0/839672042 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:43.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ed400640 1 --2- 172.21.15.22:0/839672042 >> v2:172.21.15.22:3300/0 conn(0x7f87f0162480 0x7f87f00d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ede00640 1 --2- 172.21.15.22:0/839672042 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f01620a0 0x7f87f00d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87eca00640 1 -- 172.21.15.22:0/839672042 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203095054 0 0) 0x7f87f00d37f0 con 0x7f87f00cf420 2024-04-16T16:17:43.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87eca00640 1 -- 172.21.15.22:0/839672042 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87d0003520 con 0x7f87f00cf420 2024-04-16T16:17:43.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ed400640 1 -- 172.21.15.22:0/839672042 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f01620a0 msgr2=0x7f87f00d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:43.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ed400640 1 --2- 172.21.15.22:0/839672042 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f01620a0 0x7f87f00d30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ed400640 1 -- 172.21.15.22:0/839672042 >> v1:172.21.15.22:6789/0 conn(0x7f87f00cf420 legacy=0x7f87f00b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ed400640 1 -- 172.21.15.22:0/839672042 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f00d4090 con 0x7f87f0162480 2024-04-16T16:17:43.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.566+0000 7f87ede00640 1 --2- 172.21.15.22:0/839672042 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f01620a0 0x7f87f00d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:43.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.568+0000 7f87ed400640 1 --2- 172.21.15.22:0/839672042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0162480 0x7f87f00d4b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff6452c8297d183 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:43.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.568+0000 7f87eca00640 1 -- 172.21.15.22:0/839672042 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8039070 con 0x7f87f0162480 2024-04-16T16:17:43.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.568+0000 7f87eca00640 1 -- 172.21.15.22:0/839672042 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d802cc50 con 0x7f87f0162480 2024-04-16T16:17:43.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.568+0000 7f87eca00640 1 -- 172.21.15.22:0/839672042 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8034440 con 0x7f87f0162480 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.568+0000 7f87f4e00640 1 -- 172.21.15.22:0/839672042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0162480 msgr2=0x7f87f00d4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.568+0000 7f87f4e00640 1 --2- 172.21.15.22:0/839672042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0162480 0x7f87f00d4b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d802bea0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.568+0000 7f87f4e00640 1 -- 172.21.15.22:0/839672042 shutdown_connections 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.569+0000 7f87f4e00640 1 --2- 172.21.15.22:0/839672042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0162480 0x7f87f00d4b20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.569+0000 7f87f4e00640 1 --2- 172.21.15.22:0/839672042 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f01620a0 0x7f87f00d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.569+0000 7f87f4e00640 1 -- 172.21.15.22:0/839672042 >> 172.21.15.22:0/839672042 conn(0x7f87f0072490 msgr2=0x7f87f00728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.569+0000 7f87f4e00640 1 -- 172.21.15.22:0/839672042 shutdown_connections 2024-04-16T16:17:43.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.569+0000 7f87f4e00640 1 -- 172.21.15.22:0/839672042 wait complete. 2024-04-16T16:17:43.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.570+0000 7f87f4e00640 1 Processor -- start 2024-04-16T16:17:43.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.570+0000 7f87f4e00640 1 -- start start 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.571+0000 7f87f4e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f00cf420 0x7f87f0160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.571+0000 7f87f4e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f01620a0 0x7f87f00ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.571+0000 7f87f4e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f0162480 0x7f87f00ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.571+0000 7f87f4e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87f00b8eb0 con 0x7f87f01620a0 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.571+0000 7f87f4e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f87f00d4890 con 0x7f87f00cf420 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.571+0000 7f87f4e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f87f00b9030 con 0x7f87f0162480 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f01620a0 0x7f87f00ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f01620a0 0x7f87f00ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40082/0 (socket says 172.21.15.22:40082) 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 -- 172.21.15.22:0/2170466641 learned_addr learned my addr 172.21.15.22:0/2170466641 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ede00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f00cf420 0x7f87f0160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ee800640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f0162480 0x7f87f00ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 -- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f0162480 msgr2=0x7f87f00ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f0162480 0x7f87f00ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 -- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f00cf420 msgr2=0x7f87f0160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f00cf420 0x7f87f0160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ed400640 1 -- 172.21.15.22:0/2170466641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f00ad6b0 con 0x7f87f01620a0 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ee800640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f0162480 0x7f87f00ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.572+0000 7f87ede00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f00cf420 0x7f87f0160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.573+0000 7f87ed400640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f01620a0 0x7f87f00ae9f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.573+0000 7f87e6000640 1 -- 172.21.15.22:0/2170466641 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8039050 con 0x7f87f01620a0 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.573+0000 7f87e6000640 1 -- 172.21.15.22:0/2170466641 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d8045070 con 0x7f87f01620a0 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.573+0000 7f87e6000640 1 -- 172.21.15.22:0/2170466641 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d803e610 con 0x7f87f01620a0 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.573+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f00ad950 con 0x7f87f01620a0 2024-04-16T16:17:43.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.573+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f00adf10 con 0x7f87f01620a0 2024-04-16T16:17:43.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.574+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f004fd90 con 0x7f87f01620a0 2024-04-16T16:17:43.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.575+0000 7f87e6000640 1 -- 172.21.15.22:0/2170466641 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87d803e7b0 con 0x7f87f01620a0 2024-04-16T16:17:43.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.576+0000 7f87e6000640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87cc06c920 0x7f87cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:43.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.576+0000 7f87e6000640 1 -- 172.21.15.22:0/2170466641 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f87d80ae130 con 0x7f87f01620a0 2024-04-16T16:17:43.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.576+0000 7f87ede00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87cc06c920 0x7f87cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:43.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.577+0000 7f87ede00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87cc06c920 0x7f87cc06ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f87e0006fd0 tx=0x7f87e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:43.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.580+0000 7f87e6000640 1 -- 172.21.15.22:0/2170466641 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87d804e020 con 0x7f87f01620a0 2024-04-16T16:17:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.821+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f87f006c170 con 0x7f87f01620a0 2024-04-16T16:17:43.820 INFO:tasks.ceph.mon.a.smithi022.stderr:2024-04-16T16:17:43.822+0000 7f6a16800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T16:17:43.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.826+0000 7f87e6000640 1 -- 172.21.15.22:0/2170466641 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f87d807c4d0 con 0x7f87f01620a0 2024-04-16T16:17:43.825 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.828+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87cc06c920 msgr2=0x7f87cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.828+0000 7f87f4e00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87cc06c920 0x7f87cc06ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f87e0006fd0 tx=0x7f87e0008040 comp rx=0 tx=0).stop 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f01620a0 msgr2=0x7f87f00ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f01620a0 0x7f87f00ae9f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d8004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 shutdown_connections 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87cc06c920 0x7f87cc06ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87f0162480 0x7f87f00ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f01620a0 0x7f87f00ae9f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 --2- 172.21.15.22:0/2170466641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f00cf420 0x7f87f0160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 >> 172.21.15.22:0/2170466641 conn(0x7f87f0072490 msgr2=0x7f87f0161220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 shutdown_connections 2024-04-16T16:17:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:43.829+0000 7f87f4e00640 1 -- 172.21.15.22:0/2170466641 wait complete. 2024-04-16T16:17:43.845 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T16:17:43.866 INFO:tasks.ceph.mds.d.smithi043.stderr: -8496> 2024-04-16T16:16:45.878+0000 7f11ab800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:17:43.956 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-04-16T16:17:44.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.069+0000 7fd20e800640 1 Processor -- start 2024-04-16T16:17:44.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.069+0000 7fd20e800640 1 -- start start 2024-04-16T16:17:44.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.070+0000 7fd20e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd20815eb80 0x7fd2080d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:44.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.070+0000 7fd20e800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2080d3000 con 0x7fd2080d1100 2024-04-16T16:17:44.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.070+0000 7fd20e800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2080d32e0 con 0x7fd2080d40a0 2024-04-16T16:17:44.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.070+0000 7fd20e800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd2080d35c0 con 0x7fd20815eb80 2024-04-16T16:17:44.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.070+0000 7fd20d400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd20815eb80 0x7fd2080d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:44.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.070+0000 7fd20de00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd2080d1100 0x7fd2080b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46856/0 (socket says 172.21.15.22:46856) 2024-04-16T16:17:44.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.070+0000 7fd20de00640 1 -- 172.21.15.22:0/1262357544 learned_addr learned my addr 172.21.15.22:0/1262357544 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:44.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.071+0000 7fd20d400640 1 -- 172.21.15.22:0/1262357544 >> v1:172.21.15.43:6789/0 conn(0x7fd2080d40a0 legacy=0x7fd2080ba250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:44.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.071+0000 7fd20d400640 1 -- 172.21.15.22:0/1262357544 >> v1:172.21.15.22:6789/0 conn(0x7fd2080d1100 legacy=0x7fd2080b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:44.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.071+0000 7fd20d400640 1 -- 172.21.15.22:0/1262357544 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2080d38a0 con 0x7fd20815eb80 2024-04-16T16:17:44.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.072+0000 7fd20d400640 1 --2- 172.21.15.22:0/1262357544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20815eb80 0x7fd2080d2a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097a0 tx=0x7fd1f802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58f68ff5e32e660 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:44.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.073+0000 7fd207e00640 1 -- 172.21.15.22:0/1262357544 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f802f810 con 0x7fd20815eb80 2024-04-16T16:17:44.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.073+0000 7fd207e00640 1 -- 172.21.15.22:0/1262357544 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f802f9b0 con 0x7fd20815eb80 2024-04-16T16:17:44.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.073+0000 7fd207e00640 1 -- 172.21.15.22:0/1262357544 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f802fd80 con 0x7fd20815eb80 2024-04-16T16:17:44.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.074+0000 7fd20e800640 1 -- 172.21.15.22:0/1262357544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20815eb80 msgr2=0x7fd2080d2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:44.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.074+0000 7fd20e800640 1 --2- 172.21.15.22:0/1262357544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20815eb80 0x7fd2080d2a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097a0 tx=0x7fd1f802b9f0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.074+0000 7fd20e800640 1 -- 172.21.15.22:0/1262357544 shutdown_connections 2024-04-16T16:17:44.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.074+0000 7fd20e800640 1 --2- 172.21.15.22:0/1262357544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd20815eb80 0x7fd2080d2a20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.074+0000 7fd20e800640 1 -- 172.21.15.22:0/1262357544 >> 172.21.15.22:0/1262357544 conn(0x7fd208072460 msgr2=0x7fd208072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:44.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.074+0000 7fd20e800640 1 -- 172.21.15.22:0/1262357544 shutdown_connections 2024-04-16T16:17:44.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.074+0000 7fd20e800640 1 -- 172.21.15.22:0/1262357544 wait complete. 2024-04-16T16:17:44.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.076+0000 7fd20e800640 1 Processor -- start 2024-04-16T16:17:44.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.076+0000 7fd20e800640 1 -- start start 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.077+0000 7fd20e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2080d1100 0x7fd2080b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.077+0000 7fd20e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2080d40a0 0x7fd2081f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.077+0000 7fd20e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd20815eb80 0x7fd2080b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.077+0000 7fd20e800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd2080d4530 con 0x7fd2080d40a0 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.077+0000 7fd20e800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd20815ef60 con 0x7fd20815eb80 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.077+0000 7fd20e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd2080b3260 con 0x7fd2080d1100 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.077+0000 7fd20ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2080d40a0 0x7fd2081f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2080d40a0 0x7fd2081f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40094/0 (socket says 172.21.15.22:40094) 2024-04-16T16:17:44.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 -- 172.21.15.22:0/2632426058 learned_addr learned my addr 172.21.15.22:0/2632426058 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20d400640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2080d1100 0x7fd2080b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 -- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2080d1100 msgr2=0x7fd2080b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2080d1100 0x7fd2080b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20de00640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd20815eb80 0x7fd2080b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 -- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd20815eb80 msgr2=0x7fd2080b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd20815eb80 0x7fd2080b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 -- 172.21.15.22:0/2632426058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2080b59f0 con 0x7fd2080d40a0 2024-04-16T16:17:44.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.078+0000 7fd20ca00640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2080d40a0 0x7fd2081f4c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c430 tx=0x7fd1fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.079+0000 7fd205600640 1 -- 172.21.15.22:0/2632426058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0052d0 con 0x7fd2080d40a0 2024-04-16T16:17:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.079+0000 7fd205600640 1 -- 172.21.15.22:0/2632426058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc005490 con 0x7fd2080d40a0 2024-04-16T16:17:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.079+0000 7fd205600640 1 -- 172.21.15.22:0/2632426058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc007260 con 0x7fd2080d40a0 2024-04-16T16:17:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.079+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2080c8380 con 0x7fd2080d40a0 2024-04-16T16:17:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.079+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2080c8940 con 0x7fd2080d40a0 2024-04-16T16:17:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.080+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd208075f30 con 0x7fd2080d40a0 2024-04-16T16:17:44.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.081+0000 7fd205600640 1 -- 172.21.15.22:0/2632426058 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1fc007400 con 0x7fd2080d40a0 2024-04-16T16:17:44.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.082+0000 7fd205600640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd1ec06c8f0 0x7fd1ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:44.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.083+0000 7fd205600640 1 -- 172.21.15.22:0/2632426058 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7fd1fc08b0f0 con 0x7fd2080d40a0 2024-04-16T16:17:44.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.083+0000 7fd20d400640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd1ec06c8f0 0x7fd1ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:44.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.084+0000 7fd20d400640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd1ec06c8f0 0x7fd1ec06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8036000 tx=0x7fd1f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:44.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.087+0000 7fd205600640 1 -- 172.21.15.22:0/2632426058 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd1fc0594e0 con 0x7fd2080d40a0 2024-04-16T16:17:44.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.338+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd20815df30 con 0x7fd2080d40a0 2024-04-16T16:17:44.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.829+0000 7fd205600640 1 -- 172.21.15.22:0/2632426058 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fd1fc058de0 con 0x7fd2080d40a0 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd1ec06c8f0 msgr2=0x7fd1ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd1ec06c8f0 0x7fd1ec06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8036000 tx=0x7fd1f8008030 comp rx=0 tx=0).stop 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2080d40a0 msgr2=0x7fd2081f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2080d40a0 0x7fd2081f4c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c430 tx=0x7fd1fc00c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 shutdown_connections 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd1ec06c8f0 0x7fd1ec06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd20815eb80 0x7fd2080b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2080d40a0 0x7fd2081f4c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 --2- 172.21.15.22:0/2632426058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2080d1100 0x7fd2080b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.833+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 >> 172.21.15.22:0/2632426058 conn(0x7fd208072460 msgr2=0x7fd2080ba120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.834+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 shutdown_connections 2024-04-16T16:17:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:44.834+0000 7fd20e800640 1 -- 172.21.15.22:0/2632426058 wait complete. 2024-04-16T16:17:44.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T16:17:45.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.087+0000 7f612be00640 1 Processor -- start 2024-04-16T16:17:45.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.088+0000 7f612be00640 1 -- start start 2024-04-16T16:17:45.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.089+0000 7f612be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f612c0ccdd0 0x7f612c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.089+0000 7f612be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612c15ccc0 con 0x7f612c072070 2024-04-16T16:17:45.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.089+0000 7f612be00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612c15cf80 con 0x7f612c156cd0 2024-04-16T16:17:45.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.089+0000 7f612be00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f612c0cd7c0 con 0x7f612c0ccdd0 2024-04-16T16:17:45.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f612b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f612c072070 0x7f612c0724a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46860/0 (socket says 172.21.15.22:46860) 2024-04-16T16:17:45.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f612b400640 1 -- 172.21.15.22:0/3285400164 learned_addr learned my addr 172.21.15.22:0/3285400164 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776390855 0 0) 0x7f612c15ccc0 con 0x7f612c072070 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6110003520 con 0x7f612c072070 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f612a000640 1 --2- 172.21.15.22:0/3285400164 >> v2:172.21.15.43:3300/0 conn(0x7f612c0ccdd0 0x7f612c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3903313037 0 0) 0x7f6110003520 con 0x7f612c072070 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 >> v2:172.21.15.43:3300/0 conn(0x7f612c0ccdd0 msgr2=0x7f612c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f6129600640 1 --2- 172.21.15.22:0/3285400164 >> v2:172.21.15.43:3300/0 conn(0x7f612c0ccdd0 0x7f612c0cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 >> v1:172.21.15.43:6789/0 conn(0x7f612c156cd0 legacy=0x7f612c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.090+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c15d260 con 0x7f612c072070 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f6124001670 con 0x7f612c072070 2024-04-16T16:17:45.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 >> v1:172.21.15.22:6789/0 conn(0x7f612c072070 legacy=0x7f612c0724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6110003a00 0x7f6110003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6110005210 0x7f611000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f612c0cd7c0 con 0x7f6110005210 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f611000c160 con 0x7f6110004800 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f611000c360 con 0x7f6110003a00 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f612b400640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6110005210 0x7f611000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f612aa00640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6110003a00 0x7f6110003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f612b400640 1 -- 172.21.15.22:0/3285400164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6110003a00 msgr2=0x7f6110003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f612b400640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6110003a00 0x7f6110003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.091+0000 7f612b400640 1 -- 172.21.15.22:0/3285400164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110004800 msgr2=0x7f6110004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.092+0000 7f612b400640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:45.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.092+0000 7f612b400640 1 -- 172.21.15.22:0/3285400164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6110003520 con 0x7f6110005210 2024-04-16T16:17:45.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.092+0000 7f612b400640 1 -- 172.21.15.22:0/3285400164 reap_dead start 2024-04-16T16:17:45.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.093+0000 7f612b400640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6110005210 0x7f611000b9c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f612400c0e0 tx=0x7f6110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1517bcfe3e93345b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:45.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.093+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124007c20 con 0x7f6110005210 2024-04-16T16:17:45.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.093+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124030070 con 0x7f6110005210 2024-04-16T16:17:45.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.093+0000 7f6129600640 1 -- 172.21.15.22:0/3285400164 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124005d30 con 0x7f6110005210 2024-04-16T16:17:45.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.093+0000 7f612be00640 1 -- 172.21.15.22:0/3285400164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6110005210 msgr2=0x7f611000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.093+0000 7f612be00640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6110005210 0x7f611000b9c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f612400c0e0 tx=0x7f6110005830 comp rx=0 tx=0).stop 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.094+0000 7f612be00640 1 -- 172.21.15.22:0/3285400164 shutdown_connections 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.094+0000 7f612be00640 1 --2- 172.21.15.22:0/3285400164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6110005210 0x7f611000b9c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.094+0000 7f612be00640 1 -- 172.21.15.22:0/3285400164 >> 172.21.15.22:0/3285400164 conn(0x7f612c0b2110 msgr2=0x7f612c0b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.094+0000 7f612be00640 1 -- 172.21.15.22:0/3285400164 shutdown_connections 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.094+0000 7f612be00640 1 -- 172.21.15.22:0/3285400164 wait complete. 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.095+0000 7f612be00640 1 Processor -- start 2024-04-16T16:17:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.096+0000 7f612be00640 1 -- start start 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.096+0000 7f612be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110005210 0x7f612c155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.096+0000 7f612be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c1e73e0 0x7f612c1e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.096+0000 7f612be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f612c158610 0x7f612c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.096+0000 7f612be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f612c1570b0 con 0x7f612c1e73e0 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.096+0000 7f612be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f612c15d820 con 0x7f6110005210 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.096+0000 7f612be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f612c06dbd0 con 0x7f612c158610 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c1e73e0 0x7f612c1e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c1e73e0 0x7f612c1e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40104/0 (socket says 172.21.15.22:40104) 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 -- 172.21.15.22:0/1938709118 learned_addr learned my addr 172.21.15.22:0/1938709118 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 -- 172.21.15.22:0/1938709118 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f612c158610 msgr2=0x7f612c158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f612c158610 0x7f612c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 -- 172.21.15.22:0/1938709118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110005210 msgr2=0x7f612c155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612aa00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110005210 0x7f612c155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110005210 0x7f612c155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.097+0000 7f612a000640 1 -- 172.21.15.22:0/1938709118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c1593e0 con 0x7f612c1e73e0 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.098+0000 7f612a000640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c1e73e0 0x7f612c1e7860 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f611800d830 tx=0x7f611800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.098+0000 7f6123400640 1 -- 172.21.15.22:0/1938709118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118018020 con 0x7f612c1e73e0 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.098+0000 7f6123400640 1 -- 172.21.15.22:0/1938709118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611800b6c0 con 0x7f612c1e73e0 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.098+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612c1596c0 con 0x7f612c1e73e0 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.098+0000 7f6123400640 1 -- 172.21.15.22:0/1938709118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611800ba90 con 0x7f612c1e73e0 2024-04-16T16:17:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.098+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612c159c80 con 0x7f612c1e73e0 2024-04-16T16:17:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.099+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c06f700 con 0x7f612c1e73e0 2024-04-16T16:17:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.100+0000 7f6123400640 1 -- 172.21.15.22:0/1938709118 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f611801b020 con 0x7f612c1e73e0 2024-04-16T16:17:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.101+0000 7f6123400640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f610c06c8f0 0x7f610c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.101+0000 7f6123400640 1 -- 172.21.15.22:0/1938709118 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f611808bf60 con 0x7f612c1e73e0 2024-04-16T16:17:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.101+0000 7f612aa00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f610c06c8f0 0x7f610c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:45.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.102+0000 7f612aa00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f610c06c8f0 0x7f610c06edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f611c001c10 tx=0x7f611c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:45.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.106+0000 7f6123400640 1 -- 172.21.15.22:0/1938709118 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f612c06f700 con 0x7f612c1e73e0 2024-04-16T16:17:45.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:45.311+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f612c075f30 con 0x7f612c1e73e0 2024-04-16T16:17:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.082+0000 7f6123400640 1 -- 172.21.15.22:0/1938709118 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f6118022030 con 0x7f612c1e73e0 2024-04-16T16:17:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-04-16T16:17:46.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.086+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f610c06c8f0 msgr2=0x7f610c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:46.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.086+0000 7f612be00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f610c06c8f0 0x7f610c06edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f611c001c10 tx=0x7f611c009040 comp rx=0 tx=0).stop 2024-04-16T16:17:46.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.086+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c1e73e0 msgr2=0x7f612c1e7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:46.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.086+0000 7f612be00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c1e73e0 0x7f612c1e7860 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f611800d830 tx=0x7f611800dcf0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 shutdown_connections 2024-04-16T16:17:46.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f610c06c8f0 0x7f610c06edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f612c158610 0x7f612c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c1e73e0 0x7f612c1e7860 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 --2- 172.21.15.22:0/1938709118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6110005210 0x7f612c155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 >> 172.21.15.22:0/1938709118 conn(0x7f612c0b2110 msgr2=0x7f612c0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:46.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 shutdown_connections 2024-04-16T16:17:46.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.087+0000 7f612be00640 1 -- 172.21.15.22:0/1938709118 wait complete. 2024-04-16T16:17:46.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T16:17:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.339+0000 7fc5abe00640 1 Processor -- start 2024-04-16T16:17:46.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.340+0000 7fc5abe00640 1 -- start start 2024-04-16T16:17:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.341+0000 7fc5abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b6640 0x7fc5ac0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.341+0000 7fc5abe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5ac0d41b0 0x7fc5ac0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.341+0000 7fc5abe00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5ac0cfee0 con 0x7fc5ac0b3b80 2024-04-16T16:17:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.341+0000 7fc5abe00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc5ac0d3d20 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.341+0000 7fc5abe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ac0d4610 con 0x7fc5ac0b6640 2024-04-16T16:17:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5ab400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5ac0d41b0 0x7fc5ac0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5ab400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5ac0d41b0 0x7fc5ac0b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40120/0 (socket says 172.21.15.22:40120) 2024-04-16T16:17:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5ab400640 1 -- 172.21.15.22:0/3778366002 learned_addr learned my addr 172.21.15.22:0/3778366002 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5aaa00640 1 --2- 172.21.15.22:0/3778366002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b6640 0x7fc5ac0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5ab400640 1 -- 172.21.15.22:0/3778366002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b6640 msgr2=0x7fc5ac0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5ab400640 1 --2- 172.21.15.22:0/3778366002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b6640 0x7fc5ac0cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5ab400640 1 -- 172.21.15.22:0/3778366002 >> v1:172.21.15.43:6789/0 conn(0x7fc5ac0b3b80 legacy=0x7fc5ac0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.342+0000 7fc5ab400640 1 -- 172.21.15.22:0/3778366002 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ac0cfc00 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.344+0000 7fc5ab400640 1 --2- 172.21.15.22:0/3778366002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0b79f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e248a647161a1fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.344+0000 7fc5a9600640 1 -- 172.21.15.22:0/3778366002 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a402cb00 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.344+0000 7fc5a9600640 1 -- 172.21.15.22:0/3778366002 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a402cca0 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.344+0000 7fc5a9600640 1 -- 172.21.15.22:0/3778366002 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4034610 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.344+0000 7fc5abe00640 1 -- 172.21.15.22:0/3778366002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 msgr2=0x7fc5ac0b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.344+0000 7fc5abe00640 1 --2- 172.21.15.22:0/3778366002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0b79f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a402bf60 comp rx=0 tx=0).stop 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.345+0000 7fc5abe00640 1 -- 172.21.15.22:0/3778366002 shutdown_connections 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.345+0000 7fc5abe00640 1 --2- 172.21.15.22:0/3778366002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0b79f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.345+0000 7fc5abe00640 1 --2- 172.21.15.22:0/3778366002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b6640 0x7fc5ac0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.345+0000 7fc5abe00640 1 -- 172.21.15.22:0/3778366002 >> 172.21.15.22:0/3778366002 conn(0x7fc5ac062620 msgr2=0x7fc5ac062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.345+0000 7fc5abe00640 1 -- 172.21.15.22:0/3778366002 shutdown_connections 2024-04-16T16:17:46.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.345+0000 7fc5abe00640 1 -- 172.21.15.22:0/3778366002 wait complete. 2024-04-16T16:17:46.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.346+0000 7fc5abe00640 1 Processor -- start 2024-04-16T16:17:46.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.347+0000 7fc5abe00640 1 -- start start 2024-04-16T16:17:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b3b80 0x7fc5ac0b9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5abe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5ac0b6640 0x7fc5ac1f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5abe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5abe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ac0cf890 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5abe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ac0d39b0 con 0x7fc5ac0b6640 2024-04-16T16:17:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5abe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ac0b7f30 con 0x7fc5ac0b3b80 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40132/0 (socket says 172.21.15.22:40132) 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 -- 172.21.15.22:0/2196300908 learned_addr learned my addr 172.21.15.22:0/2196300908 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5aa000640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5ac0b6640 0x7fc5ac1f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 -- 172.21.15.22:0/2196300908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b3b80 msgr2=0x7fc5ac0b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b3b80 0x7fc5ac0b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 -- 172.21.15.22:0/2196300908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5ac0b6640 msgr2=0x7fc5ac1f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5ac0b6640 0x7fc5ac1f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.348+0000 7fc5ab400640 1 -- 172.21.15.22:0/2196300908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ac1f4e60 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.349+0000 7fc5ab400640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0cbc10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4036040 tx=0x7fc5a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.349+0000 7fc5a2a00640 1 -- 172.21.15.22:0/2196300908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4043020 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.349+0000 7fc5a2a00640 1 -- 172.21.15.22:0/2196300908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a402ce50 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.349+0000 7fc5a2a00640 1 -- 172.21.15.22:0/2196300908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4009510 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.349+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ac0cc150 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.350+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ac1f53d0 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.351+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5ac075f30 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.352+0000 7fc5a2a00640 1 -- 172.21.15.22:0/2196300908 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5a4005d10 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.353+0000 7fc5a2a00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc58c06c8f0 0x7fc58c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.353+0000 7fc5a2a00640 1 -- 172.21.15.22:0/2196300908 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5473+0+0 (secure 0 0 0) 0x7fc5a40ae490 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.353+0000 7fc5aaa00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc58c06c8f0 0x7fc58c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.354+0000 7fc5aaa00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc58c06c8f0 0x7fc58c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0098f0 tx=0x7fc59c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:46.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.357+0000 7fc5a2a00640 1 -- 172.21.15.22:0/2196300908 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5a407c900 con 0x7fc5ac0d41b0 2024-04-16T16:17:46.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:46.568+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc5ac0cf670 con 0x7fc5ac0d41b0 2024-04-16T16:17:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.095+0000 7fc5a2a00640 1 -- 172.21.15.22:0/2196300908 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fc5a40ace20 con 0x7fc5ac0d41b0 2024-04-16T16:17:47.095 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-04-16T16:17:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc58c06c8f0 msgr2=0x7fc58c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc58c06c8f0 0x7fc58c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0098f0 tx=0x7fc59c008040 comp rx=0 tx=0).stop 2024-04-16T16:17:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 msgr2=0x7fc5ac0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0cbc10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4036040 tx=0x7fc5a4004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 shutdown_connections 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc58c06c8f0 0x7fc58c06edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5ac0d41b0 0x7fc5ac0cbc10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5ac0b6640 0x7fc5ac1f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 --2- 172.21.15.22:0/2196300908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5ac0b3b80 0x7fc5ac0b9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 >> 172.21.15.22:0/2196300908 conn(0x7fc5ac062620 msgr2=0x7fc5ac0d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 shutdown_connections 2024-04-16T16:17:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.099+0000 7fc5abe00640 1 -- 172.21.15.22:0/2196300908 wait complete. 2024-04-16T16:17:47.130 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T16:17:47.130 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T16:17:47.131 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T16:17:47.131 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:17:47.131 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T16:17:47.131 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-16T16:17:47.131 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T16:17:47.131 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:17:47.132 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T16:17:47.132 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T16:17:47.132 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T16:17:47.132 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:17:47.132 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T16:17:47.133 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-16T16:17:47.133 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T16:17:47.133 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:17:47.152 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T16:17:47.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T16:17:47.153 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T16:17:47.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T16:17:47.154 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T16:17:47.154 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T16:17:47.155 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T16:17:47.155 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T16:17:47.198 INFO:tasks.ceph.mds.c:Started 2024-04-16T16:17:47.198 DEBUG:teuthology.parallel:result is None 2024-04-16T16:17:47.201 INFO:tasks.ceph.mds.b:Started 2024-04-16T16:17:47.201 DEBUG:teuthology.parallel:result is None 2024-04-16T16:17:47.202 INFO:tasks.ceph.mds.a:Started 2024-04-16T16:17:47.202 DEBUG:teuthology.parallel:result is None 2024-04-16T16:17:47.207 INFO:tasks.ceph.mds.d:Started 2024-04-16T16:17:47.207 DEBUG:teuthology.parallel:result is None 2024-04-16T16:17:47.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T16:17:47.358 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2024-04-16T16:17:47.358 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2024-04-16T16:17:47.364 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-04-16T16:17:47.365 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-04-16T16:17:47.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.403+0000 7f5332000640 1 Processor -- start 2024-04-16T16:17:47.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.403+0000 7f5332000640 1 -- start start 2024-04-16T16:17:47.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.404+0000 7f5332000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c15c990 0x7f532c0728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.404+0000 7f5332000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f532c072df0 0x7f532c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.404+0000 7f5332000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f532c0d09f0 0x7f532c071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f5332000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f532c073250 con 0x7f532c0d09f0 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f5332000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f532c161540 con 0x7f532c072df0 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f5332000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f532c0afd80 con 0x7f532c15c990 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f532c0d09f0 0x7f532c071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f532c0d09f0 0x7f532c071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40164/0 (socket says 172.21.15.22:40164) 2024-04-16T16:17:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 -- 172.21.15.22:0/3398865452 learned_addr learned my addr 172.21.15.22:0/3398865452 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f5323e00640 1 --2- 172.21.15.22:0/3398865452 >> v2:172.21.15.43:3300/0 conn(0x7f532c072df0 0x7f532c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532b400640 1 --2- 172.21.15.22:0/3398865452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c15c990 0x7f532c0728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 -- 172.21.15.22:0/3398865452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c15c990 msgr2=0x7f532c0728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 --2- 172.21.15.22:0/3398865452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c15c990 0x7f532c0728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 -- 172.21.15.22:0/3398865452 >> v2:172.21.15.43:3300/0 conn(0x7f532c072df0 msgr2=0x7f532c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 --2- 172.21.15.22:0/3398865452 >> v2:172.21.15.43:3300/0 conn(0x7f532c072df0 0x7f532c0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f532be00640 1 -- 172.21.15.22:0/3398865452 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c160780 con 0x7f532c0d09f0 2024-04-16T16:17:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.405+0000 7f5323e00640 1 --2- 172.21.15.22:0/3398865452 >> v2:172.21.15.43:3300/0 conn(0x7f532c072df0 0x7f532c0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:17:47.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.407+0000 7f532be00640 1 --2- 172.21.15.22:0/3398865452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c0d09f0 0x7f532c071120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f532c063420 tx=0x7f532402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4114f0d2074a5c0f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.407+0000 7f532aa00640 1 -- 172.21.15.22:0/3398865452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532402ca70 con 0x7f532c0d09f0 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.407+0000 7f532aa00640 1 -- 172.21.15.22:0/3398865452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532402cc10 con 0x7f532c0d09f0 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.407+0000 7f532aa00640 1 -- 172.21.15.22:0/3398865452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240343f0 con 0x7f532c0d09f0 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.407+0000 7f5332000640 1 -- 172.21.15.22:0/3398865452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c0d09f0 msgr2=0x7f532c071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.407+0000 7f5332000640 1 --2- 172.21.15.22:0/3398865452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c0d09f0 0x7f532c071120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f532c063420 tx=0x7f532402bed0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.408+0000 7f5332000640 1 -- 172.21.15.22:0/3398865452 shutdown_connections 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.408+0000 7f5332000640 1 --2- 172.21.15.22:0/3398865452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c0d09f0 0x7f532c071120 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.408+0000 7f5332000640 1 --2- 172.21.15.22:0/3398865452 >> v2:172.21.15.43:3300/0 conn(0x7f532c072df0 0x7f532c0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.408+0000 7f5332000640 1 --2- 172.21.15.22:0/3398865452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c15c990 0x7f532c0728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.408+0000 7f5332000640 1 -- 172.21.15.22:0/3398865452 >> 172.21.15.22:0/3398865452 conn(0x7f532c062440 msgr2=0x7f532c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.408+0000 7f5332000640 1 -- 172.21.15.22:0/3398865452 shutdown_connections 2024-04-16T16:17:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.408+0000 7f5332000640 1 -- 172.21.15.22:0/3398865452 wait complete. 2024-04-16T16:17:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.409+0000 7f5332000640 1 Processor -- start 2024-04-16T16:17:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.410+0000 7f5332000640 1 -- start start 2024-04-16T16:17:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.410+0000 7f5332000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c072df0 0x7f532c150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f5332000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0d09f0 0x7f532c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f5332000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c15c990 0x7f532c06e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f5332000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f532c161020 con 0x7f532c15c990 2024-04-16T16:17:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f5332000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f532c160d40 con 0x7f532c0d09f0 2024-04-16T16:17:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f5332000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f532c15cd70 con 0x7f532c072df0 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c15c990 0x7f532c06e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c15c990 0x7f532c06e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40176/0 (socket says 172.21.15.22:40176) 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 -- 172.21.15.22:0/1480069958 learned_addr learned my addr 172.21.15.22:0/1480069958 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f5323e00640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0d09f0 0x7f532c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532b400640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c072df0 0x7f532c150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 -- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c072df0 msgr2=0x7f532c150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c072df0 0x7f532c150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 -- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0d09f0 msgr2=0x7f532c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0d09f0 0x7f532c15e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532be00640 1 -- 172.21.15.22:0/1480069958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c15d160 con 0x7f532c15c990 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f5323e00640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0d09f0 0x7f532c15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.411+0000 7f532b400640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c072df0 0x7f532c150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.412+0000 7f532be00640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c15c990 0x7f532c06e5e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5324009e50 tx=0x7f5324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.412+0000 7f5323400640 1 -- 172.21.15.22:0/1480069958 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324043020 con 0x7f532c15c990 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.412+0000 7f5323400640 1 -- 172.21.15.22:0/1480069958 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532403e450 con 0x7f532c15c990 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.412+0000 7f5323400640 1 -- 172.21.15.22:0/1480069958 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324009510 con 0x7f532c15c990 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.412+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c15d440 con 0x7f532c15c990 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.412+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c15da00 con 0x7f532c15c990 2024-04-16T16:17:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.413+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532c0cd670 con 0x7f532c15c990 2024-04-16T16:17:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.414+0000 7f5323400640 1 -- 172.21.15.22:0/1480069958 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5324005d10 con 0x7f532c15c990 2024-04-16T16:17:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.415+0000 7f5323400640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f530806c8f0 0x7f530806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.415+0000 7f5323400640 1 -- 172.21.15.22:0/1480069958 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f53240ae270 con 0x7f532c15c990 2024-04-16T16:17:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.416+0000 7f532b400640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f530806c8f0 0x7f530806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.416+0000 7f532b400640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f530806c8f0 0x7f530806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f531c009af0 tx=0x7f531c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:47.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.420+0000 7f5323400640 1 -- 172.21.15.22:0/1480069958 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f532c0cd670 con 0x7f532c15c990 2024-04-16T16:17:47.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:47.636+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f532c04fd90 con 0x7f532c15c990 2024-04-16T16:17:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.119+0000 7f5323400640 1 -- 172.21.15.22:0/1480069958 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f53240ace20 con 0x7f532c15c990 2024-04-16T16:17:48.118 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2024-04-16T16:17:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f530806c8f0 msgr2=0x7f530806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f530806c8f0 0x7f530806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f531c009af0 tx=0x7f531c008040 comp rx=0 tx=0).stop 2024-04-16T16:17:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c15c990 msgr2=0x7f532c06e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c15c990 0x7f532c06e5e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5324009e50 tx=0x7f5324004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 shutdown_connections 2024-04-16T16:17:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f530806c8f0 0x7f530806edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f532c15c990 0x7f532c06e5e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0d09f0 0x7f532c15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 --2- 172.21.15.22:0/1480069958 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f532c072df0 0x7f532c150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.122+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 >> 172.21.15.22:0/1480069958 conn(0x7f532c062440 msgr2=0x7f532c071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.123+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 shutdown_connections 2024-04-16T16:17:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.123+0000 7f5332000640 1 -- 172.21.15.22:0/1480069958 wait complete. 2024-04-16T16:17:48.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T16:17:48.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.352+0000 7fa9d1e00640 1 Processor -- start 2024-04-16T16:17:48.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.352+0000 7fa9d1e00640 1 -- start start 2024-04-16T16:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.354+0000 7fa9d1e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9cc06e860 0x7fa9cc1667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.354+0000 7fa9d1e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9cc0afdc0 con 0x7fa9cc15cb70 2024-04-16T16:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.354+0000 7fa9d1e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9cc0b47f0 con 0x7fa9cc15b7e0 2024-04-16T16:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.354+0000 7fa9d1e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc0b45c0 con 0x7fa9cc06e860 2024-04-16T16:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.354+0000 7fa9ca000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa9cc15cb70 0x7fa9cc06e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46890/0 (socket says 172.21.15.22:46890) 2024-04-16T16:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.354+0000 7fa9ca000640 1 -- 172.21.15.22:0/774209499 learned_addr learned my addr 172.21.15.22:0/774209499 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.354+0000 7fa9cb400640 1 --2- 172.21.15.22:0/774209499 >> v2:172.21.15.22:3300/0 conn(0x7fa9cc06e860 0x7fa9cc1667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.355+0000 7fa9c9600640 1 -- 172.21.15.22:0/774209499 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342390332 0 0) 0x7fa9cc0afdc0 con 0x7fa9cc15cb70 2024-04-16T16:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.355+0000 7fa9c9600640 1 -- 172.21.15.22:0/774209499 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9b0005730 con 0x7fa9cc15cb70 2024-04-16T16:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.355+0000 7fa9cb400640 1 -- 172.21.15.22:0/774209499 >> v1:172.21.15.43:6789/0 conn(0x7fa9cc15b7e0 legacy=0x7fa9cc0af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.355+0000 7fa9cb400640 1 -- 172.21.15.22:0/774209499 >> v1:172.21.15.22:6789/0 conn(0x7fa9cc15cb70 legacy=0x7fa9cc06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.355+0000 7fa9cb400640 1 -- 172.21.15.22:0/774209499 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc0b4ad0 con 0x7fa9cc06e860 2024-04-16T16:17:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.356+0000 7fa9cb400640 1 --2- 172.21.15.22:0/774209499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc1667d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009d90 tx=0x7fa9c402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee93724bea1fb4d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.356+0000 7fa9c9600640 1 -- 172.21.15.22:0/774209499 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4039070 con 0x7fa9cc06e860 2024-04-16T16:17:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.356+0000 7fa9c9600640 1 -- 172.21.15.22:0/774209499 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c402cbd0 con 0x7fa9cc06e860 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.356+0000 7fa9c9600640 1 -- 172.21.15.22:0/774209499 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4034440 con 0x7fa9cc06e860 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.357+0000 7fa9d1e00640 1 -- 172.21.15.22:0/774209499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 msgr2=0x7fa9cc1667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.357+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/774209499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc1667d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009d90 tx=0x7fa9c402be20 comp rx=0 tx=0).stop 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.357+0000 7fa9d1e00640 1 -- 172.21.15.22:0/774209499 shutdown_connections 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.357+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/774209499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc1667d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.357+0000 7fa9d1e00640 1 -- 172.21.15.22:0/774209499 >> 172.21.15.22:0/774209499 conn(0x7fa9cc062440 msgr2=0x7fa9cc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.357+0000 7fa9d1e00640 1 -- 172.21.15.22:0/774209499 shutdown_connections 2024-04-16T16:17:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.357+0000 7fa9d1e00640 1 -- 172.21.15.22:0/774209499 wait complete. 2024-04-16T16:17:48.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.359+0000 7fa9d1e00640 1 Processor -- start 2024-04-16T16:17:48.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.359+0000 7fa9d1e00640 1 -- start start 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9d1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9d1e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9cc15b7e0 0x7fa9cc0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9d1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9cc15cb70 0x7fa9cc153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9d1e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc15bbc0 con 0x7fa9cc06e860 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9d1e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc0b5090 con 0x7fa9cc15cb70 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9d1e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc15bd40 con 0x7fa9cc15b7e0 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9caa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9caa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc13ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40184/0 (socket says 172.21.15.22:40184) 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.360+0000 7fa9caa00640 1 -- 172.21.15.22:0/772827285 learned_addr learned my addr 172.21.15.22:0/772827285 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9cb400640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9cc15cb70 0x7fa9cc153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9caa00640 1 -- 172.21.15.22:0/772827285 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9cc15b7e0 msgr2=0x7fa9cc0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9caa00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9cc15b7e0 0x7fa9cc0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9caa00640 1 -- 172.21.15.22:0/772827285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9cc15cb70 msgr2=0x7fa9cc153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9caa00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9cc15cb70 0x7fa9cc153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9caa00640 1 -- 172.21.15.22:0/772827285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc0d0920 con 0x7fa9cc06e860 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9caa00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc13ef10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c430 tx=0x7fa9bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9c3400640 1 -- 172.21.15.22:0/772827285 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc011790 con 0x7fa9cc06e860 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9c3400640 1 -- 172.21.15.22:0/772827285 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc017070 con 0x7fa9cc06e860 2024-04-16T16:17:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc0cf600 con 0x7fa9cc06e860 2024-04-16T16:17:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.361+0000 7fa9c3400640 1 -- 172.21.15.22:0/772827285 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc011b70 con 0x7fa9cc06e860 2024-04-16T16:17:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.362+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc0cfb60 con 0x7fa9cc06e860 2024-04-16T16:17:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.363+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9cc04fd90 con 0x7fa9cc06e860 2024-04-16T16:17:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.364+0000 7fa9c3400640 1 -- 172.21.15.22:0/772827285 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9bc011d10 con 0x7fa9cc06e860 2024-04-16T16:17:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.365+0000 7fa9c3400640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa9ac06c8f0 0x7fa9ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.365+0000 7fa9c3400640 1 -- 172.21.15.22:0/772827285 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fa9bc08b6b0 con 0x7fa9cc06e860 2024-04-16T16:17:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.365+0000 7fa9ca000640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa9ac06c8f0 0x7fa9ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.366+0000 7fa9ca000640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa9ac06c8f0 0x7fa9ac06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8000f60 tx=0x7fa9b80078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:48.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.370+0000 7fa9c3400640 1 -- 172.21.15.22:0/772827285 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa9cc0cf600 con 0x7fa9cc06e860 2024-04-16T16:17:48.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.649+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa9cc0b00e0 con 0x7fa9cc06e860 2024-04-16T16:17:48.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.651+0000 7fa9c3400640 1 -- 172.21.15.22:0/772827285 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7fa9bc059e20 con 0x7fa9cc06e860 2024-04-16T16:17:48.650 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:48.650 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5maPz2BxAAivyrcX8Q0RVwbHZKA4d4Qw==", 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:17:48.651 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5mWRiSKhAANQmBIwdBnXhI5EGtK2c86g==", 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:17:48.652 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5mqenxGBAAjtp8wD4KQJxzHvXwFiGhOw==", 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:17:48.653 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mjhgTARAAGaEgDRX6W3PVFW0MCREAlg==", 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.654 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAvpB5mOTo2JxAAv8ODGhoblmotI4MCQe6yFg==", 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.655 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAypB5m+sawMxAAnAne7tM6gWBZtKrFrv53WA==", 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.656 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA2pB5mr/n9BRAA8Cg5a95OxPY//SZrLgt5iQ==", 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.657 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA5pB5mzNRPFBAArNK/lgB2DkkAP/cZ8uD+Vg==", 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.658 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA+pB5mW52mERAAub8dzTaWbs/HB3ZLiwua+Q==", 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBBpB5mXWImHRAAWuZAlqR/+YQikJD4n34FUQ==", 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.660 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBEpB5mgBf6KhAAqcT5kTzdBSoQR6+MdHRIBA==", 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.661 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBIpB5mhwmwCxAA33jQ9ARJ1dCc0D2CjzyaZA==", 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw==", 2024-04-16T16:17:48.662 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mnxe/JxAAbmM9S9qN7oeLgRvCGkAxMA==", 2024-04-16T16:17:48.663 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mfNS0GxAAeD6JDkePBk6Zlda+ku47+g==", 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.664 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mumHtMhAA4utGeU4f5JWOEHCvpo3Onw==", 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.665 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAqpB5moKzeMxAAQT7umjghe+/+tmNzbOi7ZQ==", 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.666 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mds", 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWpB5m3GucHBAACNoruHRiKrnlRsEQYjhwtw==", 2024-04-16T16:17:48.667 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mds" 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mgr", 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWpB5mlomcHBAAoDkxJpx5ULUlbuBUh/kGKA==", 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-16T16:17:48.668 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-osd", 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWpB5mm6ScHBAADE85HY8OELd23CTr60ahVA==", 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-osd" 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd", 2024-04-16T16:17:48.669 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWpB5mhL6cHBAA3vg5g4cfjQ0XphnNGNJpTw==", 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWpB5mBN6cHBAAEflQ7EbdS6Pe6cgfU7qUMw==", 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.670 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rgw", 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWpB5m8vmcHBAAAJBe+rn66XIveuGCoBteLg==", 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.671 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQArpB5mApKSNhAAAgDOhVl6JdS2WqfiNmMpQQ==", 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQArpB5mcdOSKRAAF92yoRpysHC1g6FsLdqIYw==", 2024-04-16T16:17:48.672 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:17:48.673 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:17:48.673 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2024-04-16T16:17:48.673 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:17:48.673 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.673 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:48.673 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-16T16:17:48.673 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:17:48.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa9ac06c8f0 msgr2=0x7fa9ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa9ac06c8f0 0x7fa9ac06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8000f60 tx=0x7fa9b80078f0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 msgr2=0x7fa9cc13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc13ef10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c430 tx=0x7fa9bc00c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 shutdown_connections 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa9ac06c8f0 0x7fa9ac06edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9cc15cb70 0x7fa9cc153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9cc15b7e0 0x7fa9cc0cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 --2- 172.21.15.22:0/772827285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9cc06e860 0x7fa9cc13ef10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 >> 172.21.15.22:0/772827285 conn(0x7fa9cc062440 msgr2=0x7fa9cc071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:48.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 shutdown_connections 2024-04-16T16:17:48.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.654+0000 7fa9d1e00640 1 -- 172.21.15.22:0/772827285 wait complete. 2024-04-16T16:17:48.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-16T16:17:48.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.900+0000 7f3333200640 1 Processor -- start 2024-04-16T16:17:48.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.900+0000 7f3333200640 1 -- start start 2024-04-16T16:17:48.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.901+0000 7f3333200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 0x7f332c0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.901+0000 7f3333200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c0d4650 con 0x7f332c0d2de0 2024-04-16T16:17:48.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.902+0000 7f3333200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c15ef10 con 0x7f332c15eb30 2024-04-16T16:17:48.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.902+0000 7f3333200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f332c0d35b0 con 0x7f332c0d1940 2024-04-16T16:17:48.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.902+0000 7f3332800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f332c0d2de0 0x7f332c0b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46904/0 (socket says 172.21.15.22:46904) 2024-04-16T16:17:48.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.902+0000 7f3332800640 1 -- 172.21.15.22:0/2035417331 learned_addr learned my addr 172.21.15.22:0/2035417331 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:48.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.902+0000 7f3331400640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 0x7f332c0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.902+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544812922 0 0) 0x7f332c0d4650 con 0x7f332c0d2de0 2024-04-16T16:17:48.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.902+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3314003520 con 0x7f332c0d2de0 2024-04-16T16:17:48.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2262041893 0 0) 0x7f3314003520 con 0x7f332c0d2de0 2024-04-16T16:17:48.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 msgr2=0x7f332c0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:48.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 0x7f332c0d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 >> v1:172.21.15.43:6789/0 conn(0x7f332c15eb30 legacy=0x7f332c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c0d3890 con 0x7f332c0d2de0 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f33280019f0 con 0x7f332c0d2de0 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 >> v1:172.21.15.22:6789/0 conn(0x7f332c0d2de0 legacy=0x7f332c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3314003a50 0x7f3314003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3314004800 0x7f3314004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 0x7f3314005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0d35b0 con 0x7f3314004800 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f331400bb80 con 0x7f3314003a50 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f331400bd80 con 0x7f332c0d1940 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.903+0000 7f3331400640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3314004800 0x7f3314004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.904+0000 7f3331e00640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3314003a50 0x7f3314003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.904+0000 7f3332800640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 0x7f3314005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.904+0000 7f3331400640 1 -- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 msgr2=0x7f3314005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.904+0000 7f3331400640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c0d1940 0x7f3314005270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.904+0000 7f3331400640 1 -- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3314003a50 msgr2=0x7f3314003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.904+0000 7f3331400640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3314003a50 0x7f3314003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.904+0000 7f3331400640 1 -- 172.21.15.22:0/2035417331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3314003520 con 0x7f3314004800 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.905+0000 7f3331400640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3314004800 0x7f3314004c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f331c00ba10 tx=0x7f3314005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea158fe832e3134f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.905+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c036020 con 0x7f3314004800 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.905+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331c032630 con 0x7f3314004800 2024-04-16T16:17:48.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.905+0000 7f3330a00640 1 -- 172.21.15.22:0/2035417331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c00b610 con 0x7f3314004800 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.906+0000 7f3333200640 1 -- 172.21.15.22:0/2035417331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3314004800 msgr2=0x7f3314004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.906+0000 7f3333200640 1 --2- 172.21.15.22:0/2035417331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3314004800 0x7f3314004c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f331c00ba10 tx=0x7f3314005830 comp rx=0 tx=0).stop 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.906+0000 7f3332800640 1 -- 172.21.15.22:0/2035417331 reap_dead start 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.906+0000 7f3333200640 1 -- 172.21.15.22:0/2035417331 shutdown_connections 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.906+0000 7f3333200640 1 -- 172.21.15.22:0/2035417331 >> 172.21.15.22:0/2035417331 conn(0x7f332c072670 msgr2=0x7f332c062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.906+0000 7f3333200640 1 -- 172.21.15.22:0/2035417331 shutdown_connections 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.906+0000 7f3333200640 1 -- 172.21.15.22:0/2035417331 wait complete. 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.908+0000 7f3333200640 1 Processor -- start 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.908+0000 7f3333200640 1 -- start start 2024-04-16T16:17:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3333200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c1408a0 0x7f332c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3333200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c140c80 0x7f332c144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3333200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0cdd00 0x7f332c0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3333200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0d4130 con 0x7f332c0cdd00 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3333200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0d3e50 con 0x7f332c1408a0 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3333200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f332c0d3290 con 0x7f332c140c80 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3332800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0cdd00 0x7f332c0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3332800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0cdd00 0x7f332c0ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40198/0 (socket says 172.21.15.22:40198) 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.909+0000 7f3332800640 1 -- 172.21.15.22:0/4133462839 learned_addr learned my addr 172.21.15.22:0/4133462839 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3331e00640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c1408a0 0x7f332c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3332800640 1 -- 172.21.15.22:0/4133462839 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c140c80 msgr2=0x7f332c144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3332800640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c140c80 0x7f332c144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3332800640 1 -- 172.21.15.22:0/4133462839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c1408a0 msgr2=0x7f332c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3332800640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c1408a0 0x7f332c0b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3332800640 1 -- 172.21.15.22:0/4133462839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c0b6760 con 0x7f332c0cdd00 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3332800640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0cdd00 0x7f332c0ce180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f332c072f20 tx=0x7f332800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3326000640 1 -- 172.21.15.22:0/4133462839 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328019070 con 0x7f332c0cdd00 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3326000640 1 -- 172.21.15.22:0/4133462839 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332800bd20 con 0x7f332c0cdd00 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c0b6a40 con 0x7f332c0cdd00 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.910+0000 7f3326000640 1 -- 172.21.15.22:0/4133462839 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33280125d0 con 0x7f332c0cdd00 2024-04-16T16:17:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.911+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c0b7000 con 0x7f332c0cdd00 2024-04-16T16:17:48.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.912+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332c161ec0 con 0x7f332c0cdd00 2024-04-16T16:17:48.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.913+0000 7f3326000640 1 -- 172.21.15.22:0/4133462839 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3328012770 con 0x7f332c0cdd00 2024-04-16T16:17:48.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.914+0000 7f3326000640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f331006c920 0x7f331006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:48.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.914+0000 7f3326000640 1 -- 172.21.15.22:0/4133462839 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f332808b6f0 con 0x7f332c0cdd00 2024-04-16T16:17:48.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.914+0000 7f3331e00640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f331006c920 0x7f331006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:48.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.915+0000 7f3331e00640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f331006c920 0x7f331006ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3320007fd0 tx=0x7f3320009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:48.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:48.919+0000 7f3326000640 1 -- 172.21.15.22:0/4133462839 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f332c161ec0 con 0x7f332c0cdd00 2024-04-16T16:17:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.214+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f332c075f30 con 0x7f332c0cdd00 2024-04-16T16:17:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.220+0000 7f3326000640 1 -- 172.21.15.22:0/4133462839 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f3328059820 con 0x7f332c0cdd00 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f331006c920 msgr2=0x7f331006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f331006c920 0x7f331006ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3320007fd0 tx=0x7f3320009040 comp rx=0 tx=0).stop 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0cdd00 msgr2=0x7f332c0ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0cdd00 0x7f332c0ce180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f332c072f20 tx=0x7f332800b4a0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 shutdown_connections 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f331006c920 0x7f331006ede0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f332c0cdd00 0x7f332c0ce180 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f332c140c80 0x7f332c144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 --2- 172.21.15.22:0/4133462839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c1408a0 0x7f332c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 >> 172.21.15.22:0/4133462839 conn(0x7f332c072670 msgr2=0x7f332c160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 shutdown_connections 2024-04-16T16:17:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.224+0000 7f3333200640 1 -- 172.21.15.22:0/4133462839 wait complete. 2024-04-16T16:17:49.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-16T16:17:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.467+0000 7f7775600640 1 Processor -- start 2024-04-16T16:17:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.467+0000 7f7775600640 1 -- start start 2024-04-16T16:17:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f7775600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f777015c990 0x7f77700728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f7775600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77700d0bc0 0x7f77700b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f7775600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7770161540 con 0x7f7770072df0 2024-04-16T16:17:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f7775600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f77700afd80 con 0x7f777015c990 2024-04-16T16:17:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f7775600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7770160780 con 0x7f77700d0bc0 2024-04-16T16:17:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f776ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f777015c990 0x7f77700728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f776ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f777015c990 0x7f77700728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40206/0 (socket says 172.21.15.22:40206) 2024-04-16T16:17:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.469+0000 7f776ea00640 1 -- 172.21.15.22:0/647489127 learned_addr learned my addr 172.21.15.22:0/647489127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.470+0000 7f776ea00640 1 -- 172.21.15.22:0/647489127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77700d0bc0 msgr2=0x7f77700b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.470+0000 7f776f400640 1 --2- 172.21.15.22:0/647489127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77700d0bc0 0x7f77700b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.470+0000 7f776ea00640 1 --2- 172.21.15.22:0/647489127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77700d0bc0 0x7f77700b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.470+0000 7f776ea00640 1 -- 172.21.15.22:0/647489127 >> v1:172.21.15.43:6789/0 conn(0x7f7770072df0 legacy=0x7f77700d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.470+0000 7f776ea00640 1 -- 172.21.15.22:0/647489127 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7770160a60 con 0x7f777015c990 2024-04-16T16:17:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.470+0000 7f776f400640 1 --2- 172.21.15.22:0/647489127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77700d0bc0 0x7f77700b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.471+0000 7f776ea00640 1 --2- 172.21.15.22:0/647489127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777015c990 0x7f77700728b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7760009870 tx=0x7f776002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971d7ed0c66e01f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.471+0000 7f776e000640 1 -- 172.21.15.22:0/647489127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760035020 con 0x7f777015c990 2024-04-16T16:17:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f776e000640 1 -- 172.21.15.22:0/647489127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7760031640 con 0x7f777015c990 2024-04-16T16:17:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f776e000640 1 -- 172.21.15.22:0/647489127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776002d040 con 0x7f777015c990 2024-04-16T16:17:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 -- 172.21.15.22:0/647489127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777015c990 msgr2=0x7f77700728b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 --2- 172.21.15.22:0/647489127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777015c990 0x7f77700728b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7760009870 tx=0x7f776002b8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 -- 172.21.15.22:0/647489127 shutdown_connections 2024-04-16T16:17:49.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 --2- 172.21.15.22:0/647489127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77700d0bc0 0x7f77700b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 --2- 172.21.15.22:0/647489127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777015c990 0x7f77700728b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 -- 172.21.15.22:0/647489127 >> 172.21.15.22:0/647489127 conn(0x7f7770062440 msgr2=0x7f7770062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 -- 172.21.15.22:0/647489127 shutdown_connections 2024-04-16T16:17:49.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.472+0000 7f7775600640 1 -- 172.21.15.22:0/647489127 wait complete. 2024-04-16T16:17:49.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.474+0000 7f7775600640 1 Processor -- start 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.474+0000 7f7775600640 1 -- start start 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.475+0000 7f7775600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7770072df0 0x7f777006e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.475+0000 7f7775600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77700d0bc0 0x7f777014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.475+0000 7f7775600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f777015c990 0x7f77700ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.475+0000 7f7775600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f777015cd70 con 0x7f77700d0bc0 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.475+0000 7f7775600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7770161020 con 0x7f7770072df0 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.475+0000 7f7775600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f77700b3b60 con 0x7f777015c990 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.475+0000 7f7767e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77700d0bc0 0x7f777014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77700d0bc0 0x7f777014d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40212/0 (socket says 172.21.15.22:40212) 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 -- 172.21.15.22:0/4060856907 learned_addr learned my addr 172.21.15.22:0/4060856907 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f776ea00640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7770072df0 0x7f777006e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f776f400640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f777015c990 0x7f77700ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 -- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f777015c990 msgr2=0x7f77700ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f777015c990 0x7f77700ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 -- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7770072df0 msgr2=0x7f777006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7770072df0 0x7f777006e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 -- 172.21.15.22:0/4060856907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77701599d0 con 0x7f77700d0bc0 2024-04-16T16:17:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.476+0000 7f7767e00640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77700d0bc0 0x7f777014d320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f775800c430 tx=0x7f775800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.477+0000 7f7766a00640 1 -- 172.21.15.22:0/4060856907 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758011790 con 0x7f77700d0bc0 2024-04-16T16:17:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.477+0000 7f7766a00640 1 -- 172.21.15.22:0/4060856907 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7758017070 con 0x7f77700d0bc0 2024-04-16T16:17:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.477+0000 7f7766a00640 1 -- 172.21.15.22:0/4060856907 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758011b70 con 0x7f77700d0bc0 2024-04-16T16:17:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.477+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7770159cb0 con 0x7f77700d0bc0 2024-04-16T16:17:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.477+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777015a270 con 0x7f77700d0bc0 2024-04-16T16:17:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.478+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777004fd90 con 0x7f77700d0bc0 2024-04-16T16:17:49.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.479+0000 7f7766a00640 1 -- 172.21.15.22:0/4060856907 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7758011d10 con 0x7f77700d0bc0 2024-04-16T16:17:49.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.481+0000 7f7766a00640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f774c06c8f0 0x7f774c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:49.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.481+0000 7f7766a00640 1 -- 172.21.15.22:0/4060856907 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f775808b740 con 0x7f77700d0bc0 2024-04-16T16:17:49.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.481+0000 7f776ea00640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f774c06c8f0 0x7f774c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:49.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.482+0000 7f776ea00640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f774c06c8f0 0x7f774c06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7760036000 tx=0x7f776003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:49.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.485+0000 7f7766a00640 1 -- 172.21.15.22:0/4060856907 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7758059eb0 con 0x7f77700d0bc0 2024-04-16T16:17:49.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.764+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f77700cfe20 con 0x7f77700d0bc0 2024-04-16T16:17:49.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.769+0000 7f7766a00640 1 -- 172.21.15.22:0/4060856907 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f77580597b0 con 0x7f77700d0bc0 2024-04-16T16:17:49.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f774c06c8f0 msgr2=0x7f774c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:49.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f774c06c8f0 0x7f774c06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7760036000 tx=0x7f776003c040 comp rx=0 tx=0).stop 2024-04-16T16:17:49.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77700d0bc0 msgr2=0x7f777014d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:49.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77700d0bc0 0x7f777014d320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f775800c430 tx=0x7f775800c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 shutdown_connections 2024-04-16T16:17:49.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f774c06c8f0 0x7f774c06edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f777015c990 0x7f77700ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77700d0bc0 0x7f777014d320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 --2- 172.21.15.22:0/4060856907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7770072df0 0x7f777006e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:49.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 >> 172.21.15.22:0/4060856907 conn(0x7f7770062440 msgr2=0x7f77700b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:49.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 shutdown_connections 2024-04-16T16:17:49.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:49.772+0000 7f7775600640 1 -- 172.21.15.22:0/4060856907 wait complete. 2024-04-16T16:17:49.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-16T16:17:50.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.008+0000 7f8fad600640 1 Processor -- start 2024-04-16T16:17:50.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.008+0000 7f8fad600640 1 -- start start 2024-04-16T16:17:50.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.010+0000 7f8fad600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8fa815eb30 0x7f8fa80d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.010+0000 7f8fad600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fa80d1770 0x7f8fa80d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.010+0000 7f8fad600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d2de0 0x7f8fa80b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.010+0000 7f8fad600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa80d4650 con 0x7f8fa80d1770 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.010+0000 7f8fad600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa80d1be0 con 0x7f8fa815eb30 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.010+0000 7f8fad600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa815ef10 con 0x7f8fa80d2de0 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.010+0000 7f8f9fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fa80d1770 0x7f8fa80d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8f9fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fa80d1770 0x7f8fa80d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49264/0 (socket says 172.21.15.22:49264) 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8f9fe00640 1 -- 172.21.15.22:0/1456050077 learned_addr learned my addr 172.21.15.22:0/1456050077 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8facc00640 1 --2- 172.21.15.22:0/1456050077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d2de0 0x7f8fa80b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8f9fe00640 1 -- 172.21.15.22:0/1456050077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d2de0 msgr2=0x7f8fa80b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8fa7e00640 1 --2- 172.21.15.22:0/1456050077 >> v2:172.21.15.43:3300/0 conn(0x7f8fa815eb30 0x7f8fa80d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8f9fe00640 1 --2- 172.21.15.22:0/1456050077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d2de0 0x7f8fa80b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8f9fe00640 1 -- 172.21.15.22:0/1456050077 >> v2:172.21.15.43:3300/0 conn(0x7f8fa815eb30 msgr2=0x7f8fa80d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8f9fe00640 1 --2- 172.21.15.22:0/1456050077 >> v2:172.21.15.43:3300/0 conn(0x7f8fa815eb30 0x7f8fa80d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8f9fe00640 1 -- 172.21.15.22:0/1456050077 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa80d35b0 con 0x7f8fa80d1770 2024-04-16T16:17:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8facc00640 1 --2- 172.21.15.22:0/1456050077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d2de0 0x7f8fa80b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.011+0000 7f8fa7e00640 1 --2- 172.21.15.22:0/1456050077 >> v2:172.21.15.43:3300/0 conn(0x7f8fa815eb30 0x7f8fa80d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.012+0000 7f8f9fe00640 1 --2- 172.21.15.22:0/1456050077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa80d1770 0x7f8fa80d28a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80d1200 tx=0x7f8f9002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ff54112dd65c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fa7400640 1 -- 172.21.15.22:0/1456050077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90035020 con 0x7f8fa80d1770 2024-04-16T16:17:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fa7400640 1 -- 172.21.15.22:0/1456050077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f90031880 con 0x7f8fa80d1770 2024-04-16T16:17:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fa7400640 1 -- 172.21.15.22:0/1456050077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90031c50 con 0x7f8fa80d1770 2024-04-16T16:17:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 -- 172.21.15.22:0/1456050077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa80d1770 msgr2=0x7f8fa80d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 --2- 172.21.15.22:0/1456050077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa80d1770 0x7f8fa80d28a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80d1200 tx=0x7f8f9002b920 comp rx=0 tx=0).stop 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 -- 172.21.15.22:0/1456050077 shutdown_connections 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 --2- 172.21.15.22:0/1456050077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d2de0 0x7f8fa80b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 --2- 172.21.15.22:0/1456050077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa80d1770 0x7f8fa80d28a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 --2- 172.21.15.22:0/1456050077 >> v2:172.21.15.43:3300/0 conn(0x7f8fa815eb30 0x7f8fa80d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 -- 172.21.15.22:0/1456050077 >> 172.21.15.22:0/1456050077 conn(0x7f8fa8072670 msgr2=0x7f8fa8062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 -- 172.21.15.22:0/1456050077 shutdown_connections 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.013+0000 7f8fad600640 1 -- 172.21.15.22:0/1456050077 wait complete. 2024-04-16T16:17:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.015+0000 7f8fad600640 1 Processor -- start 2024-04-16T16:17:50.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.015+0000 7f8fad600640 1 -- start start 2024-04-16T16:17:50.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.016+0000 7f8fad600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d1770 0x7f8fa80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.016+0000 7f8fad600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa80d2de0 0x7f8fa80b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8fad600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa815eb30 0x7f8fa814c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8fad600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa80d3e50 con 0x7f8fa815eb30 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8fad600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa80d3b70 con 0x7f8fa80d2de0 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8fad600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa80d4130 con 0x7f8fa80d1770 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa815eb30 0x7f8fa814c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa815eb30 0x7f8fa814c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49278/0 (socket says 172.21.15.22:49278) 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 -- 172.21.15.22:0/703720971 learned_addr learned my addr 172.21.15.22:0/703720971 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8fa7e00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d1770 0x7f8fa80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8f9fe00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa80d2de0 0x7f8fa80b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 -- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d1770 msgr2=0x7f8fa80b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d1770 0x7f8fa80b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 -- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa80d2de0 msgr2=0x7f8fa80b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa80d2de0 0x7f8fa80b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.017+0000 7f8facc00640 1 -- 172.21.15.22:0/703720971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa80b4bf0 con 0x7f8fa815eb30 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.018+0000 7f8facc00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa815eb30 0x7f8fa814c8a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000cf20 tx=0x7f8fa000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.018+0000 7f8fa4c00640 1 -- 172.21.15.22:0/703720971 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa001a070 con 0x7f8fa815eb30 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.018+0000 7f8fa4c00640 1 -- 172.21.15.22:0/703720971 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa000d840 con 0x7f8fa815eb30 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.018+0000 7f8fa4c00640 1 -- 172.21.15.22:0/703720971 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000dc30 con 0x7f8fa815eb30 2024-04-16T16:17:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.018+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa80b4ed0 con 0x7f8fa815eb30 2024-04-16T16:17:50.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.018+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa80b5490 con 0x7f8fa815eb30 2024-04-16T16:17:50.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.019+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa8075f30 con 0x7f8fa815eb30 2024-04-16T16:17:50.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.020+0000 7f8fa4c00640 1 -- 172.21.15.22:0/703720971 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fa001d070 con 0x7f8fa815eb30 2024-04-16T16:17:50.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.021+0000 7f8fa4c00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8f8406c8f0 0x7f8f8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.021+0000 7f8fa4c00640 1 -- 172.21.15.22:0/703720971 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8fa008c160 con 0x7f8fa815eb30 2024-04-16T16:17:50.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.022+0000 7f8fa7e00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8f8406c8f0 0x7f8f8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.022+0000 7f8fa7e00640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8f8406c8f0 0x7f8f8406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b7330 tx=0x7f8f98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:50.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.029+0000 7f8fa4c00640 1 -- 172.21.15.22:0/703720971 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8fa005a840 con 0x7f8fa815eb30 2024-04-16T16:17:50.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.311+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f8fa8160900 con 0x7f8fa815eb30 2024-04-16T16:17:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.315+0000 7f8fa4c00640 1 -- 172.21.15.22:0/703720971 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f8fa005a140 con 0x7f8fa815eb30 2024-04-16T16:17:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8f8406c8f0 msgr2=0x7f8f8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8f8406c8f0 0x7f8f8406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b7330 tx=0x7f8f98008040 comp rx=0 tx=0).stop 2024-04-16T16:17:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa815eb30 msgr2=0x7f8fa814c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa815eb30 0x7f8fa814c8a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000cf20 tx=0x7f8fa000a7d0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 shutdown_connections 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8f8406c8f0 0x7f8f8406edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fa815eb30 0x7f8fa814c8a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa80d2de0 0x7f8fa80b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 --2- 172.21.15.22:0/703720971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8fa80d1770 0x7f8fa80b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 >> 172.21.15.22:0/703720971 conn(0x7f8fa8072670 msgr2=0x7f8fa81611e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 shutdown_connections 2024-04-16T16:17:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.319+0000 7f8fad600640 1 -- 172.21.15.22:0/703720971 wait complete. 2024-04-16T16:17:50.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-16T16:17:50.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.568+0000 7fd10e200640 1 Processor -- start 2024-04-16T16:17:50.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.568+0000 7fd10e200640 1 -- start start 2024-04-16T16:17:50.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd10e200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd10815a240 0x7fd1080d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd10e200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd10815cd90 0x7fd1080d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd10e200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10815d300 con 0x7fd108160380 2024-04-16T16:17:50.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd10e200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd10815d5e0 con 0x7fd10815cd90 2024-04-16T16:17:50.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd10e200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd10815d8c0 con 0x7fd10815a240 2024-04-16T16:17:50.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd10d800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd108160380 0x7fd108070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34730/0 (socket says 172.21.15.22:34730) 2024-04-16T16:17:50.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd10d800640 1 -- 172.21.15.22:0/3139594355 learned_addr learned my addr 172.21.15.22:0/3139594355 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:50.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.570+0000 7fd107e00640 1 --2- 172.21.15.22:0/3139594355 >> v2:172.21.15.22:3300/0 conn(0x7fd10815cd90 0x7fd1080d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd10ce00640 1 --2- 172.21.15.22:0/3139594355 >> v2:172.21.15.43:3300/0 conn(0x7fd10815a240 0x7fd1080d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd107400640 1 -- 172.21.15.22:0/3139594355 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144210393 0 0) 0x7fd10815d300 con 0x7fd108160380 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd107400640 1 -- 172.21.15.22:0/3139594355 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0f0003520 con 0x7fd108160380 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd107e00640 1 -- 172.21.15.22:0/3139594355 >> v2:172.21.15.43:3300/0 conn(0x7fd10815a240 msgr2=0x7fd1080d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd107e00640 1 --2- 172.21.15.22:0/3139594355 >> v2:172.21.15.43:3300/0 conn(0x7fd10815a240 0x7fd1080d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd107e00640 1 -- 172.21.15.22:0/3139594355 >> v1:172.21.15.22:6789/0 conn(0x7fd108160380 legacy=0x7fd108070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd107e00640 1 -- 172.21.15.22:0/3139594355 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10815dba0 con 0x7fd10815cd90 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.571+0000 7fd10ce00640 1 --2- 172.21.15.22:0/3139594355 >> v2:172.21.15.43:3300/0 conn(0x7fd10815a240 0x7fd1080d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:17:50.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.572+0000 7fd107e00640 1 --2- 172.21.15.22:0/3139594355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd10815cd90 0x7fd1080d07d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd108072200 tx=0x7fd0f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b877d55ca4fa7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:50.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd107400640 1 -- 172.21.15.22:0/3139594355 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40315a0 con 0x7fd10815cd90 2024-04-16T16:17:50.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd107400640 1 -- 172.21.15.22:0/3139594355 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f4037070 con 0x7fd10815cd90 2024-04-16T16:17:50.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd107400640 1 -- 172.21.15.22:0/3139594355 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4031940 con 0x7fd10815cd90 2024-04-16T16:17:50.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd10e200640 1 -- 172.21.15.22:0/3139594355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd10815cd90 msgr2=0x7fd1080d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd10e200640 1 --2- 172.21.15.22:0/3139594355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd10815cd90 0x7fd1080d07d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd108072200 tx=0x7fd0f402b840 comp rx=0 tx=0).stop 2024-04-16T16:17:50.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd10e200640 1 -- 172.21.15.22:0/3139594355 shutdown_connections 2024-04-16T16:17:50.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd10e200640 1 --2- 172.21.15.22:0/3139594355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd10815cd90 0x7fd1080d07d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd10e200640 1 --2- 172.21.15.22:0/3139594355 >> v2:172.21.15.43:3300/0 conn(0x7fd10815a240 0x7fd1080d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd10e200640 1 -- 172.21.15.22:0/3139594355 >> 172.21.15.22:0/3139594355 conn(0x7fd108075070 msgr2=0x7fd108062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:50.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.573+0000 7fd10e200640 1 -- 172.21.15.22:0/3139594355 shutdown_connections 2024-04-16T16:17:50.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.574+0000 7fd10e200640 1 -- 172.21.15.22:0/3139594355 wait complete. 2024-04-16T16:17:50.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.575+0000 7fd10e200640 1 Processor -- start 2024-04-16T16:17:50.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.576+0000 7fd10e200640 1 -- start start 2024-04-16T16:17:50.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.576+0000 7fd10e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10815a240 0x7fd1080b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.576+0000 7fd10e200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd108160380 0x7fd1081e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd10e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1081e6b90 0x7fd1080ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd10e200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd108073120 con 0x7fd108160380 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd10e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd108072fa0 con 0x7fd10815a240 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd10e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd10815a620 con 0x7fd1081e6b90 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd108160380 0x7fd1081e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd108160380 0x7fd1081e6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49304/0 (socket says 172.21.15.22:49304) 2024-04-16T16:17:50.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 -- 172.21.15.22:0/3420958677 learned_addr learned my addr 172.21.15.22:0/3420958677 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:50.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 -- 172.21.15.22:0/3420958677 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1081e6b90 msgr2=0x7fd1080ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1081e6b90 0x7fd1080ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 -- 172.21.15.22:0/3420958677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10815a240 msgr2=0x7fd1080b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10815a240 0x7fd1080b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.577+0000 7fd107e00640 1 -- 172.21.15.22:0/3420958677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1081563e0 con 0x7fd108160380 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.578+0000 7fd107e00640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd108160380 0x7fd1081e6650 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000c00 tx=0x7fd0f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.578+0000 7fd104c00640 1 -- 172.21.15.22:0/3420958677 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4006e10 con 0x7fd108160380 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.578+0000 7fd104c00640 1 -- 172.21.15.22:0/3420958677 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f40317a0 con 0x7fd108160380 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.578+0000 7fd104c00640 1 -- 172.21.15.22:0/3420958677 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4031b70 con 0x7fd108160380 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.578+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1081566c0 con 0x7fd108160380 2024-04-16T16:17:50.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.578+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd108156c80 con 0x7fd108160380 2024-04-16T16:17:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.580+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd108075f30 con 0x7fd108160380 2024-04-16T16:17:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.580+0000 7fd104c00640 1 -- 172.21.15.22:0/3420958677 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0f4031d10 con 0x7fd108160380 2024-04-16T16:17:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.581+0000 7fd104c00640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0e806c8f0 0x7fd0e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.581+0000 7fd104c00640 1 -- 172.21.15.22:0/3420958677 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd0f402f020 con 0x7fd108160380 2024-04-16T16:17:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.582+0000 7fd10ce00640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0e806c8f0 0x7fd0e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.582+0000 7fd10ce00640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0e806c8f0 0x7fd0e806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006fd0 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.586+0000 7fd104c00640 1 -- 172.21.15.22:0/3420958677 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0f407be50 con 0x7fd108160380 2024-04-16T16:17:50.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.869+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fd10815fb00 con 0x7fd108160380 2024-04-16T16:17:50.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.873+0000 7fd104c00640 1 -- 172.21.15.22:0/3420958677 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fd0f407b750 con 0x7fd108160380 2024-04-16T16:17:50.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0e806c8f0 msgr2=0x7fd0e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0e806c8f0 0x7fd0e806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006fd0 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2024-04-16T16:17:50.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd108160380 msgr2=0x7fd1081e6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:50.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd108160380 0x7fd1081e6650 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000c00 tx=0x7fd0f40046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 shutdown_connections 2024-04-16T16:17:50.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0e806c8f0 0x7fd0e806edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1081e6b90 0x7fd1080ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd108160380 0x7fd1081e6650 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 --2- 172.21.15.22:0/3420958677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd10815a240 0x7fd1080b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:50.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.876+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 >> 172.21.15.22:0/3420958677 conn(0x7fd108075070 msgr2=0x7fd10815eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:50.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.877+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 shutdown_connections 2024-04-16T16:17:50.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:50.877+0000 7fd10e200640 1 -- 172.21.15.22:0/3420958677 wait complete. 2024-04-16T16:17:50.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-16T16:17:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.119+0000 7f7904a00640 1 Processor -- start 2024-04-16T16:17:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.119+0000 7f7904a00640 1 -- start start 2024-04-16T16:17:51.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.120+0000 7f7904a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790015b5f0 0x7f790006e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f7904a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7900072640 0x7f790015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f7904a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79000b36d0 con 0x7f790006d9e0 2024-04-16T16:17:51.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f7904a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f79000b42e0 con 0x7f7900072640 2024-04-16T16:17:51.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f7904a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f79000b39b0 con 0x7f790015b5f0 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ffe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7900072640 0x7f790015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ffe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7900072640 0x7f790015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49308/0 (socket says 172.21.15.22:49308) 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ffe00640 1 -- 172.21.15.22:0/3876869157 learned_addr learned my addr 172.21.15.22:0/3876869157 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ff400640 1 --2- 172.21.15.22:0/3876869157 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790015b5f0 0x7f790006e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ffe00640 1 -- 172.21.15.22:0/3876869157 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790015b5f0 msgr2=0x7f790006e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ffe00640 1 --2- 172.21.15.22:0/3876869157 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790015b5f0 0x7f790006e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ffe00640 1 -- 172.21.15.22:0/3876869157 >> v1:172.21.15.43:6789/0 conn(0x7f790006d9e0 legacy=0x7f7900071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:51.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.121+0000 7f78ffe00640 1 -- 172.21.15.22:0/3876869157 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79000b3c90 con 0x7f7900072640 2024-04-16T16:17:51.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.123+0000 7f78ffe00640 1 --2- 172.21.15.22:0/3876869157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015b9d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009e50 tx=0x7f78f802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466dee079c95f382 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:51.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.123+0000 7f78fe000640 1 -- 172.21.15.22:0/3876869157 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f802c9e0 con 0x7f7900072640 2024-04-16T16:17:51.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.123+0000 7f78fe000640 1 -- 172.21.15.22:0/3876869157 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f802cb80 con 0x7f7900072640 2024-04-16T16:17:51.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.123+0000 7f78fe000640 1 -- 172.21.15.22:0/3876869157 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80343f0 con 0x7f7900072640 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.123+0000 7f7904a00640 1 -- 172.21.15.22:0/3876869157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 msgr2=0x7f790015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.123+0000 7f7904a00640 1 --2- 172.21.15.22:0/3876869157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015b9d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009e50 tx=0x7f78f802be40 comp rx=0 tx=0).stop 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.124+0000 7f7904a00640 1 -- 172.21.15.22:0/3876869157 shutdown_connections 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.124+0000 7f7904a00640 1 --2- 172.21.15.22:0/3876869157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015b9d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.124+0000 7f7904a00640 1 --2- 172.21.15.22:0/3876869157 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790015b5f0 0x7f790006e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.124+0000 7f7904a00640 1 -- 172.21.15.22:0/3876869157 >> 172.21.15.22:0/3876869157 conn(0x7f7900075070 msgr2=0x7f7900062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.124+0000 7f7904a00640 1 -- 172.21.15.22:0/3876869157 shutdown_connections 2024-04-16T16:17:51.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.124+0000 7f7904a00640 1 -- 172.21.15.22:0/3876869157 wait complete. 2024-04-16T16:17:51.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.125+0000 7f7904a00640 1 Processor -- start 2024-04-16T16:17:51.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.126+0000 7f7904a00640 1 -- start start 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f7904a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790006d9e0 0x7f7900149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f7904a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f7904a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f790015b5f0 0x7f790014f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f7904a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f79000b4770 con 0x7f7900072640 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f7904a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f79000b33a0 con 0x7f790015b5f0 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f7904a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f790015c4a0 con 0x7f790006d9e0 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f78fea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f78fea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49312/0 (socket says 172.21.15.22:49312) 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f78fea00640 1 -- 172.21.15.22:0/2611674893 learned_addr learned my addr 172.21.15.22:0/2611674893 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:51.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f78ff400640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790006d9e0 0x7f7900149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f78fea00640 1 -- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790006d9e0 msgr2=0x7f7900149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.127+0000 7f78ffe00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f790015b5f0 0x7f790014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78fea00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790006d9e0 0x7f7900149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78fea00640 1 -- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f790015b5f0 msgr2=0x7f790014f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78fea00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f790015b5f0 0x7f790014f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78fea00640 1 -- 172.21.15.22:0/2611674893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790014ba30 con 0x7f7900072640 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78ffe00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f790015b5f0 0x7f790014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78fea00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015a000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f78e800c430 tx=0x7f78e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78f7400640 1 -- 172.21.15.22:0/2611674893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8017070 con 0x7f7900072640 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78f7400640 1 -- 172.21.15.22:0/2611674893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e80035f0 con 0x7f7900072640 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790015bb70 con 0x7f7900072640 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f78f7400640 1 -- 172.21.15.22:0/2611674893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80039e0 con 0x7f7900072640 2024-04-16T16:17:51.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.128+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790015c130 con 0x7f7900072640 2024-04-16T16:17:51.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.129+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7900075f30 con 0x7f7900072640 2024-04-16T16:17:51.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.131+0000 7f78f7400640 1 -- 172.21.15.22:0/2611674893 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78e801a070 con 0x7f7900072640 2024-04-16T16:17:51.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.132+0000 7f78f7400640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f78dc06c920 0x7f78dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.132+0000 7f78f7400640 1 -- 172.21.15.22:0/2611674893 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f78e808aba0 con 0x7f7900072640 2024-04-16T16:17:51.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.132+0000 7f78ff400640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f78dc06c920 0x7f78dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.133+0000 7f78ff400640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f78dc06c920 0x7f78dc06ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78f0006fd0 tx=0x7f78f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:51.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.136+0000 7f78f7400640 1 -- 172.21.15.22:0/2611674893 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f790014ba30 con 0x7f7900072640 2024-04-16T16:17:51.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.418+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f790006d430 con 0x7f7900072640 2024-04-16T16:17:51.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.424+0000 7f78f7400640 1 -- 172.21.15.22:0/2611674893 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f78e80010c0 con 0x7f7900072640 2024-04-16T16:17:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f78dc06c920 msgr2=0x7f78dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f78dc06c920 0x7f78dc06ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78f0006fd0 tx=0x7f78f0008040 comp rx=0 tx=0).stop 2024-04-16T16:17:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 msgr2=0x7f790015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015a000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f78e800c430 tx=0x7f78e800c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 shutdown_connections 2024-04-16T16:17:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f78dc06c920 0x7f78dc06ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f790015b5f0 0x7f790014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7900072640 0x7f790015a000 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 --2- 172.21.15.22:0/2611674893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f790006d9e0 0x7f7900149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 >> 172.21.15.22:0/2611674893 conn(0x7f7900075070 msgr2=0x7f7900155260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.426+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 shutdown_connections 2024-04-16T16:17:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.427+0000 7f7904a00640 1 -- 172.21.15.22:0/2611674893 wait complete. 2024-04-16T16:17:51.443 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-16T16:17:51.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.663+0000 7f2a92400640 1 Processor -- start 2024-04-16T16:17:51.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.663+0000 7f2a92400640 1 -- start start 2024-04-16T16:17:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.665+0000 7f2a92400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2a8c15e8b0 0x7f2a8c162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.665+0000 7f2a92400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a8c163400 con 0x7f2a8c0d07c0 2024-04-16T16:17:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.665+0000 7f2a92400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a8c06d060 con 0x7f2a8c0b56b0 2024-04-16T16:17:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.665+0000 7f2a92400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2a8c06dc70 con 0x7f2a8c15e8b0 2024-04-16T16:17:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.666+0000 7f2a91a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2a8c0d07c0 0x7f2a8c0b3680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34744/0 (socket says 172.21.15.22:34744) 2024-04-16T16:17:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.666+0000 7f2a91a00640 1 -- 172.21.15.22:0/3054962067 learned_addr learned my addr 172.21.15.22:0/3054962067 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.666+0000 7f2a91000640 1 --2- 172.21.15.22:0/3054962067 >> v2:172.21.15.43:3300/0 conn(0x7f2a8c15e8b0 0x7f2a8c162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.666+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446480318 0 0) 0x7f2a8c163400 con 0x7f2a8c0d07c0 2024-04-16T16:17:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.666+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a74003520 con 0x7f2a8c0d07c0 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2341191572 0 0) 0x7f2a74003520 con 0x7f2a8c0d07c0 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 >> v2:172.21.15.43:3300/0 conn(0x7f2a8c15e8b0 msgr2=0x7f2a8c162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 --2- 172.21.15.22:0/3054962067 >> v2:172.21.15.43:3300/0 conn(0x7f2a8c15e8b0 0x7f2a8c162ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 >> v1:172.21.15.43:6789/0 conn(0x7f2a8c0b56b0 legacy=0x7f2a8c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c06d340 con 0x7f2a8c0d07c0 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f2a840019f0 con 0x7f2a8c0d07c0 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 >> v1:172.21.15.22:6789/0 conn(0x7f2a8c0d07c0 legacy=0x7f2a8c0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a74003a70 0x7f2a74003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a74004800 0x7f2a74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c06dc70 con 0x7f2a74005210 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7400c140 con 0x7f2a74004800 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7400c340 con 0x7f2a74003a70 2024-04-16T16:17:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.667+0000 7f2a91a00640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.668+0000 7f2a8be00640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a74004800 0x7f2a74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.668+0000 7f2a91a00640 1 -- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a74003a70 msgr2=0x7f2a74003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.668+0000 7f2a91a00640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a74003a70 0x7f2a74003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.668+0000 7f2a91a00640 1 -- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a74004800 msgr2=0x7f2a74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.668+0000 7f2a91a00640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a74004800 0x7f2a74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.668+0000 7f2a91a00640 1 -- 172.21.15.22:0/3054962067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a74003520 con 0x7f2a74005210 2024-04-16T16:17:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.668+0000 7f2a8be00640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a74004800 0x7f2a74004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.669+0000 7f2a91a00640 1 -- 172.21.15.22:0/3054962067 reap_dead start 2024-04-16T16:17:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.669+0000 7f2a91a00640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a7400b9c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400a740 tx=0x7f2a74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4128e73744254455 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.669+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400a390 con 0x7f2a74005210 2024-04-16T16:17:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.669+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a84034650 con 0x7f2a74005210 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.669+0000 7f2a8b400640 1 -- 172.21.15.22:0/3054962067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84034a40 con 0x7f2a74005210 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.670+0000 7f2a92400640 1 -- 172.21.15.22:0/3054962067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 msgr2=0x7f2a7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.670+0000 7f2a92400640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a7400b9c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400a740 tx=0x7f2a74005830 comp rx=0 tx=0).stop 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.670+0000 7f2a92400640 1 -- 172.21.15.22:0/3054962067 shutdown_connections 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.670+0000 7f2a92400640 1 --2- 172.21.15.22:0/3054962067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a7400b9c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.670+0000 7f2a92400640 1 -- 172.21.15.22:0/3054962067 >> 172.21.15.22:0/3054962067 conn(0x7f2a8c075070 msgr2=0x7f2a8c062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.670+0000 7f2a92400640 1 -- 172.21.15.22:0/3054962067 shutdown_connections 2024-04-16T16:17:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.670+0000 7f2a92400640 1 -- 172.21.15.22:0/3054962067 wait complete. 2024-04-16T16:17:51.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.672+0000 7f2a92400640 1 Processor -- start 2024-04-16T16:17:51.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.672+0000 7f2a92400640 1 -- start start 2024-04-16T16:17:51.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a92400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a8c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a92400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c151c70 0x7f2a8c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a92400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a8c154ac0 0x7f2a8c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a92400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c06d900 con 0x7f2a74005210 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a92400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c06e100 con 0x7f2a8c151c70 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a92400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8c15ec90 con 0x7f2a8c154ac0 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a91000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a8c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a91000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a8c1532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49338/0 (socket says 172.21.15.22:49338) 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.673+0000 7f2a91000640 1 -- 172.21.15.22:0/1651470212 learned_addr learned my addr 172.21.15.22:0/1651470212 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a91000640 1 -- 172.21.15.22:0/1651470212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a8c154ac0 msgr2=0x7f2a8c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a91000640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a8c154ac0 0x7f2a8c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a91000640 1 -- 172.21.15.22:0/1651470212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c151c70 msgr2=0x7f2a8c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a91000640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c151c70 0x7f2a8c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a91000640 1 -- 172.21.15.22:0/1651470212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c152510 con 0x7f2a74005210 2024-04-16T16:17:51.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a91000640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a8c1532d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000e7a0 tx=0x7f2a8000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:51.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a88c00640 1 -- 172.21.15.22:0/1651470212 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80017070 con 0x7f2a74005210 2024-04-16T16:17:51.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a88c00640 1 -- 172.21.15.22:0/1651470212 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8000c940 con 0x7f2a74005210 2024-04-16T16:17:51.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a88c00640 1 -- 172.21.15.22:0/1651470212 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000cd10 con 0x7f2a74005210 2024-04-16T16:17:51.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8c1527f0 con 0x7f2a74005210 2024-04-16T16:17:51.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.674+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8c154fd0 con 0x7f2a74005210 2024-04-16T16:17:51.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.676+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8c075f30 con 0x7f2a74005210 2024-04-16T16:17:51.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.677+0000 7f2a88c00640 1 -- 172.21.15.22:0/1651470212 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a8001a070 con 0x7f2a74005210 2024-04-16T16:17:51.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.678+0000 7f2a88c00640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a6c06c8f0 0x7f2a6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:51.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.678+0000 7f2a88c00640 1 -- 172.21.15.22:0/1651470212 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f2a8008ba90 con 0x7f2a74005210 2024-04-16T16:17:51.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.678+0000 7f2a8be00640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a6c06c8f0 0x7f2a6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:51.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.679+0000 7f2a8be00640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a6c06c8f0 0x7f2a6c06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c15d790 tx=0x7f2a78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:51.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.683+0000 7f2a88c00640 1 -- 172.21.15.22:0/1651470212 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a8005a200 con 0x7f2a74005210 2024-04-16T16:17:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.973+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f2a8c071160 con 0x7f2a74005210 2024-04-16T16:17:51.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.978+0000 7f2a88c00640 1 -- 172.21.15.22:0/1651470212 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f2a80059b00 con 0x7f2a74005210 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a6c06c8f0 msgr2=0x7f2a6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a6c06c8f0 0x7f2a6c06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c15d790 tx=0x7f2a78009040 comp rx=0 tx=0).stop 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 msgr2=0x7f2a8c1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a8c1532d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000e7a0 tx=0x7f2a8000ec60 comp rx=0 tx=0).stop 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 shutdown_connections 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2a6c06c8f0 0x7f2a6c06edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a8c154ac0 0x7f2a8c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c151c70 0x7f2a8c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 --2- 172.21.15.22:0/1651470212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a74005210 0x7f2a8c1532d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:51.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 >> 172.21.15.22:0/1651470212 conn(0x7f2a8c075070 msgr2=0x7f2a8c161820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:51.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 shutdown_connections 2024-04-16T16:17:51.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:51.981+0000 7f2a92400640 1 -- 172.21.15.22:0/1651470212 wait complete. 2024-04-16T16:17:52.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.221+0000 7f16ef000640 1 Processor -- start 2024-04-16T16:17:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.221+0000 7f16ef000640 1 -- start start 2024-04-16T16:17:52.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.223+0000 7f16ef000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f16e81478c0 0x7f16e8163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.223+0000 7f16ef000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e80d0c50 0x7f16e806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.223+0000 7f16ef000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e80af0b0 con 0x7f16e80ae860 2024-04-16T16:17:52.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.223+0000 7f16ef000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f16e80af950 con 0x7f16e81478c0 2024-04-16T16:17:52.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.223+0000 7f16ef000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f16e8147ca0 con 0x7f16e80d0c50 2024-04-16T16:17:52.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.224+0000 7f16e7e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f16e81478c0 0x7f16e8163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.224+0000 7f16e7e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f16e81478c0 0x7f16e8163340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:49308/0 (socket says 172.21.15.22:49308) 2024-04-16T16:17:52.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.224+0000 7f16e7e00640 1 -- 172.21.15.22:0/3341821649 learned_addr learned my addr 172.21.15.22:0/3341821649 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:52.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.224+0000 7f16ed000640 1 --2- 172.21.15.22:0/3341821649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e80d0c50 0x7f16e806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.225+0000 7f16ed000640 1 -- 172.21.15.22:0/3341821649 >> v2:172.21.15.43:3300/0 conn(0x7f16e81478c0 msgr2=0x7f16e8163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:52.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.225+0000 7f16ed000640 1 --2- 172.21.15.22:0/3341821649 >> v2:172.21.15.43:3300/0 conn(0x7f16e81478c0 0x7f16e8163340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.225+0000 7f16ed000640 1 -- 172.21.15.22:0/3341821649 >> v1:172.21.15.43:6789/0 conn(0x7f16e80ae860 legacy=0x7f16e80d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.225+0000 7f16ed000640 1 -- 172.21.15.22:0/3341821649 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e80af390 con 0x7f16e80d0c50 2024-04-16T16:17:52.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.227+0000 7f16ed000640 1 --2- 172.21.15.22:0/3341821649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e80d0c50 0x7f16e806d700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009d90 tx=0x7f16e002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eece3aaa8fcbefe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:52.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.227+0000 7f16e7400640 1 -- 172.21.15.22:0/3341821649 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0039070 con 0x7f16e80d0c50 2024-04-16T16:17:52.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.227+0000 7f16e7400640 1 -- 172.21.15.22:0/3341821649 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e002cbc0 con 0x7f16e80d0c50 2024-04-16T16:17:52.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.228+0000 7f16e7400640 1 -- 172.21.15.22:0/3341821649 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0034440 con 0x7f16e80d0c50 2024-04-16T16:17:52.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.228+0000 7f16ef000640 1 -- 172.21.15.22:0/3341821649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e80d0c50 msgr2=0x7f16e806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.228+0000 7f16ef000640 1 --2- 172.21.15.22:0/3341821649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e80d0c50 0x7f16e806d700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009d90 tx=0x7f16e002be10 comp rx=0 tx=0).stop 2024-04-16T16:17:52.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.228+0000 7f16ef000640 1 -- 172.21.15.22:0/3341821649 shutdown_connections 2024-04-16T16:17:52.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.228+0000 7f16ef000640 1 --2- 172.21.15.22:0/3341821649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e80d0c50 0x7f16e806d700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.228+0000 7f16ef000640 1 --2- 172.21.15.22:0/3341821649 >> v2:172.21.15.43:3300/0 conn(0x7f16e81478c0 0x7f16e8163340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.228+0000 7f16ef000640 1 -- 172.21.15.22:0/3341821649 >> 172.21.15.22:0/3341821649 conn(0x7f16e8062440 msgr2=0x7f16e8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.229+0000 7f16ef000640 1 -- 172.21.15.22:0/3341821649 shutdown_connections 2024-04-16T16:17:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.229+0000 7f16ef000640 1 -- 172.21.15.22:0/3341821649 wait complete. 2024-04-16T16:17:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.230+0000 7f16ef000640 1 Processor -- start 2024-04-16T16:17:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.230+0000 7f16ef000640 1 -- start start 2024-04-16T16:17:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.231+0000 7f16ef000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e80ae860 0x7f16e81613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.231+0000 7f16ef000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e80d0c50 0x7f16e813b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.231+0000 7f16ef000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e81478c0 0x7f16e81f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.231+0000 7f16ef000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f16e80aee20 con 0x7f16e80d0c50 2024-04-16T16:17:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.231+0000 7f16ef000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16e80aeca0 con 0x7f16e80ae860 2024-04-16T16:17:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.231+0000 7f16ef000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f16e806dc40 con 0x7f16e81478c0 2024-04-16T16:17:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e80d0c50 0x7f16e813b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e80d0c50 0x7f16e813b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49352/0 (socket says 172.21.15.22:49352) 2024-04-16T16:17:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 -- 172.21.15.22:0/595605248 learned_addr learned my addr 172.21.15.22:0/595605248 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 -- 172.21.15.22:0/595605248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e81478c0 msgr2=0x7f16e81f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16ed000640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e81478c0 0x7f16e81f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e81478c0 0x7f16e81f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 -- 172.21.15.22:0/595605248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e80ae860 msgr2=0x7f16e81613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e80ae860 0x7f16e81613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.232+0000 7f16dfe00640 1 -- 172.21.15.22:0/595605248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e8161910 con 0x7f16e80d0c50 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.233+0000 7f16dfe00640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e80d0c50 0x7f16e813b1d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c430 tx=0x7f16d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.233+0000 7f16e4c00640 1 -- 172.21.15.22:0/595605248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0017070 con 0x7f16e80d0c50 2024-04-16T16:17:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.233+0000 7f16e4c00640 1 -- 172.21.15.22:0/595605248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d00052d0 con 0x7f16e80d0c50 2024-04-16T16:17:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.233+0000 7f16e4c00640 1 -- 172.21.15.22:0/595605248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0003850 con 0x7f16e80d0c50 2024-04-16T16:17:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.233+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e813e020 con 0x7f16e80d0c50 2024-04-16T16:17:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.233+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e8160bd0 con 0x7f16e80d0c50 2024-04-16T16:17:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.234+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e804fd90 con 0x7f16e80d0c50 2024-04-16T16:17:52.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.235+0000 7f16e4c00640 1 -- 172.21.15.22:0/595605248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f16d001a070 con 0x7f16e80d0c50 2024-04-16T16:17:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.236+0000 7f16e4c00640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f16c406c940 0x7f16c406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.236+0000 7f16e4c00640 1 -- 172.21.15.22:0/595605248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f16d008ac50 con 0x7f16e80d0c50 2024-04-16T16:17:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.236+0000 7f16e7e00640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f16c406c940 0x7f16c406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.237+0000 7f16e7e00640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f16c406c940 0x7f16c406ee00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f16d8006f40 tx=0x7f16d8006e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.241+0000 7f16e4c00640 1 -- 172.21.15.22:0/595605248 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f16d00593b0 con 0x7f16e80d0c50 2024-04-16T16:17:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.447+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16e80628c0 con 0x7f16e80d0c50 2024-04-16T16:17:52.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.449+0000 7f16e4c00640 1 -- 172.21.15.22:0/595605248 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12771 (secure 0 0 0) 0x7f16d0058cb0 con 0x7f16e80d0c50 2024-04-16T16:17:52.448 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:52.448 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":30,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:48.132782+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.451+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f16c406c940 msgr2=0x7f16c406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.451+0000 7f16ef000640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f16c406c940 0x7f16c406ee00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f16d8006f40 tx=0x7f16d8006e90 comp rx=0 tx=0).stop 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.451+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e80d0c50 msgr2=0x7f16e813b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.451+0000 7f16ef000640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e80d0c50 0x7f16e813b1d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c430 tx=0x7f16d000c8f0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 shutdown_connections 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f16c406c940 0x7f16c406ee00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e81478c0 0x7f16e81f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e80d0c50 0x7f16e813b1d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 --2- 172.21.15.22:0/595605248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e80ae860 0x7f16e81613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 >> 172.21.15.22:0/595605248 conn(0x7f16e8062440 msgr2=0x7f16e80b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 shutdown_connections 2024-04-16T16:17:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.452+0000 7f16ef000640 1 -- 172.21.15.22:0/595605248 wait complete. 2024-04-16T16:17:52.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:17:52.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:17:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.698+0000 7f2943000640 1 Processor -- start 2024-04-16T16:17:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.698+0000 7f2943000640 1 -- start start 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2943000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0d0a10 0x7f293c0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2943000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f293c0cc830 0x7f293c0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2943000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f293c15cc20 con 0x7f293c15c840 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2943000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f293c0ce390 con 0x7f293c0cc830 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2943000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f293c06dda0 con 0x7f293c0d0a10 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2942600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f293c0cc830 0x7f293c0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2942600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f293c0cc830 0x7f293c0cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49368/0 (socket says 172.21.15.22:49368) 2024-04-16T16:17:52.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.700+0000 7f2942600640 1 -- 172.21.15.22:0/2772256347 learned_addr learned my addr 172.21.15.22:0/2772256347 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:52.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.701+0000 7f2941200640 1 --2- 172.21.15.22:0/2772256347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0d0a10 0x7f293c0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.701+0000 7f2942600640 1 -- 172.21.15.22:0/2772256347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0d0a10 msgr2=0x7f293c0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:52.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.701+0000 7f2942600640 1 --2- 172.21.15.22:0/2772256347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0d0a10 0x7f293c0cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.701+0000 7f2942600640 1 -- 172.21.15.22:0/2772256347 >> v1:172.21.15.43:6789/0 conn(0x7f293c15c840 legacy=0x7f293c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:52.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.701+0000 7f2942600640 1 -- 172.21.15.22:0/2772256347 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c06d800 con 0x7f293c0cc830 2024-04-16T16:17:52.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.702+0000 7f2942600640 1 --2- 172.21.15.22:0/2772256347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c0cc830 0x7f293c0cf5e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2934009e50 tx=0x7f293402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986b5323fa93dc4b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:52.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.702+0000 7f293be00640 1 -- 172.21.15.22:0/2772256347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293402ca70 con 0x7f293c0cc830 2024-04-16T16:17:52.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.702+0000 7f293be00640 1 -- 172.21.15.22:0/2772256347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293402cc10 con 0x7f293c0cc830 2024-04-16T16:17:52.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.702+0000 7f293be00640 1 -- 172.21.15.22:0/2772256347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29340343f0 con 0x7f293c0cc830 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 -- 172.21.15.22:0/2772256347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c0cc830 msgr2=0x7f293c0cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 --2- 172.21.15.22:0/2772256347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c0cc830 0x7f293c0cf5e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2934009e50 tx=0x7f293402bed0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 -- 172.21.15.22:0/2772256347 shutdown_connections 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 --2- 172.21.15.22:0/2772256347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c0cc830 0x7f293c0cf5e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 --2- 172.21.15.22:0/2772256347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0d0a10 0x7f293c0cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 -- 172.21.15.22:0/2772256347 >> 172.21.15.22:0/2772256347 conn(0x7f293c062440 msgr2=0x7f293c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 -- 172.21.15.22:0/2772256347 shutdown_connections 2024-04-16T16:17:52.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.703+0000 7f2943000640 1 -- 172.21.15.22:0/2772256347 wait complete. 2024-04-16T16:17:52.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.705+0000 7f2943000640 1 Processor -- start 2024-04-16T16:17:52.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.705+0000 7f2943000640 1 -- start start 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2943000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0cc830 0x7f293c1407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2943000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c0d0a10 0x7f293c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2943000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c15c840 0x7f293c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2943000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f293c0ce8a0 con 0x7f293c15c840 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2943000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f293c0ce5c0 con 0x7f293c0d0a10 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2943000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f293c0ceb80 con 0x7f293c0cc830 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2942600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c15c840 0x7f293c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2942600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c15c840 0x7f293c156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49370/0 (socket says 172.21.15.22:49370) 2024-04-16T16:17:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.706+0000 7f2942600640 1 -- 172.21.15.22:0/2035988452 learned_addr learned my addr 172.21.15.22:0/2035988452 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2941c00640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0cc830 0x7f293c1407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2942600640 1 -- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0cc830 msgr2=0x7f293c1407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2942600640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0cc830 0x7f293c1407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2942600640 1 -- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c0d0a10 msgr2=0x7f293c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2941200640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c0d0a10 0x7f293c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2942600640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c0d0a10 0x7f293c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2942600640 1 -- 172.21.15.22:0/2035988452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c0b42b0 con 0x7f293c15c840 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2941c00640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0cc830 0x7f293c1407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2941200640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c0d0a10 0x7f293c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2942600640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c15c840 0x7f293c156df0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2934036040 tx=0x7f2934004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2939600640 1 -- 172.21.15.22:0/2035988452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934043020 con 0x7f293c15c840 2024-04-16T16:17:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2939600640 1 -- 172.21.15.22:0/2035988452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293403e450 con 0x7f293c15c840 2024-04-16T16:17:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.707+0000 7f2939600640 1 -- 172.21.15.22:0/2035988452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934009510 con 0x7f293c15c840 2024-04-16T16:17:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.708+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293c0b4590 con 0x7f293c15c840 2024-04-16T16:17:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.708+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293c0b4b50 con 0x7f293c15c840 2024-04-16T16:17:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.709+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293c075f30 con 0x7f293c15c840 2024-04-16T16:17:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.710+0000 7f2939600640 1 -- 172.21.15.22:0/2035988452 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2934046020 con 0x7f293c15c840 2024-04-16T16:17:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.711+0000 7f2939600640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f291c06c8f0 0x7f291c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.711+0000 7f2939600640 1 -- 172.21.15.22:0/2035988452 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f29340adff0 con 0x7f293c15c840 2024-04-16T16:17:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.711+0000 7f2941c00640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f291c06c8f0 0x7f291c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.712+0000 7f2941c00640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f291c06c8f0 0x7f291c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f293c1f7ec0 tx=0x7f2930008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.716+0000 7f2939600640 1 -- 172.21.15.22:0/2035988452 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f293404d030 con 0x7f293c15c840 2024-04-16T16:17:52.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.918+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f293c06dfb0 con 0x7f293c15c840 2024-04-16T16:17:52.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.920+0000 7f2939600640 1 -- 172.21.15.22:0/2035988452 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f293c15cc20 con 0x7f293c15c840 2024-04-16T16:17:52.919 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f291c06c8f0 msgr2=0x7f291c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f291c06c8f0 0x7f291c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f293c1f7ec0 tx=0x7f2930008040 comp rx=0 tx=0).stop 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c15c840 msgr2=0x7f293c156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c15c840 0x7f293c156df0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2934036040 tx=0x7f2934004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 shutdown_connections 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f291c06c8f0 0x7f291c06edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f293c15c840 0x7f293c156df0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c0d0a10 0x7f293c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 --2- 172.21.15.22:0/2035988452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f293c0cc830 0x7f293c1407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:52.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 >> 172.21.15.22:0/2035988452 conn(0x7f293c062440 msgr2=0x7f293c070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:52.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 shutdown_connections 2024-04-16T16:17:52.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:52.922+0000 7f2943000640 1 -- 172.21.15.22:0/2035988452 wait complete. 2024-04-16T16:17:52.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T16:17:53.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.166+0000 7f0721a00640 1 Processor -- start 2024-04-16T16:17:53.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.166+0000 7f0721a00640 1 -- start start 2024-04-16T16:17:53.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.167+0000 7f0721a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f071c0d0b80 0x7f071c15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.167+0000 7f0721a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f071c0728c0 0x7f071c06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.167+0000 7f0721a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071c071b00 con 0x7f071c15b790 2024-04-16T16:17:53.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f0721a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f071c072430 con 0x7f071c0728c0 2024-04-16T16:17:53.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f0721a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f071c071de0 con 0x7f071c0d0b80 2024-04-16T16:17:53.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f0721000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f071c0728c0 0x7f071c06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f071be00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f071c15b790 0x7f071c0d0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34752/0 (socket says 172.21.15.22:34752) 2024-04-16T16:17:53.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f071be00640 1 -- 172.21.15.22:0/2613422092 learned_addr learned my addr 172.21.15.22:0/2613422092 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:53.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f071b400640 1 --2- 172.21.15.22:0/2613422092 >> v2:172.21.15.43:3300/0 conn(0x7f071c0d0b80 0x7f071c15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f0721000640 1 -- 172.21.15.22:0/2613422092 >> v2:172.21.15.43:3300/0 conn(0x7f071c0d0b80 msgr2=0x7f071c15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f0721000640 1 --2- 172.21.15.22:0/2613422092 >> v2:172.21.15.43:3300/0 conn(0x7f071c0d0b80 0x7f071c15fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f071aa00640 1 -- 172.21.15.22:0/2613422092 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651975602 0 0) 0x7f071c071b00 con 0x7f071c15b790 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f0721000640 1 -- 172.21.15.22:0/2613422092 >> v1:172.21.15.22:6789/0 conn(0x7f071c15b790 legacy=0x7f071c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.168+0000 7f0721000640 1 -- 172.21.15.22:0/2613422092 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c0720c0 con 0x7f071c0728c0 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.170+0000 7f0721000640 1 --2- 172.21.15.22:0/2613422092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c0728c0 0x7f071c06cf10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f071c15f2a0 tx=0x7f071402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b060782e596923d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.170+0000 7f071aa00640 1 -- 172.21.15.22:0/2613422092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714039070 con 0x7f071c0728c0 2024-04-16T16:17:53.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.170+0000 7f071aa00640 1 -- 172.21.15.22:0/2613422092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071402cc80 con 0x7f071c0728c0 2024-04-16T16:17:53.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.170+0000 7f071aa00640 1 -- 172.21.15.22:0/2613422092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714034660 con 0x7f071c0728c0 2024-04-16T16:17:53.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.170+0000 7f0721a00640 1 -- 172.21.15.22:0/2613422092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c0728c0 msgr2=0x7f071c06cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.170+0000 7f0721a00640 1 --2- 172.21.15.22:0/2613422092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c0728c0 0x7f071c06cf10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f071c15f2a0 tx=0x7f071402bed0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.171+0000 7f0721a00640 1 -- 172.21.15.22:0/2613422092 shutdown_connections 2024-04-16T16:17:53.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.171+0000 7f0721a00640 1 --2- 172.21.15.22:0/2613422092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c0728c0 0x7f071c06cf10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.171+0000 7f0721a00640 1 --2- 172.21.15.22:0/2613422092 >> v2:172.21.15.43:3300/0 conn(0x7f071c0d0b80 0x7f071c15fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.171+0000 7f0721a00640 1 -- 172.21.15.22:0/2613422092 >> 172.21.15.22:0/2613422092 conn(0x7f071c062440 msgr2=0x7f071c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:53.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.171+0000 7f0721a00640 1 -- 172.21.15.22:0/2613422092 shutdown_connections 2024-04-16T16:17:53.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.171+0000 7f0721a00640 1 -- 172.21.15.22:0/2613422092 wait complete. 2024-04-16T16:17:53.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.172+0000 7f0721a00640 1 Processor -- start 2024-04-16T16:17:53.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.173+0000 7f0721a00640 1 -- start start 2024-04-16T16:17:53.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.173+0000 7f0721a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f071c0728c0 0x7f071c146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.173+0000 7f0721a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f071c0d0b80 0x7f071c0b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.173+0000 7f0721a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c15b790 0x7f071c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.173+0000 7f0721a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f071c0cc7c0 con 0x7f071c15b790 2024-04-16T16:17:53.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.173+0000 7f0721a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f071c0afde0 con 0x7f071c0d0b80 2024-04-16T16:17:53.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.173+0000 7f0721a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f071c0cc940 con 0x7f071c0728c0 2024-04-16T16:17:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c15b790 0x7f071c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c15b790 0x7f071c155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49398/0 (socket says 172.21.15.22:49398) 2024-04-16T16:17:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 -- 172.21.15.22:0/1268007073 learned_addr learned my addr 172.21.15.22:0/1268007073 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f071be00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f071c0728c0 0x7f071c146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f071b400640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f071c0d0b80 0x7f071c0b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 -- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f071c0728c0 msgr2=0x7f071c146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f071c0728c0 0x7f071c146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 -- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f071c0d0b80 msgr2=0x7f071c0b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f071c0d0b80 0x7f071c0b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.174+0000 7f0721000640 1 -- 172.21.15.22:0/1268007073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c154340 con 0x7f071c15b790 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.175+0000 7f0721000640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c15b790 0x7f071c155d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0714009e80 tx=0x7f0714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.175+0000 7f0713e00640 1 -- 172.21.15.22:0/1268007073 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714039050 con 0x7f071c15b790 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.175+0000 7f0713e00640 1 -- 172.21.15.22:0/1268007073 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714045070 con 0x7f071c15b790 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.175+0000 7f0713e00640 1 -- 172.21.15.22:0/1268007073 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071403e830 con 0x7f071c15b790 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.175+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071c154620 con 0x7f071c15b790 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.175+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071c153900 con 0x7f071c15b790 2024-04-16T16:17:53.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.176+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071c075f30 con 0x7f071c15b790 2024-04-16T16:17:53.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.178+0000 7f0713e00640 1 -- 172.21.15.22:0/1268007073 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f071403e9d0 con 0x7f071c15b790 2024-04-16T16:17:53.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.178+0000 7f0713e00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f06fc06c8f0 0x7f06fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.179+0000 7f0713e00640 1 -- 172.21.15.22:0/1268007073 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f07140ae640 con 0x7f071c15b790 2024-04-16T16:17:53.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.179+0000 7f071be00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f06fc06c8f0 0x7f06fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.180+0000 7f071be00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f06fc06c8f0 0x7f06fc06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f070c000f60 tx=0x7f070c007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:53.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.183+0000 7f0713e00640 1 -- 172.21.15.22:0/1268007073 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f071407ce40 con 0x7f071c15b790 2024-04-16T16:17:53.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.387+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f071c154820 con 0x7f071c15b790 2024-04-16T16:17:53.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.388+0000 7f0713e00640 1 -- 172.21.15.22:0/1268007073 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f071407c740 con 0x7f071c15b790 2024-04-16T16:17:53.387 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:53.387 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-04-16T16:17:53.387 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:17:53.388 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-04-16T16:17:53.388 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-04-16T16:17:53.388 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:17:53.388 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f06fc06c8f0 msgr2=0x7f06fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f06fc06c8f0 0x7f06fc06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f070c000f60 tx=0x7f070c007c00 comp rx=0 tx=0).stop 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c15b790 msgr2=0x7f071c155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c15b790 0x7f071c155d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0714009e80 tx=0x7f0714004a40 comp rx=0 tx=0).stop 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 shutdown_connections 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f06fc06c8f0 0x7f06fc06edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f071c15b790 0x7f071c155d90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f071c0d0b80 0x7f071c0b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 --2- 172.21.15.22:0/1268007073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f071c0728c0 0x7f071c146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 >> 172.21.15.22:0/1268007073 conn(0x7f071c062440 msgr2=0x7f071c15fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 shutdown_connections 2024-04-16T16:17:53.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.391+0000 7f0721a00640 1 -- 172.21.15.22:0/1268007073 wait complete. 2024-04-16T16:17:53.408 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T16:17:53.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T16:17:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.633+0000 7fa242e00640 1 Processor -- start 2024-04-16T16:17:53.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.633+0000 7fa242e00640 1 -- start start 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.635+0000 7fa242e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa23c15c6e0 0x7fa23c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.635+0000 7fa242e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c06cf80 con 0x7fa23c0af930 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.635+0000 7fa242e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c06d260 con 0x7fa23c072e30 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.635+0000 7fa242e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c06d540 con 0x7fa23c15c6e0 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.635+0000 7fa241a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa23c15c6e0 0x7fa23c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.635+0000 7fa241a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa23c15c6e0 0x7fa23c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49404/0 (socket says 172.21.15.22:49404) 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.635+0000 7fa241a00640 1 -- 172.21.15.22:0/4264027285 learned_addr learned my addr 172.21.15.22:0/4264027285 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.636+0000 7fa241a00640 1 -- 172.21.15.22:0/4264027285 >> v1:172.21.15.43:6789/0 conn(0x7fa23c072e30 legacy=0x7fa23c0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:53.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.636+0000 7fa241a00640 1 -- 172.21.15.22:0/4264027285 >> v1:172.21.15.22:6789/0 conn(0x7fa23c0af930 legacy=0x7fa23c072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.636+0000 7fa241a00640 1 -- 172.21.15.22:0/4264027285 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c06d820 con 0x7fa23c15c6e0 2024-04-16T16:17:53.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.637+0000 7fa241a00640 1 --2- 172.21.15.22:0/4264027285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c15c6e0 0x7fa23c06e940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b97caca46a6ac67 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:53.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa23be00640 1 -- 172.21.15.22:0/4264027285 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230034070 con 0x7fa23c15c6e0 2024-04-16T16:17:53.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa23be00640 1 -- 172.21.15.22:0/4264027285 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa230030860 con 0x7fa23c15c6e0 2024-04-16T16:17:53.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa23be00640 1 -- 172.21.15.22:0/4264027285 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230030c30 con 0x7fa23c15c6e0 2024-04-16T16:17:53.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa242e00640 1 -- 172.21.15.22:0/4264027285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c15c6e0 msgr2=0x7fa23c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa242e00640 1 --2- 172.21.15.22:0/4264027285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c15c6e0 0x7fa23c06e940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23002b9a0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa242e00640 1 -- 172.21.15.22:0/4264027285 shutdown_connections 2024-04-16T16:17:53.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa242e00640 1 --2- 172.21.15.22:0/4264027285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c15c6e0 0x7fa23c06e940 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa242e00640 1 -- 172.21.15.22:0/4264027285 >> 172.21.15.22:0/4264027285 conn(0x7fa23c062440 msgr2=0x7fa23c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:53.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa242e00640 1 -- 172.21.15.22:0/4264027285 shutdown_connections 2024-04-16T16:17:53.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.638+0000 7fa242e00640 1 -- 172.21.15.22:0/4264027285 wait complete. 2024-04-16T16:17:53.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.640+0000 7fa242e00640 1 Processor -- start 2024-04-16T16:17:53.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.640+0000 7fa242e00640 1 -- start start 2024-04-16T16:17:53.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.641+0000 7fa242e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c072e30 0x7fa23c146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.641+0000 7fa242e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa23c0af930 0x7fa23c15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.641+0000 7fa242e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa23c15c6e0 0x7fa23c15e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.641+0000 7fa242e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c15cc40 con 0x7fa23c072e30 2024-04-16T16:17:53.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.641+0000 7fa242e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c15cac0 con 0x7fa23c0af930 2024-04-16T16:17:53.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.641+0000 7fa242e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa23c0cec40 con 0x7fa23c15c6e0 2024-04-16T16:17:53.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c072e30 0x7fa23c146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c072e30 0x7fa23c146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49408/0 (socket says 172.21.15.22:49408) 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 -- 172.21.15.22:0/1091816086 learned_addr learned my addr 172.21.15.22:0/1091816086 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241000640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa23c0af930 0x7fa23c15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 -- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa23c15c6e0 msgr2=0x7fa23c15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa23c15c6e0 0x7fa23c15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 -- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa23c0af930 msgr2=0x7fa23c15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa23c0af930 0x7fa23c15e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 -- 172.21.15.22:0/1091816086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c155740 con 0x7fa23c072e30 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241000640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa23c0af930 0x7fa23c15e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.642+0000 7fa241a00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c072e30 0x7fa23c146eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa2300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.643+0000 7fa239600640 1 -- 172.21.15.22:0/1091816086 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230034040 con 0x7fa23c072e30 2024-04-16T16:17:53.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.643+0000 7fa239600640 1 -- 172.21.15.22:0/1091816086 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2300433f0 con 0x7fa23c072e30 2024-04-16T16:17:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.643+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23c155f60 con 0x7fa23c072e30 2024-04-16T16:17:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.643+0000 7fa239600640 1 -- 172.21.15.22:0/1091816086 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300437e0 con 0x7fa23c072e30 2024-04-16T16:17:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.643+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23c1473f0 con 0x7fa23c072e30 2024-04-16T16:17:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.644+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23c075f30 con 0x7fa23c072e30 2024-04-16T16:17:53.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.645+0000 7fa239600640 1 -- 172.21.15.22:0/1091816086 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa230037070 con 0x7fa23c072e30 2024-04-16T16:17:53.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.646+0000 7fa239600640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa21c06c8f0 0x7fa21c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:53.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.646+0000 7fa239600640 1 -- 172.21.15.22:0/1091816086 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fa2300adb90 con 0x7fa23c072e30 2024-04-16T16:17:53.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.646+0000 7fa241000640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa21c06c8f0 0x7fa21c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:53.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.647+0000 7fa241000640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa21c06c8f0 0x7fa21c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa23c147730 tx=0x7fa228009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:53.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.651+0000 7fa239600640 1 -- 172.21.15.22:0/1091816086 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa23003e070 con 0x7fa23c072e30 2024-04-16T16:17:53.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:53.857+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa23c15d5b0 con 0x7fa23c072e30 2024-04-16T16:17:54.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.442+0000 7fa239600640 1 -- 172.21.15.22:0/1091816086 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7fa23007c270 con 0x7fa23c072e30 2024-04-16T16:17:54.442 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-04-16T16:17:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.446+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa21c06c8f0 msgr2=0x7fa21c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.446+0000 7fa242e00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa21c06c8f0 0x7fa21c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa23c147730 tx=0x7fa228009040 comp rx=0 tx=0).stop 2024-04-16T16:17:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.446+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c072e30 msgr2=0x7fa23c146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.446+0000 7fa242e00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c072e30 0x7fa23c146eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa2300046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 shutdown_connections 2024-04-16T16:17:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa21c06c8f0 0x7fa21c06edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa23c15c6e0 0x7fa23c15e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa23c0af930 0x7fa23c15e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 --2- 172.21.15.22:0/1091816086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa23c072e30 0x7fa23c146eb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 >> 172.21.15.22:0/1091816086 conn(0x7fa23c062440 msgr2=0x7fa23c070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 shutdown_connections 2024-04-16T16:17:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.447+0000 7fa242e00640 1 -- 172.21.15.22:0/1091816086 wait complete. 2024-04-16T16:17:54.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T16:17:54.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.692+0000 7f0e21c00640 1 Processor -- start 2024-04-16T16:17:54.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.692+0000 7f0e21c00640 1 -- start start 2024-04-16T16:17:54.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.693+0000 7f0e21c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c15ee70 0x7f0e1c0d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:54.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.693+0000 7f0e21c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e1c0d2f50 0x7f0e1c0d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.693+0000 7f0e21c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c0d34c0 con 0x7f0e1c0cf450 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.693+0000 7f0e21c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1c0d40d0 con 0x7f0e1c0d2f50 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.693+0000 7f0e21c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c0d37a0 con 0x7f0e1c15ee70 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1a000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e1c0d2f50 0x7f0e1c0d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1a000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e1c0d2f50 0x7f0e1c0d1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49422/0 (socket says 172.21.15.22:49422) 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1a000640 1 -- 172.21.15.22:0/2368429787 learned_addr learned my addr 172.21.15.22:0/2368429787 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1aa00640 1 --2- 172.21.15.22:0/2368429787 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c15ee70 0x7f0e1c0d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1a000640 1 -- 172.21.15.22:0/2368429787 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c15ee70 msgr2=0x7f0e1c0d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1a000640 1 --2- 172.21.15.22:0/2368429787 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c15ee70 0x7f0e1c0d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1a000640 1 -- 172.21.15.22:0/2368429787 >> v1:172.21.15.43:6789/0 conn(0x7f0e1c0cf450 legacy=0x7f0e1c0b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:54.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.694+0000 7f0e1a000640 1 -- 172.21.15.22:0/2368429787 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c0d3a80 con 0x7f0e1c0d2f50 2024-04-16T16:17:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.696+0000 7f0e1a000640 1 --2- 172.21.15.22:0/2368429787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0d2f50 0x7f0e1c0d1460 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009870 tx=0x7f0e0802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b2af54416265fa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:54.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e19600640 1 -- 172.21.15.22:0/2368429787 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08034070 con 0x7f0e1c0d2f50 2024-04-16T16:17:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e19600640 1 -- 172.21.15.22:0/2368429787 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e08030840 con 0x7f0e1c0d2f50 2024-04-16T16:17:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e19600640 1 -- 172.21.15.22:0/2368429787 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08030c10 con 0x7f0e1c0d2f50 2024-04-16T16:17:54.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e21c00640 1 -- 172.21.15.22:0/2368429787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0d2f50 msgr2=0x7f0e1c0d1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:54.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e21c00640 1 --2- 172.21.15.22:0/2368429787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0d2f50 0x7f0e1c0d1460 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009870 tx=0x7f0e0802b980 comp rx=0 tx=0).stop 2024-04-16T16:17:54.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e21c00640 1 -- 172.21.15.22:0/2368429787 shutdown_connections 2024-04-16T16:17:54.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e21c00640 1 --2- 172.21.15.22:0/2368429787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0d2f50 0x7f0e1c0d1460 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e21c00640 1 --2- 172.21.15.22:0/2368429787 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c15ee70 0x7f0e1c0d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.697+0000 7f0e21c00640 1 -- 172.21.15.22:0/2368429787 >> 172.21.15.22:0/2368429787 conn(0x7f0e1c062440 msgr2=0x7f0e1c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:54.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.698+0000 7f0e21c00640 1 -- 172.21.15.22:0/2368429787 shutdown_connections 2024-04-16T16:17:54.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.698+0000 7f0e21c00640 1 -- 172.21.15.22:0/2368429787 wait complete. 2024-04-16T16:17:54.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.699+0000 7f0e21c00640 1 Processor -- start 2024-04-16T16:17:54.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.699+0000 7f0e21c00640 1 -- start start 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.700+0000 7f0e21c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0cf450 0x7f0e1c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.700+0000 7f0e21c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c0d2f50 0x7f0e1c0b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.700+0000 7f0e21c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e1c15ee70 0x7f0e1c161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.700+0000 7f0e21c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c15f3d0 con 0x7f0e1c0cf450 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.700+0000 7f0e21c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c15f250 con 0x7f0e1c15ee70 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.700+0000 7f0e21c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c0b4050 con 0x7f0e1c0d2f50 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0cf450 0x7f0e1c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0cf450 0x7f0e1c155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49434/0 (socket says 172.21.15.22:49434) 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 -- 172.21.15.22:0/356355710 learned_addr learned my addr 172.21.15.22:0/356355710 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1a000640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c0d2f50 0x7f0e1c0b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:54.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1b400640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e1c15ee70 0x7f0e1c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:54.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 -- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c0d2f50 msgr2=0x7f0e1c0b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c0d2f50 0x7f0e1c0b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 -- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e1c15ee70 msgr2=0x7f0e1c161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e1c15ee70 0x7f0e1c161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.701+0000 7f0e1aa00640 1 -- 172.21.15.22:0/356355710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c1562f0 con 0x7f0e1c0cf450 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.702+0000 7f0e1aa00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0cf450 0x7f0e1c155db0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c007e70 tx=0x7f0e0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.702+0000 7f0e12a00640 1 -- 172.21.15.22:0/356355710 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c014620 con 0x7f0e1c0cf450 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.702+0000 7f0e12a00640 1 -- 172.21.15.22:0/356355710 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c019070 con 0x7f0e1c0cf450 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.702+0000 7f0e12a00640 1 -- 172.21.15.22:0/356355710 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c014a00 con 0x7f0e1c0cf450 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.702+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c0b5090 con 0x7f0e1c0cf450 2024-04-16T16:17:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.702+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c0b5650 con 0x7f0e1c0cf450 2024-04-16T16:17:54.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.703+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c04fd90 con 0x7f0e1c0cf450 2024-04-16T16:17:54.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.705+0000 7f0e12a00640 1 -- 172.21.15.22:0/356355710 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e0c014ba0 con 0x7f0e1c0cf450 2024-04-16T16:17:54.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.706+0000 7f0e12a00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0dfc06c8f0 0x7f0dfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.706+0000 7f0e12a00640 1 -- 172.21.15.22:0/356355710 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f0e0c08c230 con 0x7f0e1c0cf450 2024-04-16T16:17:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.706+0000 7f0e1a000640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0dfc06c8f0 0x7f0dfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.707+0000 7f0e1a000640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0dfc06c8f0 0x7f0dfc06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0e08036000 tx=0x7f0e0803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:54.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.711+0000 7f0e12a00640 1 -- 172.21.15.22:0/356355710 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0e0c05a830 con 0x7f0e1c0cf450 2024-04-16T16:17:54.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:54.916+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0e1c0cb2d0 con 0x7f0e1c0cf450 2024-04-16T16:17:55.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.460+0000 7f0e12a00640 1 -- 172.21.15.22:0/356355710 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f0e0c05a130 con 0x7f0e1c0cf450 2024-04-16T16:17:55.459 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.463+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0dfc06c8f0 msgr2=0x7f0dfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.463+0000 7f0e21c00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0dfc06c8f0 0x7f0dfc06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0e08036000 tx=0x7f0e0803b040 comp rx=0 tx=0).stop 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.463+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0cf450 msgr2=0x7f0e1c155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.463+0000 7f0e21c00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0cf450 0x7f0e1c155db0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c007e70 tx=0x7f0e0c00e4b0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 shutdown_connections 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0dfc06c8f0 0x7f0dfc06edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e1c15ee70 0x7f0e1c161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e1c0d2f50 0x7f0e1c0b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 --2- 172.21.15.22:0/356355710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1c0cf450 0x7f0e1c155db0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 >> 172.21.15.22:0/356355710 conn(0x7f0e1c062440 msgr2=0x7f0e1c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 shutdown_connections 2024-04-16T16:17:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.464+0000 7f0e21c00640 1 -- 172.21.15.22:0/356355710 wait complete. 2024-04-16T16:17:55.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T16:17:55.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.695+0000 7fc5c9e00640 1 Processor -- start 2024-04-16T16:17:55.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.695+0000 7fc5c9e00640 1 -- start start 2024-04-16T16:17:55.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c40b3dc0 0x7fc5c406df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:55.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5c4072680 0x7fc5c4070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:55.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c4163170 con 0x7fc5c415e850 2024-04-16T16:17:55.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c406e4c0 con 0x7fc5c4072680 2024-04-16T16:17:55.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c406d4a0 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5c4072680 0x7fc5c4070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5c4072680 0x7fc5c4070ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49440/0 (socket says 172.21.15.22:49440) 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c9400640 1 -- 172.21.15.22:0/808546793 learned_addr learned my addr 172.21.15.22:0/808546793 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.697+0000 7fc5c3e00640 1 --2- 172.21.15.22:0/808546793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c40b3dc0 0x7fc5c406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.698+0000 7fc5c9400640 1 -- 172.21.15.22:0/808546793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c40b3dc0 msgr2=0x7fc5c406df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.698+0000 7fc5c9400640 1 --2- 172.21.15.22:0/808546793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c40b3dc0 0x7fc5c406df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.698+0000 7fc5c9400640 1 -- 172.21.15.22:0/808546793 >> v1:172.21.15.43:6789/0 conn(0x7fc5c415e850 legacy=0x7fc5c40b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.698+0000 7fc5c9400640 1 -- 172.21.15.22:0/808546793 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c406d780 con 0x7fc5c4072680 2024-04-16T16:17:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.699+0000 7fc5c9400640 1 --2- 172.21.15.22:0/808546793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c4072680 0x7fc5c4070ea0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7cc8a214be9f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.699+0000 7fc5c3400640 1 -- 172.21.15.22:0/808546793 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc02cb00 con 0x7fc5c4072680 2024-04-16T16:17:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.699+0000 7fc5c3400640 1 -- 172.21.15.22:0/808546793 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5bc02cca0 con 0x7fc5c4072680 2024-04-16T16:17:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.699+0000 7fc5c3400640 1 -- 172.21.15.22:0/808546793 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc034610 con 0x7fc5c4072680 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 -- 172.21.15.22:0/808546793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c4072680 msgr2=0x7fc5c4070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/808546793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c4072680 0x7fc5c4070ea0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc02bf60 comp rx=0 tx=0).stop 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 -- 172.21.15.22:0/808546793 shutdown_connections 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/808546793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c4072680 0x7fc5c4070ea0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/808546793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c40b3dc0 0x7fc5c406df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 -- 172.21.15.22:0/808546793 >> 172.21.15.22:0/808546793 conn(0x7fc5c4062440 msgr2=0x7fc5c4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 -- 172.21.15.22:0/808546793 shutdown_connections 2024-04-16T16:17:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.700+0000 7fc5c9e00640 1 -- 172.21.15.22:0/808546793 wait complete. 2024-04-16T16:17:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.702+0000 7fc5c9e00640 1 Processor -- start 2024-04-16T16:17:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.702+0000 7fc5c9e00640 1 -- start start 2024-04-16T16:17:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.703+0000 7fc5c9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c4072680 0x7fc5c4160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.703+0000 7fc5c9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c40b3dc0 0x7fc5c4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.703+0000 7fc5c9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5c415e850 0x7fc5c415c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.703+0000 7fc5c9e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c4162e10 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.703+0000 7fc5c9e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c415ec30 con 0x7fc5c415e850 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.703+0000 7fc5c9e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c4072d60 con 0x7fc5c4072680 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c40b3dc0 0x7fc5c4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c40b3dc0 0x7fc5c4153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49450/0 (socket says 172.21.15.22:49450) 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 -- 172.21.15.22:0/979362770 learned_addr learned my addr 172.21.15.22:0/979362770 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c8a00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c4072680 0x7fc5c4160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c9400640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5c415e850 0x7fc5c415c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 -- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c4072680 msgr2=0x7fc5c4160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c4072680 0x7fc5c4160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 -- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5c415e850 msgr2=0x7fc5c415c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5c415e850 0x7fc5c415c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.704+0000 7fc5c3e00640 1 -- 172.21.15.22:0/979362770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c41611c0 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.705+0000 7fc5c3e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c40b3dc0 0x7fc5c4153ba0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000d800 tx=0x7fc5b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.705+0000 7fc5c0c00640 1 -- 172.21.15.22:0/979362770 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000b6c0 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.705+0000 7fc5c0c00640 1 -- 172.21.15.22:0/979362770 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0019070 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.705+0000 7fc5c0c00640 1 -- 172.21.15.22:0/979362770 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000ba80 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.705+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c41614a0 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.705+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c4161a60 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.706+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c4075f30 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.707+0000 7fc5c0c00640 1 -- 172.21.15.22:0/979362770 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5b000bc20 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.708+0000 7fc5c0c00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5a406c920 0x7fc5a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.709+0000 7fc5c0c00640 1 -- 172.21.15.22:0/979362770 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fc5b008bfe0 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.709+0000 7fc5c8a00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5a406c920 0x7fc5a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:55.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.709+0000 7fc5c8a00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5a406c920 0x7fc5a406ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8007fd0 tx=0x7fc5b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:55.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.714+0000 7fc5c0c00640 1 -- 172.21.15.22:0/979362770 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5b001c360 con 0x7fc5c40b3dc0 2024-04-16T16:17:55.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:55.962+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc5c40d0560 con 0x7fc5c40b3dc0 2024-04-16T16:17:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.484+0000 7fc5c0c00640 1 -- 172.21.15.22:0/979362770 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fc5b005a410 con 0x7fc5c40b3dc0 2024-04-16T16:17:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 4 and data pool 5 2024-04-16T16:17:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.491+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5a406c920 msgr2=0x7fc5a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.491+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5a406c920 0x7fc5a406ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8007fd0 tx=0x7fc5b8009040 comp rx=0 tx=0).stop 2024-04-16T16:17:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.491+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c40b3dc0 msgr2=0x7fc5c4153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.491+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c40b3dc0 0x7fc5c4153ba0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000d800 tx=0x7fc5b000dcc0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.492+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 shutdown_connections 2024-04-16T16:17:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.492+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5a406c920 0x7fc5a406ede0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.492+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5c415e850 0x7fc5c415c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.492+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5c40b3dc0 0x7fc5c4153ba0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.492+0000 7fc5c9e00640 1 --2- 172.21.15.22:0/979362770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5c4072680 0x7fc5c4160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.492+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 >> 172.21.15.22:0/979362770 conn(0x7fc5c4062440 msgr2=0x7fc5c415d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:56.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.497+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 shutdown_connections 2024-04-16T16:17:56.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.497+0000 7fc5c9e00640 1 -- 172.21.15.22:0/979362770 wait complete. 2024-04-16T16:17:56.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:56.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.720+0000 7f952e200640 1 Processor -- start 2024-04-16T16:17:56.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.720+0000 7f952e200640 1 -- start start 2024-04-16T16:17:56.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.721+0000 7f952e200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f952815cb70 0x7f952806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.721+0000 7f952e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.721+0000 7f952e200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95280afdc0 con 0x7f952815b7e0 2024-04-16T16:17:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.721+0000 7f952e200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f952806eb00 con 0x7f952815cb70 2024-04-16T16:17:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.721+0000 7f952e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f95280b45c0 con 0x7f952806e690 2024-04-16T16:17:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9527400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f952815b7e0 0x7f95280af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34772/0 (socket says 172.21.15.22:34772) 2024-04-16T16:17:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9527400640 1 -- 172.21.15.22:0/2516259301 learned_addr learned my addr 172.21.15.22:0/2516259301 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:56.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9526a00640 1 --2- 172.21.15.22:0/2516259301 >> v2:172.21.15.22:3300/0 conn(0x7f952815cb70 0x7f952806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9526000640 1 -- 172.21.15.22:0/2516259301 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084844488 0 0) 0x7f95280afdc0 con 0x7f952815b7e0 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9526000640 1 -- 172.21.15.22:0/2516259301 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f950c003520 con 0x7f952815b7e0 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9527e00640 1 --2- 172.21.15.22:0/2516259301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9526a00640 1 -- 172.21.15.22:0/2516259301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 msgr2=0x7f9528071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9526a00640 1 --2- 172.21.15.22:0/2516259301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9526a00640 1 -- 172.21.15.22:0/2516259301 >> v1:172.21.15.22:6789/0 conn(0x7f952815b7e0 legacy=0x7f95280af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.722+0000 7f9526a00640 1 -- 172.21.15.22:0/2516259301 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95280b47f0 con 0x7f952815cb70 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.724+0000 7f9526a00640 1 --2- 172.21.15.22:0/2516259301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815cb70 0x7f952806e150 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f95140097a0 tx=0x7f951402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49c85e66dc7024b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.724+0000 7f9526000640 1 -- 172.21.15.22:0/2516259301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514035020 con 0x7f952815cb70 2024-04-16T16:17:56.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.724+0000 7f9526000640 1 -- 172.21.15.22:0/2516259301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514031830 con 0x7f952815cb70 2024-04-16T16:17:56.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.724+0000 7f9526000640 1 -- 172.21.15.22:0/2516259301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514031c00 con 0x7f952815cb70 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.724+0000 7f952e200640 1 -- 172.21.15.22:0/2516259301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815cb70 msgr2=0x7f952806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.724+0000 7f952e200640 1 --2- 172.21.15.22:0/2516259301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815cb70 0x7f952806e150 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f95140097a0 tx=0x7f951402b8d0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.725+0000 7f952e200640 1 -- 172.21.15.22:0/2516259301 shutdown_connections 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.725+0000 7f952e200640 1 --2- 172.21.15.22:0/2516259301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.725+0000 7f952e200640 1 --2- 172.21.15.22:0/2516259301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815cb70 0x7f952806e150 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.725+0000 7f952e200640 1 -- 172.21.15.22:0/2516259301 >> 172.21.15.22:0/2516259301 conn(0x7f9528062440 msgr2=0x7f9528062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.725+0000 7f952e200640 1 -- 172.21.15.22:0/2516259301 shutdown_connections 2024-04-16T16:17:56.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.725+0000 7f952e200640 1 -- 172.21.15.22:0/2516259301 wait complete. 2024-04-16T16:17:56.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.726+0000 7f952e200640 1 Processor -- start 2024-04-16T16:17:56.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.727+0000 7f952e200640 1 -- start start 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.727+0000 7f952e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f952e200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815b7e0 0x7f95280cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f952e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952815cb70 0x7f95280cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f952e200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95280b5090 con 0x7f952815b7e0 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f952e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f95280b4db0 con 0x7f952815cb70 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f952e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f952815bbc0 con 0x7f952806e690 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9526a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815b7e0 0x7f95280cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9526a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815b7e0 0x7f95280cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49462/0 (socket says 172.21.15.22:49462) 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9526a00640 1 -- 172.21.15.22:0/3601491806 learned_addr learned my addr 172.21.15.22:0/3601491806 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9527400640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9527e00640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952815cb70 0x7f95280cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9526a00640 1 -- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 msgr2=0x7f9528147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9526a00640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9526a00640 1 -- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952815cb70 msgr2=0x7f95280cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.728+0000 7f9526a00640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952815cb70 0x7f95280cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.729+0000 7f9526a00640 1 -- 172.21.15.22:0/3601491806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9528148020 con 0x7f952815b7e0 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.729+0000 7f9526a00640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815b7e0 0x7f95280cedf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f95140098c0 tx=0x7f95140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.729+0000 7f951f400640 1 -- 172.21.15.22:0/3601491806 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514040070 con 0x7f952815b7e0 2024-04-16T16:17:56.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.729+0000 7f951f400640 1 -- 172.21.15.22:0/3601491806 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951403e070 con 0x7f952815b7e0 2024-04-16T16:17:56.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.729+0000 7f951f400640 1 -- 172.21.15.22:0/3601491806 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514035040 con 0x7f952815b7e0 2024-04-16T16:17:56.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.729+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95281525d0 con 0x7f952815b7e0 2024-04-16T16:17:56.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.729+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9528152b90 con 0x7f952815b7e0 2024-04-16T16:17:56.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.731+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952804fd90 con 0x7f952815b7e0 2024-04-16T16:17:56.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.732+0000 7f951f400640 1 -- 172.21.15.22:0/3601491806 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9514038020 con 0x7f952815b7e0 2024-04-16T16:17:56.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.732+0000 7f951f400640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f950806c8f0 0x7f950806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:56.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.733+0000 7f951f400640 1 -- 172.21.15.22:0/3601491806 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f95140ad0f0 con 0x7f952815b7e0 2024-04-16T16:17:56.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.733+0000 7f9527400640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f950806c8f0 0x7f950806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:56.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.733+0000 7f9527400640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f950806c8f0 0x7f950806edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9518005880 tx=0x7f9518009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:56.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.738+0000 7f951f400640 1 -- 172.21.15.22:0/3601491806 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9514031800 con 0x7f952815b7e0 2024-04-16T16:17:56.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.937+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95280b00e0 con 0x7f952815b7e0 2024-04-16T16:17:56.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.940+0000 7f951f400640 1 -- 172.21.15.22:0/3601491806 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16562 (secure 0 0 0) 0x7f951407b480 con 0x7f952815b7e0 2024-04-16T16:17:56.940 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:56.940 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:55.963598+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:56.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f950806c8f0 msgr2=0x7f950806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f950806c8f0 0x7f950806edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9518005880 tx=0x7f9518009040 comp rx=0 tx=0).stop 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815b7e0 msgr2=0x7f95280cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815b7e0 0x7f95280cedf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f95140098c0 tx=0x7f95140046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 shutdown_connections 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f950806c8f0 0x7f950806edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952815cb70 0x7f95280cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952815b7e0 0x7f95280cedf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 --2- 172.21.15.22:0/3601491806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952806e690 0x7f9528147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 >> 172.21.15.22:0/3601491806 conn(0x7f9528062440 msgr2=0x7f95280ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 shutdown_connections 2024-04-16T16:17:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:56.943+0000 7f952e200640 1 -- 172.21.15.22:0/3601491806 wait complete. 2024-04-16T16:17:56.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:17:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.179+0000 7f7892c00640 1 Processor -- start 2024-04-16T16:17:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.180+0000 7f7892c00640 1 -- start start 2024-04-16T16:17:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.181+0000 7f7892c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f788c0721f0 0x7f788c072600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.181+0000 7f7892c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c072b40 con 0x7f788c159550 2024-04-16T16:17:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.181+0000 7f7892c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c0b6540 con 0x7f788c0d1100 2024-04-16T16:17:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.181+0000 7f7892c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f788c070060 con 0x7f788c0721f0 2024-04-16T16:17:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f788be00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f788c159550 0x7f788c0b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34776/0 (socket says 172.21.15.22:34776) 2024-04-16T16:17:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f788be00640 1 -- 172.21.15.22:0/1193375160 learned_addr learned my addr 172.21.15.22:0/1193375160 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:57.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f7890c00640 1 --2- 172.21.15.22:0/1193375160 >> v2:172.21.15.22:3300/0 conn(0x7f788c0721f0 0x7f788c072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f788aa00640 1 -- 172.21.15.22:0/1193375160 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664910354 0 0) 0x7f787c001490 con 0x7f788c159550 2024-04-16T16:17:57.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f788aa00640 1 -- 172.21.15.22:0/1193375160 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7870003520 con 0x7f788c159550 2024-04-16T16:17:57.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f7890c00640 1 -- 172.21.15.22:0/1193375160 >> v1:172.21.15.43:6789/0 conn(0x7f788c0d1100 legacy=0x7f788c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:57.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f7890c00640 1 -- 172.21.15.22:0/1193375160 >> v1:172.21.15.22:6789/0 conn(0x7f788c159550 legacy=0x7f788c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.182+0000 7f7890c00640 1 -- 172.21.15.22:0/1193375160 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c0b6820 con 0x7f788c0721f0 2024-04-16T16:17:57.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.184+0000 7f7890c00640 1 --2- 172.21.15.22:0/1193375160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c0721f0 0x7f788c072600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f78840097a0 tx=0x7f788402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414f2c7364a2fbd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.184+0000 7f788aa00640 1 -- 172.21.15.22:0/1193375160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78840315a0 con 0x7f788c0721f0 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.184+0000 7f788aa00640 1 -- 172.21.15.22:0/1193375160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7884037070 con 0x7f788c0721f0 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.184+0000 7f788aa00640 1 -- 172.21.15.22:0/1193375160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884031940 con 0x7f788c0721f0 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.184+0000 7f7892c00640 1 -- 172.21.15.22:0/1193375160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c0721f0 msgr2=0x7f788c072600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.184+0000 7f7892c00640 1 --2- 172.21.15.22:0/1193375160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c0721f0 0x7f788c072600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f78840097a0 tx=0x7f788402b840 comp rx=0 tx=0).stop 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.185+0000 7f7892c00640 1 -- 172.21.15.22:0/1193375160 shutdown_connections 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.185+0000 7f7892c00640 1 --2- 172.21.15.22:0/1193375160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c0721f0 0x7f788c072600 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.185+0000 7f7892c00640 1 -- 172.21.15.22:0/1193375160 >> 172.21.15.22:0/1193375160 conn(0x7f788c0d1820 msgr2=0x7f788c0d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.185+0000 7f7892c00640 1 -- 172.21.15.22:0/1193375160 shutdown_connections 2024-04-16T16:17:57.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.185+0000 7f7892c00640 1 -- 172.21.15.22:0/1193375160 wait complete. 2024-04-16T16:17:57.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.186+0000 7f7892c00640 1 Processor -- start 2024-04-16T16:17:57.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.186+0000 7f7892c00640 1 -- start start 2024-04-16T16:17:57.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.187+0000 7f7892c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f788c0721f0 0x7f788c0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.187+0000 7f7892c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f788c0d1100 0x7f788c0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.187+0000 7f7892c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c159550 0x7f788c0af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.187+0000 7f7892c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f788c15be50 con 0x7f788c159550 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.187+0000 7f7892c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f788c159930 con 0x7f788c0d1100 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.187+0000 7f7892c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f788c15bfd0 con 0x7f788c0721f0 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c159550 0x7f788c0af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c159550 0x7f788c0af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49484/0 (socket says 172.21.15.22:49484) 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 -- 172.21.15.22:0/1850772399 learned_addr learned my addr 172.21.15.22:0/1850772399 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f788be00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f788c0721f0 0x7f788c0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f788b400640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f788c0d1100 0x7f788c0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 -- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f788c0721f0 msgr2=0x7f788c0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f788c0721f0 0x7f788c0d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 -- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f788c0d1100 msgr2=0x7f788c0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f788c0d1100 0x7f788c0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.188+0000 7f7890c00640 1 -- 172.21.15.22:0/1850772399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c1567d0 con 0x7f788c159550 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.189+0000 7f7890c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c159550 0x7f788c0af9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78840097a0 tx=0x7f78840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.189+0000 7f7883e00640 1 -- 172.21.15.22:0/1850772399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884032630 con 0x7f788c159550 2024-04-16T16:17:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.189+0000 7f7883e00640 1 -- 172.21.15.22:0/1850772399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78840327d0 con 0x7f788c159550 2024-04-16T16:17:57.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.189+0000 7f7883e00640 1 -- 172.21.15.22:0/1850772399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884032bc0 con 0x7f788c159550 2024-04-16T16:17:57.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.189+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788c156ab0 con 0x7f788c159550 2024-04-16T16:17:57.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.189+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c157070 con 0x7f788c159550 2024-04-16T16:17:57.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.190+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788c04fd90 con 0x7f788c159550 2024-04-16T16:17:57.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.191+0000 7f7883e00640 1 -- 172.21.15.22:0/1850772399 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f788404c020 con 0x7f788c159550 2024-04-16T16:17:57.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.192+0000 7f7883e00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f786806c8f0 0x7f786806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.193+0000 7f7883e00640 1 -- 172.21.15.22:0/1850772399 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f788402f020 con 0x7f788c159550 2024-04-16T16:17:57.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.193+0000 7f788be00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f786806c8f0 0x7f786806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.194+0000 7f788be00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f786806c8f0 0x7f786806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f787c005c00 tx=0x7f787c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:57.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.197+0000 7f7883e00640 1 -- 172.21.15.22:0/1850772399 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7884040070 con 0x7f788c159550 2024-04-16T16:17:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.408+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f788c0b4670 con 0x7f788c159550 2024-04-16T16:17:57.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.412+0000 7f7883e00640 1 -- 172.21.15.22:0/1850772399 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16562 (secure 0 0 0) 0x7f788407bc10 con 0x7f788c159550 2024-04-16T16:17:57.411 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:17:57.411 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:55.963598+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:17:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.414+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f786806c8f0 msgr2=0x7f786806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.414+0000 7f7892c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f786806c8f0 0x7f786806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f787c005c00 tx=0x7f787c009040 comp rx=0 tx=0).stop 2024-04-16T16:17:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.414+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c159550 msgr2=0x7f788c0af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.414+0000 7f7892c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c159550 0x7f788c0af9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78840097a0 tx=0x7f78840046c0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 shutdown_connections 2024-04-16T16:17:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f786806c8f0 0x7f786806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f788c159550 0x7f788c0af9b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f788c0d1100 0x7f788c0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 --2- 172.21.15.22:0/1850772399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f788c0721f0 0x7f788c0d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 >> 172.21.15.22:0/1850772399 conn(0x7f788c0d1820 msgr2=0x7f788c0ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:57.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 shutdown_connections 2024-04-16T16:17:57.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.415+0000 7f7892c00640 1 -- 172.21.15.22:0/1850772399 wait complete. 2024-04-16T16:17:57.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T16:17:57.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.660+0000 7f8108a00640 1 Processor -- start 2024-04-16T16:17:57.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.660+0000 7f8108a00640 1 -- start start 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8108a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f810415fe30 0x7f8104070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8108a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81040b33a0 0x7f81040ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8108a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81040715c0 con 0x7f81040b4fa0 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8108a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8104071360 con 0x7f81040b33a0 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8108a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f81040718a0 con 0x7f810415fe30 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8103200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81040b33a0 0x7f81040ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8103200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81040b33a0 0x7f81040ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49498/0 (socket says 172.21.15.22:49498) 2024-04-16T16:17:57.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.662+0000 7f8103200640 1 -- 172.21.15.22:0/79052061 learned_addr learned my addr 172.21.15.22:0/79052061 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:57.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.663+0000 7f8101e00640 1 --2- 172.21.15.22:0/79052061 >> v2:172.21.15.43:3300/0 conn(0x7f810415fe30 0x7f8104070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.663+0000 7f8103200640 1 -- 172.21.15.22:0/79052061 >> v2:172.21.15.43:3300/0 conn(0x7f810415fe30 msgr2=0x7f8104070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:57.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.663+0000 7f8103200640 1 --2- 172.21.15.22:0/79052061 >> v2:172.21.15.43:3300/0 conn(0x7f810415fe30 0x7f8104070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.663+0000 7f8103200640 1 -- 172.21.15.22:0/79052061 >> v1:172.21.15.43:6789/0 conn(0x7f81040b4fa0 legacy=0x7f810415f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:57.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.663+0000 7f8103200640 1 -- 172.21.15.22:0/79052061 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8104071b80 con 0x7f81040b33a0 2024-04-16T16:17:57.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.663+0000 7f8101e00640 1 --2- 172.21.15.22:0/79052061 >> v2:172.21.15.43:3300/0 conn(0x7f810415fe30 0x7f8104070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:57.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.664+0000 7f8103200640 1 --2- 172.21.15.22:0/79052061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b33a0 0x7f81040ceb30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f81040cdff0 tx=0x7f80fc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1650011d6652a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:57.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.664+0000 7f8101400640 1 -- 172.21.15.22:0/79052061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc02ca80 con 0x7f81040b33a0 2024-04-16T16:17:57.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.664+0000 7f8101400640 1 -- 172.21.15.22:0/79052061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80fc02cc20 con 0x7f81040b33a0 2024-04-16T16:17:57.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.664+0000 7f8101400640 1 -- 172.21.15.22:0/79052061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0343f0 con 0x7f81040b33a0 2024-04-16T16:17:57.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 -- 172.21.15.22:0/79052061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b33a0 msgr2=0x7f81040ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 --2- 172.21.15.22:0/79052061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b33a0 0x7f81040ceb30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f81040cdff0 tx=0x7f80fc02bee0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 -- 172.21.15.22:0/79052061 shutdown_connections 2024-04-16T16:17:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 --2- 172.21.15.22:0/79052061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b33a0 0x7f81040ceb30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 --2- 172.21.15.22:0/79052061 >> v2:172.21.15.43:3300/0 conn(0x7f810415fe30 0x7f8104070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 -- 172.21.15.22:0/79052061 >> 172.21.15.22:0/79052061 conn(0x7f8104075070 msgr2=0x7f8104062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 -- 172.21.15.22:0/79052061 shutdown_connections 2024-04-16T16:17:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.665+0000 7f8108a00640 1 -- 172.21.15.22:0/79052061 wait complete. 2024-04-16T16:17:57.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.667+0000 7f8108a00640 1 Processor -- start 2024-04-16T16:17:57.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.667+0000 7f8108a00640 1 -- start start 2024-04-16T16:17:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8108a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81040b33a0 0x7f81041f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8108a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b4fa0 0x7f810415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8108a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f810415fe30 0x7f81041e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8108a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81040b5380 con 0x7f81040b4fa0 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8108a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81040ce630 con 0x7f810415fe30 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8108a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f81040b5500 con 0x7f81040b33a0 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8101e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b4fa0 0x7f810415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8101e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b4fa0 0x7f810415a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49508/0 (socket says 172.21.15.22:49508) 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.668+0000 7f8101e00640 1 -- 172.21.15.22:0/475965108 learned_addr learned my addr 172.21.15.22:0/475965108 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8103200640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f810415fe30 0x7f81041e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8102800640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81040b33a0 0x7f81041f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8101e00640 1 -- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81040b33a0 msgr2=0x7f81041f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8101e00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81040b33a0 0x7f81041f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8101e00640 1 -- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f810415fe30 msgr2=0x7f81041e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8101e00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f810415fe30 0x7f81041e8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8101e00640 1 -- 172.21.15.22:0/475965108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81041f5a20 con 0x7f81040b4fa0 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8103200640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f810415fe30 0x7f81041e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.669+0000 7f8101e00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b4fa0 0x7f810415a880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c7f0 tx=0x7f80f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.670+0000 7f80faa00640 1 -- 172.21.15.22:0/475965108 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0015070 con 0x7f81040b4fa0 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.670+0000 7f80faa00640 1 -- 172.21.15.22:0/475965108 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f0007820 con 0x7f81040b4fa0 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.670+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81041e7350 con 0x7f81040b4fa0 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.670+0000 7f80faa00640 1 -- 172.21.15.22:0/475965108 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0007bd0 con 0x7f81040b4fa0 2024-04-16T16:17:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.670+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81041e7b90 con 0x7f81040b4fa0 2024-04-16T16:17:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.671+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81040729d0 con 0x7f81040b4fa0 2024-04-16T16:17:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.672+0000 7f80faa00640 1 -- 172.21.15.22:0/475965108 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80f0018070 con 0x7f81040b4fa0 2024-04-16T16:17:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.673+0000 7f80faa00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f80e406c8f0 0x7f80e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.673+0000 7f80faa00640 1 -- 172.21.15.22:0/475965108 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f80f008bc70 con 0x7f81040b4fa0 2024-04-16T16:17:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.673+0000 7f8102800640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f80e406c8f0 0x7f80e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.674+0000 7f8102800640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f80e406c8f0 0x7f80e406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81040afef0 tx=0x7f80f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.678+0000 7f80faa00640 1 -- 172.21.15.22:0/475965108 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81040729d0 con 0x7f81040b4fa0 2024-04-16T16:17:57.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:57.921+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8104075f30 con 0x7f81040b4fa0 2024-04-16T16:17:58.114 INFO:tasks.ceph.mds.c.smithi022.stderr:2024-04-16T16:17:58.115+0000 7f4e03a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:17:58.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.500+0000 7f80faa00640 1 -- 172.21.15.22:0/475965108 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f81041e7350 con 0x7f81040b4fa0 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f80e406c8f0 msgr2=0x7f80e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f80e406c8f0 0x7f80e406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81040afef0 tx=0x7f80f4009040 comp rx=0 tx=0).stop 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b4fa0 msgr2=0x7f810415a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b4fa0 0x7f810415a880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c7f0 tx=0x7f80f000ccb0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 shutdown_connections 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f80e406c8f0 0x7f80e406edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f810415fe30 0x7f81041e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81040b4fa0 0x7f810415a880 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 --2- 172.21.15.22:0/475965108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81040b33a0 0x7f81041f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 >> 172.21.15.22:0/475965108 conn(0x7f8104075070 msgr2=0x7f81040b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:58.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 shutdown_connections 2024-04-16T16:17:58.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.504+0000 7f8108a00640 1 -- 172.21.15.22:0/475965108 wait complete. 2024-04-16T16:17:58.528 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T16:17:58.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T16:17:58.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.756+0000 7fdfbbe00640 1 Processor -- start 2024-04-16T16:17:58.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.756+0000 7fdfbbe00640 1 -- start start 2024-04-16T16:17:58.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.757+0000 7fdfbbe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdfbc0b33a0 0x7fdfbc070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.757+0000 7fdfbbe00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc0715c0 con 0x7fdfbc15fe30 2024-04-16T16:17:58.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.757+0000 7fdfbbe00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc0718a0 con 0x7fdfbc0b4fa0 2024-04-16T16:17:58.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.757+0000 7fdfbbe00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fdfbc071360 con 0x7fdfbc0b33a0 2024-04-16T16:17:58.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.758+0000 7fdfba000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdfbc15fe30 0x7fdfbc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34786/0 (socket says 172.21.15.22:34786) 2024-04-16T16:17:58.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.758+0000 7fdfba000640 1 -- 172.21.15.22:0/454476480 learned_addr learned my addr 172.21.15.22:0/454476480 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:58.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.758+0000 7fdfbb400640 1 --2- 172.21.15.22:0/454476480 >> v2:172.21.15.43:3300/0 conn(0x7fdfbc0b33a0 0x7fdfbc070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.758+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351880017 0 0) 0x7fdfbc0715c0 con 0x7fdfbc15fe30 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.758+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfa0003520 con 0x7fdfbc15fe30 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2439844555 0 0) 0x7fdfa0003520 con 0x7fdfbc15fe30 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 >> v2:172.21.15.43:3300/0 conn(0x7fdfbc0b33a0 msgr2=0x7fdfbc070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 --2- 172.21.15.22:0/454476480 >> v2:172.21.15.43:3300/0 conn(0x7fdfbc0b33a0 0x7fdfbc070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 >> v1:172.21.15.43:6789/0 conn(0x7fdfbc0b4fa0 legacy=0x7fdfbc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc071b80 con 0x7fdfbc15fe30 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fdfa8001670 con 0x7fdfbc15fe30 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 >> v1:172.21.15.22:6789/0 conn(0x7fdfbc15fe30 legacy=0x7fdfbc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00051c0 0x7fdfa000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc071360 con 0x7fdfa00039b0 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa000c060 con 0x7fdfa0004800 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa000c260 con 0x7fdfa00051c0 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfbaa00640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfbaa00640 1 -- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00051c0 msgr2=0x7fdfa000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfbaa00640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00051c0 0x7fdfa000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfba000640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.759+0000 7fdfbaa00640 1 -- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa0004800 msgr2=0x7fdfa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.760+0000 7fdfbaa00640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.760+0000 7fdfbaa00640 1 -- 172.21.15.22:0/454476480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa0003520 con 0x7fdfa00039b0 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.760+0000 7fdfbb400640 1 -- 172.21.15.22:0/454476480 reap_dead start 2024-04-16T16:17:58.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.760+0000 7fdfba000640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:17:58.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.761+0000 7fdfbaa00640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdfac001750 tx=0x7fdfa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8092925c2b6cee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:58.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.761+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac001370 con 0x7fdfa00039b0 2024-04-16T16:17:58.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.761+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac0052d0 con 0x7fdfa00039b0 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.761+0000 7fdfb9600640 1 -- 172.21.15.22:0/454476480 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac003830 con 0x7fdfa00039b0 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.762+0000 7fdfbbe00640 1 -- 172.21.15.22:0/454476480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa00039b0 msgr2=0x7fdfa0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.762+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdfac001750 tx=0x7fdfa0005830 comp rx=0 tx=0).stop 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.762+0000 7fdfbbe00640 1 -- 172.21.15.22:0/454476480 shutdown_connections 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.762+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/454476480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003dd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.762+0000 7fdfbbe00640 1 -- 172.21.15.22:0/454476480 >> 172.21.15.22:0/454476480 conn(0x7fdfbc075070 msgr2=0x7fdfbc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.762+0000 7fdfbbe00640 1 -- 172.21.15.22:0/454476480 shutdown_connections 2024-04-16T16:17:58.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.762+0000 7fdfbbe00640 1 -- 172.21.15.22:0/454476480 wait complete. 2024-04-16T16:17:58.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.764+0000 7fdfbbe00640 1 Processor -- start 2024-04-16T16:17:58.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.764+0000 7fdfbbe00640 1 -- start start 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00039b0 0x7fdfbc1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfbc159e80 0x7fdfbc15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc1f5ce0 0x7fdfbc1f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbbe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0b5380 con 0x7fdfbc159e80 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0ce630 con 0x7fdfbc1f5ce0 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc0b5500 con 0x7fdfa00039b0 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfba000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfbc159e80 0x7fdfbc15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfba000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfbc159e80 0x7fdfbc15a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49516/0 (socket says 172.21.15.22:49516) 2024-04-16T16:17:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfba000640 1 -- 172.21.15.22:0/2405407753 learned_addr learned my addr 172.21.15.22:0/2405407753 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:58.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbb400640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc1f5ce0 0x7fdfbc1f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:58.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfba000640 1 -- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00039b0 msgr2=0x7fdfbc1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:58.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.765+0000 7fdfbaa00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00039b0 0x7fdfbc1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:58.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfba000640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00039b0 0x7fdfbc1511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfba000640 1 -- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc1f5ce0 msgr2=0x7fdfbc1f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfba000640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc1f5ce0 0x7fdfbc1f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfba000640 1 -- 172.21.15.22:0/2405407753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc1f6a50 con 0x7fdfbc159e80 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfba000640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfbc159e80 0x7fdfbc15a300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800d770 tx=0x7fdfa800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfb2a00640 1 -- 172.21.15.22:0/2405407753 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8019070 con 0x7fdfbc159e80 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfb2a00640 1 -- 172.21.15.22:0/2405407753 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa80074e0 con 0x7fdfbc159e80 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfb2a00640 1 -- 172.21.15.22:0/2405407753 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8004a20 con 0x7fdfbc159e80 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc1532f0 con 0x7fdfbc159e80 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.766+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc1538b0 con 0x7fdfbc159e80 2024-04-16T16:17:58.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.768+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc075f30 con 0x7fdfbc159e80 2024-04-16T16:17:58.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.769+0000 7fdfb2a00640 1 -- 172.21.15.22:0/2405407753 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfa8004bc0 con 0x7fdfbc159e80 2024-04-16T16:17:58.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.769+0000 7fdfb2a00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf9c06c920 0x7fdf9c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:58.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.770+0000 7fdfb2a00640 1 -- 172.21.15.22:0/2405407753 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdfa808b440 con 0x7fdfbc159e80 2024-04-16T16:17:58.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.770+0000 7fdfbaa00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf9c06c920 0x7fdf9c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:58.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.771+0000 7fdfbaa00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf9c06c920 0x7fdf9c06ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdfac033000 tx=0x7fdfac009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:58.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:58.774+0000 7fdfb2a00640 1 -- 172.21.15.22:0/2405407753 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfa8059900 con 0x7fdfbc159e80 2024-04-16T16:17:59.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.020+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdfbc0626f0 con 0x7fdfbc159e80 2024-04-16T16:17:59.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.504+0000 7fdfb2a00640 1 -- 172.21.15.22:0/2405407753 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fdfa8059200 con 0x7fdfbc159e80 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.507+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf9c06c920 msgr2=0x7fdf9c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.507+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf9c06c920 0x7fdf9c06ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdfac033000 tx=0x7fdfac009030 comp rx=0 tx=0).stop 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.507+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfbc159e80 msgr2=0x7fdfbc15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.507+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfbc159e80 0x7fdfbc15a300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800d770 tx=0x7fdfa800dc30 comp rx=0 tx=0).stop 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 shutdown_connections 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf9c06c920 0x7fdf9c06ede0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc1f5ce0 0x7fdfbc1f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfbc159e80 0x7fdfbc15a300 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 --2- 172.21.15.22:0/2405407753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdfa00039b0 0x7fdfbc1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 >> 172.21.15.22:0/2405407753 conn(0x7fdfbc075070 msgr2=0x7fdfbc0b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:59.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 shutdown_connections 2024-04-16T16:17:59.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.508+0000 7fdfbbe00640 1 -- 172.21.15.22:0/2405407753 wait complete. 2024-04-16T16:17:59.529 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T16:17:59.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:17:59.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.759+0000 7f4690a00640 1 Processor -- start 2024-04-16T16:17:59.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.759+0000 7f4690a00640 1 -- start start 2024-04-16T16:17:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f4690a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06eaa0 0x7f468c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f4690a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f468c06ee80 0x7f468c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f4690a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468c06d160 con 0x7f468c0cc810 2024-04-16T16:17:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f4690a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f468c06cf10 con 0x7f468c06ee80 2024-04-16T16:17:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f4690a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f468c06d440 con 0x7f468c06eaa0 2024-04-16T16:17:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f468aa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f468c0cc810 0x7f468c06df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34796/0 (socket says 172.21.15.22:34796) 2024-04-16T16:17:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f468aa00640 1 -- 172.21.15.22:0/1729973663 learned_addr learned my addr 172.21.15.22:0/1729973663 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:17:59.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.761+0000 7f468be00640 1 --2- 172.21.15.22:0/1729973663 >> v2:172.21.15.22:3300/0 conn(0x7f468c06ee80 0x7f468c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:59.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.762+0000 7f468a000640 1 -- 172.21.15.22:0/1729973663 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213502412 0 0) 0x7f468c06d160 con 0x7f468c0cc810 2024-04-16T16:17:59.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.762+0000 7f468b400640 1 --2- 172.21.15.22:0/1729973663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06eaa0 0x7f468c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:59.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.762+0000 7f468a000640 1 -- 172.21.15.22:0/1729973663 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4670003520 con 0x7f468c0cc810 2024-04-16T16:17:59.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.762+0000 7f468be00640 1 -- 172.21.15.22:0/1729973663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06eaa0 msgr2=0x7f468c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:17:59.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.762+0000 7f468be00640 1 --2- 172.21.15.22:0/1729973663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06eaa0 0x7f468c0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.762+0000 7f468be00640 1 -- 172.21.15.22:0/1729973663 >> v1:172.21.15.22:6789/0 conn(0x7f468c0cc810 legacy=0x7f468c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:59.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.762+0000 7f468be00640 1 -- 172.21.15.22:0/1729973663 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c06d720 con 0x7f468c06ee80 2024-04-16T16:17:59.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.763+0000 7f468be00640 1 --2- 172.21.15.22:0/1729973663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c06ee80 0x7f468c15c200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4684009d90 tx=0x7f468402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace513cc335bdb81 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:59.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f468a000640 1 -- 172.21.15.22:0/1729973663 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684039070 con 0x7f468c06ee80 2024-04-16T16:17:59.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f468a000640 1 -- 172.21.15.22:0/1729973663 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468402cc50 con 0x7f468c06ee80 2024-04-16T16:17:59.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f468a000640 1 -- 172.21.15.22:0/1729973663 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684034440 con 0x7f468c06ee80 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f4690a00640 1 -- 172.21.15.22:0/1729973663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c06ee80 msgr2=0x7f468c15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f4690a00640 1 --2- 172.21.15.22:0/1729973663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c06ee80 0x7f468c15c200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4684009d90 tx=0x7f468402bea0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f4690a00640 1 -- 172.21.15.22:0/1729973663 shutdown_connections 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f4690a00640 1 --2- 172.21.15.22:0/1729973663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c06ee80 0x7f468c15c200 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f4690a00640 1 --2- 172.21.15.22:0/1729973663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06eaa0 0x7f468c0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f4690a00640 1 -- 172.21.15.22:0/1729973663 >> 172.21.15.22:0/1729973663 conn(0x7f468c062440 msgr2=0x7f468c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.764+0000 7f4690a00640 1 -- 172.21.15.22:0/1729973663 shutdown_connections 2024-04-16T16:17:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.765+0000 7f4690a00640 1 -- 172.21.15.22:0/1729973663 wait complete. 2024-04-16T16:17:59.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.766+0000 7f4690a00640 1 Processor -- start 2024-04-16T16:17:59.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.766+0000 7f4690a00640 1 -- start start 2024-04-16T16:17:59.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.767+0000 7f4690a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f468c06eaa0 0x7f468c14d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:59.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.767+0000 7f4690a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06ee80 0x7f468c15a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:59.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.767+0000 7f4690a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c0cc810 0x7f468c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:59.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.767+0000 7f4690a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f468c15c740 con 0x7f468c0cc810 2024-04-16T16:17:59.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.767+0000 7f4690a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0b4360 con 0x7f468c06eaa0 2024-04-16T16:17:59.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.767+0000 7f4690a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f468c15c8c0 con 0x7f468c06ee80 2024-04-16T16:17:59.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c0cc810 0x7f468c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c0cc810 0x7f468c15ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49526/0 (socket says 172.21.15.22:49526) 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 -- 172.21.15.22:0/3768267001 learned_addr learned my addr 172.21.15.22:0/3768267001 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468aa00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06ee80 0x7f468c15a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468b400640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f468c06eaa0 0x7f468c14d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 -- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06ee80 msgr2=0x7f468c15a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06ee80 0x7f468c15a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 -- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f468c06eaa0 msgr2=0x7f468c14d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f468c06eaa0 0x7f468c14d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.768+0000 7f468be00640 1 -- 172.21.15.22:0/3768267001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c15dc70 con 0x7f468c0cc810 2024-04-16T16:17:59.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.769+0000 7f468be00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c0cc810 0x7f468c15ae10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4684009d90 tx=0x7f4684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:59.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.769+0000 7f4683400640 1 -- 172.21.15.22:0/3768267001 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684039050 con 0x7f468c0cc810 2024-04-16T16:17:59.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.769+0000 7f4683400640 1 -- 172.21.15.22:0/3768267001 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4684045070 con 0x7f468c0cc810 2024-04-16T16:17:59.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.769+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c15df10 con 0x7f468c0cc810 2024-04-16T16:17:59.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.769+0000 7f4683400640 1 -- 172.21.15.22:0/3768267001 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684009450 con 0x7f468c0cc810 2024-04-16T16:17:59.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.769+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c1543a0 con 0x7f468c0cc810 2024-04-16T16:17:59.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.771+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c075f30 con 0x7f468c0cc810 2024-04-16T16:17:59.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.772+0000 7f4683400640 1 -- 172.21.15.22:0/3768267001 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f468403e610 con 0x7f468c0cc810 2024-04-16T16:17:59.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.773+0000 7f4683400640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f466c06c8f0 0x7f466c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:17:59.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.773+0000 7f4683400640 1 -- 172.21.15.22:0/3768267001 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f46840ae5f0 con 0x7f468c0cc810 2024-04-16T16:17:59.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.773+0000 7f468b400640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f466c06c8f0 0x7f466c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:17:59.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.774+0000 7f468b400640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f466c06c8f0 0x7f466c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f467c006fd0 tx=0x7f467c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:17:59.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:17:59.778+0000 7f4683400640 1 -- 172.21.15.22:0/3768267001 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f468407ca20 con 0x7f468c0cc810 2024-04-16T16:18:00.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.024+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f468c0b4b70 con 0x7f468c0cc810 2024-04-16T16:18:00.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.025+0000 7f4683400640 1 -- 172.21.15.22:0/3768267001 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5178 (secure 0 0 0) 0x7f468407c320 con 0x7f468c0cc810 2024-04-16T16:18:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:00.025 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/2477236609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2477236609},{"type":"v1","addr":"172.21.15.43:6834","nonce":2477236609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2059330399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2059330399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2059330399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/4293003845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":4293003845},{"type":"v1","addr":"172.21.15.22:6837","nonce":4293003845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:17:55.963504+0000","modified":"2024-04-16T16:17:59.021268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6836/430366264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":430366264},{"type":"v1","addr":"172.21.15.22:6836","nonce":430366264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5118,"qdb_cluster":[5118]},"id":2}]} 2024-04-16T16:18:00.025 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 16 2024-04-16T16:18:00.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f466c06c8f0 msgr2=0x7f466c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f466c06c8f0 0x7f466c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f467c006fd0 tx=0x7f467c008040 comp rx=0 tx=0).stop 2024-04-16T16:18:00.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c0cc810 msgr2=0x7f468c15ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c0cc810 0x7f468c15ae10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4684009d90 tx=0x7f4684004a40 comp rx=0 tx=0).stop 2024-04-16T16:18:00.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 shutdown_connections 2024-04-16T16:18:00.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f466c06c8f0 0x7f466c06edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c0cc810 0x7f468c15ae10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f468c06ee80 0x7f468c15a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 --2- 172.21.15.22:0/3768267001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f468c06eaa0 0x7f468c14d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 >> 172.21.15.22:0/3768267001 conn(0x7f468c062440 msgr2=0x7f468c0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:00.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.028+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 shutdown_connections 2024-04-16T16:18:00.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.029+0000 7f4690a00640 1 -- 172.21.15.22:0/3768267001 wait complete. 2024-04-16T16:18:00.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:18:00.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.272+0000 7f1602600640 1 Processor -- start 2024-04-16T16:18:00.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.272+0000 7f1602600640 1 -- start start 2024-04-16T16:18:00.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.274+0000 7f1602600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 0x7f15fc072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.274+0000 7f1602600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15fc1606d0 con 0x7f15fc073050 2024-04-16T16:18:00.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.274+0000 7f1602600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15fc1609b0 con 0x7f15fc06dc80 2024-04-16T16:18:00.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.274+0000 7f1602600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15fc160480 con 0x7f15fc0afd90 2024-04-16T16:18:00.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.274+0000 7f15fbe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f15fc073050 0x7f15fc15ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36790/0 (socket says 172.21.15.22:36790) 2024-04-16T16:18:00.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.274+0000 7f15fbe00640 1 -- 172.21.15.22:0/1318724256 learned_addr learned my addr 172.21.15.22:0/1318724256 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:00.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fb400640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 0x7f15fc072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809366648 0 0) 0x7f15fc1606d0 con 0x7f15fc073050 2024-04-16T16:18:00.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e0003520 con 0x7f15fc073050 2024-04-16T16:18:00.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3838207586 0 0) 0x7f15e0003520 con 0x7f15fc073050 2024-04-16T16:18:00.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 msgr2=0x7f15fc072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 0x7f15fc072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 >> v1:172.21.15.43:6789/0 conn(0x7f15fc06dc80 legacy=0x7f15fc0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc160c90 con 0x7f15fc073050 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f15f40019f0 con 0x7f15fc073050 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 >> v1:172.21.15.22:6789/0 conn(0x7f15fc073050 legacy=0x7f15fc15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15e0004800 0x7f15e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 0x7f15e0005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc160480 con 0x7f15e00039e0 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15e000ff90 con 0x7f15e0004800 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.275+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15e0010190 con 0x7f15fc0afd90 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fb400640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15faa00640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15e0004800 0x7f15e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fbe00640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 0x7f15e0005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fb400640 1 -- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 msgr2=0x7f15e0005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:00.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fb400640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 0x7f15e0005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fb400640 1 -- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15e0004800 msgr2=0x7f15e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:00.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fb400640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15e0004800 0x7f15e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fb400640 1 -- 172.21.15.22:0/1318724256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e0003520 con 0x7f15e00039e0 2024-04-16T16:18:00.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.276+0000 7f15fbe00640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc0afd90 0x7f15e0005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.277+0000 7f15fb400640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15e0003e20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009a90 tx=0x7f15e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33a232c2ed10776 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec039070 con 0x7f15e00039e0 2024-04-16T16:18:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec02c680 con 0x7f15e00039e0 2024-04-16T16:18:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f15fa000640 1 -- 172.21.15.22:0/1318724256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec009690 con 0x7f15e00039e0 2024-04-16T16:18:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f1602600640 1 -- 172.21.15.22:0/1318724256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 msgr2=0x7f15e0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f1602600640 1 --2- 172.21.15.22:0/1318724256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15e0003e20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009a90 tx=0x7f15e0005830 comp rx=0 tx=0).stop 2024-04-16T16:18:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f15fbe00640 1 -- 172.21.15.22:0/1318724256 reap_dead start 2024-04-16T16:18:00.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f1602600640 1 -- 172.21.15.22:0/1318724256 shutdown_connections 2024-04-16T16:18:00.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f1602600640 1 -- 172.21.15.22:0/1318724256 >> 172.21.15.22:0/1318724256 conn(0x7f15fc062440 msgr2=0x7f15fc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:00.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f1602600640 1 -- 172.21.15.22:0/1318724256 shutdown_connections 2024-04-16T16:18:00.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.278+0000 7f1602600640 1 -- 172.21.15.22:0/1318724256 wait complete. 2024-04-16T16:18:00.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.280+0000 7f1602600640 1 Processor -- start 2024-04-16T16:18:00.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.280+0000 7f1602600640 1 -- start start 2024-04-16T16:18:00.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.281+0000 7f1602600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15fc14dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.281+0000 7f1602600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc157fa0 0x7f15fc13abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.281+0000 7f1602600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15fc13b130 0x7f15fc158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.281+0000 7f1602600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc0ce8a0 con 0x7f15e00039e0 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.281+0000 7f1602600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc0b0170 con 0x7f15fc13b130 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.281+0000 7f1602600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15fc0cea20 con 0x7f15fc157fa0 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15fc14dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15fc14dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39634/0 (socket says 172.21.15.22:39634) 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 -- 172.21.15.22:0/2211107013 learned_addr learned my addr 172.21.15.22:0/2211107013 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 -- 172.21.15.22:0/2211107013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc157fa0 msgr2=0x7f15fc13abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc157fa0 0x7f15fc13abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fbe00640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15fc13b130 0x7f15fc158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 -- 172.21.15.22:0/2211107013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15fc13b130 msgr2=0x7f15fc158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15fc13b130 0x7f15fc158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 -- 172.21.15.22:0/2211107013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc14d590 con 0x7f15e00039e0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.282+0000 7f15fb400640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15fc14dcb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f15ec000c00 tx=0x7f15ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.283+0000 7f15f3400640 1 -- 172.21.15.22:0/2211107013 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec042020 con 0x7f15e00039e0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.283+0000 7f15f3400640 1 -- 172.21.15.22:0/2211107013 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec03a040 con 0x7f15e00039e0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.283+0000 7f15f3400640 1 -- 172.21.15.22:0/2211107013 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec039070 con 0x7f15e00039e0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.283+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc1587e0 con 0x7f15e00039e0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.283+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15fc1509f0 con 0x7f15e00039e0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.284+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15fc04fd90 con 0x7f15e00039e0 2024-04-16T16:18:00.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.285+0000 7f15f3400640 1 -- 172.21.15.22:0/2211107013 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15ec045020 con 0x7f15e00039e0 2024-04-16T16:18:00.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.286+0000 7f15f3400640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15dc06c920 0x7f15dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.286+0000 7f15f3400640 1 -- 172.21.15.22:0/2211107013 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f15ec0ad2b0 con 0x7f15e00039e0 2024-04-16T16:18:00.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.286+0000 7f15faa00640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15dc06c920 0x7f15dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.287+0000 7f15faa00640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15dc06c920 0x7f15dc06ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007fd0 tx=0x7f15e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:00.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.290+0000 7f15f3400640 1 -- 172.21.15.22:0/2211107013 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15ec04c030 con 0x7f15e00039e0 2024-04-16T16:18:00.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.498+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15fc15ad50 con 0x7f15e00039e0 2024-04-16T16:18:00.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.500+0000 7f15f3400640 1 -- 172.21.15.22:0/2211107013 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16549 (secure 0 0 0) 0x7f15ec07b650 con 0x7f15e00039e0 2024-04-16T16:18:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:00.500 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:17:57.480219+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:18:00.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15dc06c920 msgr2=0x7f15dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15dc06c920 0x7f15dc06ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007fd0 tx=0x7f15e8009040 comp rx=0 tx=0).stop 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 msgr2=0x7f15fc14dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15fc14dcb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f15ec000c00 tx=0x7f15ec004730 comp rx=0 tx=0).stop 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 shutdown_connections 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15dc06c920 0x7f15dc06ede0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15fc13b130 0x7f15fc158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15fc157fa0 0x7f15fc13abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 --2- 172.21.15.22:0/2211107013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15e00039e0 0x7f15fc14dcb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 >> 172.21.15.22:0/2211107013 conn(0x7f15fc062440 msgr2=0x7f15fc15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 shutdown_connections 2024-04-16T16:18:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.503+0000 7f1602600640 1 -- 172.21.15.22:0/2211107013 wait complete. 2024-04-16T16:18:00.524 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T16:18:00.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:18:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.745+0000 7f28e7200640 1 Processor -- start 2024-04-16T16:18:00.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.745+0000 7f28e7200640 1 -- start start 2024-04-16T16:18:00.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.746+0000 7f28e7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e815ec90 0x7f28e80b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.746+0000 7f28e7200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80b57e0 0x7f28e80b7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.746+0000 7f28e7200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f28e80b7590 0x7f28e8070a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.746+0000 7f28e7200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f28e80b7a40 con 0x7f28e80b57e0 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.746+0000 7f28e7200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f28e80b1fd0 con 0x7f28e80b7590 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.746+0000 7f28e7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f28e806bbc0 con 0x7f28e815ec90 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80b57e0 0x7f28e80b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80b57e0 0x7f28e80b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39646/0 (socket says 172.21.15.22:39646) 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 -- 172.21.15.22:0/3432296792 learned_addr learned my addr 172.21.15.22:0/3432296792 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e6800640 1 --2- 172.21.15.22:0/3432296792 >> v2:172.21.15.43:3300/0 conn(0x7f28e80b7590 0x7f28e8070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5e00640 1 --2- 172.21.15.22:0/3432296792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e815ec90 0x7f28e80b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 -- 172.21.15.22:0/3432296792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e815ec90 msgr2=0x7f28e80b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 --2- 172.21.15.22:0/3432296792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e815ec90 0x7f28e80b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 -- 172.21.15.22:0/3432296792 >> v2:172.21.15.43:3300/0 conn(0x7f28e80b7590 msgr2=0x7f28e8070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 --2- 172.21.15.22:0/3432296792 >> v2:172.21.15.43:3300/0 conn(0x7f28e80b7590 0x7f28e8070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e5400640 1 -- 172.21.15.22:0/3432296792 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e806bea0 con 0x7f28e80b57e0 2024-04-16T16:18:00.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.747+0000 7f28e6800640 1 --2- 172.21.15.22:0/3432296792 >> v2:172.21.15.43:3300/0 conn(0x7f28e80b7590 0x7f28e8070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.749+0000 7f28e5400640 1 --2- 172.21.15.22:0/3432296792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b57e0 0x7f28e80b7050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f28e8074230 tx=0x7f28d402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92ff3e1f1ace6a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.749+0000 7f28e4a00640 1 -- 172.21.15.22:0/3432296792 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d402c9e0 con 0x7f28e80b57e0 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.749+0000 7f28e4a00640 1 -- 172.21.15.22:0/3432296792 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d402cb80 con 0x7f28e80b57e0 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.749+0000 7f28e4a00640 1 -- 172.21.15.22:0/3432296792 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40343f0 con 0x7f28e80b57e0 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 -- 172.21.15.22:0/3432296792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b57e0 msgr2=0x7f28e80b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 --2- 172.21.15.22:0/3432296792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b57e0 0x7f28e80b7050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f28e8074230 tx=0x7f28d402be40 comp rx=0 tx=0).stop 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 -- 172.21.15.22:0/3432296792 shutdown_connections 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 --2- 172.21.15.22:0/3432296792 >> v2:172.21.15.43:3300/0 conn(0x7f28e80b7590 0x7f28e8070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 --2- 172.21.15.22:0/3432296792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b57e0 0x7f28e80b7050 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 --2- 172.21.15.22:0/3432296792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e815ec90 0x7f28e80b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 -- 172.21.15.22:0/3432296792 >> 172.21.15.22:0/3432296792 conn(0x7f28e80731a0 msgr2=0x7f28e80735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:00.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 -- 172.21.15.22:0/3432296792 shutdown_connections 2024-04-16T16:18:00.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.750+0000 7f28e7200640 1 -- 172.21.15.22:0/3432296792 wait complete. 2024-04-16T16:18:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.752+0000 7f28e7200640 1 Processor -- start 2024-04-16T16:18:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.752+0000 7f28e7200640 1 -- start start 2024-04-16T16:18:00.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e80b57e0 0x7f28e81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b7590 0x7f28e81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28e815ec90 0x7f28e814fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e7200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80b1d90 con 0x7f28e80b7590 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80b1c10 con 0x7f28e815ec90 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f28e8070f60 con 0x7f28e80b57e0 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b7590 0x7f28e81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b7590 0x7f28e81529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39648/0 (socket says 172.21.15.22:39648) 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 -- 172.21.15.22:0/986304770 learned_addr learned my addr 172.21.15.22:0/986304770 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 -- 172.21.15.22:0/986304770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e80b57e0 msgr2=0x7f28e81538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e80b57e0 0x7f28e81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 -- 172.21.15.22:0/986304770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28e815ec90 msgr2=0x7f28e814fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28e815ec90 0x7f28e814fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.754+0000 7f28e5400640 1 -- 172.21.15.22:0/986304770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e8158880 con 0x7f28e80b7590 2024-04-16T16:18:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.755+0000 7f28e5400640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b7590 0x7f28e81529c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f28d4000f80 tx=0x7f28d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:00.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.755+0000 7f28de000640 1 -- 172.21.15.22:0/986304770 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4043020 con 0x7f28e80b7590 2024-04-16T16:18:00.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.755+0000 7f28de000640 1 -- 172.21.15.22:0/986304770 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d403e450 con 0x7f28e80b7590 2024-04-16T16:18:00.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.755+0000 7f28de000640 1 -- 172.21.15.22:0/986304770 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d403e840 con 0x7f28e80b7590 2024-04-16T16:18:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.755+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e8151ee0 con 0x7f28e80b7590 2024-04-16T16:18:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.756+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e81524a0 con 0x7f28e80b7590 2024-04-16T16:18:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.757+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e8153e60 con 0x7f28e80b7590 2024-04-16T16:18:00.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.758+0000 7f28de000640 1 -- 172.21.15.22:0/986304770 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28d4046020 con 0x7f28e80b7590 2024-04-16T16:18:00.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.759+0000 7f28de000640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f28c806c8f0 0x7f28c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:00.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.759+0000 7f28de000640 1 -- 172.21.15.22:0/986304770 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f28d40ae440 con 0x7f28e80b7590 2024-04-16T16:18:00.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.759+0000 7f28e5e00640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f28c806c8f0 0x7f28c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:00.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.760+0000 7f28e5e00640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f28c806c8f0 0x7f28c806edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f28d8006fd0 tx=0x7f28d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.765+0000 7f28de000640 1 -- 172.21.15.22:0/986304770 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28d404d030 con 0x7f28e80b7590 2024-04-16T16:18:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.960+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28e8075f30 con 0x7f28c806c8f0 2024-04-16T16:18:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.968+0000 7f28de000640 1 -- 172.21.15.22:0/986304770 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239855 (secure 0 0 0) 0x7f28e8075f30 con 0x7f28c806c8f0 2024-04-16T16:18:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:18:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f28c806c8f0 msgr2=0x7f28c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f28c806c8f0 0x7f28c806edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f28d8006fd0 tx=0x7f28d8008040 comp rx=0 tx=0).stop 2024-04-16T16:18:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b7590 msgr2=0x7f28e81529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b7590 0x7f28e81529c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f28d4000f80 tx=0x7f28d4004a40 comp rx=0 tx=0).stop 2024-04-16T16:18:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 shutdown_connections 2024-04-16T16:18:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f28c806c8f0 0x7f28c806edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28e815ec90 0x7f28e814fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80b7590 0x7f28e81529c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 --2- 172.21.15.22:0/986304770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28e80b57e0 0x7f28e81538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:00.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 >> 172.21.15.22:0/986304770 conn(0x7f28e80731a0 msgr2=0x7f28e8073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:00.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 shutdown_connections 2024-04-16T16:18:00.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:00.974+0000 7f28e7200640 1 -- 172.21.15.22:0/986304770 wait complete. 2024-04-16T16:18:00.991 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-16T16:17:59.730436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253316,"kb_used_data":3868,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721404,"statfs":{"total":773094113280,"available":772834717696,"internally_reserved":0,"allocated":3960832,"data_stored":2230415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.286358"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.461714+0000","last_change":"2024-04-16T16:17:54.461714+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.461714+0000","last_undegraded":"2024-04-16T16:17:54.461714+0000","last_fullsized":"2024-04-16T16:17:54.461714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.453198+0000","last_change":"2024-04-16T16:17:54.453198+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.453198+0000","last_undegraded":"2024-04-16T16:17:54.453198+0000","last_fullsized":"2024-04-16T16:17:54.453198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457084+0000","last_change":"2024-04-16T16:17:54.457084+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457084+0000","last_undegraded":"2024-04-16T16:17:54.457084+0000","last_fullsized":"2024-04-16T16:17:54.457084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457721+0000","last_change":"2024-04-16T16:17:54.457721+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457721+0000","last_undegraded":"2024-04-16T16:17:54.457721+0000","last_fullsized":"2024-04-16T16:17:54.457721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.452426+0000","last_change":"2024-04-16T16:17:54.452426+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.452426+0000","last_undegraded":"2024-04-16T16:17:54.452426+0000","last_fullsized":"2024-04-16T16:17:54.452426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450852+0000","last_change":"2024-04-16T16:17:54.450852+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450852+0000","last_undegraded":"2024-04-16T16:17:54.450852+0000","last_fullsized":"2024-04-16T16:17:54.450852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.456820+0000","last_change":"2024-04-16T16:17:54.456820+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.456820+0000","last_undegraded":"2024-04-16T16:17:54.456820+0000","last_fullsized":"2024-04-16T16:17:54.456820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451088+0000","last_change":"2024-04-16T16:17:54.451088+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451088+0000","last_undegraded":"2024-04-16T16:17:54.451088+0000","last_fullsized":"2024-04-16T16:17:54.451088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457691+0000","last_change":"2024-04-16T16:17:54.457691+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457691+0000","last_undegraded":"2024-04-16T16:17:54.457691+0000","last_fullsized":"2024-04-16T16:17:54.457691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451987+0000","last_change":"2024-04-16T16:17:54.451987+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451987+0000","last_undegraded":"2024-04-16T16:17:54.451987+0000","last_fullsized":"2024-04-16T16:17:54.451987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450381+0000","last_change":"2024-04-16T16:17:54.450381+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450381+0000","last_undegraded":"2024-04-16T16:17:54.450381+0000","last_fullsized":"2024-04-16T16:17:54.450381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.455838+0000","last_change":"2024-04-16T16:17:54.455838+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.455838+0000","last_undegraded":"2024-04-16T16:17:54.455838+0000","last_fullsized":"2024-04-16T16:17:54.455838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450960+0000","last_change":"2024-04-16T16:17:54.450960+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450960+0000","last_undegraded":"2024-04-16T16:17:54.450960+0000","last_fullsized":"2024-04-16T16:17:54.450960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.460393+0000","last_change":"2024-04-16T16:17:54.460393+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.460393+0000","last_undegraded":"2024-04-16T16:17:54.460393+0000","last_fullsized":"2024-04-16T16:17:54.460393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.455793+0000","last_change":"2024-04-16T16:17:54.455793+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.455793+0000","last_undegraded":"2024-04-16T16:17:54.455793+0000","last_fullsized":"2024-04-16T16:17:54.455793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457115+0000","last_change":"2024-04-16T16:17:54.457115+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457115+0000","last_undegraded":"2024-04-16T16:17:54.457115+0000","last_fullsized":"2024-04-16T16:17:54.457115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.459464+0000","last_change":"2024-04-16T16:17:54.459464+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.459464+0000","last_undegraded":"2024-04-16T16:17:54.459464+0000","last_fullsized":"2024-04-16T16:17:54.459464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.452132+0000","last_change":"2024-04-16T16:17:54.452132+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.452132+0000","last_undegraded":"2024-04-16T16:17:54.452132+0000","last_fullsized":"2024-04-16T16:17:54.452132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451822+0000","last_change":"2024-04-16T16:17:54.451822+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451822+0000","last_undegraded":"2024-04-16T16:17:54.451822+0000","last_fullsized":"2024-04-16T16:17:54.451822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451223+0000","last_change":"2024-04-16T16:17:54.451223+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451223+0000","last_undegraded":"2024-04-16T16:17:54.451223+0000","last_fullsized":"2024-04-16T16:17:54.451223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451867+0000","last_change":"2024-04-16T16:17:54.451867+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451867+0000","last_undegraded":"2024-04-16T16:17:54.451867+0000","last_fullsized":"2024-04-16T16:17:54.451867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.460373+0000","last_change":"2024-04-16T16:17:54.460373+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.460373+0000","last_undegraded":"2024-04-16T16:17:54.460373+0000","last_fullsized":"2024-04-16T16:17:54.460373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.452590+0000","last_change":"2024-04-16T16:17:54.452590+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.452590+0000","last_undegraded":"2024-04-16T16:17:54.452590+0000","last_fullsized":"2024-04-16T16:17:54.452590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450397+0000","last_change":"2024-04-16T16:17:54.450397+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450397+0000","last_undegraded":"2024-04-16T16:17:54.450397+0000","last_fullsized":"2024-04-16T16:17:54.450397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.458874+0000","last_change":"2024-04-16T16:17:54.458874+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.458874+0000","last_undegraded":"2024-04-16T16:17:54.458874+0000","last_fullsized":"2024-04-16T16:17:54.458874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451021+0000","last_change":"2024-04-16T16:17:54.451021+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451021+0000","last_undegraded":"2024-04-16T16:17:54.451021+0000","last_fullsized":"2024-04-16T16:17:54.451021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.460044+0000","last_change":"2024-04-16T16:17:54.460044+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.460044+0000","last_undegraded":"2024-04-16T16:17:54.460044+0000","last_fullsized":"2024-04-16T16:17:54.460044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451021+0000","last_change":"2024-04-16T16:17:54.451021+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451021+0000","last_undegraded":"2024-04-16T16:17:54.451021+0000","last_fullsized":"2024-04-16T16:17:54.451021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.459222+0000","last_change":"2024-04-16T16:17:54.459222+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.459222+0000","last_undegraded":"2024-04-16T16:17:54.459222+0000","last_fullsized":"2024-04-16T16:17:54.459222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450883+0000","last_change":"2024-04-16T16:17:54.450883+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450883+0000","last_undegraded":"2024-04-16T16:17:54.450883+0000","last_fullsized":"2024-04-16T16:17:54.450883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.456525+0000","last_change":"2024-04-16T16:17:54.456525+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.456525+0000","last_undegraded":"2024-04-16T16:17:54.456525+0000","last_fullsized":"2024-04-16T16:17:54.456525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.459635+0000","last_change":"2024-04-16T16:17:54.459635+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.459635+0000","last_undegraded":"2024-04-16T16:17:54.459635+0000","last_fullsized":"2024-04-16T16:17:54.459635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-16T16:17:54.461918+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:17:54.461918+0000","last_peered":"2024-04-16T16:17:54.461918+0000","last_clean":"2024-04-16T16:17:54.461918+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:17:54.461918+0000","last_undegraded":"2024-04-16T16:17:54.461918+0000","last_fullsized":"2024-04-16T16:17:54.461918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":929792,"data_stored":716488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:18:00.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:18:01.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.246+0000 7f9a19600640 1 Processor -- start 2024-04-16T16:18:01.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.246+0000 7f9a19600640 1 -- start start 2024-04-16T16:18:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a19600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9a140afd90 0x7f9a14072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a19600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a1406dc80 0x7f9a140d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a19600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a141606d0 con 0x7f9a14073050 2024-04-16T16:18:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a19600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9a14160480 con 0x7f9a140afd90 2024-04-16T16:18:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a19600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9a141609b0 con 0x7f9a1406dc80 2024-04-16T16:18:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a12a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9a140afd90 0x7f9a14072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a12a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9a140afd90 0x7f9a14072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39658/0 (socket says 172.21.15.22:39658) 2024-04-16T16:18:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.248+0000 7f9a12a00640 1 -- 172.21.15.22:0/2290829987 learned_addr learned my addr 172.21.15.22:0/2290829987 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.249+0000 7f9a12000640 1 --2- 172.21.15.22:0/2290829987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a1406dc80 0x7f9a140d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.249+0000 7f9a12a00640 1 -- 172.21.15.22:0/2290829987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a1406dc80 msgr2=0x7f9a140d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.249+0000 7f9a12a00640 1 --2- 172.21.15.22:0/2290829987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a1406dc80 0x7f9a140d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.249+0000 7f9a12a00640 1 -- 172.21.15.22:0/2290829987 >> v1:172.21.15.43:6789/0 conn(0x7f9a14073050 legacy=0x7f9a14071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.249+0000 7f9a12a00640 1 -- 172.21.15.22:0/2290829987 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a14160c90 con 0x7f9a140afd90 2024-04-16T16:18:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.250+0000 7f9a12a00640 1 --2- 172.21.15.22:0/2290829987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a140afd90 0x7f9a14072b10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a0402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fb1206aacd329c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.250+0000 7f9a11600640 1 -- 172.21.15.22:0/2290829987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a040317c0 con 0x7f9a140afd90 2024-04-16T16:18:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.250+0000 7f9a11600640 1 -- 172.21.15.22:0/2290829987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a04037070 con 0x7f9a140afd90 2024-04-16T16:18:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.250+0000 7f9a11600640 1 -- 172.21.15.22:0/2290829987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04031b80 con 0x7f9a140afd90 2024-04-16T16:18:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 -- 172.21.15.22:0/2290829987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a140afd90 msgr2=0x7f9a14072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 --2- 172.21.15.22:0/2290829987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a140afd90 0x7f9a14072b10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a0402b860 comp rx=0 tx=0).stop 2024-04-16T16:18:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 -- 172.21.15.22:0/2290829987 shutdown_connections 2024-04-16T16:18:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 --2- 172.21.15.22:0/2290829987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a1406dc80 0x7f9a140d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 --2- 172.21.15.22:0/2290829987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a140afd90 0x7f9a14072b10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 -- 172.21.15.22:0/2290829987 >> 172.21.15.22:0/2290829987 conn(0x7f9a14062440 msgr2=0x7f9a14062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:01.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 -- 172.21.15.22:0/2290829987 shutdown_connections 2024-04-16T16:18:01.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.251+0000 7f9a19600640 1 -- 172.21.15.22:0/2290829987 wait complete. 2024-04-16T16:18:01.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.253+0000 7f9a19600640 1 Processor -- start 2024-04-16T16:18:01.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.253+0000 7f9a19600640 1 -- start start 2024-04-16T16:18:01.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.254+0000 7f9a19600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a1406dc80 0x7f9a14154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.254+0000 7f9a19600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a14073050 0x7f9a140b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.254+0000 7f9a19600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a140afd90 0x7f9a141490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.254+0000 7f9a19600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a140ce8a0 con 0x7f9a1406dc80 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.254+0000 7f9a19600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a140b0170 con 0x7f9a14073050 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.254+0000 7f9a19600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9a140cea20 con 0x7f9a140afd90 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a1406dc80 0x7f9a14154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a1406dc80 0x7f9a14154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39664/0 (socket says 172.21.15.22:39664) 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 -- 172.21.15.22:0/2382676576 learned_addr learned my addr 172.21.15.22:0/2382676576 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12000640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a14073050 0x7f9a140b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a13400640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a140afd90 0x7f9a141490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 -- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a140afd90 msgr2=0x7f9a141490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a140afd90 0x7f9a141490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 -- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a14073050 msgr2=0x7f9a140b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a14073050 0x7f9a140b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 -- 172.21.15.22:0/2382676576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a140b2c70 con 0x7f9a1406dc80 2024-04-16T16:18:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.255+0000 7f9a12a00640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a1406dc80 0x7f9a14154990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.256+0000 7f9a0aa00640 1 -- 172.21.15.22:0/2382676576 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04032650 con 0x7f9a1406dc80 2024-04-16T16:18:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.256+0000 7f9a0aa00640 1 -- 172.21.15.22:0/2382676576 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a040327f0 con 0x7f9a1406dc80 2024-04-16T16:18:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.256+0000 7f9a0aa00640 1 -- 172.21.15.22:0/2382676576 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04032be0 con 0x7f9a1406dc80 2024-04-16T16:18:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.256+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a140b2f30 con 0x7f9a1406dc80 2024-04-16T16:18:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.256+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a14152160 con 0x7f9a1406dc80 2024-04-16T16:18:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.257+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1404fd90 con 0x7f9a1406dc80 2024-04-16T16:18:01.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.258+0000 7f9a0aa00640 1 -- 172.21.15.22:0/2382676576 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a0404c060 con 0x7f9a1406dc80 2024-04-16T16:18:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.259+0000 7f9a0aa00640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f99f406c8f0 0x7f99f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.259+0000 7f9a0aa00640 1 -- 172.21.15.22:0/2382676576 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9a040ad670 con 0x7f9a1406dc80 2024-04-16T16:18:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.259+0000 7f9a12000640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f99f406c8f0 0x7f99f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.260+0000 7f9a12000640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f99f406c8f0 0x7f99f406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a140b5a50 tx=0x7f9a00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.264+0000 7f9a0aa00640 1 -- 172.21.15.22:0/2382676576 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a04040070 con 0x7f9a1406dc80 2024-04-16T16:18:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.469+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a140b0a80 con 0x7f99f406c8f0 2024-04-16T16:18:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.477+0000 7f9a0aa00640 1 -- 172.21.15.22:0/2382676576 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239855 (secure 0 0 0) 0x7f9a0000b200 con 0x7f99f406c8f0 2024-04-16T16:18:01.479 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.482+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f99f406c8f0 msgr2=0x7f99f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.482+0000 7f9a19600640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f99f406c8f0 0x7f99f406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a140b5a50 tx=0x7f9a00008040 comp rx=0 tx=0).stop 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.482+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a1406dc80 msgr2=0x7f9a14154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.482+0000 7f9a19600640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a1406dc80 0x7f9a14154990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a040046c0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 shutdown_connections 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f99f406c8f0 0x7f99f406edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a140afd90 0x7f9a141490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a14073050 0x7f9a140b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 --2- 172.21.15.22:0/2382676576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a1406dc80 0x7f9a14154990 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 >> 172.21.15.22:0/2382676576 conn(0x7f9a14062440 msgr2=0x7f9a14159550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 shutdown_connections 2024-04-16T16:18:01.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.483+0000 7f9a19600640 1 -- 172.21.15.22:0/2382676576 wait complete. 2024-04-16T16:18:01.502 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-16T16:17:59.730436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253316,"kb_used_data":3868,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721404,"statfs":{"total":773094113280,"available":772834717696,"internally_reserved":0,"allocated":3960832,"data_stored":2230415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.286358"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.461714+0000","last_change":"2024-04-16T16:17:54.461714+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.461714+0000","last_undegraded":"2024-04-16T16:17:54.461714+0000","last_fullsized":"2024-04-16T16:17:54.461714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.453198+0000","last_change":"2024-04-16T16:17:54.453198+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.453198+0000","last_undegraded":"2024-04-16T16:17:54.453198+0000","last_fullsized":"2024-04-16T16:17:54.453198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457084+0000","last_change":"2024-04-16T16:17:54.457084+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457084+0000","last_undegraded":"2024-04-16T16:17:54.457084+0000","last_fullsized":"2024-04-16T16:17:54.457084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457721+0000","last_change":"2024-04-16T16:17:54.457721+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457721+0000","last_undegraded":"2024-04-16T16:17:54.457721+0000","last_fullsized":"2024-04-16T16:17:54.457721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.452426+0000","last_change":"2024-04-16T16:17:54.452426+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.452426+0000","last_undegraded":"2024-04-16T16:17:54.452426+0000","last_fullsized":"2024-04-16T16:17:54.452426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450852+0000","last_change":"2024-04-16T16:17:54.450852+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450852+0000","last_undegraded":"2024-04-16T16:17:54.450852+0000","last_fullsized":"2024-04-16T16:17:54.450852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.456820+0000","last_change":"2024-04-16T16:17:54.456820+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.456820+0000","last_undegraded":"2024-04-16T16:17:54.456820+0000","last_fullsized":"2024-04-16T16:17:54.456820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451088+0000","last_change":"2024-04-16T16:17:54.451088+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451088+0000","last_undegraded":"2024-04-16T16:17:54.451088+0000","last_fullsized":"2024-04-16T16:17:54.451088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457691+0000","last_change":"2024-04-16T16:17:54.457691+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457691+0000","last_undegraded":"2024-04-16T16:17:54.457691+0000","last_fullsized":"2024-04-16T16:17:54.457691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451987+0000","last_change":"2024-04-16T16:17:54.451987+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451987+0000","last_undegraded":"2024-04-16T16:17:54.451987+0000","last_fullsized":"2024-04-16T16:17:54.451987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450381+0000","last_change":"2024-04-16T16:17:54.450381+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450381+0000","last_undegraded":"2024-04-16T16:17:54.450381+0000","last_fullsized":"2024-04-16T16:17:54.450381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.455838+0000","last_change":"2024-04-16T16:17:54.455838+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.455838+0000","last_undegraded":"2024-04-16T16:17:54.455838+0000","last_fullsized":"2024-04-16T16:17:54.455838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450960+0000","last_change":"2024-04-16T16:17:54.450960+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450960+0000","last_undegraded":"2024-04-16T16:17:54.450960+0000","last_fullsized":"2024-04-16T16:17:54.450960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.460393+0000","last_change":"2024-04-16T16:17:54.460393+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.460393+0000","last_undegraded":"2024-04-16T16:17:54.460393+0000","last_fullsized":"2024-04-16T16:17:54.460393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.455793+0000","last_change":"2024-04-16T16:17:54.455793+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.455793+0000","last_undegraded":"2024-04-16T16:17:54.455793+0000","last_fullsized":"2024-04-16T16:17:54.455793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.457115+0000","last_change":"2024-04-16T16:17:54.457115+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.457115+0000","last_undegraded":"2024-04-16T16:17:54.457115+0000","last_fullsized":"2024-04-16T16:17:54.457115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.459464+0000","last_change":"2024-04-16T16:17:54.459464+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.459464+0000","last_undegraded":"2024-04-16T16:17:54.459464+0000","last_fullsized":"2024-04-16T16:17:54.459464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.452132+0000","last_change":"2024-04-16T16:17:54.452132+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.452132+0000","last_undegraded":"2024-04-16T16:17:54.452132+0000","last_fullsized":"2024-04-16T16:17:54.452132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451822+0000","last_change":"2024-04-16T16:17:54.451822+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451822+0000","last_undegraded":"2024-04-16T16:17:54.451822+0000","last_fullsized":"2024-04-16T16:17:54.451822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451223+0000","last_change":"2024-04-16T16:17:54.451223+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451223+0000","last_undegraded":"2024-04-16T16:17:54.451223+0000","last_fullsized":"2024-04-16T16:17:54.451223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451867+0000","last_change":"2024-04-16T16:17:54.451867+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451867+0000","last_undegraded":"2024-04-16T16:17:54.451867+0000","last_fullsized":"2024-04-16T16:17:54.451867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.460373+0000","last_change":"2024-04-16T16:17:54.460373+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.460373+0000","last_undegraded":"2024-04-16T16:17:54.460373+0000","last_fullsized":"2024-04-16T16:17:54.460373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.452590+0000","last_change":"2024-04-16T16:17:54.452590+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.452590+0000","last_undegraded":"2024-04-16T16:17:54.452590+0000","last_fullsized":"2024-04-16T16:17:54.452590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450397+0000","last_change":"2024-04-16T16:17:54.450397+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450397+0000","last_undegraded":"2024-04-16T16:17:54.450397+0000","last_fullsized":"2024-04-16T16:17:54.450397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.458874+0000","last_change":"2024-04-16T16:17:54.458874+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.458874+0000","last_undegraded":"2024-04-16T16:17:54.458874+0000","last_fullsized":"2024-04-16T16:17:54.458874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451021+0000","last_change":"2024-04-16T16:17:54.451021+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451021+0000","last_undegraded":"2024-04-16T16:17:54.451021+0000","last_fullsized":"2024-04-16T16:17:54.451021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.460044+0000","last_change":"2024-04-16T16:17:54.460044+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.460044+0000","last_undegraded":"2024-04-16T16:17:54.460044+0000","last_fullsized":"2024-04-16T16:17:54.460044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.451021+0000","last_change":"2024-04-16T16:17:54.451021+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.451021+0000","last_undegraded":"2024-04-16T16:17:54.451021+0000","last_fullsized":"2024-04-16T16:17:54.451021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.459222+0000","last_change":"2024-04-16T16:17:54.459222+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.459222+0000","last_undegraded":"2024-04-16T16:17:54.459222+0000","last_fullsized":"2024-04-16T16:17:54.459222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.450883+0000","last_change":"2024-04-16T16:17:54.450883+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.450883+0000","last_undegraded":"2024-04-16T16:17:54.450883+0000","last_fullsized":"2024-04-16T16:17:54.450883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.456525+0000","last_change":"2024-04-16T16:17:54.456525+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.456525+0000","last_undegraded":"2024-04-16T16:17:54.456525+0000","last_fullsized":"2024-04-16T16:17:54.456525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:17:55.443868+0000","last_change":"2024-04-16T16:17:55.443868+0000","last_active":"2024-04-16T16:17:55.443868+0000","last_peered":"2024-04-16T16:17:55.443868+0000","last_clean":"2024-04-16T16:17:55.443868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:55.443868+0000","last_undegraded":"2024-04-16T16:17:55.443868+0000","last_fullsized":"2024-04-16T16:17:55.443868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T16:17:54.459635+0000","last_change":"2024-04-16T16:17:54.459635+0000","last_active":"2024-04-16T16:17:54.429834+0000","last_peered":"2024-04-16T16:17:54.429834+0000","last_clean":"2024-04-16T16:17:54.429834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:17:54.459635+0000","last_undegraded":"2024-04-16T16:17:54.459635+0000","last_fullsized":"2024-04-16T16:17:54.459635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-16T16:17:54.461918+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:17:54.461918+0000","last_peered":"2024-04-16T16:17:54.461918+0000","last_clean":"2024-04-16T16:17:54.461918+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:17:54.461918+0000","last_undegraded":"2024-04-16T16:17:54.461918+0000","last_fullsized":"2024-04-16T16:17:54.461918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":929792,"data_stored":716488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:18:01.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:18:01.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.771+0000 7f0c81200640 1 Processor -- start 2024-04-16T16:18:01.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.771+0000 7f0c81200640 1 -- start start 2024-04-16T16:18:01.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.772+0000 7f0c81200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c7c0d3dd0 0x7f0c7c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.772+0000 7f0c81200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c0cfb70 0x7f0c7c0b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.772+0000 7f0c81200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c7c0b9080 con 0x7f0c7c15ea50 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.772+0000 7f0c81200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7c0b9c90 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.772+0000 7f0c81200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c0b9360 con 0x7f0c7c0cfb70 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7aa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c7c0d3dd0 0x7f0c7c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0c7c15ea50 0x7f0c7c0ba280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36794/0 (socket says 172.21.15.22:36794) 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7b400640 1 -- 172.21.15.22:0/760877534 learned_addr learned my addr 172.21.15.22:0/760877534 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:01.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7be00640 1 --2- 172.21.15.22:0/760877534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c0cfb70 0x7f0c7c0b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7a000640 1 -- 172.21.15.22:0/760877534 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491590338 0 0) 0x7f0c7c0b9080 con 0x7f0c7c15ea50 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7aa00640 1 -- 172.21.15.22:0/760877534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c0cfb70 msgr2=0x7f0c7c0b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7aa00640 1 --2- 172.21.15.22:0/760877534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c0cfb70 0x7f0c7c0b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7aa00640 1 -- 172.21.15.22:0/760877534 >> v1:172.21.15.22:6789/0 conn(0x7f0c7c15ea50 legacy=0x7f0c7c0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.773+0000 7f0c7aa00640 1 -- 172.21.15.22:0/760877534 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c0b9640 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.774+0000 7f0c7aa00640 1 --2- 172.21.15.22:0/760877534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c0cf630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0097a0 tx=0x7f0c6c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb3b194f3d24dde server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.775+0000 7f0c7a000640 1 -- 172.21.15.22:0/760877534 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c039070 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.775+0000 7f0c7a000640 1 -- 172.21.15.22:0/760877534 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c0316f0 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.775+0000 7f0c7a000640 1 -- 172.21.15.22:0/760877534 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c031ac0 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.775+0000 7f0c81200640 1 -- 172.21.15.22:0/760877534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 msgr2=0x7f0c7c0cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.775+0000 7f0c81200640 1 --2- 172.21.15.22:0/760877534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c0cf630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0097a0 tx=0x7f0c6c02b790 comp rx=0 tx=0).stop 2024-04-16T16:18:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.776+0000 7f0c81200640 1 -- 172.21.15.22:0/760877534 shutdown_connections 2024-04-16T16:18:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.776+0000 7f0c81200640 1 --2- 172.21.15.22:0/760877534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c0cfb70 0x7f0c7c0b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.776+0000 7f0c81200640 1 --2- 172.21.15.22:0/760877534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c0cf630 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.776+0000 7f0c81200640 1 -- 172.21.15.22:0/760877534 >> 172.21.15.22:0/760877534 conn(0x7f0c7c072430 msgr2=0x7f0c7c072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.776+0000 7f0c81200640 1 -- 172.21.15.22:0/760877534 shutdown_connections 2024-04-16T16:18:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.776+0000 7f0c81200640 1 -- 172.21.15.22:0/760877534 wait complete. 2024-04-16T16:18:01.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.777+0000 7f0c81200640 1 Processor -- start 2024-04-16T16:18:01.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.778+0000 7f0c81200640 1 -- start start 2024-04-16T16:18:01.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c81200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c7c0cfb70 0x7f0c7c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c81200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c1f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c81200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c15ea50 0x7f0c7c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c81200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c0b7fd0 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c81200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c15ee30 con 0x7f0c7c0cfb70 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c81200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c0b8150 con 0x7f0c7c15ea50 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c1f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c1f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39680/0 (socket says 172.21.15.22:39680) 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 -- 172.21.15.22:0/3640844678 learned_addr learned my addr 172.21.15.22:0/3640844678 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7b400640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c7c0cfb70 0x7f0c7c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 -- 172.21.15.22:0/3640844678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c15ea50 msgr2=0x7f0c7c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c15ea50 0x7f0c7c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 -- 172.21.15.22:0/3640844678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c7c0cfb70 msgr2=0x7f0c7c1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c7c0cfb70 0x7f0c7c1573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.779+0000 7f0c7aa00640 1 -- 172.21.15.22:0/3640844678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c0ce960 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.780+0000 7f0c7aa00640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c1f4900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c000c00 tx=0x7f0c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.780+0000 7f0c73400640 1 -- 172.21.15.22:0/3640844678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c043070 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.780+0000 7f0c73400640 1 -- 172.21.15.22:0/3640844678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c034680 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.780+0000 7f0c73400640 1 -- 172.21.15.22:0/3640844678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c039040 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.780+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7c1f5000 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.780+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7c1f55c0 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.781+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7c15b330 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.782+0000 7f0c73400640 1 -- 172.21.15.22:0/3640844678 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c6c046070 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.784+0000 7f0c73400640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0c5806c8f0 0x7f0c5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.784+0000 7f0c73400640 1 -- 172.21.15.22:0/3640844678 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0c6c0ad730 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.784+0000 7f0c7b400640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0c5806c8f0 0x7f0c5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.785+0000 7f0c7b400640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0c5806c8f0 0x7f0c5806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000f60 tx=0x7f0c64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:01.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.789+0000 7f0c73400640 1 -- 172.21.15.22:0/3640844678 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c7c15b330 con 0x7f0c7c0d3dd0 2024-04-16T16:18:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:01.989+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c7c075f30 con 0x7f0c5806c8f0 2024-04-16T16:18:02.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.010+0000 7f0c73400640 1 -- 172.21.15.22:0/3640844678 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251950 (secure 0 0 0) 0x7f0c7c075f30 con 0x7f0c5806c8f0 2024-04-16T16:18:02.013 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:02.014 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:18:02.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0c5806c8f0 msgr2=0x7f0c5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0c5806c8f0 0x7f0c5806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000f60 tx=0x7f0c64009040 comp rx=0 tx=0).stop 2024-04-16T16:18:02.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 msgr2=0x7f0c7c1f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c1f4900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c000c00 tx=0x7f0c6c0046c0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 shutdown_connections 2024-04-16T16:18:02.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0c5806c8f0 0x7f0c5806edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c7c15ea50 0x7f0c7c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7c0d3dd0 0x7f0c7c1f4900 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 --2- 172.21.15.22:0/3640844678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c7c0cfb70 0x7f0c7c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 >> 172.21.15.22:0/3640844678 conn(0x7f0c7c072430 msgr2=0x7f0c7c15c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:02.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 shutdown_connections 2024-04-16T16:18:02.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.015+0000 7f0c81200640 1 -- 172.21.15.22:0/3640844678 wait complete. 2024-04-16T16:18:02.032 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-04-16T16:18:01.730958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253684,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721036,"statfs":{"total":773094113280,"available":772834340864,"internally_reserved":0,"allocated":4333568,"data_stored":2395788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.268859"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154389+0000","last_change":"2024-04-16T16:17:56.504008+0000","last_active":"2024-04-16T16:17:58.154389+0000","last_peered":"2024-04-16T16:17:58.154389+0000","last_clean":"2024-04-16T16:17:58.154389+0000","last_became_active":"2024-04-16T16:17:56.503413+0000","last_became_peered":"2024-04-16T16:17:56.503413+0000","last_unstale":"2024-04-16T16:17:58.154389+0000","last_undegraded":"2024-04-16T16:17:58.154389+0000","last_fullsized":"2024-04-16T16:17:58.154389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493379+0000","last_change":"2024-04-16T16:17:56.516912+0000","last_active":"2024-04-16T16:17:57.493379+0000","last_peered":"2024-04-16T16:17:57.493379+0000","last_clean":"2024-04-16T16:17:57.493379+0000","last_became_active":"2024-04-16T16:17:56.516598+0000","last_became_peered":"2024-04-16T16:17:56.516598+0000","last_unstale":"2024-04-16T16:17:57.493379+0000","last_undegraded":"2024-04-16T16:17:57.493379+0000","last_fullsized":"2024-04-16T16:17:57.493379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:57:10.646516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154781+0000","last_change":"2024-04-16T16:17:56.503278+0000","last_active":"2024-04-16T16:17:58.154781+0000","last_peered":"2024-04-16T16:17:58.154781+0000","last_clean":"2024-04-16T16:17:58.154781+0000","last_became_active":"2024-04-16T16:17:56.502493+0000","last_became_peered":"2024-04-16T16:17:56.502493+0000","last_unstale":"2024-04-16T16:17:58.154781+0000","last_undegraded":"2024-04-16T16:17:58.154781+0000","last_fullsized":"2024-04-16T16:17:58.154781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:17.749181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516597+0000","last_change":"2024-04-16T16:17:56.514534+0000","last_active":"2024-04-16T16:17:57.516597+0000","last_peered":"2024-04-16T16:17:57.516597+0000","last_clean":"2024-04-16T16:17:57.516597+0000","last_became_active":"2024-04-16T16:17:56.514227+0000","last_became_peered":"2024-04-16T16:17:56.514227+0000","last_unstale":"2024-04-16T16:17:57.516597+0000","last_undegraded":"2024-04-16T16:17:57.516597+0000","last_fullsized":"2024-04-16T16:17:57.516597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:09:27.455247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153094+0000","last_change":"2024-04-16T16:17:56.522948+0000","last_active":"2024-04-16T16:17:58.153094+0000","last_peered":"2024-04-16T16:17:58.153094+0000","last_clean":"2024-04-16T16:17:58.153094+0000","last_became_active":"2024-04-16T16:17:56.522558+0000","last_became_peered":"2024-04-16T16:17:56.522558+0000","last_unstale":"2024-04-16T16:17:58.153094+0000","last_undegraded":"2024-04-16T16:17:58.153094+0000","last_fullsized":"2024-04-16T16:17:58.153094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:20.121131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492696+0000","last_change":"2024-04-16T16:17:56.517173+0000","last_active":"2024-04-16T16:17:57.492696+0000","last_peered":"2024-04-16T16:17:57.492696+0000","last_clean":"2024-04-16T16:17:57.492696+0000","last_became_active":"2024-04-16T16:17:56.516749+0000","last_became_peered":"2024-04-16T16:17:56.516749+0000","last_unstale":"2024-04-16T16:17:57.492696+0000","last_undegraded":"2024-04-16T16:17:57.492696+0000","last_fullsized":"2024-04-16T16:17:57.492696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497706+0000","last_change":"2024-04-16T16:17:56.505321+0000","last_active":"2024-04-16T16:17:57.497706+0000","last_peered":"2024-04-16T16:17:57.497706+0000","last_clean":"2024-04-16T16:17:57.497706+0000","last_became_active":"2024-04-16T16:17:56.503979+0000","last_became_peered":"2024-04-16T16:17:56.503979+0000","last_unstale":"2024-04-16T16:17:57.497706+0000","last_undegraded":"2024-04-16T16:17:57.497706+0000","last_fullsized":"2024-04-16T16:17:57.497706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.496995+0000","last_change":"2024-04-16T16:17:56.501157+0000","last_active":"2024-04-16T16:17:57.496995+0000","last_peered":"2024-04-16T16:17:57.496995+0000","last_clean":"2024-04-16T16:17:57.496995+0000","last_became_active":"2024-04-16T16:17:56.500191+0000","last_became_peered":"2024-04-16T16:17:56.500191+0000","last_unstale":"2024-04-16T16:17:57.496995+0000","last_undegraded":"2024-04-16T16:17:57.496995+0000","last_fullsized":"2024-04-16T16:17:57.496995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499169+0000","last_change":"2024-04-16T16:17:56.502074+0000","last_active":"2024-04-16T16:17:57.499169+0000","last_peered":"2024-04-16T16:17:57.499169+0000","last_clean":"2024-04-16T16:17:57.499169+0000","last_became_active":"2024-04-16T16:17:56.501708+0000","last_became_peered":"2024-04-16T16:17:56.501708+0000","last_unstale":"2024-04-16T16:17:57.499169+0000","last_undegraded":"2024-04-16T16:17:57.499169+0000","last_fullsized":"2024-04-16T16:17:57.499169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:54.597447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516908+0000","last_change":"2024-04-16T16:17:56.519775+0000","last_active":"2024-04-16T16:17:57.516908+0000","last_peered":"2024-04-16T16:17:57.516908+0000","last_clean":"2024-04-16T16:17:57.516908+0000","last_became_active":"2024-04-16T16:17:56.517890+0000","last_became_peered":"2024-04-16T16:17:56.517890+0000","last_unstale":"2024-04-16T16:17:57.516908+0000","last_undegraded":"2024-04-16T16:17:57.516908+0000","last_fullsized":"2024-04-16T16:17:57.516908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499963+0000","last_change":"2024-04-16T16:17:56.515007+0000","last_active":"2024-04-16T16:17:57.499963+0000","last_peered":"2024-04-16T16:17:57.499963+0000","last_clean":"2024-04-16T16:17:57.499963+0000","last_became_active":"2024-04-16T16:17:56.514728+0000","last_became_peered":"2024-04-16T16:17:56.514728+0000","last_unstale":"2024-04-16T16:17:57.499963+0000","last_undegraded":"2024-04-16T16:17:57.499963+0000","last_fullsized":"2024-04-16T16:17:57.499963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:17.749181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153642+0000","last_change":"2024-04-16T16:17:56.522417+0000","last_active":"2024-04-16T16:17:58.153642+0000","last_peered":"2024-04-16T16:17:58.153642+0000","last_clean":"2024-04-16T16:17:58.153642+0000","last_became_active":"2024-04-16T16:17:56.522070+0000","last_became_peered":"2024-04-16T16:17:56.522070+0000","last_unstale":"2024-04-16T16:17:58.153642+0000","last_undegraded":"2024-04-16T16:17:58.153642+0000","last_fullsized":"2024-04-16T16:17:58.153642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153471+0000","last_change":"2024-04-16T16:17:56.503495+0000","last_active":"2024-04-16T16:17:58.153471+0000","last_peered":"2024-04-16T16:17:58.153471+0000","last_clean":"2024-04-16T16:17:58.153471+0000","last_became_active":"2024-04-16T16:17:56.503214+0000","last_became_peered":"2024-04-16T16:17:56.503214+0000","last_unstale":"2024-04-16T16:17:58.153471+0000","last_undegraded":"2024-04-16T16:17:58.153471+0000","last_fullsized":"2024-04-16T16:17:58.153471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:18.637778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493068+0000","last_change":"2024-04-16T16:17:56.500333+0000","last_active":"2024-04-16T16:17:57.493068+0000","last_peered":"2024-04-16T16:17:57.493068+0000","last_clean":"2024-04-16T16:17:57.493068+0000","last_became_active":"2024-04-16T16:17:56.500055+0000","last_became_peered":"2024-04-16T16:17:56.500055+0000","last_unstale":"2024-04-16T16:17:57.493068+0000","last_undegraded":"2024-04-16T16:17:57.493068+0000","last_fullsized":"2024-04-16T16:17:57.493068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:59.242254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153215+0000","last_change":"2024-04-16T16:17:56.501375+0000","last_active":"2024-04-16T16:17:58.153215+0000","last_peered":"2024-04-16T16:17:58.153215+0000","last_clean":"2024-04-16T16:17:58.153215+0000","last_became_active":"2024-04-16T16:17:56.501060+0000","last_became_peered":"2024-04-16T16:17:56.501060+0000","last_unstale":"2024-04-16T16:17:58.153215+0000","last_undegraded":"2024-04-16T16:17:58.153215+0000","last_fullsized":"2024-04-16T16:17:58.153215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498929+0000","last_change":"2024-04-16T16:17:56.527011+0000","last_active":"2024-04-16T16:17:57.498929+0000","last_peered":"2024-04-16T16:17:57.498929+0000","last_clean":"2024-04-16T16:17:57.498929+0000","last_became_active":"2024-04-16T16:17:56.526634+0000","last_became_peered":"2024-04-16T16:17:56.526634+0000","last_unstale":"2024-04-16T16:17:57.498929+0000","last_undegraded":"2024-04-16T16:17:57.498929+0000","last_fullsized":"2024-04-16T16:17:57.498929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:17.809471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.500363+0000","last_change":"2024-04-16T16:17:56.503656+0000","last_active":"2024-04-16T16:17:57.500363+0000","last_peered":"2024-04-16T16:17:57.500363+0000","last_clean":"2024-04-16T16:17:57.500363+0000","last_became_active":"2024-04-16T16:17:56.501346+0000","last_became_peered":"2024-04-16T16:17:56.501346+0000","last_unstale":"2024-04-16T16:17:57.500363+0000","last_undegraded":"2024-04-16T16:17:57.500363+0000","last_fullsized":"2024-04-16T16:17:57.500363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493608+0000","last_change":"2024-04-16T16:17:56.498898+0000","last_active":"2024-04-16T16:17:57.493608+0000","last_peered":"2024-04-16T16:17:57.493608+0000","last_clean":"2024-04-16T16:17:57.493608+0000","last_became_active":"2024-04-16T16:17:56.498114+0000","last_became_peered":"2024-04-16T16:17:56.498114+0000","last_unstale":"2024-04-16T16:17:57.493608+0000","last_undegraded":"2024-04-16T16:17:57.493608+0000","last_fullsized":"2024-04-16T16:17:57.493608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:37.663896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493073+0000","last_change":"2024-04-16T16:17:56.513521+0000","last_active":"2024-04-16T16:17:57.493073+0000","last_peered":"2024-04-16T16:17:57.493073+0000","last_clean":"2024-04-16T16:17:57.493073+0000","last_became_active":"2024-04-16T16:17:56.513263+0000","last_became_peered":"2024-04-16T16:17:56.513263+0000","last_unstale":"2024-04-16T16:17:57.493073+0000","last_undegraded":"2024-04-16T16:17:57.493073+0000","last_fullsized":"2024-04-16T16:17:57.493073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:42.373864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153246+0000","last_change":"2024-04-16T16:17:56.499823+0000","last_active":"2024-04-16T16:17:58.153246+0000","last_peered":"2024-04-16T16:17:58.153246+0000","last_clean":"2024-04-16T16:17:58.153246+0000","last_became_active":"2024-04-16T16:17:56.499472+0000","last_became_peered":"2024-04-16T16:17:56.499472+0000","last_unstale":"2024-04-16T16:17:58.153246+0000","last_undegraded":"2024-04-16T16:17:58.153246+0000","last_fullsized":"2024-04-16T16:17:58.153246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:54.107187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498248+0000","last_change":"2024-04-16T16:17:56.505602+0000","last_active":"2024-04-16T16:17:57.498248+0000","last_peered":"2024-04-16T16:17:57.498248+0000","last_clean":"2024-04-16T16:17:57.498248+0000","last_became_active":"2024-04-16T16:17:56.505281+0000","last_became_peered":"2024-04-16T16:17:56.505281+0000","last_unstale":"2024-04-16T16:17:57.498248+0000","last_undegraded":"2024-04-16T16:17:57.498248+0000","last_fullsized":"2024-04-16T16:17:57.498248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:18.641103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498061+0000","last_change":"2024-04-16T16:17:56.517999+0000","last_active":"2024-04-16T16:17:57.498061+0000","last_peered":"2024-04-16T16:17:57.498061+0000","last_clean":"2024-04-16T16:17:57.498061+0000","last_became_active":"2024-04-16T16:17:56.517710+0000","last_became_peered":"2024-04-16T16:17:56.517710+0000","last_unstale":"2024-04-16T16:17:57.498061+0000","last_undegraded":"2024-04-16T16:17:57.498061+0000","last_fullsized":"2024-04-16T16:17:57.498061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.509863+0000","last_change":"2024-04-16T16:17:56.507304+0000","last_active":"2024-04-16T16:17:57.509863+0000","last_peered":"2024-04-16T16:17:57.509863+0000","last_clean":"2024-04-16T16:17:57.509863+0000","last_became_active":"2024-04-16T16:17:56.506972+0000","last_became_peered":"2024-04-16T16:17:56.506972+0000","last_unstale":"2024-04-16T16:17:57.509863+0000","last_undegraded":"2024-04-16T16:17:57.509863+0000","last_fullsized":"2024-04-16T16:17:57.509863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:49.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152901+0000","last_change":"2024-04-16T16:17:56.497834+0000","last_active":"2024-04-16T16:17:58.152901+0000","last_peered":"2024-04-16T16:17:58.152901+0000","last_clean":"2024-04-16T16:17:58.152901+0000","last_became_active":"2024-04-16T16:17:56.497528+0000","last_became_peered":"2024-04-16T16:17:56.497528+0000","last_unstale":"2024-04-16T16:17:58.152901+0000","last_undegraded":"2024-04-16T16:17:58.152901+0000","last_fullsized":"2024-04-16T16:17:58.152901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517138+0000","last_change":"2024-04-16T16:17:56.508439+0000","last_active":"2024-04-16T16:17:57.517138+0000","last_peered":"2024-04-16T16:17:57.517138+0000","last_clean":"2024-04-16T16:17:57.517138+0000","last_became_active":"2024-04-16T16:17:56.508030+0000","last_became_peered":"2024-04-16T16:17:56.508030+0000","last_unstale":"2024-04-16T16:17:57.517138+0000","last_undegraded":"2024-04-16T16:17:57.517138+0000","last_fullsized":"2024-04-16T16:17:57.517138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493754+0000","last_change":"2024-04-16T16:17:56.502130+0000","last_active":"2024-04-16T16:17:57.493754+0000","last_peered":"2024-04-16T16:17:57.493754+0000","last_clean":"2024-04-16T16:17:57.493754+0000","last_became_active":"2024-04-16T16:17:56.501314+0000","last_became_peered":"2024-04-16T16:17:56.501314+0000","last_unstale":"2024-04-16T16:17:57.493754+0000","last_undegraded":"2024-04-16T16:17:57.493754+0000","last_fullsized":"2024-04-16T16:17:57.493754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:08.109447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517671+0000","last_change":"2024-04-16T16:17:56.513141+0000","last_active":"2024-04-16T16:17:57.517671+0000","last_peered":"2024-04-16T16:17:57.517671+0000","last_clean":"2024-04-16T16:17:57.517671+0000","last_became_active":"2024-04-16T16:17:56.511366+0000","last_became_peered":"2024-04-16T16:17:56.511366+0000","last_unstale":"2024-04-16T16:17:57.517671+0000","last_undegraded":"2024-04-16T16:17:57.517671+0000","last_fullsized":"2024-04-16T16:17:57.517671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154236+0000","last_change":"2024-04-16T16:17:56.497253+0000","last_active":"2024-04-16T16:17:58.154236+0000","last_peered":"2024-04-16T16:17:58.154236+0000","last_clean":"2024-04-16T16:17:58.154236+0000","last_became_active":"2024-04-16T16:17:56.496953+0000","last_became_peered":"2024-04-16T16:17:56.496953+0000","last_unstale":"2024-04-16T16:17:58.154236+0000","last_undegraded":"2024-04-16T16:17:58.154236+0000","last_fullsized":"2024-04-16T16:17:58.154236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:17.809471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498678+0000","last_change":"2024-04-16T16:17:56.522234+0000","last_active":"2024-04-16T16:17:57.498678+0000","last_peered":"2024-04-16T16:17:57.498678+0000","last_clean":"2024-04-16T16:17:57.498678+0000","last_became_active":"2024-04-16T16:17:56.521812+0000","last_became_peered":"2024-04-16T16:17:56.521812+0000","last_unstale":"2024-04-16T16:17:57.498678+0000","last_undegraded":"2024-04-16T16:17:57.498678+0000","last_fullsized":"2024-04-16T16:17:57.498678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:09:27.455247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499712+0000","last_change":"2024-04-16T16:17:56.501528+0000","last_active":"2024-04-16T16:17:57.499712+0000","last_peered":"2024-04-16T16:17:57.499712+0000","last_clean":"2024-04-16T16:17:57.499712+0000","last_became_active":"2024-04-16T16:17:56.500783+0000","last_became_peered":"2024-04-16T16:17:56.500783+0000","last_unstale":"2024-04-16T16:17:57.499712+0000","last_undegraded":"2024-04-16T16:17:57.499712+0000","last_fullsized":"2024-04-16T16:17:57.499712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:45:36.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153566+0000","last_change":"2024-04-16T16:17:56.498532+0000","last_active":"2024-04-16T16:17:58.153566+0000","last_peered":"2024-04-16T16:17:58.153566+0000","last_clean":"2024-04-16T16:17:58.153566+0000","last_became_active":"2024-04-16T16:17:56.498200+0000","last_became_peered":"2024-04-16T16:17:56.498200+0000","last_unstale":"2024-04-16T16:17:58.153566+0000","last_undegraded":"2024-04-16T16:17:58.153566+0000","last_fullsized":"2024-04-16T16:17:58.153566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:09:17.398636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.496980+0000","last_change":"2024-04-16T16:17:56.512883+0000","last_active":"2024-04-16T16:17:57.496980+0000","last_peered":"2024-04-16T16:17:57.496980+0000","last_clean":"2024-04-16T16:17:57.496980+0000","last_became_active":"2024-04-16T16:17:56.511662+0000","last_became_peered":"2024-04-16T16:17:56.511662+0000","last_unstale":"2024-04-16T16:17:57.496980+0000","last_undegraded":"2024-04-16T16:17:57.496980+0000","last_fullsized":"2024-04-16T16:17:57.496980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510620+0000","last_change":"2024-04-16T16:17:56.505463+0000","last_active":"2024-04-16T16:17:57.510620+0000","last_peered":"2024-04-16T16:17:57.510620+0000","last_clean":"2024-04-16T16:17:57.510620+0000","last_became_active":"2024-04-16T16:17:56.502336+0000","last_became_peered":"2024-04-16T16:17:56.502336+0000","last_unstale":"2024-04-16T16:17:57.510620+0000","last_undegraded":"2024-04-16T16:17:57.510620+0000","last_fullsized":"2024-04-16T16:17:57.510620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154547+0000","last_change":"2024-04-16T16:17:55.501902+0000","last_active":"2024-04-16T16:17:58.154547+0000","last_peered":"2024-04-16T16:17:58.154547+0000","last_clean":"2024-04-16T16:17:58.154547+0000","last_became_active":"2024-04-16T16:17:55.501467+0000","last_became_peered":"2024-04-16T16:17:55.501467+0000","last_unstale":"2024-04-16T16:17:58.154547+0000","last_undegraded":"2024-04-16T16:17:58.154547+0000","last_fullsized":"2024-04-16T16:17:58.154547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.156005+0000","last_change":"2024-04-16T16:17:56.511938+0000","last_active":"2024-04-16T16:17:58.156005+0000","last_peered":"2024-04-16T16:17:58.156005+0000","last_clean":"2024-04-16T16:17:58.156005+0000","last_became_active":"2024-04-16T16:17:56.510346+0000","last_became_peered":"2024-04-16T16:17:56.510346+0000","last_unstale":"2024-04-16T16:17:58.156005+0000","last_undegraded":"2024-04-16T16:17:58.156005+0000","last_fullsized":"2024-04-16T16:17:58.156005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510541+0000","last_change":"2024-04-16T16:17:55.498496+0000","last_active":"2024-04-16T16:17:57.510541+0000","last_peered":"2024-04-16T16:17:57.510541+0000","last_clean":"2024-04-16T16:17:57.510541+0000","last_became_active":"2024-04-16T16:17:55.498148+0000","last_became_peered":"2024-04-16T16:17:55.498148+0000","last_unstale":"2024-04-16T16:17:57.510541+0000","last_undegraded":"2024-04-16T16:17:57.510541+0000","last_fullsized":"2024-04-16T16:17:57.510541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499570+0000","last_change":"2024-04-16T16:17:56.522166+0000","last_active":"2024-04-16T16:17:57.499570+0000","last_peered":"2024-04-16T16:17:57.499570+0000","last_clean":"2024-04-16T16:17:57.499570+0000","last_became_active":"2024-04-16T16:17:56.521847+0000","last_became_peered":"2024-04-16T16:17:56.521847+0000","last_unstale":"2024-04-16T16:17:57.499570+0000","last_undegraded":"2024-04-16T16:17:57.499570+0000","last_fullsized":"2024-04-16T16:17:57.499570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492966+0000","last_change":"2024-04-16T16:17:55.489599+0000","last_active":"2024-04-16T16:17:57.492966+0000","last_peered":"2024-04-16T16:17:57.492966+0000","last_clean":"2024-04-16T16:17:57.492966+0000","last_became_active":"2024-04-16T16:17:55.489035+0000","last_became_peered":"2024-04-16T16:17:55.489035+0000","last_unstale":"2024-04-16T16:17:57.492966+0000","last_undegraded":"2024-04-16T16:17:57.492966+0000","last_fullsized":"2024-04-16T16:17:57.492966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:48.713597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517860+0000","last_change":"2024-04-16T16:17:56.511325+0000","last_active":"2024-04-16T16:17:57.517860+0000","last_peered":"2024-04-16T16:17:57.517860+0000","last_clean":"2024-04-16T16:17:57.517860+0000","last_became_active":"2024-04-16T16:17:56.511026+0000","last_became_peered":"2024-04-16T16:17:56.511026+0000","last_unstale":"2024-04-16T16:17:57.517860+0000","last_undegraded":"2024-04-16T16:17:57.517860+0000","last_fullsized":"2024-04-16T16:17:57.517860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153239+0000","last_change":"2024-04-16T16:17:55.492715+0000","last_active":"2024-04-16T16:17:58.153239+0000","last_peered":"2024-04-16T16:17:58.153239+0000","last_clean":"2024-04-16T16:17:58.153239+0000","last_became_active":"2024-04-16T16:17:55.492461+0000","last_became_peered":"2024-04-16T16:17:55.492461+0000","last_unstale":"2024-04-16T16:17:58.153239+0000","last_undegraded":"2024-04-16T16:17:58.153239+0000","last_fullsized":"2024-04-16T16:17:58.153239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:41:55.032946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.500056+0000","last_change":"2024-04-16T16:17:56.509933+0000","last_active":"2024-04-16T16:17:57.500056+0000","last_peered":"2024-04-16T16:17:57.500056+0000","last_clean":"2024-04-16T16:17:57.500056+0000","last_became_active":"2024-04-16T16:17:56.509670+0000","last_became_peered":"2024-04-16T16:17:56.509670+0000","last_unstale":"2024-04-16T16:17:57.500056+0000","last_undegraded":"2024-04-16T16:17:57.500056+0000","last_fullsized":"2024-04-16T16:17:57.500056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498548+0000","last_change":"2024-04-16T16:17:55.498614+0000","last_active":"2024-04-16T16:17:57.498548+0000","last_peered":"2024-04-16T16:17:57.498548+0000","last_clean":"2024-04-16T16:17:57.498548+0000","last_became_active":"2024-04-16T16:17:55.498220+0000","last_became_peered":"2024-04-16T16:17:55.498220+0000","last_unstale":"2024-04-16T16:17:57.498548+0000","last_undegraded":"2024-04-16T16:17:57.498548+0000","last_fullsized":"2024-04-16T16:17:57.498548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:25:12.960648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154095+0000","last_change":"2024-04-16T16:17:56.492281+0000","last_active":"2024-04-16T16:17:58.154095+0000","last_peered":"2024-04-16T16:17:58.154095+0000","last_clean":"2024-04-16T16:17:58.154095+0000","last_became_active":"2024-04-16T16:17:56.491918+0000","last_became_peered":"2024-04-16T16:17:56.491918+0000","last_unstale":"2024-04-16T16:17:58.154095+0000","last_undegraded":"2024-04-16T16:17:58.154095+0000","last_fullsized":"2024-04-16T16:17:58.154095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:56.520798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497848+0000","last_change":"2024-04-16T16:17:55.498772+0000","last_active":"2024-04-16T16:17:57.497848+0000","last_peered":"2024-04-16T16:17:57.497848+0000","last_clean":"2024-04-16T16:17:57.497848+0000","last_became_active":"2024-04-16T16:17:55.498140+0000","last_became_peered":"2024-04-16T16:17:55.498140+0000","last_unstale":"2024-04-16T16:17:57.497848+0000","last_undegraded":"2024-04-16T16:17:57.497848+0000","last_fullsized":"2024-04-16T16:17:57.497848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:48:49.711527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497716+0000","last_change":"2024-04-16T16:17:56.495123+0000","last_active":"2024-04-16T16:17:57.497716+0000","last_peered":"2024-04-16T16:17:57.497716+0000","last_clean":"2024-04-16T16:17:57.497716+0000","last_became_active":"2024-04-16T16:17:56.494372+0000","last_became_peered":"2024-04-16T16:17:56.494372+0000","last_unstale":"2024-04-16T16:17:57.497716+0000","last_undegraded":"2024-04-16T16:17:57.497716+0000","last_fullsized":"2024-04-16T16:17:57.497716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492600+0000","last_change":"2024-04-16T16:17:55.496597+0000","last_active":"2024-04-16T16:17:57.492600+0000","last_peered":"2024-04-16T16:17:57.492600+0000","last_clean":"2024-04-16T16:17:57.492600+0000","last_became_active":"2024-04-16T16:17:55.496282+0000","last_became_peered":"2024-04-16T16:17:55.496282+0000","last_unstale":"2024-04-16T16:17:57.492600+0000","last_undegraded":"2024-04-16T16:17:57.492600+0000","last_fullsized":"2024-04-16T16:17:57.492600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:13.627825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516632+0000","last_change":"2024-04-16T16:17:56.503671+0000","last_active":"2024-04-16T16:17:57.516632+0000","last_peered":"2024-04-16T16:17:57.516632+0000","last_clean":"2024-04-16T16:17:57.516632+0000","last_became_active":"2024-04-16T16:17:56.503360+0000","last_became_peered":"2024-04-16T16:17:56.503360+0000","last_unstale":"2024-04-16T16:17:57.516632+0000","last_undegraded":"2024-04-16T16:17:57.516632+0000","last_fullsized":"2024-04-16T16:17:57.516632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:54.597447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497870+0000","last_change":"2024-04-16T16:17:55.496087+0000","last_active":"2024-04-16T16:17:57.497870+0000","last_peered":"2024-04-16T16:17:57.497870+0000","last_clean":"2024-04-16T16:17:57.497870+0000","last_became_active":"2024-04-16T16:17:55.495702+0000","last_became_peered":"2024-04-16T16:17:55.495702+0000","last_unstale":"2024-04-16T16:17:57.497870+0000","last_undegraded":"2024-04-16T16:17:57.497870+0000","last_fullsized":"2024-04-16T16:17:57.497870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:15.658237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155981+0000","last_change":"2024-04-16T16:17:56.518597+0000","last_active":"2024-04-16T16:17:58.155981+0000","last_peered":"2024-04-16T16:17:58.155981+0000","last_clean":"2024-04-16T16:17:58.155981+0000","last_became_active":"2024-04-16T16:17:56.518173+0000","last_became_peered":"2024-04-16T16:17:56.518173+0000","last_unstale":"2024-04-16T16:17:58.155981+0000","last_undegraded":"2024-04-16T16:17:58.155981+0000","last_fullsized":"2024-04-16T16:17:58.155981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493261+0000","last_change":"2024-04-16T16:17:55.502598+0000","last_active":"2024-04-16T16:17:57.493261+0000","last_peered":"2024-04-16T16:17:57.493261+0000","last_clean":"2024-04-16T16:17:57.493261+0000","last_became_active":"2024-04-16T16:17:55.500438+0000","last_became_peered":"2024-04-16T16:17:55.500438+0000","last_unstale":"2024-04-16T16:17:57.493261+0000","last_undegraded":"2024-04-16T16:17:57.493261+0000","last_fullsized":"2024-04-16T16:17:57.493261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:17.627068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493372+0000","last_change":"2024-04-16T16:17:56.518072+0000","last_active":"2024-04-16T16:17:57.493372+0000","last_peered":"2024-04-16T16:17:57.493372+0000","last_clean":"2024-04-16T16:17:57.493372+0000","last_became_active":"2024-04-16T16:17:56.517785+0000","last_became_peered":"2024-04-16T16:17:56.517785+0000","last_unstale":"2024-04-16T16:17:57.493372+0000","last_undegraded":"2024-04-16T16:17:57.493372+0000","last_fullsized":"2024-04-16T16:17:57.493372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:09.446148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510710+0000","last_change":"2024-04-16T16:17:55.491916+0000","last_active":"2024-04-16T16:17:57.510710+0000","last_peered":"2024-04-16T16:17:57.510710+0000","last_clean":"2024-04-16T16:17:57.510710+0000","last_became_active":"2024-04-16T16:17:55.491653+0000","last_became_peered":"2024-04-16T16:17:55.491653+0000","last_unstale":"2024-04-16T16:17:57.510710+0000","last_undegraded":"2024-04-16T16:17:57.510710+0000","last_fullsized":"2024-04-16T16:17:57.510710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:19.107096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493266+0000","last_change":"2024-04-16T16:17:56.501329+0000","last_active":"2024-04-16T16:17:57.493266+0000","last_peered":"2024-04-16T16:17:57.493266+0000","last_clean":"2024-04-16T16:17:57.493266+0000","last_became_active":"2024-04-16T16:17:56.501066+0000","last_became_peered":"2024-04-16T16:17:56.501066+0000","last_unstale":"2024-04-16T16:17:57.493266+0000","last_undegraded":"2024-04-16T16:17:57.493266+0000","last_fullsized":"2024-04-16T16:17:57.493266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:27:36.595251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154604+0000","last_change":"2024-04-16T16:17:55.493838+0000","last_active":"2024-04-16T16:17:58.154604+0000","last_peered":"2024-04-16T16:17:58.154604+0000","last_clean":"2024-04-16T16:17:58.154604+0000","last_became_active":"2024-04-16T16:17:55.493444+0000","last_became_peered":"2024-04-16T16:17:55.493444+0000","last_unstale":"2024-04-16T16:17:58.154604+0000","last_undegraded":"2024-04-16T16:17:58.154604+0000","last_fullsized":"2024-04-16T16:17:58.154604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:44:04.842040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154437+0000","last_change":"2024-04-16T16:17:56.504256+0000","last_active":"2024-04-16T16:17:58.154437+0000","last_peered":"2024-04-16T16:17:58.154437+0000","last_clean":"2024-04-16T16:17:58.154437+0000","last_became_active":"2024-04-16T16:17:56.503835+0000","last_became_peered":"2024-04-16T16:17:56.503835+0000","last_unstale":"2024-04-16T16:17:58.154437+0000","last_undegraded":"2024-04-16T16:17:58.154437+0000","last_fullsized":"2024-04-16T16:17:58.154437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:45:36.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493228+0000","last_change":"2024-04-16T16:17:55.489575+0000","last_active":"2024-04-16T16:17:57.493228+0000","last_peered":"2024-04-16T16:17:57.493228+0000","last_clean":"2024-04-16T16:17:57.493228+0000","last_became_active":"2024-04-16T16:17:55.489273+0000","last_became_peered":"2024-04-16T16:17:55.489273+0000","last_unstale":"2024-04-16T16:17:57.493228+0000","last_undegraded":"2024-04-16T16:17:57.493228+0000","last_fullsized":"2024-04-16T16:17:57.493228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:01.905935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516327+0000","last_change":"2024-04-16T16:17:56.504261+0000","last_active":"2024-04-16T16:17:57.516327+0000","last_peered":"2024-04-16T16:17:57.516327+0000","last_clean":"2024-04-16T16:17:57.516327+0000","last_became_active":"2024-04-16T16:17:56.503915+0000","last_became_peered":"2024-04-16T16:17:56.503915+0000","last_unstale":"2024-04-16T16:17:57.516327+0000","last_undegraded":"2024-04-16T16:17:57.516327+0000","last_fullsized":"2024-04-16T16:17:57.516327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:18.641103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498833+0000","last_change":"2024-04-16T16:17:55.495996+0000","last_active":"2024-04-16T16:17:57.498833+0000","last_peered":"2024-04-16T16:17:57.498833+0000","last_clean":"2024-04-16T16:17:57.498833+0000","last_became_active":"2024-04-16T16:17:55.495677+0000","last_became_peered":"2024-04-16T16:17:55.495677+0000","last_unstale":"2024-04-16T16:17:57.498833+0000","last_undegraded":"2024-04-16T16:17:57.498833+0000","last_fullsized":"2024-04-16T16:17:57.498833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:00:54.269393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493321+0000","last_change":"2024-04-16T16:17:56.518138+0000","last_active":"2024-04-16T16:17:57.493321+0000","last_peered":"2024-04-16T16:17:57.493321+0000","last_clean":"2024-04-16T16:17:57.493321+0000","last_became_active":"2024-04-16T16:17:56.517555+0000","last_became_peered":"2024-04-16T16:17:56.517555+0000","last_unstale":"2024-04-16T16:17:57.493321+0000","last_undegraded":"2024-04-16T16:17:57.493321+0000","last_fullsized":"2024-04-16T16:17:57.493321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:12.986654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516457+0000","last_change":"2024-04-16T16:17:55.498257+0000","last_active":"2024-04-16T16:17:57.516457+0000","last_peered":"2024-04-16T16:17:57.516457+0000","last_clean":"2024-04-16T16:17:57.516457+0000","last_became_active":"2024-04-16T16:17:55.497361+0000","last_became_peered":"2024-04-16T16:17:55.497361+0000","last_unstale":"2024-04-16T16:17:57.516457+0000","last_undegraded":"2024-04-16T16:17:57.516457+0000","last_fullsized":"2024-04-16T16:17:57.516457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498671+0000","last_change":"2024-04-16T16:17:56.518550+0000","last_active":"2024-04-16T16:17:57.498671+0000","last_peered":"2024-04-16T16:17:57.498671+0000","last_clean":"2024-04-16T16:17:57.498671+0000","last_became_active":"2024-04-16T16:17:56.512051+0000","last_became_peered":"2024-04-16T16:17:56.512051+0000","last_unstale":"2024-04-16T16:17:57.498671+0000","last_undegraded":"2024-04-16T16:17:57.498671+0000","last_fullsized":"2024-04-16T16:17:57.498671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:56.520798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492739+0000","last_change":"2024-04-16T16:17:55.501273+0000","last_active":"2024-04-16T16:17:57.492739+0000","last_peered":"2024-04-16T16:17:57.492739+0000","last_clean":"2024-04-16T16:17:57.492739+0000","last_became_active":"2024-04-16T16:17:55.499868+0000","last_became_peered":"2024-04-16T16:17:55.499868+0000","last_unstale":"2024-04-16T16:17:57.492739+0000","last_undegraded":"2024-04-16T16:17:57.492739+0000","last_fullsized":"2024-04-16T16:17:57.492739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:26.690513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153776+0000","last_change":"2024-04-16T16:17:56.509695+0000","last_active":"2024-04-16T16:17:58.153776+0000","last_peered":"2024-04-16T16:17:58.153776+0000","last_clean":"2024-04-16T16:17:58.153776+0000","last_became_active":"2024-04-16T16:17:56.509395+0000","last_became_peered":"2024-04-16T16:17:56.509395+0000","last_unstale":"2024-04-16T16:17:58.153776+0000","last_undegraded":"2024-04-16T16:17:58.153776+0000","last_fullsized":"2024-04-16T16:17:58.153776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:49.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492566+0000","last_change":"2024-04-16T16:17:55.494052+0000","last_active":"2024-04-16T16:17:57.492566+0000","last_peered":"2024-04-16T16:17:57.492566+0000","last_clean":"2024-04-16T16:17:57.492566+0000","last_became_active":"2024-04-16T16:17:55.491048+0000","last_became_peered":"2024-04-16T16:17:55.491048+0000","last_unstale":"2024-04-16T16:17:57.492566+0000","last_undegraded":"2024-04-16T16:17:57.492566+0000","last_fullsized":"2024-04-16T16:17:57.492566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:48.210032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499235+0000","last_change":"2024-04-16T16:17:56.492416+0000","last_active":"2024-04-16T16:17:57.499235+0000","last_peered":"2024-04-16T16:17:57.499235+0000","last_clean":"2024-04-16T16:17:57.499235+0000","last_became_active":"2024-04-16T16:17:56.491236+0000","last_became_peered":"2024-04-16T16:17:56.491236+0000","last_unstale":"2024-04-16T16:17:57.499235+0000","last_undegraded":"2024-04-16T16:17:57.499235+0000","last_fullsized":"2024-04-16T16:17:57.499235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:08:13.188909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517110+0000","last_change":"2024-04-16T16:17:55.497413+0000","last_active":"2024-04-16T16:17:57.517110+0000","last_peered":"2024-04-16T16:17:57.517110+0000","last_clean":"2024-04-16T16:17:57.517110+0000","last_became_active":"2024-04-16T16:17:55.497021+0000","last_became_peered":"2024-04-16T16:17:55.497021+0000","last_unstale":"2024-04-16T16:17:57.517110+0000","last_undegraded":"2024-04-16T16:17:57.517110+0000","last_fullsized":"2024-04-16T16:17:57.517110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:19.107096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155509+0000","last_change":"2024-04-16T16:17:56.492333+0000","last_active":"2024-04-16T16:17:58.155509+0000","last_peered":"2024-04-16T16:17:58.155509+0000","last_clean":"2024-04-16T16:17:58.155509+0000","last_became_active":"2024-04-16T16:17:56.492011+0000","last_became_peered":"2024-04-16T16:17:56.492011+0000","last_unstale":"2024-04-16T16:17:58.155509+0000","last_undegraded":"2024-04-16T16:17:58.155509+0000","last_fullsized":"2024-04-16T16:17:58.155509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:40.711440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499185+0000","last_change":"2024-04-16T16:17:55.497889+0000","last_active":"2024-04-16T16:17:57.499185+0000","last_peered":"2024-04-16T16:17:57.499185+0000","last_clean":"2024-04-16T16:17:57.499185+0000","last_became_active":"2024-04-16T16:17:55.495651+0000","last_became_peered":"2024-04-16T16:17:55.495651+0000","last_unstale":"2024-04-16T16:17:57.499185+0000","last_undegraded":"2024-04-16T16:17:57.499185+0000","last_fullsized":"2024-04-16T16:17:57.499185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516779+0000","last_change":"2024-04-16T16:17:56.513563+0000","last_active":"2024-04-16T16:17:57.516779+0000","last_peered":"2024-04-16T16:17:57.516779+0000","last_clean":"2024-04-16T16:17:57.516779+0000","last_became_active":"2024-04-16T16:17:56.511843+0000","last_became_peered":"2024-04-16T16:17:56.511843+0000","last_unstale":"2024-04-16T16:17:57.516779+0000","last_undegraded":"2024-04-16T16:17:57.516779+0000","last_fullsized":"2024-04-16T16:17:57.516779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:08:13.188909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498615+0000","last_change":"2024-04-16T16:17:55.490431+0000","last_active":"2024-04-16T16:17:57.498615+0000","last_peered":"2024-04-16T16:17:57.498615+0000","last_clean":"2024-04-16T16:17:57.498615+0000","last_became_active":"2024-04-16T16:17:55.487984+0000","last_became_peered":"2024-04-16T16:17:55.487984+0000","last_unstale":"2024-04-16T16:17:57.498615+0000","last_undegraded":"2024-04-16T16:17:57.498615+0000","last_fullsized":"2024-04-16T16:17:57.498615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153349+0000","last_change":"2024-04-16T16:17:56.505087+0000","last_active":"2024-04-16T16:17:58.153349+0000","last_peered":"2024-04-16T16:17:58.153349+0000","last_clean":"2024-04-16T16:17:58.153349+0000","last_became_active":"2024-04-16T16:17:56.504290+0000","last_became_peered":"2024-04-16T16:17:56.504290+0000","last_unstale":"2024-04-16T16:17:58.153349+0000","last_undegraded":"2024-04-16T16:17:58.153349+0000","last_fullsized":"2024-04-16T16:17:58.153349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:04.283344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499351+0000","last_change":"2024-04-16T16:17:55.501138+0000","last_active":"2024-04-16T16:17:57.499351+0000","last_peered":"2024-04-16T16:17:57.499351+0000","last_clean":"2024-04-16T16:17:57.499351+0000","last_became_active":"2024-04-16T16:17:55.500609+0000","last_became_peered":"2024-04-16T16:17:55.500609+0000","last_unstale":"2024-04-16T16:17:57.499351+0000","last_undegraded":"2024-04-16T16:17:57.499351+0000","last_fullsized":"2024-04-16T16:17:57.499351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:17.994231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152927+0000","last_change":"2024-04-16T16:17:56.495926+0000","last_active":"2024-04-16T16:17:58.152927+0000","last_peered":"2024-04-16T16:17:58.152927+0000","last_clean":"2024-04-16T16:17:58.152927+0000","last_became_active":"2024-04-16T16:17:56.495633+0000","last_became_peered":"2024-04-16T16:17:56.495633+0000","last_unstale":"2024-04-16T16:17:58.152927+0000","last_undegraded":"2024-04-16T16:17:58.152927+0000","last_fullsized":"2024-04-16T16:17:58.152927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:09.188268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510038+0000","last_change":"2024-04-16T16:17:55.489593+0000","last_active":"2024-04-16T16:17:57.510038+0000","last_peered":"2024-04-16T16:17:57.510038+0000","last_clean":"2024-04-16T16:17:57.510038+0000","last_became_active":"2024-04-16T16:17:55.489318+0000","last_became_peered":"2024-04-16T16:17:55.489318+0000","last_unstale":"2024-04-16T16:17:57.510038+0000","last_undegraded":"2024-04-16T16:17:57.510038+0000","last_fullsized":"2024-04-16T16:17:57.510038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:53.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153531+0000","last_change":"2024-04-16T16:17:56.500584+0000","last_active":"2024-04-16T16:17:58.153531+0000","last_peered":"2024-04-16T16:17:58.153531+0000","last_clean":"2024-04-16T16:17:58.153531+0000","last_became_active":"2024-04-16T16:17:56.500262+0000","last_became_peered":"2024-04-16T16:17:56.500262+0000","last_unstale":"2024-04-16T16:17:58.153531+0000","last_undegraded":"2024-04-16T16:17:58.153531+0000","last_fullsized":"2024-04-16T16:17:58.153531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:44:05.856075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154505+0000","last_change":"2024-04-16T16:17:55.500134+0000","last_active":"2024-04-16T16:17:58.154505+0000","last_peered":"2024-04-16T16:17:58.154505+0000","last_clean":"2024-04-16T16:17:58.154505+0000","last_became_active":"2024-04-16T16:17:55.499080+0000","last_became_peered":"2024-04-16T16:17:55.499080+0000","last_unstale":"2024-04-16T16:17:58.154505+0000","last_undegraded":"2024-04-16T16:17:58.154505+0000","last_fullsized":"2024-04-16T16:17:58.154505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153059+0000","last_change":"2024-04-16T16:17:56.506701+0000","last_active":"2024-04-16T16:17:58.153059+0000","last_peered":"2024-04-16T16:17:58.153059+0000","last_clean":"2024-04-16T16:17:58.153059+0000","last_became_active":"2024-04-16T16:17:56.505920+0000","last_became_peered":"2024-04-16T16:17:56.505920+0000","last_unstale":"2024-04-16T16:17:58.153059+0000","last_undegraded":"2024-04-16T16:17:58.153059+0000","last_fullsized":"2024-04-16T16:17:58.153059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:22.516152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497870+0000","last_change":"2024-04-16T16:17:55.499317+0000","last_active":"2024-04-16T16:17:57.497870+0000","last_peered":"2024-04-16T16:17:57.497870+0000","last_clean":"2024-04-16T16:17:57.497870+0000","last_became_active":"2024-04-16T16:17:55.498292+0000","last_became_peered":"2024-04-16T16:17:55.498292+0000","last_unstale":"2024-04-16T16:17:57.497870+0000","last_undegraded":"2024-04-16T16:17:57.497870+0000","last_fullsized":"2024-04-16T16:17:57.497870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:00.317630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497496+0000","last_change":"2024-04-16T16:17:56.503487+0000","last_active":"2024-04-16T16:17:57.497496+0000","last_peered":"2024-04-16T16:17:57.497496+0000","last_clean":"2024-04-16T16:17:57.497496+0000","last_became_active":"2024-04-16T16:17:56.502743+0000","last_became_peered":"2024-04-16T16:17:56.502743+0000","last_unstale":"2024-04-16T16:17:57.497496+0000","last_undegraded":"2024-04-16T16:17:57.497496+0000","last_fullsized":"2024-04-16T16:17:57.497496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152554+0000","last_change":"2024-04-16T16:17:55.493997+0000","last_active":"2024-04-16T16:17:58.152554+0000","last_peered":"2024-04-16T16:17:58.152554+0000","last_clean":"2024-04-16T16:17:58.152554+0000","last_became_active":"2024-04-16T16:17:55.493555+0000","last_became_peered":"2024-04-16T16:17:55.493555+0000","last_unstale":"2024-04-16T16:17:58.152554+0000","last_undegraded":"2024-04-16T16:17:58.152554+0000","last_fullsized":"2024-04-16T16:17:58.152554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:17.623743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153069+0000","last_change":"2024-04-16T16:17:56.494968+0000","last_active":"2024-04-16T16:17:58.153069+0000","last_peered":"2024-04-16T16:17:58.153069+0000","last_clean":"2024-04-16T16:17:58.153069+0000","last_became_active":"2024-04-16T16:17:56.493121+0000","last_became_peered":"2024-04-16T16:17:56.493121+0000","last_unstale":"2024-04-16T16:17:58.153069+0000","last_undegraded":"2024-04-16T16:17:58.153069+0000","last_fullsized":"2024-04-16T16:17:58.153069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:29.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517196+0000","last_change":"2024-04-16T16:17:55.493480+0000","last_active":"2024-04-16T16:17:57.517196+0000","last_peered":"2024-04-16T16:17:57.517196+0000","last_clean":"2024-04-16T16:17:57.517196+0000","last_became_active":"2024-04-16T16:17:55.493211+0000","last_became_peered":"2024-04-16T16:17:55.493211+0000","last_unstale":"2024-04-16T16:17:57.517196+0000","last_undegraded":"2024-04-16T16:17:57.517196+0000","last_fullsized":"2024-04-16T16:17:57.517196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:53.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155902+0000","last_change":"2024-04-16T16:17:56.498460+0000","last_active":"2024-04-16T16:17:58.155902+0000","last_peered":"2024-04-16T16:17:58.155902+0000","last_clean":"2024-04-16T16:17:58.155902+0000","last_became_active":"2024-04-16T16:17:56.498154+0000","last_became_peered":"2024-04-16T16:17:56.498154+0000","last_unstale":"2024-04-16T16:17:58.155902+0000","last_undegraded":"2024-04-16T16:17:58.155902+0000","last_fullsized":"2024-04-16T16:17:58.155902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510947+0000","last_change":"2024-04-16T16:17:55.489803+0000","last_active":"2024-04-16T16:17:57.510947+0000","last_peered":"2024-04-16T16:17:57.510947+0000","last_clean":"2024-04-16T16:17:57.510947+0000","last_became_active":"2024-04-16T16:17:55.489449+0000","last_became_peered":"2024-04-16T16:17:55.489449+0000","last_unstale":"2024-04-16T16:17:57.510947+0000","last_undegraded":"2024-04-16T16:17:57.510947+0000","last_fullsized":"2024-04-16T16:17:57.510947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510538+0000","last_change":"2024-04-16T16:17:56.507757+0000","last_active":"2024-04-16T16:17:57.510538+0000","last_peered":"2024-04-16T16:17:57.510538+0000","last_clean":"2024-04-16T16:17:57.510538+0000","last_became_active":"2024-04-16T16:17:56.505997+0000","last_became_peered":"2024-04-16T16:17:56.505997+0000","last_unstale":"2024-04-16T16:17:57.510538+0000","last_undegraded":"2024-04-16T16:17:57.510538+0000","last_fullsized":"2024-04-16T16:17:57.510538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516844+0000","last_change":"2024-04-16T16:17:55.488048+0000","last_active":"2024-04-16T16:17:57.516844+0000","last_peered":"2024-04-16T16:17:57.516844+0000","last_clean":"2024-04-16T16:17:57.516844+0000","last_became_active":"2024-04-16T16:17:55.487453+0000","last_became_peered":"2024-04-16T16:17:55.487453+0000","last_unstale":"2024-04-16T16:17:57.516844+0000","last_undegraded":"2024-04-16T16:17:57.516844+0000","last_fullsized":"2024-04-16T16:17:57.516844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154901+0000","last_change":"2024-04-16T16:17:56.497861+0000","last_active":"2024-04-16T16:17:58.154901+0000","last_peered":"2024-04-16T16:17:58.154901+0000","last_clean":"2024-04-16T16:17:58.154901+0000","last_became_active":"2024-04-16T16:17:56.496190+0000","last_became_peered":"2024-04-16T16:17:56.496190+0000","last_unstale":"2024-04-16T16:17:58.154901+0000","last_undegraded":"2024-04-16T16:17:58.154901+0000","last_fullsized":"2024-04-16T16:17:58.154901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510233+0000","last_change":"2024-04-16T16:17:55.497516+0000","last_active":"2024-04-16T16:17:57.510233+0000","last_peered":"2024-04-16T16:17:57.510233+0000","last_clean":"2024-04-16T16:17:57.510233+0000","last_became_active":"2024-04-16T16:17:55.497139+0000","last_became_peered":"2024-04-16T16:17:55.497139+0000","last_unstale":"2024-04-16T16:17:57.510233+0000","last_undegraded":"2024-04-16T16:17:57.510233+0000","last_fullsized":"2024-04-16T16:17:57.510233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510147+0000","last_change":"2024-04-16T16:17:56.494896+0000","last_active":"2024-04-16T16:17:57.510147+0000","last_peered":"2024-04-16T16:17:57.510147+0000","last_clean":"2024-04-16T16:17:57.510147+0000","last_became_active":"2024-04-16T16:17:56.494613+0000","last_became_peered":"2024-04-16T16:17:56.494613+0000","last_unstale":"2024-04-16T16:17:57.510147+0000","last_undegraded":"2024-04-16T16:17:57.510147+0000","last_fullsized":"2024-04-16T16:17:57.510147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516613+0000","last_change":"2024-04-16T16:17:55.491264+0000","last_active":"2024-04-16T16:17:57.516613+0000","last_peered":"2024-04-16T16:17:57.516613+0000","last_clean":"2024-04-16T16:17:57.516613+0000","last_became_active":"2024-04-16T16:17:55.490967+0000","last_became_peered":"2024-04-16T16:17:55.490967+0000","last_unstale":"2024-04-16T16:17:57.516613+0000","last_undegraded":"2024-04-16T16:17:57.516613+0000","last_fullsized":"2024-04-16T16:17:57.516613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492629+0000","last_change":"2024-04-16T16:17:56.524360+0000","last_active":"2024-04-16T16:17:57.492629+0000","last_peered":"2024-04-16T16:17:57.492629+0000","last_clean":"2024-04-16T16:17:57.492629+0000","last_became_active":"2024-04-16T16:17:56.522731+0000","last_became_peered":"2024-04-16T16:17:56.522731+0000","last_unstale":"2024-04-16T16:17:57.492629+0000","last_undegraded":"2024-04-16T16:17:57.492629+0000","last_fullsized":"2024-04-16T16:17:57.492629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498212+0000","last_change":"2024-04-16T16:17:55.495329+0000","last_active":"2024-04-16T16:17:57.498212+0000","last_peered":"2024-04-16T16:17:57.498212+0000","last_clean":"2024-04-16T16:17:57.498212+0000","last_became_active":"2024-04-16T16:17:55.494980+0000","last_became_peered":"2024-04-16T16:17:55.494980+0000","last_unstale":"2024-04-16T16:17:57.498212+0000","last_undegraded":"2024-04-16T16:17:57.498212+0000","last_fullsized":"2024-04-16T16:17:57.498212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:17.331783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497710+0000","last_change":"2024-04-16T16:17:56.507046+0000","last_active":"2024-04-16T16:17:57.497710+0000","last_peered":"2024-04-16T16:17:57.497710+0000","last_clean":"2024-04-16T16:17:57.497710+0000","last_became_active":"2024-04-16T16:17:56.501609+0000","last_became_peered":"2024-04-16T16:17:56.501609+0000","last_unstale":"2024-04-16T16:17:57.497710+0000","last_undegraded":"2024-04-16T16:17:57.497710+0000","last_fullsized":"2024-04-16T16:17:57.497710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492721+0000","last_change":"2024-04-16T16:17:55.500519+0000","last_active":"2024-04-16T16:17:57.492721+0000","last_peered":"2024-04-16T16:17:57.492721+0000","last_clean":"2024-04-16T16:17:57.492721+0000","last_became_active":"2024-04-16T16:17:55.499828+0000","last_became_peered":"2024-04-16T16:17:55.499828+0000","last_unstale":"2024-04-16T16:17:57.492721+0000","last_undegraded":"2024-04-16T16:17:57.492721+0000","last_fullsized":"2024-04-16T16:17:57.492721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:53.583412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499987+0000","last_change":"2024-04-16T16:17:56.503025+0000","last_active":"2024-04-16T16:17:57.499987+0000","last_peered":"2024-04-16T16:17:57.499987+0000","last_clean":"2024-04-16T16:17:57.499987+0000","last_became_active":"2024-04-16T16:17:56.500552+0000","last_became_peered":"2024-04-16T16:17:56.500552+0000","last_unstale":"2024-04-16T16:17:57.499987+0000","last_undegraded":"2024-04-16T16:17:57.499987+0000","last_fullsized":"2024-04-16T16:17:57.499987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:40.711440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153781+0000","last_change":"2024-04-16T16:17:55.491794+0000","last_active":"2024-04-16T16:17:58.153781+0000","last_peered":"2024-04-16T16:17:58.153781+0000","last_clean":"2024-04-16T16:17:58.153781+0000","last_became_active":"2024-04-16T16:17:55.491411+0000","last_became_peered":"2024-04-16T16:17:55.491411+0000","last_unstale":"2024-04-16T16:17:58.153781+0000","last_undegraded":"2024-04-16T16:17:58.153781+0000","last_fullsized":"2024-04-16T16:17:58.153781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498833+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:17:57.498833+0000","last_peered":"2024-04-16T16:17:57.498833+0000","last_clean":"2024-04-16T16:17:57.498833+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:17:57.498833+0000","last_undegraded":"2024-04-16T16:17:57.498833+0000","last_fullsized":"2024-04-16T16:17:57.498833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":741737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":151349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":741647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:18:02.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-16T16:18:02.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.299+0000 7fa802e00640 1 Processor -- start 2024-04-16T16:18:02.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.299+0000 7fa802e00640 1 -- start start 2024-04-16T16:18:02.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa802e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa7fc1478c0 0x7fa7fc163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa802e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7fc0ae860 0x7fa7fc0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa802e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7fc0d0e80 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa802e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa7fc0af950 con 0x7fa7fc0ae860 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa802e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa7fc147ca0 con 0x7fa7fc1478c0 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa800e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa7fc0d0a80 0x7fa7fc0b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36810/0 (socket says 172.21.15.22:36810) 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa800e00640 1 -- 172.21.15.22:0/386155573 learned_addr learned my addr 172.21.15.22:0/386155573 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.301+0000 7fa7fb400640 1 --2- 172.21.15.22:0/386155573 >> v2:172.21.15.22:3300/0 conn(0x7fa7fc0ae860 0x7fa7fc0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.302+0000 7fa7fbe00640 1 --2- 172.21.15.22:0/386155573 >> v2:172.21.15.43:3300/0 conn(0x7fa7fc1478c0 0x7fa7fc163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.302+0000 7fa7faa00640 1 -- 172.21.15.22:0/386155573 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364160037 0 0) 0x7fa7fc0d0e80 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.302+0000 7fa7fb400640 1 -- 172.21.15.22:0/386155573 >> v2:172.21.15.43:3300/0 conn(0x7fa7fc1478c0 msgr2=0x7fa7fc163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:02.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.302+0000 7fa7fb400640 1 --2- 172.21.15.22:0/386155573 >> v2:172.21.15.43:3300/0 conn(0x7fa7fc1478c0 0x7fa7fc163340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.302+0000 7fa7fb400640 1 -- 172.21.15.22:0/386155573 >> v1:172.21.15.22:6789/0 conn(0x7fa7fc0d0a80 legacy=0x7fa7fc0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.302+0000 7fa7fb400640 1 -- 172.21.15.22:0/386155573 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc0af0b0 con 0x7fa7fc0ae860 2024-04-16T16:18:02.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.303+0000 7fa7fb400640 1 --2- 172.21.15.22:0/386155573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0ae860 0x7fa7fc0d0540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0631f0 tx=0x7fa7e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16902c794c6f606b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:02.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.303+0000 7fa7faa00640 1 -- 172.21.15.22:0/386155573 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80315a0 con 0x7fa7fc0ae860 2024-04-16T16:18:02.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa7faa00640 1 -- 172.21.15.22:0/386155573 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e8037070 con 0x7fa7fc0ae860 2024-04-16T16:18:02.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa7faa00640 1 -- 172.21.15.22:0/386155573 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8031960 con 0x7fa7fc0ae860 2024-04-16T16:18:02.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 -- 172.21.15.22:0/386155573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0ae860 msgr2=0x7fa7fc0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 --2- 172.21.15.22:0/386155573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0ae860 0x7fa7fc0d0540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0631f0 tx=0x7fa7e802b840 comp rx=0 tx=0).stop 2024-04-16T16:18:02.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 -- 172.21.15.22:0/386155573 shutdown_connections 2024-04-16T16:18:02.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 --2- 172.21.15.22:0/386155573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0ae860 0x7fa7fc0d0540 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 --2- 172.21.15.22:0/386155573 >> v2:172.21.15.43:3300/0 conn(0x7fa7fc1478c0 0x7fa7fc163340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 -- 172.21.15.22:0/386155573 >> 172.21.15.22:0/386155573 conn(0x7fa7fc062440 msgr2=0x7fa7fc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:02.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 -- 172.21.15.22:0/386155573 shutdown_connections 2024-04-16T16:18:02.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.304+0000 7fa802e00640 1 -- 172.21.15.22:0/386155573 wait complete. 2024-04-16T16:18:02.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.306+0000 7fa802e00640 1 Processor -- start 2024-04-16T16:18:02.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.306+0000 7fa802e00640 1 -- start start 2024-04-16T16:18:02.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa802e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7fc0ae860 0x7fa7fc161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa802e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0d0a80 0x7fa7fc141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa802e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7fc1478c0 0x7fa7fc134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa802e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc0aeca0 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa802e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc0af670 con 0x7fa7fc1478c0 2024-04-16T16:18:02.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa802e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa7fc0aee20 con 0x7fa7fc0ae860 2024-04-16T16:18:02.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa7fb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0d0a80 0x7fa7fc141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa7fb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0d0a80 0x7fa7fc141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39694/0 (socket says 172.21.15.22:39694) 2024-04-16T16:18:02.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.307+0000 7fa7fb400640 1 -- 172.21.15.22:0/1959684405 learned_addr learned my addr 172.21.15.22:0/1959684405 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa7fbe00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7fc0ae860 0x7fa7fc161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa800e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7fc1478c0 0x7fa7fc134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa7fb400640 1 -- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7fc0ae860 msgr2=0x7fa7fc161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa7fb400640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7fc0ae860 0x7fa7fc161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa7fb400640 1 -- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7fc1478c0 msgr2=0x7fa7fc134fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa7fb400640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7fc1478c0 0x7fa7fc134fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa7fb400640 1 -- 172.21.15.22:0/1959684405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc135500 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.308+0000 7fa7fb400640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0d0a80 0x7fa7fc141930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009890 tx=0x7fa7e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:02.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.309+0000 7fa7f3e00640 1 -- 172.21.15.22:0/1959684405 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8032630 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.309+0000 7fa7f3e00640 1 -- 172.21.15.22:0/1959684405 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e80327f0 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.309+0000 7fa7f3e00640 1 -- 172.21.15.22:0/1959684405 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8032be0 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.309+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc142080 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.309+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc142640 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.310+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7fc0b4ec0 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.311+0000 7fa7f3e00640 1 -- 172.21.15.22:0/1959684405 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa7e804c020 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.312+0000 7fa7f3e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa7dc06c8f0 0x7fa7dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.313+0000 7fa7f3e00640 1 -- 172.21.15.22:0/1959684405 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa7e802f020 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.313+0000 7fa7fbe00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa7dc06c8f0 0x7fa7dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.313+0000 7fa7fbe00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa7dc06c8f0 0x7fa7dc06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009970 tx=0x7fa7ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.317+0000 7fa7f3e00640 1 -- 172.21.15.22:0/1959684405 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7fc0b4ec0 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.599+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa7fc04fd90 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.600+0000 7fa7f3e00640 1 -- 172.21.15.22:0/1959684405 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1174 (secure 0 0 0) 0x7fa7e8040070 con 0x7fa7fc0d0a80 2024-04-16T16:18:02.599 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":100,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1713284194,"num_in_osds":8,"osd_in_since":1713284185,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":259772416,"bytes_avail":772834340864,"bytes_total":773094113280,"write_bytes_sec":2286,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5118}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-16T16:17:37.723812+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa7dc06c8f0 msgr2=0x7fa7dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa7dc06c8f0 0x7fa7dc06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009970 tx=0x7fa7ec008040 comp rx=0 tx=0).stop 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0d0a80 msgr2=0x7fa7fc141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0d0a80 0x7fa7fc141930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009890 tx=0x7fa7e80046c0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 shutdown_connections 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa7dc06c8f0 0x7fa7dc06edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7fc1478c0 0x7fa7fc134fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7fc0d0a80 0x7fa7fc141930 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 --2- 172.21.15.22:0/1959684405 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7fc0ae860 0x7fa7fc161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 >> 172.21.15.22:0/1959684405 conn(0x7fa7fc062440 msgr2=0x7fa7fc0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:02.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 shutdown_connections 2024-04-16T16:18:02.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.603+0000 7fa802e00640 1 -- 172.21.15.22:0/1959684405 wait complete. 2024-04-16T16:18:02.622 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-16T16:18:02.622 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:18:02.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.848+0000 7feb6e800640 1 Processor -- start 2024-04-16T16:18:02.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.849+0000 7feb6e800640 1 -- start start 2024-04-16T16:18:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.850+0000 7feb6e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb6815c7c0 0x7feb680d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.850+0000 7feb6e800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb680d1d30 0x7feb68062440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.850+0000 7feb6e800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb680cf560 con 0x7feb680b0960 2024-04-16T16:18:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.850+0000 7feb6e800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7feb680d2230 con 0x7feb680d1d30 2024-04-16T16:18:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.850+0000 7feb6e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feb680cf800 con 0x7feb6815c7c0 2024-04-16T16:18:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.850+0000 7feb6de00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feb680b0960 0x7feb680b4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36824/0 (socket says 172.21.15.22:36824) 2024-04-16T16:18:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.851+0000 7feb6de00640 1 -- 172.21.15.22:0/2563566925 learned_addr learned my addr 172.21.15.22:0/2563566925 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:02.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.851+0000 7feb6d400640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb6815c7c0 0x7feb680d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.851+0000 7feb6ca00640 1 --2- 172.21.15.22:0/2563566925 >> v2:172.21.15.43:3300/0 conn(0x7feb680d1d30 0x7feb68062440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.851+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3049772339 0 0) 0x7feb680cf560 con 0x7feb680b0960 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.851+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb50003520 con 0x7feb680b0960 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 677873147 0 0) 0x7feb50003520 con 0x7feb680b0960 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb6815c7c0 msgr2=0x7feb680d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb6815c7c0 0x7feb680d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 >> v2:172.21.15.43:3300/0 conn(0x7feb680d1d30 msgr2=0x7feb68062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 --2- 172.21.15.22:0/2563566925 >> v2:172.21.15.43:3300/0 conn(0x7feb680d1d30 0x7feb68062440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb680cfae0 con 0x7feb680b0960 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7feb60001670 con 0x7feb680b0960 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 >> v1:172.21.15.22:6789/0 conn(0x7feb680b0960 legacy=0x7feb680b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb6815c7c0 0x7feb50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb50004d40 0x7feb500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb680d2230 con 0x7feb500039b0 2024-04-16T16:18:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb680cf800 con 0x7feb50004d40 2024-04-16T16:18:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feb5000b9f0 con 0x7feb6815c7c0 2024-04-16T16:18:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb6d400640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb6d400640 1 -- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb6815c7c0 msgr2=0x7feb50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb6d400640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb6815c7c0 0x7feb50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb6d400640 1 -- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb50004d40 msgr2=0x7feb500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb6d400640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb50004d40 0x7feb500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.852+0000 7feb6d400640 1 -- 172.21.15.22:0/2563566925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50003520 con 0x7feb500039b0 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.854+0000 7feb6d400640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb50003dd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009ac0 tx=0x7feb50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e836d2d730c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.854+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c039070 con 0x7feb500039b0 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.854+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c02c710 con 0x7feb500039b0 2024-04-16T16:18:02.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.854+0000 7feb67e00640 1 -- 172.21.15.22:0/2563566925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c009690 con 0x7feb500039b0 2024-04-16T16:18:02.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.855+0000 7feb6e800640 1 -- 172.21.15.22:0/2563566925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 msgr2=0x7feb50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.855+0000 7feb6e800640 1 --2- 172.21.15.22:0/2563566925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb50003dd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009ac0 tx=0x7feb50005830 comp rx=0 tx=0).stop 2024-04-16T16:18:02.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.855+0000 7feb6de00640 1 -- 172.21.15.22:0/2563566925 reap_dead start 2024-04-16T16:18:02.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.855+0000 7feb6e800640 1 -- 172.21.15.22:0/2563566925 shutdown_connections 2024-04-16T16:18:02.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.855+0000 7feb6e800640 1 -- 172.21.15.22:0/2563566925 >> 172.21.15.22:0/2563566925 conn(0x7feb6806ba20 msgr2=0x7feb6806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:02.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.855+0000 7feb6e800640 1 -- 172.21.15.22:0/2563566925 shutdown_connections 2024-04-16T16:18:02.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.855+0000 7feb6e800640 1 -- 172.21.15.22:0/2563566925 wait complete. 2024-04-16T16:18:02.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.857+0000 7feb6e800640 1 Processor -- start 2024-04-16T16:18:02.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.857+0000 7feb6e800640 1 -- start start 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb680b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb681f46d0 0x7feb68140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb680b43c0 0x7feb6806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6e800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb680725d0 con 0x7feb500039b0 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6e800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb6815cba0 con 0x7feb680b43c0 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feb68072750 con 0x7feb681f46d0 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb680b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb680b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39712/0 (socket says 172.21.15.22:39712) 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 -- 172.21.15.22:0/1765113311 learned_addr learned my addr 172.21.15.22:0/1765113311 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:02.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 -- 172.21.15.22:0/1765113311 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb681f46d0 msgr2=0x7feb68140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb681f46d0 0x7feb68140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 -- 172.21.15.22:0/1765113311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb680b43c0 msgr2=0x7feb6806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:02.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb680b43c0 0x7feb6806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:02.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.858+0000 7feb6d400640 1 -- 172.21.15.22:0/1765113311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6814c4d0 con 0x7feb500039b0 2024-04-16T16:18:02.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.859+0000 7feb6d400640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb680b6720 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:02.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.859+0000 7feb65600640 1 -- 172.21.15.22:0/1765113311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c042020 con 0x7feb500039b0 2024-04-16T16:18:02.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.859+0000 7feb65600640 1 -- 172.21.15.22:0/1765113311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c03a040 con 0x7feb500039b0 2024-04-16T16:18:02.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.859+0000 7feb65600640 1 -- 172.21.15.22:0/1765113311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c039070 con 0x7feb500039b0 2024-04-16T16:18:02.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.859+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6815cf00 con 0x7feb500039b0 2024-04-16T16:18:02.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.859+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6815ebc0 con 0x7feb500039b0 2024-04-16T16:18:02.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.860+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6806c9b0 con 0x7feb500039b0 2024-04-16T16:18:02.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.862+0000 7feb65600640 1 -- 172.21.15.22:0/1765113311 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb5c045020 con 0x7feb500039b0 2024-04-16T16:18:02.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.863+0000 7feb65600640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7feb4c06c8f0 0x7feb4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:02.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.863+0000 7feb65600640 1 -- 172.21.15.22:0/1765113311 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7feb5c0acdb0 con 0x7feb500039b0 2024-04-16T16:18:02.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.863+0000 7feb6ca00640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7feb4c06c8f0 0x7feb4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:02.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.864+0000 7feb6ca00640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7feb4c06c8f0 0x7feb4c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb580070b0 tx=0x7feb5800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:02.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:02.868+0000 7feb65600640 1 -- 172.21.15.22:0/1765113311 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb5c04c020 con 0x7feb500039b0 2024-04-16T16:18:03.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.067+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb6815d420 con 0x7feb4c06c8f0 2024-04-16T16:18:03.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.075+0000 7feb65600640 1 -- 172.21.15.22:0/1765113311 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251950 (secure 0 0 0) 0x7feb6815d420 con 0x7feb4c06c8f0 2024-04-16T16:18:03.078 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:03.079 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:18:03.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7feb4c06c8f0 msgr2=0x7feb4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:03.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7feb4c06c8f0 0x7feb4c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb580070b0 tx=0x7feb5800b040 comp rx=0 tx=0).stop 2024-04-16T16:18:03.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 msgr2=0x7feb680b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:03.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb680b6720 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c004730 comp rx=0 tx=0).stop 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 shutdown_connections 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7feb4c06c8f0 0x7feb4c06edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb680b43c0 0x7feb6806ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb681f46d0 0x7feb68140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 --2- 172.21.15.22:0/1765113311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb500039b0 0x7feb680b6720 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.081+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 >> 172.21.15.22:0/1765113311 conn(0x7feb6806ba20 msgr2=0x7feb680d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.082+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 shutdown_connections 2024-04-16T16:18:03.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:03.082+0000 7feb6e800640 1 -- 172.21.15.22:0/1765113311 wait complete. 2024-04-16T16:18:03.098 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-04-16T16:18:01.730958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253684,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721036,"statfs":{"total":773094113280,"available":772834340864,"internally_reserved":0,"allocated":4333568,"data_stored":2395788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.268859"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154389+0000","last_change":"2024-04-16T16:17:56.504008+0000","last_active":"2024-04-16T16:17:58.154389+0000","last_peered":"2024-04-16T16:17:58.154389+0000","last_clean":"2024-04-16T16:17:58.154389+0000","last_became_active":"2024-04-16T16:17:56.503413+0000","last_became_peered":"2024-04-16T16:17:56.503413+0000","last_unstale":"2024-04-16T16:17:58.154389+0000","last_undegraded":"2024-04-16T16:17:58.154389+0000","last_fullsized":"2024-04-16T16:17:58.154389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493379+0000","last_change":"2024-04-16T16:17:56.516912+0000","last_active":"2024-04-16T16:17:57.493379+0000","last_peered":"2024-04-16T16:17:57.493379+0000","last_clean":"2024-04-16T16:17:57.493379+0000","last_became_active":"2024-04-16T16:17:56.516598+0000","last_became_peered":"2024-04-16T16:17:56.516598+0000","last_unstale":"2024-04-16T16:17:57.493379+0000","last_undegraded":"2024-04-16T16:17:57.493379+0000","last_fullsized":"2024-04-16T16:17:57.493379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:57:10.646516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154781+0000","last_change":"2024-04-16T16:17:56.503278+0000","last_active":"2024-04-16T16:17:58.154781+0000","last_peered":"2024-04-16T16:17:58.154781+0000","last_clean":"2024-04-16T16:17:58.154781+0000","last_became_active":"2024-04-16T16:17:56.502493+0000","last_became_peered":"2024-04-16T16:17:56.502493+0000","last_unstale":"2024-04-16T16:17:58.154781+0000","last_undegraded":"2024-04-16T16:17:58.154781+0000","last_fullsized":"2024-04-16T16:17:58.154781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:17.749181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516597+0000","last_change":"2024-04-16T16:17:56.514534+0000","last_active":"2024-04-16T16:17:57.516597+0000","last_peered":"2024-04-16T16:17:57.516597+0000","last_clean":"2024-04-16T16:17:57.516597+0000","last_became_active":"2024-04-16T16:17:56.514227+0000","last_became_peered":"2024-04-16T16:17:56.514227+0000","last_unstale":"2024-04-16T16:17:57.516597+0000","last_undegraded":"2024-04-16T16:17:57.516597+0000","last_fullsized":"2024-04-16T16:17:57.516597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:09:27.455247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153094+0000","last_change":"2024-04-16T16:17:56.522948+0000","last_active":"2024-04-16T16:17:58.153094+0000","last_peered":"2024-04-16T16:17:58.153094+0000","last_clean":"2024-04-16T16:17:58.153094+0000","last_became_active":"2024-04-16T16:17:56.522558+0000","last_became_peered":"2024-04-16T16:17:56.522558+0000","last_unstale":"2024-04-16T16:17:58.153094+0000","last_undegraded":"2024-04-16T16:17:58.153094+0000","last_fullsized":"2024-04-16T16:17:58.153094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:20.121131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492696+0000","last_change":"2024-04-16T16:17:56.517173+0000","last_active":"2024-04-16T16:17:57.492696+0000","last_peered":"2024-04-16T16:17:57.492696+0000","last_clean":"2024-04-16T16:17:57.492696+0000","last_became_active":"2024-04-16T16:17:56.516749+0000","last_became_peered":"2024-04-16T16:17:56.516749+0000","last_unstale":"2024-04-16T16:17:57.492696+0000","last_undegraded":"2024-04-16T16:17:57.492696+0000","last_fullsized":"2024-04-16T16:17:57.492696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497706+0000","last_change":"2024-04-16T16:17:56.505321+0000","last_active":"2024-04-16T16:17:57.497706+0000","last_peered":"2024-04-16T16:17:57.497706+0000","last_clean":"2024-04-16T16:17:57.497706+0000","last_became_active":"2024-04-16T16:17:56.503979+0000","last_became_peered":"2024-04-16T16:17:56.503979+0000","last_unstale":"2024-04-16T16:17:57.497706+0000","last_undegraded":"2024-04-16T16:17:57.497706+0000","last_fullsized":"2024-04-16T16:17:57.497706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.496995+0000","last_change":"2024-04-16T16:17:56.501157+0000","last_active":"2024-04-16T16:17:57.496995+0000","last_peered":"2024-04-16T16:17:57.496995+0000","last_clean":"2024-04-16T16:17:57.496995+0000","last_became_active":"2024-04-16T16:17:56.500191+0000","last_became_peered":"2024-04-16T16:17:56.500191+0000","last_unstale":"2024-04-16T16:17:57.496995+0000","last_undegraded":"2024-04-16T16:17:57.496995+0000","last_fullsized":"2024-04-16T16:17:57.496995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499169+0000","last_change":"2024-04-16T16:17:56.502074+0000","last_active":"2024-04-16T16:17:57.499169+0000","last_peered":"2024-04-16T16:17:57.499169+0000","last_clean":"2024-04-16T16:17:57.499169+0000","last_became_active":"2024-04-16T16:17:56.501708+0000","last_became_peered":"2024-04-16T16:17:56.501708+0000","last_unstale":"2024-04-16T16:17:57.499169+0000","last_undegraded":"2024-04-16T16:17:57.499169+0000","last_fullsized":"2024-04-16T16:17:57.499169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:54.597447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516908+0000","last_change":"2024-04-16T16:17:56.519775+0000","last_active":"2024-04-16T16:17:57.516908+0000","last_peered":"2024-04-16T16:17:57.516908+0000","last_clean":"2024-04-16T16:17:57.516908+0000","last_became_active":"2024-04-16T16:17:56.517890+0000","last_became_peered":"2024-04-16T16:17:56.517890+0000","last_unstale":"2024-04-16T16:17:57.516908+0000","last_undegraded":"2024-04-16T16:17:57.516908+0000","last_fullsized":"2024-04-16T16:17:57.516908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499963+0000","last_change":"2024-04-16T16:17:56.515007+0000","last_active":"2024-04-16T16:17:57.499963+0000","last_peered":"2024-04-16T16:17:57.499963+0000","last_clean":"2024-04-16T16:17:57.499963+0000","last_became_active":"2024-04-16T16:17:56.514728+0000","last_became_peered":"2024-04-16T16:17:56.514728+0000","last_unstale":"2024-04-16T16:17:57.499963+0000","last_undegraded":"2024-04-16T16:17:57.499963+0000","last_fullsized":"2024-04-16T16:17:57.499963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:17.749181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153642+0000","last_change":"2024-04-16T16:17:56.522417+0000","last_active":"2024-04-16T16:17:58.153642+0000","last_peered":"2024-04-16T16:17:58.153642+0000","last_clean":"2024-04-16T16:17:58.153642+0000","last_became_active":"2024-04-16T16:17:56.522070+0000","last_became_peered":"2024-04-16T16:17:56.522070+0000","last_unstale":"2024-04-16T16:17:58.153642+0000","last_undegraded":"2024-04-16T16:17:58.153642+0000","last_fullsized":"2024-04-16T16:17:58.153642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153471+0000","last_change":"2024-04-16T16:17:56.503495+0000","last_active":"2024-04-16T16:17:58.153471+0000","last_peered":"2024-04-16T16:17:58.153471+0000","last_clean":"2024-04-16T16:17:58.153471+0000","last_became_active":"2024-04-16T16:17:56.503214+0000","last_became_peered":"2024-04-16T16:17:56.503214+0000","last_unstale":"2024-04-16T16:17:58.153471+0000","last_undegraded":"2024-04-16T16:17:58.153471+0000","last_fullsized":"2024-04-16T16:17:58.153471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:18.637778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493068+0000","last_change":"2024-04-16T16:17:56.500333+0000","last_active":"2024-04-16T16:17:57.493068+0000","last_peered":"2024-04-16T16:17:57.493068+0000","last_clean":"2024-04-16T16:17:57.493068+0000","last_became_active":"2024-04-16T16:17:56.500055+0000","last_became_peered":"2024-04-16T16:17:56.500055+0000","last_unstale":"2024-04-16T16:17:57.493068+0000","last_undegraded":"2024-04-16T16:17:57.493068+0000","last_fullsized":"2024-04-16T16:17:57.493068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:59.242254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153215+0000","last_change":"2024-04-16T16:17:56.501375+0000","last_active":"2024-04-16T16:17:58.153215+0000","last_peered":"2024-04-16T16:17:58.153215+0000","last_clean":"2024-04-16T16:17:58.153215+0000","last_became_active":"2024-04-16T16:17:56.501060+0000","last_became_peered":"2024-04-16T16:17:56.501060+0000","last_unstale":"2024-04-16T16:17:58.153215+0000","last_undegraded":"2024-04-16T16:17:58.153215+0000","last_fullsized":"2024-04-16T16:17:58.153215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498929+0000","last_change":"2024-04-16T16:17:56.527011+0000","last_active":"2024-04-16T16:17:57.498929+0000","last_peered":"2024-04-16T16:17:57.498929+0000","last_clean":"2024-04-16T16:17:57.498929+0000","last_became_active":"2024-04-16T16:17:56.526634+0000","last_became_peered":"2024-04-16T16:17:56.526634+0000","last_unstale":"2024-04-16T16:17:57.498929+0000","last_undegraded":"2024-04-16T16:17:57.498929+0000","last_fullsized":"2024-04-16T16:17:57.498929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:17.809471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.500363+0000","last_change":"2024-04-16T16:17:56.503656+0000","last_active":"2024-04-16T16:17:57.500363+0000","last_peered":"2024-04-16T16:17:57.500363+0000","last_clean":"2024-04-16T16:17:57.500363+0000","last_became_active":"2024-04-16T16:17:56.501346+0000","last_became_peered":"2024-04-16T16:17:56.501346+0000","last_unstale":"2024-04-16T16:17:57.500363+0000","last_undegraded":"2024-04-16T16:17:57.500363+0000","last_fullsized":"2024-04-16T16:17:57.500363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493608+0000","last_change":"2024-04-16T16:17:56.498898+0000","last_active":"2024-04-16T16:17:57.493608+0000","last_peered":"2024-04-16T16:17:57.493608+0000","last_clean":"2024-04-16T16:17:57.493608+0000","last_became_active":"2024-04-16T16:17:56.498114+0000","last_became_peered":"2024-04-16T16:17:56.498114+0000","last_unstale":"2024-04-16T16:17:57.493608+0000","last_undegraded":"2024-04-16T16:17:57.493608+0000","last_fullsized":"2024-04-16T16:17:57.493608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:37.663896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493073+0000","last_change":"2024-04-16T16:17:56.513521+0000","last_active":"2024-04-16T16:17:57.493073+0000","last_peered":"2024-04-16T16:17:57.493073+0000","last_clean":"2024-04-16T16:17:57.493073+0000","last_became_active":"2024-04-16T16:17:56.513263+0000","last_became_peered":"2024-04-16T16:17:56.513263+0000","last_unstale":"2024-04-16T16:17:57.493073+0000","last_undegraded":"2024-04-16T16:17:57.493073+0000","last_fullsized":"2024-04-16T16:17:57.493073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:42.373864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153246+0000","last_change":"2024-04-16T16:17:56.499823+0000","last_active":"2024-04-16T16:17:58.153246+0000","last_peered":"2024-04-16T16:17:58.153246+0000","last_clean":"2024-04-16T16:17:58.153246+0000","last_became_active":"2024-04-16T16:17:56.499472+0000","last_became_peered":"2024-04-16T16:17:56.499472+0000","last_unstale":"2024-04-16T16:17:58.153246+0000","last_undegraded":"2024-04-16T16:17:58.153246+0000","last_fullsized":"2024-04-16T16:17:58.153246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:54.107187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498248+0000","last_change":"2024-04-16T16:17:56.505602+0000","last_active":"2024-04-16T16:17:57.498248+0000","last_peered":"2024-04-16T16:17:57.498248+0000","last_clean":"2024-04-16T16:17:57.498248+0000","last_became_active":"2024-04-16T16:17:56.505281+0000","last_became_peered":"2024-04-16T16:17:56.505281+0000","last_unstale":"2024-04-16T16:17:57.498248+0000","last_undegraded":"2024-04-16T16:17:57.498248+0000","last_fullsized":"2024-04-16T16:17:57.498248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:18.641103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498061+0000","last_change":"2024-04-16T16:17:56.517999+0000","last_active":"2024-04-16T16:17:57.498061+0000","last_peered":"2024-04-16T16:17:57.498061+0000","last_clean":"2024-04-16T16:17:57.498061+0000","last_became_active":"2024-04-16T16:17:56.517710+0000","last_became_peered":"2024-04-16T16:17:56.517710+0000","last_unstale":"2024-04-16T16:17:57.498061+0000","last_undegraded":"2024-04-16T16:17:57.498061+0000","last_fullsized":"2024-04-16T16:17:57.498061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.509863+0000","last_change":"2024-04-16T16:17:56.507304+0000","last_active":"2024-04-16T16:17:57.509863+0000","last_peered":"2024-04-16T16:17:57.509863+0000","last_clean":"2024-04-16T16:17:57.509863+0000","last_became_active":"2024-04-16T16:17:56.506972+0000","last_became_peered":"2024-04-16T16:17:56.506972+0000","last_unstale":"2024-04-16T16:17:57.509863+0000","last_undegraded":"2024-04-16T16:17:57.509863+0000","last_fullsized":"2024-04-16T16:17:57.509863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:49.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152901+0000","last_change":"2024-04-16T16:17:56.497834+0000","last_active":"2024-04-16T16:17:58.152901+0000","last_peered":"2024-04-16T16:17:58.152901+0000","last_clean":"2024-04-16T16:17:58.152901+0000","last_became_active":"2024-04-16T16:17:56.497528+0000","last_became_peered":"2024-04-16T16:17:56.497528+0000","last_unstale":"2024-04-16T16:17:58.152901+0000","last_undegraded":"2024-04-16T16:17:58.152901+0000","last_fullsized":"2024-04-16T16:17:58.152901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517138+0000","last_change":"2024-04-16T16:17:56.508439+0000","last_active":"2024-04-16T16:17:57.517138+0000","last_peered":"2024-04-16T16:17:57.517138+0000","last_clean":"2024-04-16T16:17:57.517138+0000","last_became_active":"2024-04-16T16:17:56.508030+0000","last_became_peered":"2024-04-16T16:17:56.508030+0000","last_unstale":"2024-04-16T16:17:57.517138+0000","last_undegraded":"2024-04-16T16:17:57.517138+0000","last_fullsized":"2024-04-16T16:17:57.517138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493754+0000","last_change":"2024-04-16T16:17:56.502130+0000","last_active":"2024-04-16T16:17:57.493754+0000","last_peered":"2024-04-16T16:17:57.493754+0000","last_clean":"2024-04-16T16:17:57.493754+0000","last_became_active":"2024-04-16T16:17:56.501314+0000","last_became_peered":"2024-04-16T16:17:56.501314+0000","last_unstale":"2024-04-16T16:17:57.493754+0000","last_undegraded":"2024-04-16T16:17:57.493754+0000","last_fullsized":"2024-04-16T16:17:57.493754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:08.109447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517671+0000","last_change":"2024-04-16T16:17:56.513141+0000","last_active":"2024-04-16T16:17:57.517671+0000","last_peered":"2024-04-16T16:17:57.517671+0000","last_clean":"2024-04-16T16:17:57.517671+0000","last_became_active":"2024-04-16T16:17:56.511366+0000","last_became_peered":"2024-04-16T16:17:56.511366+0000","last_unstale":"2024-04-16T16:17:57.517671+0000","last_undegraded":"2024-04-16T16:17:57.517671+0000","last_fullsized":"2024-04-16T16:17:57.517671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154236+0000","last_change":"2024-04-16T16:17:56.497253+0000","last_active":"2024-04-16T16:17:58.154236+0000","last_peered":"2024-04-16T16:17:58.154236+0000","last_clean":"2024-04-16T16:17:58.154236+0000","last_became_active":"2024-04-16T16:17:56.496953+0000","last_became_peered":"2024-04-16T16:17:56.496953+0000","last_unstale":"2024-04-16T16:17:58.154236+0000","last_undegraded":"2024-04-16T16:17:58.154236+0000","last_fullsized":"2024-04-16T16:17:58.154236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:17.809471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498678+0000","last_change":"2024-04-16T16:17:56.522234+0000","last_active":"2024-04-16T16:17:57.498678+0000","last_peered":"2024-04-16T16:17:57.498678+0000","last_clean":"2024-04-16T16:17:57.498678+0000","last_became_active":"2024-04-16T16:17:56.521812+0000","last_became_peered":"2024-04-16T16:17:56.521812+0000","last_unstale":"2024-04-16T16:17:57.498678+0000","last_undegraded":"2024-04-16T16:17:57.498678+0000","last_fullsized":"2024-04-16T16:17:57.498678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:09:27.455247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499712+0000","last_change":"2024-04-16T16:17:56.501528+0000","last_active":"2024-04-16T16:17:57.499712+0000","last_peered":"2024-04-16T16:17:57.499712+0000","last_clean":"2024-04-16T16:17:57.499712+0000","last_became_active":"2024-04-16T16:17:56.500783+0000","last_became_peered":"2024-04-16T16:17:56.500783+0000","last_unstale":"2024-04-16T16:17:57.499712+0000","last_undegraded":"2024-04-16T16:17:57.499712+0000","last_fullsized":"2024-04-16T16:17:57.499712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:45:36.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153566+0000","last_change":"2024-04-16T16:17:56.498532+0000","last_active":"2024-04-16T16:17:58.153566+0000","last_peered":"2024-04-16T16:17:58.153566+0000","last_clean":"2024-04-16T16:17:58.153566+0000","last_became_active":"2024-04-16T16:17:56.498200+0000","last_became_peered":"2024-04-16T16:17:56.498200+0000","last_unstale":"2024-04-16T16:17:58.153566+0000","last_undegraded":"2024-04-16T16:17:58.153566+0000","last_fullsized":"2024-04-16T16:17:58.153566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:09:17.398636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.496980+0000","last_change":"2024-04-16T16:17:56.512883+0000","last_active":"2024-04-16T16:17:57.496980+0000","last_peered":"2024-04-16T16:17:57.496980+0000","last_clean":"2024-04-16T16:17:57.496980+0000","last_became_active":"2024-04-16T16:17:56.511662+0000","last_became_peered":"2024-04-16T16:17:56.511662+0000","last_unstale":"2024-04-16T16:17:57.496980+0000","last_undegraded":"2024-04-16T16:17:57.496980+0000","last_fullsized":"2024-04-16T16:17:57.496980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510620+0000","last_change":"2024-04-16T16:17:56.505463+0000","last_active":"2024-04-16T16:17:57.510620+0000","last_peered":"2024-04-16T16:17:57.510620+0000","last_clean":"2024-04-16T16:17:57.510620+0000","last_became_active":"2024-04-16T16:17:56.502336+0000","last_became_peered":"2024-04-16T16:17:56.502336+0000","last_unstale":"2024-04-16T16:17:57.510620+0000","last_undegraded":"2024-04-16T16:17:57.510620+0000","last_fullsized":"2024-04-16T16:17:57.510620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154547+0000","last_change":"2024-04-16T16:17:55.501902+0000","last_active":"2024-04-16T16:17:58.154547+0000","last_peered":"2024-04-16T16:17:58.154547+0000","last_clean":"2024-04-16T16:17:58.154547+0000","last_became_active":"2024-04-16T16:17:55.501467+0000","last_became_peered":"2024-04-16T16:17:55.501467+0000","last_unstale":"2024-04-16T16:17:58.154547+0000","last_undegraded":"2024-04-16T16:17:58.154547+0000","last_fullsized":"2024-04-16T16:17:58.154547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.156005+0000","last_change":"2024-04-16T16:17:56.511938+0000","last_active":"2024-04-16T16:17:58.156005+0000","last_peered":"2024-04-16T16:17:58.156005+0000","last_clean":"2024-04-16T16:17:58.156005+0000","last_became_active":"2024-04-16T16:17:56.510346+0000","last_became_peered":"2024-04-16T16:17:56.510346+0000","last_unstale":"2024-04-16T16:17:58.156005+0000","last_undegraded":"2024-04-16T16:17:58.156005+0000","last_fullsized":"2024-04-16T16:17:58.156005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510541+0000","last_change":"2024-04-16T16:17:55.498496+0000","last_active":"2024-04-16T16:17:57.510541+0000","last_peered":"2024-04-16T16:17:57.510541+0000","last_clean":"2024-04-16T16:17:57.510541+0000","last_became_active":"2024-04-16T16:17:55.498148+0000","last_became_peered":"2024-04-16T16:17:55.498148+0000","last_unstale":"2024-04-16T16:17:57.510541+0000","last_undegraded":"2024-04-16T16:17:57.510541+0000","last_fullsized":"2024-04-16T16:17:57.510541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499570+0000","last_change":"2024-04-16T16:17:56.522166+0000","last_active":"2024-04-16T16:17:57.499570+0000","last_peered":"2024-04-16T16:17:57.499570+0000","last_clean":"2024-04-16T16:17:57.499570+0000","last_became_active":"2024-04-16T16:17:56.521847+0000","last_became_peered":"2024-04-16T16:17:56.521847+0000","last_unstale":"2024-04-16T16:17:57.499570+0000","last_undegraded":"2024-04-16T16:17:57.499570+0000","last_fullsized":"2024-04-16T16:17:57.499570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492966+0000","last_change":"2024-04-16T16:17:55.489599+0000","last_active":"2024-04-16T16:17:57.492966+0000","last_peered":"2024-04-16T16:17:57.492966+0000","last_clean":"2024-04-16T16:17:57.492966+0000","last_became_active":"2024-04-16T16:17:55.489035+0000","last_became_peered":"2024-04-16T16:17:55.489035+0000","last_unstale":"2024-04-16T16:17:57.492966+0000","last_undegraded":"2024-04-16T16:17:57.492966+0000","last_fullsized":"2024-04-16T16:17:57.492966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:48.713597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517860+0000","last_change":"2024-04-16T16:17:56.511325+0000","last_active":"2024-04-16T16:17:57.517860+0000","last_peered":"2024-04-16T16:17:57.517860+0000","last_clean":"2024-04-16T16:17:57.517860+0000","last_became_active":"2024-04-16T16:17:56.511026+0000","last_became_peered":"2024-04-16T16:17:56.511026+0000","last_unstale":"2024-04-16T16:17:57.517860+0000","last_undegraded":"2024-04-16T16:17:57.517860+0000","last_fullsized":"2024-04-16T16:17:57.517860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153239+0000","last_change":"2024-04-16T16:17:55.492715+0000","last_active":"2024-04-16T16:17:58.153239+0000","last_peered":"2024-04-16T16:17:58.153239+0000","last_clean":"2024-04-16T16:17:58.153239+0000","last_became_active":"2024-04-16T16:17:55.492461+0000","last_became_peered":"2024-04-16T16:17:55.492461+0000","last_unstale":"2024-04-16T16:17:58.153239+0000","last_undegraded":"2024-04-16T16:17:58.153239+0000","last_fullsized":"2024-04-16T16:17:58.153239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:41:55.032946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.500056+0000","last_change":"2024-04-16T16:17:56.509933+0000","last_active":"2024-04-16T16:17:57.500056+0000","last_peered":"2024-04-16T16:17:57.500056+0000","last_clean":"2024-04-16T16:17:57.500056+0000","last_became_active":"2024-04-16T16:17:56.509670+0000","last_became_peered":"2024-04-16T16:17:56.509670+0000","last_unstale":"2024-04-16T16:17:57.500056+0000","last_undegraded":"2024-04-16T16:17:57.500056+0000","last_fullsized":"2024-04-16T16:17:57.500056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498548+0000","last_change":"2024-04-16T16:17:55.498614+0000","last_active":"2024-04-16T16:17:57.498548+0000","last_peered":"2024-04-16T16:17:57.498548+0000","last_clean":"2024-04-16T16:17:57.498548+0000","last_became_active":"2024-04-16T16:17:55.498220+0000","last_became_peered":"2024-04-16T16:17:55.498220+0000","last_unstale":"2024-04-16T16:17:57.498548+0000","last_undegraded":"2024-04-16T16:17:57.498548+0000","last_fullsized":"2024-04-16T16:17:57.498548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:25:12.960648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154095+0000","last_change":"2024-04-16T16:17:56.492281+0000","last_active":"2024-04-16T16:17:58.154095+0000","last_peered":"2024-04-16T16:17:58.154095+0000","last_clean":"2024-04-16T16:17:58.154095+0000","last_became_active":"2024-04-16T16:17:56.491918+0000","last_became_peered":"2024-04-16T16:17:56.491918+0000","last_unstale":"2024-04-16T16:17:58.154095+0000","last_undegraded":"2024-04-16T16:17:58.154095+0000","last_fullsized":"2024-04-16T16:17:58.154095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:56.520798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497848+0000","last_change":"2024-04-16T16:17:55.498772+0000","last_active":"2024-04-16T16:17:57.497848+0000","last_peered":"2024-04-16T16:17:57.497848+0000","last_clean":"2024-04-16T16:17:57.497848+0000","last_became_active":"2024-04-16T16:17:55.498140+0000","last_became_peered":"2024-04-16T16:17:55.498140+0000","last_unstale":"2024-04-16T16:17:57.497848+0000","last_undegraded":"2024-04-16T16:17:57.497848+0000","last_fullsized":"2024-04-16T16:17:57.497848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:48:49.711527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497716+0000","last_change":"2024-04-16T16:17:56.495123+0000","last_active":"2024-04-16T16:17:57.497716+0000","last_peered":"2024-04-16T16:17:57.497716+0000","last_clean":"2024-04-16T16:17:57.497716+0000","last_became_active":"2024-04-16T16:17:56.494372+0000","last_became_peered":"2024-04-16T16:17:56.494372+0000","last_unstale":"2024-04-16T16:17:57.497716+0000","last_undegraded":"2024-04-16T16:17:57.497716+0000","last_fullsized":"2024-04-16T16:17:57.497716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492600+0000","last_change":"2024-04-16T16:17:55.496597+0000","last_active":"2024-04-16T16:17:57.492600+0000","last_peered":"2024-04-16T16:17:57.492600+0000","last_clean":"2024-04-16T16:17:57.492600+0000","last_became_active":"2024-04-16T16:17:55.496282+0000","last_became_peered":"2024-04-16T16:17:55.496282+0000","last_unstale":"2024-04-16T16:17:57.492600+0000","last_undegraded":"2024-04-16T16:17:57.492600+0000","last_fullsized":"2024-04-16T16:17:57.492600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:13.627825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516632+0000","last_change":"2024-04-16T16:17:56.503671+0000","last_active":"2024-04-16T16:17:57.516632+0000","last_peered":"2024-04-16T16:17:57.516632+0000","last_clean":"2024-04-16T16:17:57.516632+0000","last_became_active":"2024-04-16T16:17:56.503360+0000","last_became_peered":"2024-04-16T16:17:56.503360+0000","last_unstale":"2024-04-16T16:17:57.516632+0000","last_undegraded":"2024-04-16T16:17:57.516632+0000","last_fullsized":"2024-04-16T16:17:57.516632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:54.597447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497870+0000","last_change":"2024-04-16T16:17:55.496087+0000","last_active":"2024-04-16T16:17:57.497870+0000","last_peered":"2024-04-16T16:17:57.497870+0000","last_clean":"2024-04-16T16:17:57.497870+0000","last_became_active":"2024-04-16T16:17:55.495702+0000","last_became_peered":"2024-04-16T16:17:55.495702+0000","last_unstale":"2024-04-16T16:17:57.497870+0000","last_undegraded":"2024-04-16T16:17:57.497870+0000","last_fullsized":"2024-04-16T16:17:57.497870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:15.658237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155981+0000","last_change":"2024-04-16T16:17:56.518597+0000","last_active":"2024-04-16T16:17:58.155981+0000","last_peered":"2024-04-16T16:17:58.155981+0000","last_clean":"2024-04-16T16:17:58.155981+0000","last_became_active":"2024-04-16T16:17:56.518173+0000","last_became_peered":"2024-04-16T16:17:56.518173+0000","last_unstale":"2024-04-16T16:17:58.155981+0000","last_undegraded":"2024-04-16T16:17:58.155981+0000","last_fullsized":"2024-04-16T16:17:58.155981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493261+0000","last_change":"2024-04-16T16:17:55.502598+0000","last_active":"2024-04-16T16:17:57.493261+0000","last_peered":"2024-04-16T16:17:57.493261+0000","last_clean":"2024-04-16T16:17:57.493261+0000","last_became_active":"2024-04-16T16:17:55.500438+0000","last_became_peered":"2024-04-16T16:17:55.500438+0000","last_unstale":"2024-04-16T16:17:57.493261+0000","last_undegraded":"2024-04-16T16:17:57.493261+0000","last_fullsized":"2024-04-16T16:17:57.493261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:17.627068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493372+0000","last_change":"2024-04-16T16:17:56.518072+0000","last_active":"2024-04-16T16:17:57.493372+0000","last_peered":"2024-04-16T16:17:57.493372+0000","last_clean":"2024-04-16T16:17:57.493372+0000","last_became_active":"2024-04-16T16:17:56.517785+0000","last_became_peered":"2024-04-16T16:17:56.517785+0000","last_unstale":"2024-04-16T16:17:57.493372+0000","last_undegraded":"2024-04-16T16:17:57.493372+0000","last_fullsized":"2024-04-16T16:17:57.493372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:09.446148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510710+0000","last_change":"2024-04-16T16:17:55.491916+0000","last_active":"2024-04-16T16:17:57.510710+0000","last_peered":"2024-04-16T16:17:57.510710+0000","last_clean":"2024-04-16T16:17:57.510710+0000","last_became_active":"2024-04-16T16:17:55.491653+0000","last_became_peered":"2024-04-16T16:17:55.491653+0000","last_unstale":"2024-04-16T16:17:57.510710+0000","last_undegraded":"2024-04-16T16:17:57.510710+0000","last_fullsized":"2024-04-16T16:17:57.510710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:19.107096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493266+0000","last_change":"2024-04-16T16:17:56.501329+0000","last_active":"2024-04-16T16:17:57.493266+0000","last_peered":"2024-04-16T16:17:57.493266+0000","last_clean":"2024-04-16T16:17:57.493266+0000","last_became_active":"2024-04-16T16:17:56.501066+0000","last_became_peered":"2024-04-16T16:17:56.501066+0000","last_unstale":"2024-04-16T16:17:57.493266+0000","last_undegraded":"2024-04-16T16:17:57.493266+0000","last_fullsized":"2024-04-16T16:17:57.493266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:27:36.595251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154604+0000","last_change":"2024-04-16T16:17:55.493838+0000","last_active":"2024-04-16T16:17:58.154604+0000","last_peered":"2024-04-16T16:17:58.154604+0000","last_clean":"2024-04-16T16:17:58.154604+0000","last_became_active":"2024-04-16T16:17:55.493444+0000","last_became_peered":"2024-04-16T16:17:55.493444+0000","last_unstale":"2024-04-16T16:17:58.154604+0000","last_undegraded":"2024-04-16T16:17:58.154604+0000","last_fullsized":"2024-04-16T16:17:58.154604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:44:04.842040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154437+0000","last_change":"2024-04-16T16:17:56.504256+0000","last_active":"2024-04-16T16:17:58.154437+0000","last_peered":"2024-04-16T16:17:58.154437+0000","last_clean":"2024-04-16T16:17:58.154437+0000","last_became_active":"2024-04-16T16:17:56.503835+0000","last_became_peered":"2024-04-16T16:17:56.503835+0000","last_unstale":"2024-04-16T16:17:58.154437+0000","last_undegraded":"2024-04-16T16:17:58.154437+0000","last_fullsized":"2024-04-16T16:17:58.154437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:45:36.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493228+0000","last_change":"2024-04-16T16:17:55.489575+0000","last_active":"2024-04-16T16:17:57.493228+0000","last_peered":"2024-04-16T16:17:57.493228+0000","last_clean":"2024-04-16T16:17:57.493228+0000","last_became_active":"2024-04-16T16:17:55.489273+0000","last_became_peered":"2024-04-16T16:17:55.489273+0000","last_unstale":"2024-04-16T16:17:57.493228+0000","last_undegraded":"2024-04-16T16:17:57.493228+0000","last_fullsized":"2024-04-16T16:17:57.493228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:01.905935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516327+0000","last_change":"2024-04-16T16:17:56.504261+0000","last_active":"2024-04-16T16:17:57.516327+0000","last_peered":"2024-04-16T16:17:57.516327+0000","last_clean":"2024-04-16T16:17:57.516327+0000","last_became_active":"2024-04-16T16:17:56.503915+0000","last_became_peered":"2024-04-16T16:17:56.503915+0000","last_unstale":"2024-04-16T16:17:57.516327+0000","last_undegraded":"2024-04-16T16:17:57.516327+0000","last_fullsized":"2024-04-16T16:17:57.516327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:18.641103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498833+0000","last_change":"2024-04-16T16:17:55.495996+0000","last_active":"2024-04-16T16:17:57.498833+0000","last_peered":"2024-04-16T16:17:57.498833+0000","last_clean":"2024-04-16T16:17:57.498833+0000","last_became_active":"2024-04-16T16:17:55.495677+0000","last_became_peered":"2024-04-16T16:17:55.495677+0000","last_unstale":"2024-04-16T16:17:57.498833+0000","last_undegraded":"2024-04-16T16:17:57.498833+0000","last_fullsized":"2024-04-16T16:17:57.498833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:00:54.269393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493321+0000","last_change":"2024-04-16T16:17:56.518138+0000","last_active":"2024-04-16T16:17:57.493321+0000","last_peered":"2024-04-16T16:17:57.493321+0000","last_clean":"2024-04-16T16:17:57.493321+0000","last_became_active":"2024-04-16T16:17:56.517555+0000","last_became_peered":"2024-04-16T16:17:56.517555+0000","last_unstale":"2024-04-16T16:17:57.493321+0000","last_undegraded":"2024-04-16T16:17:57.493321+0000","last_fullsized":"2024-04-16T16:17:57.493321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:12.986654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516457+0000","last_change":"2024-04-16T16:17:55.498257+0000","last_active":"2024-04-16T16:17:57.516457+0000","last_peered":"2024-04-16T16:17:57.516457+0000","last_clean":"2024-04-16T16:17:57.516457+0000","last_became_active":"2024-04-16T16:17:55.497361+0000","last_became_peered":"2024-04-16T16:17:55.497361+0000","last_unstale":"2024-04-16T16:17:57.516457+0000","last_undegraded":"2024-04-16T16:17:57.516457+0000","last_fullsized":"2024-04-16T16:17:57.516457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498671+0000","last_change":"2024-04-16T16:17:56.518550+0000","last_active":"2024-04-16T16:17:57.498671+0000","last_peered":"2024-04-16T16:17:57.498671+0000","last_clean":"2024-04-16T16:17:57.498671+0000","last_became_active":"2024-04-16T16:17:56.512051+0000","last_became_peered":"2024-04-16T16:17:56.512051+0000","last_unstale":"2024-04-16T16:17:57.498671+0000","last_undegraded":"2024-04-16T16:17:57.498671+0000","last_fullsized":"2024-04-16T16:17:57.498671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:56.520798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492739+0000","last_change":"2024-04-16T16:17:55.501273+0000","last_active":"2024-04-16T16:17:57.492739+0000","last_peered":"2024-04-16T16:17:57.492739+0000","last_clean":"2024-04-16T16:17:57.492739+0000","last_became_active":"2024-04-16T16:17:55.499868+0000","last_became_peered":"2024-04-16T16:17:55.499868+0000","last_unstale":"2024-04-16T16:17:57.492739+0000","last_undegraded":"2024-04-16T16:17:57.492739+0000","last_fullsized":"2024-04-16T16:17:57.492739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:26.690513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153776+0000","last_change":"2024-04-16T16:17:56.509695+0000","last_active":"2024-04-16T16:17:58.153776+0000","last_peered":"2024-04-16T16:17:58.153776+0000","last_clean":"2024-04-16T16:17:58.153776+0000","last_became_active":"2024-04-16T16:17:56.509395+0000","last_became_peered":"2024-04-16T16:17:56.509395+0000","last_unstale":"2024-04-16T16:17:58.153776+0000","last_undegraded":"2024-04-16T16:17:58.153776+0000","last_fullsized":"2024-04-16T16:17:58.153776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:49.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492566+0000","last_change":"2024-04-16T16:17:55.494052+0000","last_active":"2024-04-16T16:17:57.492566+0000","last_peered":"2024-04-16T16:17:57.492566+0000","last_clean":"2024-04-16T16:17:57.492566+0000","last_became_active":"2024-04-16T16:17:55.491048+0000","last_became_peered":"2024-04-16T16:17:55.491048+0000","last_unstale":"2024-04-16T16:17:57.492566+0000","last_undegraded":"2024-04-16T16:17:57.492566+0000","last_fullsized":"2024-04-16T16:17:57.492566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:48.210032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499235+0000","last_change":"2024-04-16T16:17:56.492416+0000","last_active":"2024-04-16T16:17:57.499235+0000","last_peered":"2024-04-16T16:17:57.499235+0000","last_clean":"2024-04-16T16:17:57.499235+0000","last_became_active":"2024-04-16T16:17:56.491236+0000","last_became_peered":"2024-04-16T16:17:56.491236+0000","last_unstale":"2024-04-16T16:17:57.499235+0000","last_undegraded":"2024-04-16T16:17:57.499235+0000","last_fullsized":"2024-04-16T16:17:57.499235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:08:13.188909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517110+0000","last_change":"2024-04-16T16:17:55.497413+0000","last_active":"2024-04-16T16:17:57.517110+0000","last_peered":"2024-04-16T16:17:57.517110+0000","last_clean":"2024-04-16T16:17:57.517110+0000","last_became_active":"2024-04-16T16:17:55.497021+0000","last_became_peered":"2024-04-16T16:17:55.497021+0000","last_unstale":"2024-04-16T16:17:57.517110+0000","last_undegraded":"2024-04-16T16:17:57.517110+0000","last_fullsized":"2024-04-16T16:17:57.517110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:19.107096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155509+0000","last_change":"2024-04-16T16:17:56.492333+0000","last_active":"2024-04-16T16:17:58.155509+0000","last_peered":"2024-04-16T16:17:58.155509+0000","last_clean":"2024-04-16T16:17:58.155509+0000","last_became_active":"2024-04-16T16:17:56.492011+0000","last_became_peered":"2024-04-16T16:17:56.492011+0000","last_unstale":"2024-04-16T16:17:58.155509+0000","last_undegraded":"2024-04-16T16:17:58.155509+0000","last_fullsized":"2024-04-16T16:17:58.155509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:40.711440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499185+0000","last_change":"2024-04-16T16:17:55.497889+0000","last_active":"2024-04-16T16:17:57.499185+0000","last_peered":"2024-04-16T16:17:57.499185+0000","last_clean":"2024-04-16T16:17:57.499185+0000","last_became_active":"2024-04-16T16:17:55.495651+0000","last_became_peered":"2024-04-16T16:17:55.495651+0000","last_unstale":"2024-04-16T16:17:57.499185+0000","last_undegraded":"2024-04-16T16:17:57.499185+0000","last_fullsized":"2024-04-16T16:17:57.499185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516779+0000","last_change":"2024-04-16T16:17:56.513563+0000","last_active":"2024-04-16T16:17:57.516779+0000","last_peered":"2024-04-16T16:17:57.516779+0000","last_clean":"2024-04-16T16:17:57.516779+0000","last_became_active":"2024-04-16T16:17:56.511843+0000","last_became_peered":"2024-04-16T16:17:56.511843+0000","last_unstale":"2024-04-16T16:17:57.516779+0000","last_undegraded":"2024-04-16T16:17:57.516779+0000","last_fullsized":"2024-04-16T16:17:57.516779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:08:13.188909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498615+0000","last_change":"2024-04-16T16:17:55.490431+0000","last_active":"2024-04-16T16:17:57.498615+0000","last_peered":"2024-04-16T16:17:57.498615+0000","last_clean":"2024-04-16T16:17:57.498615+0000","last_became_active":"2024-04-16T16:17:55.487984+0000","last_became_peered":"2024-04-16T16:17:55.487984+0000","last_unstale":"2024-04-16T16:17:57.498615+0000","last_undegraded":"2024-04-16T16:17:57.498615+0000","last_fullsized":"2024-04-16T16:17:57.498615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153349+0000","last_change":"2024-04-16T16:17:56.505087+0000","last_active":"2024-04-16T16:17:58.153349+0000","last_peered":"2024-04-16T16:17:58.153349+0000","last_clean":"2024-04-16T16:17:58.153349+0000","last_became_active":"2024-04-16T16:17:56.504290+0000","last_became_peered":"2024-04-16T16:17:56.504290+0000","last_unstale":"2024-04-16T16:17:58.153349+0000","last_undegraded":"2024-04-16T16:17:58.153349+0000","last_fullsized":"2024-04-16T16:17:58.153349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:04.283344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499351+0000","last_change":"2024-04-16T16:17:55.501138+0000","last_active":"2024-04-16T16:17:57.499351+0000","last_peered":"2024-04-16T16:17:57.499351+0000","last_clean":"2024-04-16T16:17:57.499351+0000","last_became_active":"2024-04-16T16:17:55.500609+0000","last_became_peered":"2024-04-16T16:17:55.500609+0000","last_unstale":"2024-04-16T16:17:57.499351+0000","last_undegraded":"2024-04-16T16:17:57.499351+0000","last_fullsized":"2024-04-16T16:17:57.499351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:17.994231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152927+0000","last_change":"2024-04-16T16:17:56.495926+0000","last_active":"2024-04-16T16:17:58.152927+0000","last_peered":"2024-04-16T16:17:58.152927+0000","last_clean":"2024-04-16T16:17:58.152927+0000","last_became_active":"2024-04-16T16:17:56.495633+0000","last_became_peered":"2024-04-16T16:17:56.495633+0000","last_unstale":"2024-04-16T16:17:58.152927+0000","last_undegraded":"2024-04-16T16:17:58.152927+0000","last_fullsized":"2024-04-16T16:17:58.152927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:09.188268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510038+0000","last_change":"2024-04-16T16:17:55.489593+0000","last_active":"2024-04-16T16:17:57.510038+0000","last_peered":"2024-04-16T16:17:57.510038+0000","last_clean":"2024-04-16T16:17:57.510038+0000","last_became_active":"2024-04-16T16:17:55.489318+0000","last_became_peered":"2024-04-16T16:17:55.489318+0000","last_unstale":"2024-04-16T16:17:57.510038+0000","last_undegraded":"2024-04-16T16:17:57.510038+0000","last_fullsized":"2024-04-16T16:17:57.510038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:53.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153531+0000","last_change":"2024-04-16T16:17:56.500584+0000","last_active":"2024-04-16T16:17:58.153531+0000","last_peered":"2024-04-16T16:17:58.153531+0000","last_clean":"2024-04-16T16:17:58.153531+0000","last_became_active":"2024-04-16T16:17:56.500262+0000","last_became_peered":"2024-04-16T16:17:56.500262+0000","last_unstale":"2024-04-16T16:17:58.153531+0000","last_undegraded":"2024-04-16T16:17:58.153531+0000","last_fullsized":"2024-04-16T16:17:58.153531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:44:05.856075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154505+0000","last_change":"2024-04-16T16:17:55.500134+0000","last_active":"2024-04-16T16:17:58.154505+0000","last_peered":"2024-04-16T16:17:58.154505+0000","last_clean":"2024-04-16T16:17:58.154505+0000","last_became_active":"2024-04-16T16:17:55.499080+0000","last_became_peered":"2024-04-16T16:17:55.499080+0000","last_unstale":"2024-04-16T16:17:58.154505+0000","last_undegraded":"2024-04-16T16:17:58.154505+0000","last_fullsized":"2024-04-16T16:17:58.154505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153059+0000","last_change":"2024-04-16T16:17:56.506701+0000","last_active":"2024-04-16T16:17:58.153059+0000","last_peered":"2024-04-16T16:17:58.153059+0000","last_clean":"2024-04-16T16:17:58.153059+0000","last_became_active":"2024-04-16T16:17:56.505920+0000","last_became_peered":"2024-04-16T16:17:56.505920+0000","last_unstale":"2024-04-16T16:17:58.153059+0000","last_undegraded":"2024-04-16T16:17:58.153059+0000","last_fullsized":"2024-04-16T16:17:58.153059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:22.516152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497870+0000","last_change":"2024-04-16T16:17:55.499317+0000","last_active":"2024-04-16T16:17:57.497870+0000","last_peered":"2024-04-16T16:17:57.497870+0000","last_clean":"2024-04-16T16:17:57.497870+0000","last_became_active":"2024-04-16T16:17:55.498292+0000","last_became_peered":"2024-04-16T16:17:55.498292+0000","last_unstale":"2024-04-16T16:17:57.497870+0000","last_undegraded":"2024-04-16T16:17:57.497870+0000","last_fullsized":"2024-04-16T16:17:57.497870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:00.317630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497496+0000","last_change":"2024-04-16T16:17:56.503487+0000","last_active":"2024-04-16T16:17:57.497496+0000","last_peered":"2024-04-16T16:17:57.497496+0000","last_clean":"2024-04-16T16:17:57.497496+0000","last_became_active":"2024-04-16T16:17:56.502743+0000","last_became_peered":"2024-04-16T16:17:56.502743+0000","last_unstale":"2024-04-16T16:17:57.497496+0000","last_undegraded":"2024-04-16T16:17:57.497496+0000","last_fullsized":"2024-04-16T16:17:57.497496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152554+0000","last_change":"2024-04-16T16:17:55.493997+0000","last_active":"2024-04-16T16:17:58.152554+0000","last_peered":"2024-04-16T16:17:58.152554+0000","last_clean":"2024-04-16T16:17:58.152554+0000","last_became_active":"2024-04-16T16:17:55.493555+0000","last_became_peered":"2024-04-16T16:17:55.493555+0000","last_unstale":"2024-04-16T16:17:58.152554+0000","last_undegraded":"2024-04-16T16:17:58.152554+0000","last_fullsized":"2024-04-16T16:17:58.152554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:17.623743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153069+0000","last_change":"2024-04-16T16:17:56.494968+0000","last_active":"2024-04-16T16:17:58.153069+0000","last_peered":"2024-04-16T16:17:58.153069+0000","last_clean":"2024-04-16T16:17:58.153069+0000","last_became_active":"2024-04-16T16:17:56.493121+0000","last_became_peered":"2024-04-16T16:17:56.493121+0000","last_unstale":"2024-04-16T16:17:58.153069+0000","last_undegraded":"2024-04-16T16:17:58.153069+0000","last_fullsized":"2024-04-16T16:17:58.153069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:29.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517196+0000","last_change":"2024-04-16T16:17:55.493480+0000","last_active":"2024-04-16T16:17:57.517196+0000","last_peered":"2024-04-16T16:17:57.517196+0000","last_clean":"2024-04-16T16:17:57.517196+0000","last_became_active":"2024-04-16T16:17:55.493211+0000","last_became_peered":"2024-04-16T16:17:55.493211+0000","last_unstale":"2024-04-16T16:17:57.517196+0000","last_undegraded":"2024-04-16T16:17:57.517196+0000","last_fullsized":"2024-04-16T16:17:57.517196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:53.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155902+0000","last_change":"2024-04-16T16:17:56.498460+0000","last_active":"2024-04-16T16:17:58.155902+0000","last_peered":"2024-04-16T16:17:58.155902+0000","last_clean":"2024-04-16T16:17:58.155902+0000","last_became_active":"2024-04-16T16:17:56.498154+0000","last_became_peered":"2024-04-16T16:17:56.498154+0000","last_unstale":"2024-04-16T16:17:58.155902+0000","last_undegraded":"2024-04-16T16:17:58.155902+0000","last_fullsized":"2024-04-16T16:17:58.155902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510947+0000","last_change":"2024-04-16T16:17:55.489803+0000","last_active":"2024-04-16T16:17:57.510947+0000","last_peered":"2024-04-16T16:17:57.510947+0000","last_clean":"2024-04-16T16:17:57.510947+0000","last_became_active":"2024-04-16T16:17:55.489449+0000","last_became_peered":"2024-04-16T16:17:55.489449+0000","last_unstale":"2024-04-16T16:17:57.510947+0000","last_undegraded":"2024-04-16T16:17:57.510947+0000","last_fullsized":"2024-04-16T16:17:57.510947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510538+0000","last_change":"2024-04-16T16:17:56.507757+0000","last_active":"2024-04-16T16:17:57.510538+0000","last_peered":"2024-04-16T16:17:57.510538+0000","last_clean":"2024-04-16T16:17:57.510538+0000","last_became_active":"2024-04-16T16:17:56.505997+0000","last_became_peered":"2024-04-16T16:17:56.505997+0000","last_unstale":"2024-04-16T16:17:57.510538+0000","last_undegraded":"2024-04-16T16:17:57.510538+0000","last_fullsized":"2024-04-16T16:17:57.510538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516844+0000","last_change":"2024-04-16T16:17:55.488048+0000","last_active":"2024-04-16T16:17:57.516844+0000","last_peered":"2024-04-16T16:17:57.516844+0000","last_clean":"2024-04-16T16:17:57.516844+0000","last_became_active":"2024-04-16T16:17:55.487453+0000","last_became_peered":"2024-04-16T16:17:55.487453+0000","last_unstale":"2024-04-16T16:17:57.516844+0000","last_undegraded":"2024-04-16T16:17:57.516844+0000","last_fullsized":"2024-04-16T16:17:57.516844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154901+0000","last_change":"2024-04-16T16:17:56.497861+0000","last_active":"2024-04-16T16:17:58.154901+0000","last_peered":"2024-04-16T16:17:58.154901+0000","last_clean":"2024-04-16T16:17:58.154901+0000","last_became_active":"2024-04-16T16:17:56.496190+0000","last_became_peered":"2024-04-16T16:17:56.496190+0000","last_unstale":"2024-04-16T16:17:58.154901+0000","last_undegraded":"2024-04-16T16:17:58.154901+0000","last_fullsized":"2024-04-16T16:17:58.154901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510233+0000","last_change":"2024-04-16T16:17:55.497516+0000","last_active":"2024-04-16T16:17:57.510233+0000","last_peered":"2024-04-16T16:17:57.510233+0000","last_clean":"2024-04-16T16:17:57.510233+0000","last_became_active":"2024-04-16T16:17:55.497139+0000","last_became_peered":"2024-04-16T16:17:55.497139+0000","last_unstale":"2024-04-16T16:17:57.510233+0000","last_undegraded":"2024-04-16T16:17:57.510233+0000","last_fullsized":"2024-04-16T16:17:57.510233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510147+0000","last_change":"2024-04-16T16:17:56.494896+0000","last_active":"2024-04-16T16:17:57.510147+0000","last_peered":"2024-04-16T16:17:57.510147+0000","last_clean":"2024-04-16T16:17:57.510147+0000","last_became_active":"2024-04-16T16:17:56.494613+0000","last_became_peered":"2024-04-16T16:17:56.494613+0000","last_unstale":"2024-04-16T16:17:57.510147+0000","last_undegraded":"2024-04-16T16:17:57.510147+0000","last_fullsized":"2024-04-16T16:17:57.510147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516613+0000","last_change":"2024-04-16T16:17:55.491264+0000","last_active":"2024-04-16T16:17:57.516613+0000","last_peered":"2024-04-16T16:17:57.516613+0000","last_clean":"2024-04-16T16:17:57.516613+0000","last_became_active":"2024-04-16T16:17:55.490967+0000","last_became_peered":"2024-04-16T16:17:55.490967+0000","last_unstale":"2024-04-16T16:17:57.516613+0000","last_undegraded":"2024-04-16T16:17:57.516613+0000","last_fullsized":"2024-04-16T16:17:57.516613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492629+0000","last_change":"2024-04-16T16:17:56.524360+0000","last_active":"2024-04-16T16:17:57.492629+0000","last_peered":"2024-04-16T16:17:57.492629+0000","last_clean":"2024-04-16T16:17:57.492629+0000","last_became_active":"2024-04-16T16:17:56.522731+0000","last_became_peered":"2024-04-16T16:17:56.522731+0000","last_unstale":"2024-04-16T16:17:57.492629+0000","last_undegraded":"2024-04-16T16:17:57.492629+0000","last_fullsized":"2024-04-16T16:17:57.492629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498212+0000","last_change":"2024-04-16T16:17:55.495329+0000","last_active":"2024-04-16T16:17:57.498212+0000","last_peered":"2024-04-16T16:17:57.498212+0000","last_clean":"2024-04-16T16:17:57.498212+0000","last_became_active":"2024-04-16T16:17:55.494980+0000","last_became_peered":"2024-04-16T16:17:55.494980+0000","last_unstale":"2024-04-16T16:17:57.498212+0000","last_undegraded":"2024-04-16T16:17:57.498212+0000","last_fullsized":"2024-04-16T16:17:57.498212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:17.331783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497710+0000","last_change":"2024-04-16T16:17:56.507046+0000","last_active":"2024-04-16T16:17:57.497710+0000","last_peered":"2024-04-16T16:17:57.497710+0000","last_clean":"2024-04-16T16:17:57.497710+0000","last_became_active":"2024-04-16T16:17:56.501609+0000","last_became_peered":"2024-04-16T16:17:56.501609+0000","last_unstale":"2024-04-16T16:17:57.497710+0000","last_undegraded":"2024-04-16T16:17:57.497710+0000","last_fullsized":"2024-04-16T16:17:57.497710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492721+0000","last_change":"2024-04-16T16:17:55.500519+0000","last_active":"2024-04-16T16:17:57.492721+0000","last_peered":"2024-04-16T16:17:57.492721+0000","last_clean":"2024-04-16T16:17:57.492721+0000","last_became_active":"2024-04-16T16:17:55.499828+0000","last_became_peered":"2024-04-16T16:17:55.499828+0000","last_unstale":"2024-04-16T16:17:57.492721+0000","last_undegraded":"2024-04-16T16:17:57.492721+0000","last_fullsized":"2024-04-16T16:17:57.492721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:53.583412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499987+0000","last_change":"2024-04-16T16:17:56.503025+0000","last_active":"2024-04-16T16:17:57.499987+0000","last_peered":"2024-04-16T16:17:57.499987+0000","last_clean":"2024-04-16T16:17:57.499987+0000","last_became_active":"2024-04-16T16:17:56.500552+0000","last_became_peered":"2024-04-16T16:17:56.500552+0000","last_unstale":"2024-04-16T16:17:57.499987+0000","last_undegraded":"2024-04-16T16:17:57.499987+0000","last_fullsized":"2024-04-16T16:17:57.499987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:40.711440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153781+0000","last_change":"2024-04-16T16:17:55.491794+0000","last_active":"2024-04-16T16:17:58.153781+0000","last_peered":"2024-04-16T16:17:58.153781+0000","last_clean":"2024-04-16T16:17:58.153781+0000","last_became_active":"2024-04-16T16:17:55.491411+0000","last_became_peered":"2024-04-16T16:17:55.491411+0000","last_unstale":"2024-04-16T16:17:58.153781+0000","last_undegraded":"2024-04-16T16:17:58.153781+0000","last_fullsized":"2024-04-16T16:17:58.153781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498833+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:17:57.498833+0000","last_peered":"2024-04-16T16:17:57.498833+0000","last_clean":"2024-04-16T16:17:57.498833+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:17:57.498833+0000","last_undegraded":"2024-04-16T16:17:57.498833+0000","last_fullsized":"2024-04-16T16:17:57.498833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":741737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":151349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":741647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:18:06.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:18:06.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.331+0000 7fe117800640 1 Processor -- start 2024-04-16T16:18:06.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.332+0000 7fe117800640 1 -- start start 2024-04-16T16:18:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.333+0000 7fe117800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe1100d0d80 0x7fe110164750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.333+0000 7fe117800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100b01c0 con 0x7fe1100afde0 2024-04-16T16:18:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.333+0000 7fe117800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe110163b00 con 0x7fe110163590 2024-04-16T16:18:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.333+0000 7fe117800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe1100b3790 con 0x7fe1100d0d80 2024-04-16T16:18:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.334+0000 7fe114e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe1100afde0 0x7fe1100b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36840/0 (socket says 172.21.15.22:36840) 2024-04-16T16:18:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.334+0000 7fe114e00640 1 -- 172.21.15.22:0/3892871200 learned_addr learned my addr 172.21.15.22:0/3892871200 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.334+0000 7fe115800640 1 --2- 172.21.15.22:0/3892871200 >> v2:172.21.15.43:3300/0 conn(0x7fe1100d0d80 0x7fe110164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.334+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630980256 0 0) 0x7fe1100b01c0 con 0x7fe1100afde0 2024-04-16T16:18:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.334+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f4003520 con 0x7fe1100afde0 2024-04-16T16:18:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2785207173 0 0) 0x7fe0f4003520 con 0x7fe1100afde0 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 >> v2:172.21.15.43:3300/0 conn(0x7fe1100d0d80 msgr2=0x7fe110164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 --2- 172.21.15.22:0/3892871200 >> v2:172.21.15.43:3300/0 conn(0x7fe1100d0d80 0x7fe110164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 >> v1:172.21.15.43:6789/0 conn(0x7fe110163590 legacy=0x7fe1100d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe110163de0 con 0x7fe1100afde0 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fe1000019f0 con 0x7fe1100afde0 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 >> v1:172.21.15.22:6789/0 conn(0x7fe1100afde0 legacy=0x7fe1100b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f4003a00 0x7fe0f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0f4004800 0x7fe0f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f40051c0 0x7fe0f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f400c090 con 0x7fe0f40051c0 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f400c240 con 0x7fe0f4003a00 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f400c440 con 0x7fe0f4004800 2024-04-16T16:18:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe115800640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f40051c0 0x7fe0f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.335+0000 7fe114e00640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f4003a00 0x7fe0f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.336+0000 7fe10fe00640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0f4004800 0x7fe0f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.336+0000 7fe115800640 1 -- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0f4004800 msgr2=0x7fe0f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.336+0000 7fe115800640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0f4004800 0x7fe0f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.336+0000 7fe115800640 1 -- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f4003a00 msgr2=0x7fe0f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.336+0000 7fe115800640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f4003a00 0x7fe0f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.336+0000 7fe115800640 1 -- 172.21.15.22:0/3892871200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f4003520 con 0x7fe0f40051c0 2024-04-16T16:18:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.337+0000 7fe115800640 1 -- 172.21.15.22:0/3892871200 reap_dead start 2024-04-16T16:18:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.337+0000 7fe115800640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f40051c0 0x7fe0f400b9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe1100d05c0 tx=0x7fe0f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4474f337a26f516 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.337+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108039070 con 0x7fe0f40051c0 2024-04-16T16:18:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.337+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10802c680 con 0x7fe0f40051c0 2024-04-16T16:18:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.337+0000 7fe10f400640 1 -- 172.21.15.22:0/3892871200 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108009690 con 0x7fe0f40051c0 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.338+0000 7fe117800640 1 -- 172.21.15.22:0/3892871200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f40051c0 msgr2=0x7fe0f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.338+0000 7fe117800640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f40051c0 0x7fe0f400b9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe1100d05c0 tx=0x7fe0f4005830 comp rx=0 tx=0).stop 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.338+0000 7fe117800640 1 -- 172.21.15.22:0/3892871200 shutdown_connections 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.338+0000 7fe117800640 1 --2- 172.21.15.22:0/3892871200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f40051c0 0x7fe0f400b9c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.338+0000 7fe117800640 1 -- 172.21.15.22:0/3892871200 >> 172.21.15.22:0/3892871200 conn(0x7fe110062440 msgr2=0x7fe110062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.338+0000 7fe117800640 1 -- 172.21.15.22:0/3892871200 shutdown_connections 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.338+0000 7fe117800640 1 -- 172.21.15.22:0/3892871200 wait complete. 2024-04-16T16:18:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.340+0000 7fe117800640 1 Processor -- start 2024-04-16T16:18:06.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.340+0000 7fe117800640 1 -- start start 2024-04-16T16:18:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.341+0000 7fe117800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f40051c0 0x7fe1101fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.341+0000 7fe117800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe11015dda0 0x7fe11014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.341+0000 7fe117800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1101f9080 0x7fe1100b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.341+0000 7fe117800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe110164750 con 0x7fe11015dda0 2024-04-16T16:18:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.341+0000 7fe117800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1101643a0 con 0x7fe0f40051c0 2024-04-16T16:18:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.341+0000 7fe117800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1101648d0 con 0x7fe1101f9080 2024-04-16T16:18:06.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.341+0000 7fe10fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe11015dda0 0x7fe11014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe11015dda0 0x7fe11014d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39720/0 (socket says 172.21.15.22:39720) 2024-04-16T16:18:06.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 -- 172.21.15.22:0/156658229 learned_addr learned my addr 172.21.15.22:0/156658229 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe115800640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1101f9080 0x7fe1100b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe114e00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f40051c0 0x7fe1101fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 -- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1101f9080 msgr2=0x7fe1100b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1101f9080 0x7fe1100b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 -- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f40051c0 msgr2=0x7fe1101fbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f40051c0 0x7fe1101fbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 -- 172.21.15.22:0/156658229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1101fc630 con 0x7fe11015dda0 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe114e00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f40051c0 0x7fe1101fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.342+0000 7fe10fe00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe11015dda0 0x7fe11014d9b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800e500 tx=0x7fe0f800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.343+0000 7fe10cc00640 1 -- 172.21.15.22:0/156658229 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80052e0 con 0x7fe11015dda0 2024-04-16T16:18:06.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.343+0000 7fe10cc00640 1 -- 172.21.15.22:0/156658229 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8018070 con 0x7fe11015dda0 2024-04-16T16:18:06.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.343+0000 7fe10cc00640 1 -- 172.21.15.22:0/156658229 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8003810 con 0x7fe11015dda0 2024-04-16T16:18:06.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.343+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1101fc910 con 0x7fe11015dda0 2024-04-16T16:18:06.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.343+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1101fc340 con 0x7fe11015dda0 2024-04-16T16:18:06.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.344+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe11004fd90 con 0x7fe11015dda0 2024-04-16T16:18:06.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.345+0000 7fe10cc00640 1 -- 172.21.15.22:0/156658229 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0f80039b0 con 0x7fe11015dda0 2024-04-16T16:18:06.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.346+0000 7fe10cc00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe0ec06c920 0x7fe0ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.346+0000 7fe10cc00640 1 -- 172.21.15.22:0/156658229 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe0f808b810 con 0x7fe11015dda0 2024-04-16T16:18:06.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.347+0000 7fe114e00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe0ec06c920 0x7fe0ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.347+0000 7fe114e00640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe0ec06c920 0x7fe0ec06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe100002230 tx=0x7fe1000012d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:06.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.351+0000 7fe10cc00640 1 -- 172.21.15.22:0/156658229 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0f8059bb0 con 0x7fe11015dda0 2024-04-16T16:18:06.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:18:06.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:18:06.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.557+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe110062a30 con 0x7fe0ec06c920 2024-04-16T16:18:06.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.564+0000 7fe10cc00640 1 -- 172.21.15.22:0/156658229 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251839 (secure 0 0 0) 0x7fe110062a30 con 0x7fe0ec06c920 2024-04-16T16:18:06.567 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:06.568 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.569+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe0ec06c920 msgr2=0x7fe0ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.569+0000 7fe117800640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe0ec06c920 0x7fe0ec06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe100002230 tx=0x7fe1000012d0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.569+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe11015dda0 msgr2=0x7fe11014d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.569+0000 7fe117800640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe11015dda0 0x7fe11014d9b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800e500 tx=0x7fe0f800e9c0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.569+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 shutdown_connections 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.570+0000 7fe117800640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe0ec06c920 0x7fe0ec06ede0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.570+0000 7fe117800640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1101f9080 0x7fe1100b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.570+0000 7fe117800640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe11015dda0 0x7fe11014d9b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.570+0000 7fe117800640 1 --2- 172.21.15.22:0/156658229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0f40051c0 0x7fe1101fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.570+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 >> 172.21.15.22:0/156658229 conn(0x7fe110062440 msgr2=0x7fe1100b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.570+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 shutdown_connections 2024-04-16T16:18:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.570+0000 7fe117800640 1 -- 172.21.15.22:0/156658229 wait complete. 2024-04-16T16:18:06.588 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-16T16:18:05.732369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253684,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721036,"statfs":{"total":773094113280,"available":772834340864,"internally_reserved":0,"allocated":4333568,"data_stored":2395788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.266743"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154389+0000","last_change":"2024-04-16T16:17:56.504008+0000","last_active":"2024-04-16T16:17:58.154389+0000","last_peered":"2024-04-16T16:17:58.154389+0000","last_clean":"2024-04-16T16:17:58.154389+0000","last_became_active":"2024-04-16T16:17:56.503413+0000","last_became_peered":"2024-04-16T16:17:56.503413+0000","last_unstale":"2024-04-16T16:17:58.154389+0000","last_undegraded":"2024-04-16T16:17:58.154389+0000","last_fullsized":"2024-04-16T16:17:58.154389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493379+0000","last_change":"2024-04-16T16:17:56.516912+0000","last_active":"2024-04-16T16:17:57.493379+0000","last_peered":"2024-04-16T16:17:57.493379+0000","last_clean":"2024-04-16T16:17:57.493379+0000","last_became_active":"2024-04-16T16:17:56.516598+0000","last_became_peered":"2024-04-16T16:17:56.516598+0000","last_unstale":"2024-04-16T16:17:57.493379+0000","last_undegraded":"2024-04-16T16:17:57.493379+0000","last_fullsized":"2024-04-16T16:17:57.493379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:57:10.646516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154781+0000","last_change":"2024-04-16T16:17:56.503278+0000","last_active":"2024-04-16T16:17:58.154781+0000","last_peered":"2024-04-16T16:17:58.154781+0000","last_clean":"2024-04-16T16:17:58.154781+0000","last_became_active":"2024-04-16T16:17:56.502493+0000","last_became_peered":"2024-04-16T16:17:56.502493+0000","last_unstale":"2024-04-16T16:17:58.154781+0000","last_undegraded":"2024-04-16T16:17:58.154781+0000","last_fullsized":"2024-04-16T16:17:58.154781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:17.749181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516597+0000","last_change":"2024-04-16T16:17:56.514534+0000","last_active":"2024-04-16T16:17:57.516597+0000","last_peered":"2024-04-16T16:17:57.516597+0000","last_clean":"2024-04-16T16:17:57.516597+0000","last_became_active":"2024-04-16T16:17:56.514227+0000","last_became_peered":"2024-04-16T16:17:56.514227+0000","last_unstale":"2024-04-16T16:17:57.516597+0000","last_undegraded":"2024-04-16T16:17:57.516597+0000","last_fullsized":"2024-04-16T16:17:57.516597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:09:27.455247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153094+0000","last_change":"2024-04-16T16:17:56.522948+0000","last_active":"2024-04-16T16:17:58.153094+0000","last_peered":"2024-04-16T16:17:58.153094+0000","last_clean":"2024-04-16T16:17:58.153094+0000","last_became_active":"2024-04-16T16:17:56.522558+0000","last_became_peered":"2024-04-16T16:17:56.522558+0000","last_unstale":"2024-04-16T16:17:58.153094+0000","last_undegraded":"2024-04-16T16:17:58.153094+0000","last_fullsized":"2024-04-16T16:17:58.153094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:20.121131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492696+0000","last_change":"2024-04-16T16:17:56.517173+0000","last_active":"2024-04-16T16:17:57.492696+0000","last_peered":"2024-04-16T16:17:57.492696+0000","last_clean":"2024-04-16T16:17:57.492696+0000","last_became_active":"2024-04-16T16:17:56.516749+0000","last_became_peered":"2024-04-16T16:17:56.516749+0000","last_unstale":"2024-04-16T16:17:57.492696+0000","last_undegraded":"2024-04-16T16:17:57.492696+0000","last_fullsized":"2024-04-16T16:17:57.492696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497706+0000","last_change":"2024-04-16T16:17:56.505321+0000","last_active":"2024-04-16T16:17:57.497706+0000","last_peered":"2024-04-16T16:17:57.497706+0000","last_clean":"2024-04-16T16:17:57.497706+0000","last_became_active":"2024-04-16T16:17:56.503979+0000","last_became_peered":"2024-04-16T16:17:56.503979+0000","last_unstale":"2024-04-16T16:17:57.497706+0000","last_undegraded":"2024-04-16T16:17:57.497706+0000","last_fullsized":"2024-04-16T16:17:57.497706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.496995+0000","last_change":"2024-04-16T16:17:56.501157+0000","last_active":"2024-04-16T16:17:57.496995+0000","last_peered":"2024-04-16T16:17:57.496995+0000","last_clean":"2024-04-16T16:17:57.496995+0000","last_became_active":"2024-04-16T16:17:56.500191+0000","last_became_peered":"2024-04-16T16:17:56.500191+0000","last_unstale":"2024-04-16T16:17:57.496995+0000","last_undegraded":"2024-04-16T16:17:57.496995+0000","last_fullsized":"2024-04-16T16:17:57.496995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499169+0000","last_change":"2024-04-16T16:17:56.502074+0000","last_active":"2024-04-16T16:17:57.499169+0000","last_peered":"2024-04-16T16:17:57.499169+0000","last_clean":"2024-04-16T16:17:57.499169+0000","last_became_active":"2024-04-16T16:17:56.501708+0000","last_became_peered":"2024-04-16T16:17:56.501708+0000","last_unstale":"2024-04-16T16:17:57.499169+0000","last_undegraded":"2024-04-16T16:17:57.499169+0000","last_fullsized":"2024-04-16T16:17:57.499169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:54.597447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516908+0000","last_change":"2024-04-16T16:17:56.519775+0000","last_active":"2024-04-16T16:17:57.516908+0000","last_peered":"2024-04-16T16:17:57.516908+0000","last_clean":"2024-04-16T16:17:57.516908+0000","last_became_active":"2024-04-16T16:17:56.517890+0000","last_became_peered":"2024-04-16T16:17:56.517890+0000","last_unstale":"2024-04-16T16:17:57.516908+0000","last_undegraded":"2024-04-16T16:17:57.516908+0000","last_fullsized":"2024-04-16T16:17:57.516908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499963+0000","last_change":"2024-04-16T16:17:56.515007+0000","last_active":"2024-04-16T16:17:57.499963+0000","last_peered":"2024-04-16T16:17:57.499963+0000","last_clean":"2024-04-16T16:17:57.499963+0000","last_became_active":"2024-04-16T16:17:56.514728+0000","last_became_peered":"2024-04-16T16:17:56.514728+0000","last_unstale":"2024-04-16T16:17:57.499963+0000","last_undegraded":"2024-04-16T16:17:57.499963+0000","last_fullsized":"2024-04-16T16:17:57.499963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:17.749181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153642+0000","last_change":"2024-04-16T16:17:56.522417+0000","last_active":"2024-04-16T16:17:58.153642+0000","last_peered":"2024-04-16T16:17:58.153642+0000","last_clean":"2024-04-16T16:17:58.153642+0000","last_became_active":"2024-04-16T16:17:56.522070+0000","last_became_peered":"2024-04-16T16:17:56.522070+0000","last_unstale":"2024-04-16T16:17:58.153642+0000","last_undegraded":"2024-04-16T16:17:58.153642+0000","last_fullsized":"2024-04-16T16:17:58.153642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153471+0000","last_change":"2024-04-16T16:17:56.503495+0000","last_active":"2024-04-16T16:17:58.153471+0000","last_peered":"2024-04-16T16:17:58.153471+0000","last_clean":"2024-04-16T16:17:58.153471+0000","last_became_active":"2024-04-16T16:17:56.503214+0000","last_became_peered":"2024-04-16T16:17:56.503214+0000","last_unstale":"2024-04-16T16:17:58.153471+0000","last_undegraded":"2024-04-16T16:17:58.153471+0000","last_fullsized":"2024-04-16T16:17:58.153471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:18.637778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493068+0000","last_change":"2024-04-16T16:17:56.500333+0000","last_active":"2024-04-16T16:17:57.493068+0000","last_peered":"2024-04-16T16:17:57.493068+0000","last_clean":"2024-04-16T16:17:57.493068+0000","last_became_active":"2024-04-16T16:17:56.500055+0000","last_became_peered":"2024-04-16T16:17:56.500055+0000","last_unstale":"2024-04-16T16:17:57.493068+0000","last_undegraded":"2024-04-16T16:17:57.493068+0000","last_fullsized":"2024-04-16T16:17:57.493068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:59.242254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153215+0000","last_change":"2024-04-16T16:17:56.501375+0000","last_active":"2024-04-16T16:17:58.153215+0000","last_peered":"2024-04-16T16:17:58.153215+0000","last_clean":"2024-04-16T16:17:58.153215+0000","last_became_active":"2024-04-16T16:17:56.501060+0000","last_became_peered":"2024-04-16T16:17:56.501060+0000","last_unstale":"2024-04-16T16:17:58.153215+0000","last_undegraded":"2024-04-16T16:17:58.153215+0000","last_fullsized":"2024-04-16T16:17:58.153215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498929+0000","last_change":"2024-04-16T16:17:56.527011+0000","last_active":"2024-04-16T16:17:57.498929+0000","last_peered":"2024-04-16T16:17:57.498929+0000","last_clean":"2024-04-16T16:17:57.498929+0000","last_became_active":"2024-04-16T16:17:56.526634+0000","last_became_peered":"2024-04-16T16:17:56.526634+0000","last_unstale":"2024-04-16T16:17:57.498929+0000","last_undegraded":"2024-04-16T16:17:57.498929+0000","last_fullsized":"2024-04-16T16:17:57.498929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:17.809471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.500363+0000","last_change":"2024-04-16T16:17:56.503656+0000","last_active":"2024-04-16T16:17:57.500363+0000","last_peered":"2024-04-16T16:17:57.500363+0000","last_clean":"2024-04-16T16:17:57.500363+0000","last_became_active":"2024-04-16T16:17:56.501346+0000","last_became_peered":"2024-04-16T16:17:56.501346+0000","last_unstale":"2024-04-16T16:17:57.500363+0000","last_undegraded":"2024-04-16T16:17:57.500363+0000","last_fullsized":"2024-04-16T16:17:57.500363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493608+0000","last_change":"2024-04-16T16:17:56.498898+0000","last_active":"2024-04-16T16:17:57.493608+0000","last_peered":"2024-04-16T16:17:57.493608+0000","last_clean":"2024-04-16T16:17:57.493608+0000","last_became_active":"2024-04-16T16:17:56.498114+0000","last_became_peered":"2024-04-16T16:17:56.498114+0000","last_unstale":"2024-04-16T16:17:57.493608+0000","last_undegraded":"2024-04-16T16:17:57.493608+0000","last_fullsized":"2024-04-16T16:17:57.493608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:37.663896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493073+0000","last_change":"2024-04-16T16:17:56.513521+0000","last_active":"2024-04-16T16:17:57.493073+0000","last_peered":"2024-04-16T16:17:57.493073+0000","last_clean":"2024-04-16T16:17:57.493073+0000","last_became_active":"2024-04-16T16:17:56.513263+0000","last_became_peered":"2024-04-16T16:17:56.513263+0000","last_unstale":"2024-04-16T16:17:57.493073+0000","last_undegraded":"2024-04-16T16:17:57.493073+0000","last_fullsized":"2024-04-16T16:17:57.493073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:42.373864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153246+0000","last_change":"2024-04-16T16:17:56.499823+0000","last_active":"2024-04-16T16:17:58.153246+0000","last_peered":"2024-04-16T16:17:58.153246+0000","last_clean":"2024-04-16T16:17:58.153246+0000","last_became_active":"2024-04-16T16:17:56.499472+0000","last_became_peered":"2024-04-16T16:17:56.499472+0000","last_unstale":"2024-04-16T16:17:58.153246+0000","last_undegraded":"2024-04-16T16:17:58.153246+0000","last_fullsized":"2024-04-16T16:17:58.153246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:54.107187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498248+0000","last_change":"2024-04-16T16:17:56.505602+0000","last_active":"2024-04-16T16:17:57.498248+0000","last_peered":"2024-04-16T16:17:57.498248+0000","last_clean":"2024-04-16T16:17:57.498248+0000","last_became_active":"2024-04-16T16:17:56.505281+0000","last_became_peered":"2024-04-16T16:17:56.505281+0000","last_unstale":"2024-04-16T16:17:57.498248+0000","last_undegraded":"2024-04-16T16:17:57.498248+0000","last_fullsized":"2024-04-16T16:17:57.498248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:18.641103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498061+0000","last_change":"2024-04-16T16:17:56.517999+0000","last_active":"2024-04-16T16:17:57.498061+0000","last_peered":"2024-04-16T16:17:57.498061+0000","last_clean":"2024-04-16T16:17:57.498061+0000","last_became_active":"2024-04-16T16:17:56.517710+0000","last_became_peered":"2024-04-16T16:17:56.517710+0000","last_unstale":"2024-04-16T16:17:57.498061+0000","last_undegraded":"2024-04-16T16:17:57.498061+0000","last_fullsized":"2024-04-16T16:17:57.498061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.509863+0000","last_change":"2024-04-16T16:17:56.507304+0000","last_active":"2024-04-16T16:17:57.509863+0000","last_peered":"2024-04-16T16:17:57.509863+0000","last_clean":"2024-04-16T16:17:57.509863+0000","last_became_active":"2024-04-16T16:17:56.506972+0000","last_became_peered":"2024-04-16T16:17:56.506972+0000","last_unstale":"2024-04-16T16:17:57.509863+0000","last_undegraded":"2024-04-16T16:17:57.509863+0000","last_fullsized":"2024-04-16T16:17:57.509863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:49.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152901+0000","last_change":"2024-04-16T16:17:56.497834+0000","last_active":"2024-04-16T16:17:58.152901+0000","last_peered":"2024-04-16T16:17:58.152901+0000","last_clean":"2024-04-16T16:17:58.152901+0000","last_became_active":"2024-04-16T16:17:56.497528+0000","last_became_peered":"2024-04-16T16:17:56.497528+0000","last_unstale":"2024-04-16T16:17:58.152901+0000","last_undegraded":"2024-04-16T16:17:58.152901+0000","last_fullsized":"2024-04-16T16:17:58.152901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517138+0000","last_change":"2024-04-16T16:17:56.508439+0000","last_active":"2024-04-16T16:17:57.517138+0000","last_peered":"2024-04-16T16:17:57.517138+0000","last_clean":"2024-04-16T16:17:57.517138+0000","last_became_active":"2024-04-16T16:17:56.508030+0000","last_became_peered":"2024-04-16T16:17:56.508030+0000","last_unstale":"2024-04-16T16:17:57.517138+0000","last_undegraded":"2024-04-16T16:17:57.517138+0000","last_fullsized":"2024-04-16T16:17:57.517138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:48.113299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493754+0000","last_change":"2024-04-16T16:17:56.502130+0000","last_active":"2024-04-16T16:17:57.493754+0000","last_peered":"2024-04-16T16:17:57.493754+0000","last_clean":"2024-04-16T16:17:57.493754+0000","last_became_active":"2024-04-16T16:17:56.501314+0000","last_became_peered":"2024-04-16T16:17:56.501314+0000","last_unstale":"2024-04-16T16:17:57.493754+0000","last_undegraded":"2024-04-16T16:17:57.493754+0000","last_fullsized":"2024-04-16T16:17:57.493754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:08.109447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517671+0000","last_change":"2024-04-16T16:17:56.513141+0000","last_active":"2024-04-16T16:17:57.517671+0000","last_peered":"2024-04-16T16:17:57.517671+0000","last_clean":"2024-04-16T16:17:57.517671+0000","last_became_active":"2024-04-16T16:17:56.511366+0000","last_became_peered":"2024-04-16T16:17:56.511366+0000","last_unstale":"2024-04-16T16:17:57.517671+0000","last_undegraded":"2024-04-16T16:17:57.517671+0000","last_fullsized":"2024-04-16T16:17:57.517671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154236+0000","last_change":"2024-04-16T16:17:56.497253+0000","last_active":"2024-04-16T16:17:58.154236+0000","last_peered":"2024-04-16T16:17:58.154236+0000","last_clean":"2024-04-16T16:17:58.154236+0000","last_became_active":"2024-04-16T16:17:56.496953+0000","last_became_peered":"2024-04-16T16:17:56.496953+0000","last_unstale":"2024-04-16T16:17:58.154236+0000","last_undegraded":"2024-04-16T16:17:58.154236+0000","last_fullsized":"2024-04-16T16:17:58.154236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:17.809471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498678+0000","last_change":"2024-04-16T16:17:56.522234+0000","last_active":"2024-04-16T16:17:57.498678+0000","last_peered":"2024-04-16T16:17:57.498678+0000","last_clean":"2024-04-16T16:17:57.498678+0000","last_became_active":"2024-04-16T16:17:56.521812+0000","last_became_peered":"2024-04-16T16:17:56.521812+0000","last_unstale":"2024-04-16T16:17:57.498678+0000","last_undegraded":"2024-04-16T16:17:57.498678+0000","last_fullsized":"2024-04-16T16:17:57.498678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:09:27.455247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499712+0000","last_change":"2024-04-16T16:17:56.501528+0000","last_active":"2024-04-16T16:17:57.499712+0000","last_peered":"2024-04-16T16:17:57.499712+0000","last_clean":"2024-04-16T16:17:57.499712+0000","last_became_active":"2024-04-16T16:17:56.500783+0000","last_became_peered":"2024-04-16T16:17:56.500783+0000","last_unstale":"2024-04-16T16:17:57.499712+0000","last_undegraded":"2024-04-16T16:17:57.499712+0000","last_fullsized":"2024-04-16T16:17:57.499712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:45:36.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153566+0000","last_change":"2024-04-16T16:17:56.498532+0000","last_active":"2024-04-16T16:17:58.153566+0000","last_peered":"2024-04-16T16:17:58.153566+0000","last_clean":"2024-04-16T16:17:58.153566+0000","last_became_active":"2024-04-16T16:17:56.498200+0000","last_became_peered":"2024-04-16T16:17:56.498200+0000","last_unstale":"2024-04-16T16:17:58.153566+0000","last_undegraded":"2024-04-16T16:17:58.153566+0000","last_fullsized":"2024-04-16T16:17:58.153566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:09:17.398636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.496980+0000","last_change":"2024-04-16T16:17:56.512883+0000","last_active":"2024-04-16T16:17:57.496980+0000","last_peered":"2024-04-16T16:17:57.496980+0000","last_clean":"2024-04-16T16:17:57.496980+0000","last_became_active":"2024-04-16T16:17:56.511662+0000","last_became_peered":"2024-04-16T16:17:56.511662+0000","last_unstale":"2024-04-16T16:17:57.496980+0000","last_undegraded":"2024-04-16T16:17:57.496980+0000","last_fullsized":"2024-04-16T16:17:57.496980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510620+0000","last_change":"2024-04-16T16:17:56.505463+0000","last_active":"2024-04-16T16:17:57.510620+0000","last_peered":"2024-04-16T16:17:57.510620+0000","last_clean":"2024-04-16T16:17:57.510620+0000","last_became_active":"2024-04-16T16:17:56.502336+0000","last_became_peered":"2024-04-16T16:17:56.502336+0000","last_unstale":"2024-04-16T16:17:57.510620+0000","last_undegraded":"2024-04-16T16:17:57.510620+0000","last_fullsized":"2024-04-16T16:17:57.510620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154547+0000","last_change":"2024-04-16T16:17:55.501902+0000","last_active":"2024-04-16T16:17:58.154547+0000","last_peered":"2024-04-16T16:17:58.154547+0000","last_clean":"2024-04-16T16:17:58.154547+0000","last_became_active":"2024-04-16T16:17:55.501467+0000","last_became_peered":"2024-04-16T16:17:55.501467+0000","last_unstale":"2024-04-16T16:17:58.154547+0000","last_undegraded":"2024-04-16T16:17:58.154547+0000","last_fullsized":"2024-04-16T16:17:58.154547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.156005+0000","last_change":"2024-04-16T16:17:56.511938+0000","last_active":"2024-04-16T16:17:58.156005+0000","last_peered":"2024-04-16T16:17:58.156005+0000","last_clean":"2024-04-16T16:17:58.156005+0000","last_became_active":"2024-04-16T16:17:56.510346+0000","last_became_peered":"2024-04-16T16:17:56.510346+0000","last_unstale":"2024-04-16T16:17:58.156005+0000","last_undegraded":"2024-04-16T16:17:58.156005+0000","last_fullsized":"2024-04-16T16:17:58.156005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510541+0000","last_change":"2024-04-16T16:17:55.498496+0000","last_active":"2024-04-16T16:17:57.510541+0000","last_peered":"2024-04-16T16:17:57.510541+0000","last_clean":"2024-04-16T16:17:57.510541+0000","last_became_active":"2024-04-16T16:17:55.498148+0000","last_became_peered":"2024-04-16T16:17:55.498148+0000","last_unstale":"2024-04-16T16:17:57.510541+0000","last_undegraded":"2024-04-16T16:17:57.510541+0000","last_fullsized":"2024-04-16T16:17:57.510541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499570+0000","last_change":"2024-04-16T16:17:56.522166+0000","last_active":"2024-04-16T16:17:57.499570+0000","last_peered":"2024-04-16T16:17:57.499570+0000","last_clean":"2024-04-16T16:17:57.499570+0000","last_became_active":"2024-04-16T16:17:56.521847+0000","last_became_peered":"2024-04-16T16:17:56.521847+0000","last_unstale":"2024-04-16T16:17:57.499570+0000","last_undegraded":"2024-04-16T16:17:57.499570+0000","last_fullsized":"2024-04-16T16:17:57.499570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:59:29.165576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492966+0000","last_change":"2024-04-16T16:17:55.489599+0000","last_active":"2024-04-16T16:17:57.492966+0000","last_peered":"2024-04-16T16:17:57.492966+0000","last_clean":"2024-04-16T16:17:57.492966+0000","last_became_active":"2024-04-16T16:17:55.489035+0000","last_became_peered":"2024-04-16T16:17:55.489035+0000","last_unstale":"2024-04-16T16:17:57.492966+0000","last_undegraded":"2024-04-16T16:17:57.492966+0000","last_fullsized":"2024-04-16T16:17:57.492966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:48.713597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517860+0000","last_change":"2024-04-16T16:17:56.511325+0000","last_active":"2024-04-16T16:17:57.517860+0000","last_peered":"2024-04-16T16:17:57.517860+0000","last_clean":"2024-04-16T16:17:57.517860+0000","last_became_active":"2024-04-16T16:17:56.511026+0000","last_became_peered":"2024-04-16T16:17:56.511026+0000","last_unstale":"2024-04-16T16:17:57.517860+0000","last_undegraded":"2024-04-16T16:17:57.517860+0000","last_fullsized":"2024-04-16T16:17:57.517860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:29.768688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153239+0000","last_change":"2024-04-16T16:17:55.492715+0000","last_active":"2024-04-16T16:17:58.153239+0000","last_peered":"2024-04-16T16:17:58.153239+0000","last_clean":"2024-04-16T16:17:58.153239+0000","last_became_active":"2024-04-16T16:17:55.492461+0000","last_became_peered":"2024-04-16T16:17:55.492461+0000","last_unstale":"2024-04-16T16:17:58.153239+0000","last_undegraded":"2024-04-16T16:17:58.153239+0000","last_fullsized":"2024-04-16T16:17:58.153239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:41:55.032946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.500056+0000","last_change":"2024-04-16T16:17:56.509933+0000","last_active":"2024-04-16T16:17:57.500056+0000","last_peered":"2024-04-16T16:17:57.500056+0000","last_clean":"2024-04-16T16:17:57.500056+0000","last_became_active":"2024-04-16T16:17:56.509670+0000","last_became_peered":"2024-04-16T16:17:56.509670+0000","last_unstale":"2024-04-16T16:17:57.500056+0000","last_undegraded":"2024-04-16T16:17:57.500056+0000","last_fullsized":"2024-04-16T16:17:57.500056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498548+0000","last_change":"2024-04-16T16:17:55.498614+0000","last_active":"2024-04-16T16:17:57.498548+0000","last_peered":"2024-04-16T16:17:57.498548+0000","last_clean":"2024-04-16T16:17:57.498548+0000","last_became_active":"2024-04-16T16:17:55.498220+0000","last_became_peered":"2024-04-16T16:17:55.498220+0000","last_unstale":"2024-04-16T16:17:57.498548+0000","last_undegraded":"2024-04-16T16:17:57.498548+0000","last_fullsized":"2024-04-16T16:17:57.498548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:25:12.960648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154095+0000","last_change":"2024-04-16T16:17:56.492281+0000","last_active":"2024-04-16T16:17:58.154095+0000","last_peered":"2024-04-16T16:17:58.154095+0000","last_clean":"2024-04-16T16:17:58.154095+0000","last_became_active":"2024-04-16T16:17:56.491918+0000","last_became_peered":"2024-04-16T16:17:56.491918+0000","last_unstale":"2024-04-16T16:17:58.154095+0000","last_undegraded":"2024-04-16T16:17:58.154095+0000","last_fullsized":"2024-04-16T16:17:58.154095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:56.520798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497848+0000","last_change":"2024-04-16T16:17:55.498772+0000","last_active":"2024-04-16T16:17:57.497848+0000","last_peered":"2024-04-16T16:17:57.497848+0000","last_clean":"2024-04-16T16:17:57.497848+0000","last_became_active":"2024-04-16T16:17:55.498140+0000","last_became_peered":"2024-04-16T16:17:55.498140+0000","last_unstale":"2024-04-16T16:17:57.497848+0000","last_undegraded":"2024-04-16T16:17:57.497848+0000","last_fullsized":"2024-04-16T16:17:57.497848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:48:49.711527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497716+0000","last_change":"2024-04-16T16:17:56.495123+0000","last_active":"2024-04-16T16:17:57.497716+0000","last_peered":"2024-04-16T16:17:57.497716+0000","last_clean":"2024-04-16T16:17:57.497716+0000","last_became_active":"2024-04-16T16:17:56.494372+0000","last_became_peered":"2024-04-16T16:17:56.494372+0000","last_unstale":"2024-04-16T16:17:57.497716+0000","last_undegraded":"2024-04-16T16:17:57.497716+0000","last_fullsized":"2024-04-16T16:17:57.497716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492600+0000","last_change":"2024-04-16T16:17:55.496597+0000","last_active":"2024-04-16T16:17:57.492600+0000","last_peered":"2024-04-16T16:17:57.492600+0000","last_clean":"2024-04-16T16:17:57.492600+0000","last_became_active":"2024-04-16T16:17:55.496282+0000","last_became_peered":"2024-04-16T16:17:55.496282+0000","last_unstale":"2024-04-16T16:17:57.492600+0000","last_undegraded":"2024-04-16T16:17:57.492600+0000","last_fullsized":"2024-04-16T16:17:57.492600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:13.627825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516632+0000","last_change":"2024-04-16T16:17:56.503671+0000","last_active":"2024-04-16T16:17:57.516632+0000","last_peered":"2024-04-16T16:17:57.516632+0000","last_clean":"2024-04-16T16:17:57.516632+0000","last_became_active":"2024-04-16T16:17:56.503360+0000","last_became_peered":"2024-04-16T16:17:56.503360+0000","last_unstale":"2024-04-16T16:17:57.516632+0000","last_undegraded":"2024-04-16T16:17:57.516632+0000","last_fullsized":"2024-04-16T16:17:57.516632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:54.597447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497870+0000","last_change":"2024-04-16T16:17:55.496087+0000","last_active":"2024-04-16T16:17:57.497870+0000","last_peered":"2024-04-16T16:17:57.497870+0000","last_clean":"2024-04-16T16:17:57.497870+0000","last_became_active":"2024-04-16T16:17:55.495702+0000","last_became_peered":"2024-04-16T16:17:55.495702+0000","last_unstale":"2024-04-16T16:17:57.497870+0000","last_undegraded":"2024-04-16T16:17:57.497870+0000","last_fullsized":"2024-04-16T16:17:57.497870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:15.658237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155981+0000","last_change":"2024-04-16T16:17:56.518597+0000","last_active":"2024-04-16T16:17:58.155981+0000","last_peered":"2024-04-16T16:17:58.155981+0000","last_clean":"2024-04-16T16:17:58.155981+0000","last_became_active":"2024-04-16T16:17:56.518173+0000","last_became_peered":"2024-04-16T16:17:56.518173+0000","last_unstale":"2024-04-16T16:17:58.155981+0000","last_undegraded":"2024-04-16T16:17:58.155981+0000","last_fullsized":"2024-04-16T16:17:58.155981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:13.030854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493261+0000","last_change":"2024-04-16T16:17:55.502598+0000","last_active":"2024-04-16T16:17:57.493261+0000","last_peered":"2024-04-16T16:17:57.493261+0000","last_clean":"2024-04-16T16:17:57.493261+0000","last_became_active":"2024-04-16T16:17:55.500438+0000","last_became_peered":"2024-04-16T16:17:55.500438+0000","last_unstale":"2024-04-16T16:17:57.493261+0000","last_undegraded":"2024-04-16T16:17:57.493261+0000","last_fullsized":"2024-04-16T16:17:57.493261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:17.627068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493372+0000","last_change":"2024-04-16T16:17:56.518072+0000","last_active":"2024-04-16T16:17:57.493372+0000","last_peered":"2024-04-16T16:17:57.493372+0000","last_clean":"2024-04-16T16:17:57.493372+0000","last_became_active":"2024-04-16T16:17:56.517785+0000","last_became_peered":"2024-04-16T16:17:56.517785+0000","last_unstale":"2024-04-16T16:17:57.493372+0000","last_undegraded":"2024-04-16T16:17:57.493372+0000","last_fullsized":"2024-04-16T16:17:57.493372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:09.446148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510710+0000","last_change":"2024-04-16T16:17:55.491916+0000","last_active":"2024-04-16T16:17:57.510710+0000","last_peered":"2024-04-16T16:17:57.510710+0000","last_clean":"2024-04-16T16:17:57.510710+0000","last_became_active":"2024-04-16T16:17:55.491653+0000","last_became_peered":"2024-04-16T16:17:55.491653+0000","last_unstale":"2024-04-16T16:17:57.510710+0000","last_undegraded":"2024-04-16T16:17:57.510710+0000","last_fullsized":"2024-04-16T16:17:57.510710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:19.107096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493266+0000","last_change":"2024-04-16T16:17:56.501329+0000","last_active":"2024-04-16T16:17:57.493266+0000","last_peered":"2024-04-16T16:17:57.493266+0000","last_clean":"2024-04-16T16:17:57.493266+0000","last_became_active":"2024-04-16T16:17:56.501066+0000","last_became_peered":"2024-04-16T16:17:56.501066+0000","last_unstale":"2024-04-16T16:17:57.493266+0000","last_undegraded":"2024-04-16T16:17:57.493266+0000","last_fullsized":"2024-04-16T16:17:57.493266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:27:36.595251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154604+0000","last_change":"2024-04-16T16:17:55.493838+0000","last_active":"2024-04-16T16:17:58.154604+0000","last_peered":"2024-04-16T16:17:58.154604+0000","last_clean":"2024-04-16T16:17:58.154604+0000","last_became_active":"2024-04-16T16:17:55.493444+0000","last_became_peered":"2024-04-16T16:17:55.493444+0000","last_unstale":"2024-04-16T16:17:58.154604+0000","last_undegraded":"2024-04-16T16:17:58.154604+0000","last_fullsized":"2024-04-16T16:17:58.154604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:44:04.842040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154437+0000","last_change":"2024-04-16T16:17:56.504256+0000","last_active":"2024-04-16T16:17:58.154437+0000","last_peered":"2024-04-16T16:17:58.154437+0000","last_clean":"2024-04-16T16:17:58.154437+0000","last_became_active":"2024-04-16T16:17:56.503835+0000","last_became_peered":"2024-04-16T16:17:56.503835+0000","last_unstale":"2024-04-16T16:17:58.154437+0000","last_undegraded":"2024-04-16T16:17:58.154437+0000","last_fullsized":"2024-04-16T16:17:58.154437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:45:36.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493228+0000","last_change":"2024-04-16T16:17:55.489575+0000","last_active":"2024-04-16T16:17:57.493228+0000","last_peered":"2024-04-16T16:17:57.493228+0000","last_clean":"2024-04-16T16:17:57.493228+0000","last_became_active":"2024-04-16T16:17:55.489273+0000","last_became_peered":"2024-04-16T16:17:55.489273+0000","last_unstale":"2024-04-16T16:17:57.493228+0000","last_undegraded":"2024-04-16T16:17:57.493228+0000","last_fullsized":"2024-04-16T16:17:57.493228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:01.905935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516327+0000","last_change":"2024-04-16T16:17:56.504261+0000","last_active":"2024-04-16T16:17:57.516327+0000","last_peered":"2024-04-16T16:17:57.516327+0000","last_clean":"2024-04-16T16:17:57.516327+0000","last_became_active":"2024-04-16T16:17:56.503915+0000","last_became_peered":"2024-04-16T16:17:56.503915+0000","last_unstale":"2024-04-16T16:17:57.516327+0000","last_undegraded":"2024-04-16T16:17:57.516327+0000","last_fullsized":"2024-04-16T16:17:57.516327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:17:18.641103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498833+0000","last_change":"2024-04-16T16:17:55.495996+0000","last_active":"2024-04-16T16:17:57.498833+0000","last_peered":"2024-04-16T16:17:57.498833+0000","last_clean":"2024-04-16T16:17:57.498833+0000","last_became_active":"2024-04-16T16:17:55.495677+0000","last_became_peered":"2024-04-16T16:17:55.495677+0000","last_unstale":"2024-04-16T16:17:57.498833+0000","last_undegraded":"2024-04-16T16:17:57.498833+0000","last_fullsized":"2024-04-16T16:17:57.498833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:00:54.269393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.493321+0000","last_change":"2024-04-16T16:17:56.518138+0000","last_active":"2024-04-16T16:17:57.493321+0000","last_peered":"2024-04-16T16:17:57.493321+0000","last_clean":"2024-04-16T16:17:57.493321+0000","last_became_active":"2024-04-16T16:17:56.517555+0000","last_became_peered":"2024-04-16T16:17:56.517555+0000","last_unstale":"2024-04-16T16:17:57.493321+0000","last_undegraded":"2024-04-16T16:17:57.493321+0000","last_fullsized":"2024-04-16T16:17:57.493321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:08:12.986654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516457+0000","last_change":"2024-04-16T16:17:55.498257+0000","last_active":"2024-04-16T16:17:57.516457+0000","last_peered":"2024-04-16T16:17:57.516457+0000","last_clean":"2024-04-16T16:17:57.516457+0000","last_became_active":"2024-04-16T16:17:55.497361+0000","last_became_peered":"2024-04-16T16:17:55.497361+0000","last_unstale":"2024-04-16T16:17:57.516457+0000","last_undegraded":"2024-04-16T16:17:57.516457+0000","last_fullsized":"2024-04-16T16:17:57.516457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498671+0000","last_change":"2024-04-16T16:17:56.518550+0000","last_active":"2024-04-16T16:17:57.498671+0000","last_peered":"2024-04-16T16:17:57.498671+0000","last_clean":"2024-04-16T16:17:57.498671+0000","last_became_active":"2024-04-16T16:17:56.512051+0000","last_became_peered":"2024-04-16T16:17:56.512051+0000","last_unstale":"2024-04-16T16:17:57.498671+0000","last_undegraded":"2024-04-16T16:17:57.498671+0000","last_fullsized":"2024-04-16T16:17:57.498671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:56.520798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492739+0000","last_change":"2024-04-16T16:17:55.501273+0000","last_active":"2024-04-16T16:17:57.492739+0000","last_peered":"2024-04-16T16:17:57.492739+0000","last_clean":"2024-04-16T16:17:57.492739+0000","last_became_active":"2024-04-16T16:17:55.499868+0000","last_became_peered":"2024-04-16T16:17:55.499868+0000","last_unstale":"2024-04-16T16:17:57.492739+0000","last_undegraded":"2024-04-16T16:17:57.492739+0000","last_fullsized":"2024-04-16T16:17:57.492739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:26.690513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153776+0000","last_change":"2024-04-16T16:17:56.509695+0000","last_active":"2024-04-16T16:17:58.153776+0000","last_peered":"2024-04-16T16:17:58.153776+0000","last_clean":"2024-04-16T16:17:58.153776+0000","last_became_active":"2024-04-16T16:17:56.509395+0000","last_became_peered":"2024-04-16T16:17:56.509395+0000","last_unstale":"2024-04-16T16:17:58.153776+0000","last_undegraded":"2024-04-16T16:17:58.153776+0000","last_fullsized":"2024-04-16T16:17:58.153776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:49.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492566+0000","last_change":"2024-04-16T16:17:55.494052+0000","last_active":"2024-04-16T16:17:57.492566+0000","last_peered":"2024-04-16T16:17:57.492566+0000","last_clean":"2024-04-16T16:17:57.492566+0000","last_became_active":"2024-04-16T16:17:55.491048+0000","last_became_peered":"2024-04-16T16:17:55.491048+0000","last_unstale":"2024-04-16T16:17:57.492566+0000","last_undegraded":"2024-04-16T16:17:57.492566+0000","last_fullsized":"2024-04-16T16:17:57.492566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:48.210032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499235+0000","last_change":"2024-04-16T16:17:56.492416+0000","last_active":"2024-04-16T16:17:57.499235+0000","last_peered":"2024-04-16T16:17:57.499235+0000","last_clean":"2024-04-16T16:17:57.499235+0000","last_became_active":"2024-04-16T16:17:56.491236+0000","last_became_peered":"2024-04-16T16:17:56.491236+0000","last_unstale":"2024-04-16T16:17:57.499235+0000","last_undegraded":"2024-04-16T16:17:57.499235+0000","last_fullsized":"2024-04-16T16:17:57.499235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:08:13.188909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517110+0000","last_change":"2024-04-16T16:17:55.497413+0000","last_active":"2024-04-16T16:17:57.517110+0000","last_peered":"2024-04-16T16:17:57.517110+0000","last_clean":"2024-04-16T16:17:57.517110+0000","last_became_active":"2024-04-16T16:17:55.497021+0000","last_became_peered":"2024-04-16T16:17:55.497021+0000","last_unstale":"2024-04-16T16:17:57.517110+0000","last_undegraded":"2024-04-16T16:17:57.517110+0000","last_fullsized":"2024-04-16T16:17:57.517110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:19.107096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155509+0000","last_change":"2024-04-16T16:17:56.492333+0000","last_active":"2024-04-16T16:17:58.155509+0000","last_peered":"2024-04-16T16:17:58.155509+0000","last_clean":"2024-04-16T16:17:58.155509+0000","last_became_active":"2024-04-16T16:17:56.492011+0000","last_became_peered":"2024-04-16T16:17:56.492011+0000","last_unstale":"2024-04-16T16:17:58.155509+0000","last_undegraded":"2024-04-16T16:17:58.155509+0000","last_fullsized":"2024-04-16T16:17:58.155509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:40.711440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499185+0000","last_change":"2024-04-16T16:17:55.497889+0000","last_active":"2024-04-16T16:17:57.499185+0000","last_peered":"2024-04-16T16:17:57.499185+0000","last_clean":"2024-04-16T16:17:57.499185+0000","last_became_active":"2024-04-16T16:17:55.495651+0000","last_became_peered":"2024-04-16T16:17:55.495651+0000","last_unstale":"2024-04-16T16:17:57.499185+0000","last_undegraded":"2024-04-16T16:17:57.499185+0000","last_fullsized":"2024-04-16T16:17:57.499185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516779+0000","last_change":"2024-04-16T16:17:56.513563+0000","last_active":"2024-04-16T16:17:57.516779+0000","last_peered":"2024-04-16T16:17:57.516779+0000","last_clean":"2024-04-16T16:17:57.516779+0000","last_became_active":"2024-04-16T16:17:56.511843+0000","last_became_peered":"2024-04-16T16:17:56.511843+0000","last_unstale":"2024-04-16T16:17:57.516779+0000","last_undegraded":"2024-04-16T16:17:57.516779+0000","last_fullsized":"2024-04-16T16:17:57.516779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:08:13.188909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498615+0000","last_change":"2024-04-16T16:17:55.490431+0000","last_active":"2024-04-16T16:17:57.498615+0000","last_peered":"2024-04-16T16:17:57.498615+0000","last_clean":"2024-04-16T16:17:57.498615+0000","last_became_active":"2024-04-16T16:17:55.487984+0000","last_became_peered":"2024-04-16T16:17:55.487984+0000","last_unstale":"2024-04-16T16:17:57.498615+0000","last_undegraded":"2024-04-16T16:17:57.498615+0000","last_fullsized":"2024-04-16T16:17:57.498615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153349+0000","last_change":"2024-04-16T16:17:56.505087+0000","last_active":"2024-04-16T16:17:58.153349+0000","last_peered":"2024-04-16T16:17:58.153349+0000","last_clean":"2024-04-16T16:17:58.153349+0000","last_became_active":"2024-04-16T16:17:56.504290+0000","last_became_peered":"2024-04-16T16:17:56.504290+0000","last_unstale":"2024-04-16T16:17:58.153349+0000","last_undegraded":"2024-04-16T16:17:58.153349+0000","last_fullsized":"2024-04-16T16:17:58.153349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:04.283344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499351+0000","last_change":"2024-04-16T16:17:55.501138+0000","last_active":"2024-04-16T16:17:57.499351+0000","last_peered":"2024-04-16T16:17:57.499351+0000","last_clean":"2024-04-16T16:17:57.499351+0000","last_became_active":"2024-04-16T16:17:55.500609+0000","last_became_peered":"2024-04-16T16:17:55.500609+0000","last_unstale":"2024-04-16T16:17:57.499351+0000","last_undegraded":"2024-04-16T16:17:57.499351+0000","last_fullsized":"2024-04-16T16:17:57.499351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:17.994231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152927+0000","last_change":"2024-04-16T16:17:56.495926+0000","last_active":"2024-04-16T16:17:58.152927+0000","last_peered":"2024-04-16T16:17:58.152927+0000","last_clean":"2024-04-16T16:17:58.152927+0000","last_became_active":"2024-04-16T16:17:56.495633+0000","last_became_peered":"2024-04-16T16:17:56.495633+0000","last_unstale":"2024-04-16T16:17:58.152927+0000","last_undegraded":"2024-04-16T16:17:58.152927+0000","last_fullsized":"2024-04-16T16:17:58.152927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:09.188268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510038+0000","last_change":"2024-04-16T16:17:55.489593+0000","last_active":"2024-04-16T16:17:57.510038+0000","last_peered":"2024-04-16T16:17:57.510038+0000","last_clean":"2024-04-16T16:17:57.510038+0000","last_became_active":"2024-04-16T16:17:55.489318+0000","last_became_peered":"2024-04-16T16:17:55.489318+0000","last_unstale":"2024-04-16T16:17:57.510038+0000","last_undegraded":"2024-04-16T16:17:57.510038+0000","last_fullsized":"2024-04-16T16:17:57.510038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:53.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153531+0000","last_change":"2024-04-16T16:17:56.500584+0000","last_active":"2024-04-16T16:17:58.153531+0000","last_peered":"2024-04-16T16:17:58.153531+0000","last_clean":"2024-04-16T16:17:58.153531+0000","last_became_active":"2024-04-16T16:17:56.500262+0000","last_became_peered":"2024-04-16T16:17:56.500262+0000","last_unstale":"2024-04-16T16:17:58.153531+0000","last_undegraded":"2024-04-16T16:17:58.153531+0000","last_fullsized":"2024-04-16T16:17:58.153531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:44:05.856075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154505+0000","last_change":"2024-04-16T16:17:55.500134+0000","last_active":"2024-04-16T16:17:58.154505+0000","last_peered":"2024-04-16T16:17:58.154505+0000","last_clean":"2024-04-16T16:17:58.154505+0000","last_became_active":"2024-04-16T16:17:55.499080+0000","last_became_peered":"2024-04-16T16:17:55.499080+0000","last_unstale":"2024-04-16T16:17:58.154505+0000","last_undegraded":"2024-04-16T16:17:58.154505+0000","last_fullsized":"2024-04-16T16:17:58.154505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153059+0000","last_change":"2024-04-16T16:17:56.506701+0000","last_active":"2024-04-16T16:17:58.153059+0000","last_peered":"2024-04-16T16:17:58.153059+0000","last_clean":"2024-04-16T16:17:58.153059+0000","last_became_active":"2024-04-16T16:17:56.505920+0000","last_became_peered":"2024-04-16T16:17:56.505920+0000","last_unstale":"2024-04-16T16:17:58.153059+0000","last_undegraded":"2024-04-16T16:17:58.153059+0000","last_fullsized":"2024-04-16T16:17:58.153059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:22.516152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497870+0000","last_change":"2024-04-16T16:17:55.499317+0000","last_active":"2024-04-16T16:17:57.497870+0000","last_peered":"2024-04-16T16:17:57.497870+0000","last_clean":"2024-04-16T16:17:57.497870+0000","last_became_active":"2024-04-16T16:17:55.498292+0000","last_became_peered":"2024-04-16T16:17:55.498292+0000","last_unstale":"2024-04-16T16:17:57.497870+0000","last_undegraded":"2024-04-16T16:17:57.497870+0000","last_fullsized":"2024-04-16T16:17:57.497870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:00.317630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497496+0000","last_change":"2024-04-16T16:17:56.503487+0000","last_active":"2024-04-16T16:17:57.497496+0000","last_peered":"2024-04-16T16:17:57.497496+0000","last_clean":"2024-04-16T16:17:57.497496+0000","last_became_active":"2024-04-16T16:17:56.502743+0000","last_became_peered":"2024-04-16T16:17:56.502743+0000","last_unstale":"2024-04-16T16:17:57.497496+0000","last_undegraded":"2024-04-16T16:17:57.497496+0000","last_fullsized":"2024-04-16T16:17:57.497496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:49.224066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.152554+0000","last_change":"2024-04-16T16:17:55.493997+0000","last_active":"2024-04-16T16:17:58.152554+0000","last_peered":"2024-04-16T16:17:58.152554+0000","last_clean":"2024-04-16T16:17:58.152554+0000","last_became_active":"2024-04-16T16:17:55.493555+0000","last_became_peered":"2024-04-16T16:17:55.493555+0000","last_unstale":"2024-04-16T16:17:58.152554+0000","last_undegraded":"2024-04-16T16:17:58.152554+0000","last_fullsized":"2024-04-16T16:17:58.152554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:17.623743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153069+0000","last_change":"2024-04-16T16:17:56.494968+0000","last_active":"2024-04-16T16:17:58.153069+0000","last_peered":"2024-04-16T16:17:58.153069+0000","last_clean":"2024-04-16T16:17:58.153069+0000","last_became_active":"2024-04-16T16:17:56.493121+0000","last_became_peered":"2024-04-16T16:17:56.493121+0000","last_unstale":"2024-04-16T16:17:58.153069+0000","last_undegraded":"2024-04-16T16:17:58.153069+0000","last_fullsized":"2024-04-16T16:17:58.153069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:29.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.517196+0000","last_change":"2024-04-16T16:17:55.493480+0000","last_active":"2024-04-16T16:17:57.517196+0000","last_peered":"2024-04-16T16:17:57.517196+0000","last_clean":"2024-04-16T16:17:57.517196+0000","last_became_active":"2024-04-16T16:17:55.493211+0000","last_became_peered":"2024-04-16T16:17:55.493211+0000","last_unstale":"2024-04-16T16:17:57.517196+0000","last_undegraded":"2024-04-16T16:17:57.517196+0000","last_fullsized":"2024-04-16T16:17:57.517196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:53.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.155902+0000","last_change":"2024-04-16T16:17:56.498460+0000","last_active":"2024-04-16T16:17:58.155902+0000","last_peered":"2024-04-16T16:17:58.155902+0000","last_clean":"2024-04-16T16:17:58.155902+0000","last_became_active":"2024-04-16T16:17:56.498154+0000","last_became_peered":"2024-04-16T16:17:56.498154+0000","last_unstale":"2024-04-16T16:17:58.155902+0000","last_undegraded":"2024-04-16T16:17:58.155902+0000","last_fullsized":"2024-04-16T16:17:58.155902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510947+0000","last_change":"2024-04-16T16:17:55.489803+0000","last_active":"2024-04-16T16:17:57.510947+0000","last_peered":"2024-04-16T16:17:57.510947+0000","last_clean":"2024-04-16T16:17:57.510947+0000","last_became_active":"2024-04-16T16:17:55.489449+0000","last_became_peered":"2024-04-16T16:17:55.489449+0000","last_unstale":"2024-04-16T16:17:57.510947+0000","last_undegraded":"2024-04-16T16:17:57.510947+0000","last_fullsized":"2024-04-16T16:17:57.510947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510538+0000","last_change":"2024-04-16T16:17:56.507757+0000","last_active":"2024-04-16T16:17:57.510538+0000","last_peered":"2024-04-16T16:17:57.510538+0000","last_clean":"2024-04-16T16:17:57.510538+0000","last_became_active":"2024-04-16T16:17:56.505997+0000","last_became_peered":"2024-04-16T16:17:56.505997+0000","last_unstale":"2024-04-16T16:17:57.510538+0000","last_undegraded":"2024-04-16T16:17:57.510538+0000","last_fullsized":"2024-04-16T16:17:57.510538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:47:14.641859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516844+0000","last_change":"2024-04-16T16:17:55.488048+0000","last_active":"2024-04-16T16:17:57.516844+0000","last_peered":"2024-04-16T16:17:57.516844+0000","last_clean":"2024-04-16T16:17:57.516844+0000","last_became_active":"2024-04-16T16:17:55.487453+0000","last_became_peered":"2024-04-16T16:17:55.487453+0000","last_unstale":"2024-04-16T16:17:57.516844+0000","last_undegraded":"2024-04-16T16:17:57.516844+0000","last_fullsized":"2024-04-16T16:17:57.516844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:47:28.481079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.154901+0000","last_change":"2024-04-16T16:17:56.497861+0000","last_active":"2024-04-16T16:17:58.154901+0000","last_peered":"2024-04-16T16:17:58.154901+0000","last_clean":"2024-04-16T16:17:58.154901+0000","last_became_active":"2024-04-16T16:17:56.496190+0000","last_became_peered":"2024-04-16T16:17:56.496190+0000","last_unstale":"2024-04-16T16:17:58.154901+0000","last_undegraded":"2024-04-16T16:17:58.154901+0000","last_fullsized":"2024-04-16T16:17:58.154901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.919969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510233+0000","last_change":"2024-04-16T16:17:55.497516+0000","last_active":"2024-04-16T16:17:57.510233+0000","last_peered":"2024-04-16T16:17:57.510233+0000","last_clean":"2024-04-16T16:17:57.510233+0000","last_became_active":"2024-04-16T16:17:55.497139+0000","last_became_peered":"2024-04-16T16:17:55.497139+0000","last_unstale":"2024-04-16T16:17:57.510233+0000","last_undegraded":"2024-04-16T16:17:57.510233+0000","last_fullsized":"2024-04-16T16:17:57.510233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.510147+0000","last_change":"2024-04-16T16:17:56.494896+0000","last_active":"2024-04-16T16:17:57.510147+0000","last_peered":"2024-04-16T16:17:57.510147+0000","last_clean":"2024-04-16T16:17:57.510147+0000","last_became_active":"2024-04-16T16:17:56.494613+0000","last_became_peered":"2024-04-16T16:17:56.494613+0000","last_unstale":"2024-04-16T16:17:57.510147+0000","last_undegraded":"2024-04-16T16:17:57.510147+0000","last_fullsized":"2024-04-16T16:17:57.510147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.516613+0000","last_change":"2024-04-16T16:17:55.491264+0000","last_active":"2024-04-16T16:17:57.516613+0000","last_peered":"2024-04-16T16:17:57.516613+0000","last_clean":"2024-04-16T16:17:57.516613+0000","last_became_active":"2024-04-16T16:17:55.490967+0000","last_became_peered":"2024-04-16T16:17:55.490967+0000","last_unstale":"2024-04-16T16:17:57.516613+0000","last_undegraded":"2024-04-16T16:17:57.516613+0000","last_fullsized":"2024-04-16T16:17:57.516613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:58:21.502118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492629+0000","last_change":"2024-04-16T16:17:56.524360+0000","last_active":"2024-04-16T16:17:57.492629+0000","last_peered":"2024-04-16T16:17:57.492629+0000","last_clean":"2024-04-16T16:17:57.492629+0000","last_became_active":"2024-04-16T16:17:56.522731+0000","last_became_peered":"2024-04-16T16:17:56.522731+0000","last_unstale":"2024-04-16T16:17:57.492629+0000","last_undegraded":"2024-04-16T16:17:57.492629+0000","last_fullsized":"2024-04-16T16:17:57.492629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:42.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498212+0000","last_change":"2024-04-16T16:17:55.495329+0000","last_active":"2024-04-16T16:17:57.498212+0000","last_peered":"2024-04-16T16:17:57.498212+0000","last_clean":"2024-04-16T16:17:57.498212+0000","last_became_active":"2024-04-16T16:17:55.494980+0000","last_became_peered":"2024-04-16T16:17:55.494980+0000","last_unstale":"2024-04-16T16:17:57.498212+0000","last_undegraded":"2024-04-16T16:17:57.498212+0000","last_fullsized":"2024-04-16T16:17:57.498212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:17.331783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.497710+0000","last_change":"2024-04-16T16:17:56.507046+0000","last_active":"2024-04-16T16:17:57.497710+0000","last_peered":"2024-04-16T16:17:57.497710+0000","last_clean":"2024-04-16T16:17:57.497710+0000","last_became_active":"2024-04-16T16:17:56.501609+0000","last_became_peered":"2024-04-16T16:17:56.501609+0000","last_unstale":"2024-04-16T16:17:57.497710+0000","last_undegraded":"2024-04-16T16:17:57.497710+0000","last_fullsized":"2024-04-16T16:17:57.497710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:27.704548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.492721+0000","last_change":"2024-04-16T16:17:55.500519+0000","last_active":"2024-04-16T16:17:57.492721+0000","last_peered":"2024-04-16T16:17:57.492721+0000","last_clean":"2024-04-16T16:17:57.492721+0000","last_became_active":"2024-04-16T16:17:55.499828+0000","last_became_peered":"2024-04-16T16:17:55.499828+0000","last_unstale":"2024-04-16T16:17:57.492721+0000","last_undegraded":"2024-04-16T16:17:57.492721+0000","last_fullsized":"2024-04-16T16:17:57.492721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:53.583412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.499987+0000","last_change":"2024-04-16T16:17:56.503025+0000","last_active":"2024-04-16T16:17:57.499987+0000","last_peered":"2024-04-16T16:17:57.499987+0000","last_clean":"2024-04-16T16:17:57.499987+0000","last_became_active":"2024-04-16T16:17:56.500552+0000","last_became_peered":"2024-04-16T16:17:56.500552+0000","last_unstale":"2024-04-16T16:17:57.499987+0000","last_undegraded":"2024-04-16T16:17:57.499987+0000","last_fullsized":"2024-04-16T16:17:57.499987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:55.443868+0000","last_clean_scrub_stamp":"2024-04-16T16:17:55.443868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:40.711440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:58.153781+0000","last_change":"2024-04-16T16:17:55.491794+0000","last_active":"2024-04-16T16:17:58.153781+0000","last_peered":"2024-04-16T16:17:58.153781+0000","last_clean":"2024-04-16T16:17:58.153781+0000","last_became_active":"2024-04-16T16:17:55.491411+0000","last_became_peered":"2024-04-16T16:17:55.491411+0000","last_unstale":"2024-04-16T16:17:58.153781+0000","last_undegraded":"2024-04-16T16:17:58.153781+0000","last_fullsized":"2024-04-16T16:17:58.153781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:17:54.429834+0000","last_clean_scrub_stamp":"2024-04-16T16:17:54.429834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:08.174233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T16:17:57.498833+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:17:57.498833+0000","last_peered":"2024-04-16T16:17:57.498833+0000","last_clean":"2024-04-16T16:17:57.498833+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:17:57.498833+0000","last_undegraded":"2024-04-16T16:17:57.498833+0000","last_fullsized":"2024-04-16T16:17:57.498833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":741737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":151349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":741647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:18:06.592 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T16:18:06.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T16:18:06.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.862+0000 7ff0d7200640 1 Processor -- start 2024-04-16T16:18:06.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.862+0000 7ff0d7200640 1 -- start start 2024-04-16T16:18:06.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.864+0000 7ff0d7200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0d815bc10 0x7ff0d80b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.864+0000 7ff0d7200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d815cd20 con 0x7ff0d8159240 2024-04-16T16:18:06.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.864+0000 7ff0d7200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d80b4490 con 0x7ff0d806e690 2024-04-16T16:18:06.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.864+0000 7ff0d7200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d8159620 con 0x7ff0d815bc10 2024-04-16T16:18:06.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.864+0000 7ff0d5e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff0d8159240 0x7ff0d806df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36846/0 (socket says 172.21.15.22:36846) 2024-04-16T16:18:06.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.864+0000 7ff0d5e00640 1 -- 172.21.15.22:0/1672319158 learned_addr learned my addr 172.21.15.22:0/1672319158 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:06.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d6800640 1 --2- 172.21.15.22:0/1672319158 >> v2:172.21.15.43:3300/0 conn(0x7ff0d815bc10 0x7ff0d80b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545885141 0 0) 0x7ff0d815cd20 con 0x7ff0d8159240 2024-04-16T16:18:06.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0bc003520 con 0x7ff0d8159240 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 200002656 0 0) 0x7ff0bc003520 con 0x7ff0d8159240 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 >> v2:172.21.15.43:3300/0 conn(0x7ff0d815bc10 msgr2=0x7ff0d80b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 --2- 172.21.15.22:0/1672319158 >> v2:172.21.15.43:3300/0 conn(0x7ff0d815bc10 0x7ff0d80b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 >> v1:172.21.15.43:6789/0 conn(0x7ff0d806e690 legacy=0x7ff0d8071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d80b4770 con 0x7ff0d8159240 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.865+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7ff0c80019f0 con 0x7ff0d8159240 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 >> v1:172.21.15.22:6789/0 conn(0x7ff0d8159240 legacy=0x7ff0d806df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5400640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0bc0039b0 0x7ff0bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5400640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0bc004800 0x7ff0bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5400640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8159620 con 0x7ff0bc0051c0 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc00c060 con 0x7ff0bc0039b0 2024-04-16T16:18:06.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc00c260 con 0x7ff0bc004800 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d6800640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.866+0000 7ff0d5e00640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0bc0039b0 0x7ff0bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.867+0000 7ff0cd400640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0bc004800 0x7ff0bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.867+0000 7ff0d6800640 1 -- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0bc004800 msgr2=0x7ff0bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.867+0000 7ff0d6800640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0bc004800 0x7ff0bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.867+0000 7ff0d6800640 1 -- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0bc0039b0 msgr2=0x7ff0bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.867+0000 7ff0d6800640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0bc0039b0 0x7ff0bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.867+0000 7ff0d6800640 1 -- 172.21.15.22:0/1672319158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc003520 con 0x7ff0bc0051c0 2024-04-16T16:18:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.867+0000 7ff0cd400640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0bc004800 0x7ff0bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.868+0000 7ff0d6800640 1 -- 172.21.15.22:0/1672319158 reap_dead start 2024-04-16T16:18:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.868+0000 7ff0d6800640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0bc00b9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009ac0 tx=0x7ff0bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efe19385c5c8b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.868+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0009690 con 0x7ff0bc0051c0 2024-04-16T16:18:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.868+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d0004020 con 0x7ff0bc0051c0 2024-04-16T16:18:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.868+0000 7ff0d5400640 1 -- 172.21.15.22:0/1672319158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00043d0 con 0x7ff0bc0051c0 2024-04-16T16:18:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.869+0000 7ff0d7200640 1 -- 172.21.15.22:0/1672319158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 msgr2=0x7ff0bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.869+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0bc00b9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009ac0 tx=0x7ff0bc005830 comp rx=0 tx=0).stop 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.869+0000 7ff0d7200640 1 -- 172.21.15.22:0/1672319158 shutdown_connections 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.869+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1672319158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0bc00b9c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.869+0000 7ff0d7200640 1 -- 172.21.15.22:0/1672319158 >> 172.21.15.22:0/1672319158 conn(0x7ff0d8062440 msgr2=0x7ff0d8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.869+0000 7ff0d7200640 1 -- 172.21.15.22:0/1672319158 shutdown_connections 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.869+0000 7ff0d7200640 1 -- 172.21.15.22:0/1672319158 wait complete. 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.871+0000 7ff0d7200640 1 Processor -- start 2024-04-16T16:18:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.871+0000 7ff0d7200640 1 -- start start 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0d81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0d80cf990 0x7ff0d8142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d8154ea0 0x7ff0d81e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d7200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d80b5010 con 0x7ff0bc0051c0 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d80b4d30 con 0x7ff0d8154ea0 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d80b3d70 con 0x7ff0d80cf990 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0d81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0d81584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39742/0 (socket says 172.21.15.22:39742) 2024-04-16T16:18:06.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d5e00640 1 -- 172.21.15.22:0/1845626586 learned_addr learned my addr 172.21.15.22:0/1845626586 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:06.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0cd400640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0d80cf990 0x7ff0d8142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d5e00640 1 -- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0d80cf990 msgr2=0x7ff0d8142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.872+0000 7ff0d6800640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d8154ea0 0x7ff0d81e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d5e00640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0d80cf990 0x7ff0d8142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d5e00640 1 -- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d8154ea0 msgr2=0x7ff0d81e82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d5e00640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d8154ea0 0x7ff0d81e82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d5e00640 1 -- 172.21.15.22:0/1845626586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d8155320 con 0x7ff0bc0051c0 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0cd400640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0d80cf990 0x7ff0d8142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d6800640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d8154ea0 0x7ff0d81e82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d5e00640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0d81584d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8007a10 tx=0x7ff0c800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0cea00640 1 -- 172.21.15.22:0/1845626586 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800ee50 con 0x7ff0bc0051c0 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0cea00640 1 -- 172.21.15.22:0/1845626586 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c8018070 con 0x7ff0bc0051c0 2024-04-16T16:18:06.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0cea00640 1 -- 172.21.15.22:0/1845626586 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8013660 con 0x7ff0bc0051c0 2024-04-16T16:18:06.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d8157710 con 0x7ff0bc0051c0 2024-04-16T16:18:06.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.873+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d8157cd0 con 0x7ff0bc0051c0 2024-04-16T16:18:06.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.875+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d8075f30 con 0x7ff0bc0051c0 2024-04-16T16:18:06.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.876+0000 7ff0cea00640 1 -- 172.21.15.22:0/1845626586 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0c8013800 con 0x7ff0bc0051c0 2024-04-16T16:18:06.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.877+0000 7ff0cea00640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff0b406ca90 0x7ff0b406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:06.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.877+0000 7ff0cea00640 1 -- 172.21.15.22:0/1845626586 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff0c808c240 con 0x7ff0bc0051c0 2024-04-16T16:18:06.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.877+0000 7ff0cd400640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff0b406ca90 0x7ff0b406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:06.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.878+0000 7ff0cd400640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff0b406ca90 0x7ff0b406ef50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8159f80 tx=0x7ff0c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:06.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:06.886+0000 7ff0cea00640 1 -- 172.21.15.22:0/1845626586 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0c805a700 con 0x7ff0bc0051c0 2024-04-16T16:18:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.165+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff0d80b3900 con 0x7ff0bc0051c0 2024-04-16T16:18:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.170+0000 7ff0cea00640 1 -- 172.21.15.22:0/1845626586 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7ff0c805a000 con 0x7ff0bc0051c0 2024-04-16T16:18:07.170 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-04-16T16:18:07.170 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw== 2024-04-16T16:18:07.170 INFO:teuthology.orchestra.run.smithi022.stdout: caps mds = "allow" 2024-04-16T16:18:07.170 INFO:teuthology.orchestra.run.smithi022.stdout: caps mon = "allow r" 2024-04-16T16:18:07.170 INFO:teuthology.orchestra.run.smithi022.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T16:18:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2024-04-16T16:18:07.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff0b406ca90 msgr2=0x7ff0b406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff0b406ca90 0x7ff0b406ef50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8159f80 tx=0x7ff0c0009040 comp rx=0 tx=0).stop 2024-04-16T16:18:07.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 msgr2=0x7ff0d81584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0d81584d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8007a10 tx=0x7ff0c800e530 comp rx=0 tx=0).stop 2024-04-16T16:18:07.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 shutdown_connections 2024-04-16T16:18:07.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff0b406ca90 0x7ff0b406ef50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d8154ea0 0x7ff0d81e82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0d80cf990 0x7ff0d8142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 --2- 172.21.15.22:0/1845626586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0bc0051c0 0x7ff0d81584d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 >> 172.21.15.22:0/1845626586 conn(0x7ff0d8062440 msgr2=0x7ff0d815a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:07.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 shutdown_connections 2024-04-16T16:18:07.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.173+0000 7ff0d7200640 1 -- 172.21.15.22:0/1845626586 wait complete. 2024-04-16T16:18:07.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:18:07.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.416+0000 7f94a1a00640 1 Processor -- start 2024-04-16T16:18:07.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.416+0000 7f94a1a00640 1 -- start start 2024-04-16T16:18:07.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.418+0000 7f94a1a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 0x7f949c167600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.418+0000 7f94a1a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c1606d0 con 0x7f949c06dc80 2024-04-16T16:18:07.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.418+0000 7f94a1a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c1609b0 con 0x7f949c0afd90 2024-04-16T16:18:07.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.418+0000 7f94a1a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f949c160480 con 0x7f949c0d0d10 2024-04-16T16:18:07.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.418+0000 7f9492000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f949c06dc80 0x7f949c0d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36856/0 (socket says 172.21.15.22:36856) 2024-04-16T16:18:07.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.418+0000 7f9492000640 1 -- 172.21.15.22:0/3702746575 learned_addr learned my addr 172.21.15.22:0/3702746575 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501604830 0 0) 0x7f949c1606d0 con 0x7f949c06dc80 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949b400640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 0x7f949c167600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9480003520 con 0x7f949c06dc80 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2634671003 0 0) 0x7f9480003520 con 0x7f949c06dc80 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 msgr2=0x7f949c167600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 0x7f949c167600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 >> v1:172.21.15.43:6789/0 conn(0x7f949c0afd90 legacy=0x7f949c072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c160c90 con 0x7f949c06dc80 2024-04-16T16:18:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f9484001670 con 0x7f949c06dc80 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 >> v1:172.21.15.22:6789/0 conn(0x7f949c06dc80 legacy=0x7f949c0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 0x7f94800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9480004010 0x7f9480004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9480004d40 0x7f94800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f949c160480 con 0x7f9480004d40 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f948000bc00 con 0x7f9480004010 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.419+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f948000be00 con 0x7f949c0d0d10 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f949b400640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9480004d40 0x7f94800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f9492000640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9480004010 0x7f9480004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f949aa00640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 0x7f94800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f949b400640 1 -- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 msgr2=0x7f94800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f949b400640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f949c0d0d10 0x7f94800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f949b400640 1 -- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9480004010 msgr2=0x7f9480004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f949b400640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9480004010 0x7f9480004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f949b400640 1 -- 172.21.15.22:0/3702746575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480003520 con 0x7f9480004d40 2024-04-16T16:18:07.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.420+0000 7f9492000640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9480004010 0x7f9480004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.421+0000 7f949b400640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9480004d40 0x7f94800051c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9494007360 tx=0x7f9480005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664248687a3818d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494039070 con 0x7f9480004d40 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949402ccd0 con 0x7f9480004d40 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f949a000640 1 -- 172.21.15.22:0/3702746575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494009be0 con 0x7f9480004d40 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f94a1a00640 1 -- 172.21.15.22:0/3702746575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9480004d40 msgr2=0x7f94800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f94a1a00640 1 --2- 172.21.15.22:0/3702746575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9480004d40 0x7f94800051c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9494007360 tx=0x7f9480005830 comp rx=0 tx=0).stop 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f949b400640 1 -- 172.21.15.22:0/3702746575 reap_dead start 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f94a1a00640 1 -- 172.21.15.22:0/3702746575 shutdown_connections 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f94a1a00640 1 -- 172.21.15.22:0/3702746575 >> 172.21.15.22:0/3702746575 conn(0x7f949c062440 msgr2=0x7f949c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f94a1a00640 1 -- 172.21.15.22:0/3702746575 shutdown_connections 2024-04-16T16:18:07.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.422+0000 7f94a1a00640 1 -- 172.21.15.22:0/3702746575 wait complete. 2024-04-16T16:18:07.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.424+0000 7f94a1a00640 1 Processor -- start 2024-04-16T16:18:07.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.424+0000 7f94a1a00640 1 -- start start 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.425+0000 7f94a1a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9480004d40 0x7f949c14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.425+0000 7f94a1a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f949c14cff0 0x7f949c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.425+0000 7f94a1a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f949c153690 0x7f949c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.425+0000 7f94a1a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f949c073220 con 0x7f949c14cff0 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.425+0000 7f94a1a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f949c0b0170 con 0x7f949c153690 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.425+0000 7f94a1a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f949c0ce8a0 con 0x7f9480004d40 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f949c14cff0 0x7f949c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f949c14cff0 0x7f949c14fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39750/0 (socket says 172.21.15.22:39750) 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 -- 172.21.15.22:0/1641940642 learned_addr learned my addr 172.21.15.22:0/1641940642 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f949b400640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f949c153690 0x7f949c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f949aa00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9480004d40 0x7f949c14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 -- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9480004d40 msgr2=0x7f949c14e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9480004d40 0x7f949c14e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 -- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f949c153690 msgr2=0x7f949c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f949c153690 0x7f949c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.426+0000 7f9492000640 1 -- 172.21.15.22:0/1641940642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c150790 con 0x7f949c14cff0 2024-04-16T16:18:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.427+0000 7f9492000640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f949c14cff0 0x7f949c14fe60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f948400e7f0 tx=0x7f948400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:07.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.427+0000 7f9493400640 1 -- 172.21.15.22:0/1641940642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948400eea0 con 0x7f949c14cff0 2024-04-16T16:18:07.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.427+0000 7f9493400640 1 -- 172.21.15.22:0/1641940642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9484018070 con 0x7f949c14cff0 2024-04-16T16:18:07.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.427+0000 7f9493400640 1 -- 172.21.15.22:0/1641940642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948400ca70 con 0x7f949c14cff0 2024-04-16T16:18:07.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.427+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949c150a70 con 0x7f949c14cff0 2024-04-16T16:18:07.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.427+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f949c14d450 con 0x7f949c14cff0 2024-04-16T16:18:07.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.428+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f949c0cdec0 con 0x7f949c14cff0 2024-04-16T16:18:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.429+0000 7f9493400640 1 -- 172.21.15.22:0/1641940642 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f948400cc10 con 0x7f949c14cff0 2024-04-16T16:18:07.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.431+0000 7f9493400640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f947806c920 0x7f947806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:07.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.431+0000 7f9493400640 1 -- 172.21.15.22:0/1641940642 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f948408b6d0 con 0x7f949c14cff0 2024-04-16T16:18:07.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.431+0000 7f949aa00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f947806c920 0x7f947806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:07.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.432+0000 7f949aa00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f947806c920 0x7f947806ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f948c007fd0 tx=0x7f948c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:07.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.435+0000 7f9493400640 1 -- 172.21.15.22:0/1641940642 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f949c0cdec0 con 0x7f949c14cff0 2024-04-16T16:18:07.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.687+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f949c04fd90 con 0x7f949c14cff0 2024-04-16T16:18:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.689+0000 7f9493400640 1 -- 172.21.15.22:0/1641940642 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5178 (secure 0 0 0) 0x7f9484059a60 con 0x7f949c14cff0 2024-04-16T16:18:07.689 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:18:07.689 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/2477236609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2477236609},{"type":"v1","addr":"172.21.15.43:6834","nonce":2477236609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2059330399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2059330399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2059330399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/4293003845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":4293003845},{"type":"v1","addr":"172.21.15.22:6837","nonce":4293003845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:17:55.963504+0000","modified":"2024-04-16T16:17:59.021268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6836/430366264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":430366264},{"type":"v1","addr":"172.21.15.22:6836","nonce":430366264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5118,"qdb_cluster":[5118]},"id":2}]} 2024-04-16T16:18:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 16 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.691+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f947806c920 msgr2=0x7f947806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.691+0000 7f94a1a00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f947806c920 0x7f947806ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f948c007fd0 tx=0x7f948c009040 comp rx=0 tx=0).stop 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.691+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f949c14cff0 msgr2=0x7f949c14fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.691+0000 7f94a1a00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f949c14cff0 0x7f949c14fe60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f948400e7f0 tx=0x7f948400ecb0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 shutdown_connections 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f947806c920 0x7f947806ede0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f949c153690 0x7f949c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f949c14cff0 0x7f949c14fe60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 --2- 172.21.15.22:0/1641940642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9480004d40 0x7f949c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 >> 172.21.15.22:0/1641940642 conn(0x7f949c062440 msgr2=0x7f949c159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 shutdown_connections 2024-04-16T16:18:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:07.692+0000 7f94a1a00640 1 -- 172.21.15.22:0/1641940642 wait complete. 2024-04-16T16:18:08.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T16:17:55.963504+0000', 'modified': '2024-04-16T16:17:59.021268+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5118}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5118': {'gid': 5118, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6836/430366264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6834', 'nonce': 430366264}, {'type': 'v1', 'addr': '172.21.15.22:6836', 'nonce': 430366264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5118, 'qdb_cluster': [5118]} 2024-04-16T16:18:08.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T16:18:08.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-16T16:18:08.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.347+0000 7f15f9c00640 1 Processor -- start 2024-04-16T16:18:08.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.347+0000 7f15f9c00640 1 -- start start 2024-04-16T16:18:08.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.349+0000 7f15f9c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15f40ba770 0x7f15f40cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.349+0000 7f15f9c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40cfcb0 0x7f15f40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.349+0000 7f15f9c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f4163070 con 0x7f15f415ec20 2024-04-16T16:18:08.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.349+0000 7f15f9c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f15f4163350 con 0x7f15f40ba770 2024-04-16T16:18:08.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.349+0000 7f15f9c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15f4163630 con 0x7f15f40cfcb0 2024-04-16T16:18:08.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.350+0000 7f15f2000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15f40ba770 0x7f15f40cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.350+0000 7f15f2000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15f40ba770 0x7f15f40cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:37352/0 (socket says 172.21.15.22:37352) 2024-04-16T16:18:08.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.350+0000 7f15f2000640 1 -- 172.21.15.22:0/3349568610 learned_addr learned my addr 172.21.15.22:0/3349568610 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.350+0000 7f15f3400640 1 --2- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40cfcb0 0x7f15f40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.350+0000 7f15f2000640 1 -- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40cfcb0 msgr2=0x7f15f40d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.350+0000 7f15f2000640 1 --2- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40cfcb0 0x7f15f40d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.351+0000 7f15f2000640 1 -- 172.21.15.22:0/3349568610 >> v1:172.21.15.43:6789/0 conn(0x7f15f415ec20 legacy=0x7f15f4162770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.351+0000 7f15f2000640 1 -- 172.21.15.22:0/3349568610 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40d2c10 con 0x7f15f40ba770 2024-04-16T16:18:08.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.352+0000 7f15f2000640 1 --2- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f40ba770 0x7f15f40cf770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009870 tx=0x7f15e002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c713248a598ad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.352+0000 7f15f1600640 1 -- 172.21.15.22:0/3349568610 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e002f840 con 0x7f15f40ba770 2024-04-16T16:18:08.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.352+0000 7f15f1600640 1 -- 172.21.15.22:0/3349568610 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e002f9e0 con 0x7f15f40ba770 2024-04-16T16:18:08.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.352+0000 7f15f1600640 1 -- 172.21.15.22:0/3349568610 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e002fdb0 con 0x7f15f40ba770 2024-04-16T16:18:08.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.353+0000 7f15f9c00640 1 -- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f40ba770 msgr2=0x7f15f40cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.353+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f40ba770 0x7f15f40cf770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009870 tx=0x7f15e002ba20 comp rx=0 tx=0).stop 2024-04-16T16:18:08.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.353+0000 7f15f9c00640 1 -- 172.21.15.22:0/3349568610 shutdown_connections 2024-04-16T16:18:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.353+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40cfcb0 0x7f15f40d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.353+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3349568610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f40ba770 0x7f15f40cf770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.353+0000 7f15f9c00640 1 -- 172.21.15.22:0/3349568610 >> 172.21.15.22:0/3349568610 conn(0x7f15f4062620 msgr2=0x7f15f4062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.353+0000 7f15f9c00640 1 -- 172.21.15.22:0/3349568610 shutdown_connections 2024-04-16T16:18:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.354+0000 7f15f9c00640 1 -- 172.21.15.22:0/3349568610 wait complete. 2024-04-16T16:18:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.356+0000 7f15f9c00640 1 Processor -- start 2024-04-16T16:18:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.356+0000 7f15f9c00640 1 -- start start 2024-04-16T16:18:08.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f9c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40ba770 0x7f15f415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f9c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15f40cfcb0 0x7f15f41f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f9c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f415ec20 0x7f15f41f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f9c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40d3950 con 0x7f15f40cfcb0 2024-04-16T16:18:08.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f9c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15f415f000 con 0x7f15f415ec20 2024-04-16T16:18:08.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f9c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15f40d3ad0 con 0x7f15f40ba770 2024-04-16T16:18:08.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15f40cfcb0 0x7f15f41f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15f40cfcb0 0x7f15f41f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39762/0 (socket says 172.21.15.22:39762) 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f2000640 1 -- 172.21.15.22:0/3090958613 learned_addr learned my addr 172.21.15.22:0/3090958613 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f2000640 1 -- 172.21.15.22:0/3090958613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40ba770 msgr2=0x7f15f415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f2000640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40ba770 0x7f15f415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f2000640 1 -- 172.21.15.22:0/3090958613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f415ec20 msgr2=0x7f15f41f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.358+0000 7f15f2000640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f415ec20 0x7f15f41f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.359+0000 7f15f2000640 1 -- 172.21.15.22:0/3090958613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f415f6f0 con 0x7f15f40cfcb0 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.359+0000 7f15f2000640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15f40cfcb0 0x7f15f41f3e00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f15e0000c00 tx=0x7f15e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.359+0000 7f15eaa00640 1 -- 172.21.15.22:0/3090958613 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0037bc0 con 0x7f15f40cfcb0 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.359+0000 7f15eaa00640 1 -- 172.21.15.22:0/3090958613 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e0046070 con 0x7f15f40cfcb0 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.359+0000 7f15eaa00640 1 -- 172.21.15.22:0/3090958613 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0041400 con 0x7f15f40cfcb0 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.359+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f415f9d0 con 0x7f15f40cfcb0 2024-04-16T16:18:08.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.359+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f4160270 con 0x7f15f40cfcb0 2024-04-16T16:18:08.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.362+0000 7f15eaa00640 1 -- 172.21.15.22:0/3090958613 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15e0040070 con 0x7f15f40cfcb0 2024-04-16T16:18:08.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.363+0000 7f15eaa00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15d406c8f0 0x7f15d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.363+0000 7f15eaa00640 1 -- 172.21.15.22:0/3090958613 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f15e00ae1b0 con 0x7f15f40cfcb0 2024-04-16T16:18:08.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.363+0000 7f15f2a00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15d406c8f0 0x7f15d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.363+0000 7f15fc846740 1 Processor -- start 2024-04-16T16:18:08.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.363+0000 7f15fc846740 1 -- start start 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.364+0000 7f15f2a00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15d406c8f0 0x7f15d406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15e40012e0 tx=0x7f15e4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.364+0000 7f15fc846740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d43ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.364+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d421240 0x55802d3f9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.364+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d3fa080 0x55802d3f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.364+0000 7f15fc846740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55802d3569c0 con 0x55802d420e60 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.364+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55802d2fd560 con 0x55802d3fa080 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.364+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55802d352980 con 0x55802d421240 2024-04-16T16:18:08.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d43ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d43ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39770/0 (socket says 172.21.15.22:39770) 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 -- 172.21.15.22:0/1337726573 learned_addr learned my addr 172.21.15.22:0/1337726573 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2000640 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d421240 0x55802d3f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f3400640 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d3fa080 0x55802d3f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 -- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d421240 msgr2=0x55802d3f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d421240 0x55802d3f9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 -- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d3fa080 msgr2=0x55802d3f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d3fa080 0x55802d3f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.365+0000 7f15f2a00640 1 -- 172.21.15.22:0/1337726573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802d0692d0 con 0x55802d420e60 2024-04-16T16:18:08.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.366+0000 7f15f2a00640 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d43ffa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15e400cb20 tx=0x7f15e400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba757d720540f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.366+0000 7f15df400640 1 -- 172.21.15.22:0/1337726573 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4016a00 con 0x55802d420e60 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.366+0000 7f15df400640 1 -- 172.21.15.22:0/1337726573 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e4016ba0 con 0x55802d420e60 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.366+0000 7f15df400640 1 -- 172.21.15.22:0/1337726573 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4003970 con 0x55802d420e60 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.366+0000 7f15fc846740 1 -- 172.21.15.22:0/1337726573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 msgr2=0x55802d43ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.366+0000 7f15fc846740 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d43ffa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15e400cb20 tx=0x7f15e400f000 comp rx=0 tx=0).stop 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 -- 172.21.15.22:0/1337726573 shutdown_connections 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d3fa080 0x55802d3f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d421240 0x55802d3f9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 --2- 172.21.15.22:0/1337726573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d43ffa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 -- 172.21.15.22:0/1337726573 >> 172.21.15.22:0/1337726573 conn(0x55802d3f6120 msgr2=0x55802d43eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 -- 172.21.15.22:0/1337726573 shutdown_connections 2024-04-16T16:18:08.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 -- 172.21.15.22:0/1337726573 wait complete. 2024-04-16T16:18:08.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.367+0000 7f15fc846740 1 -- start start 2024-04-16T16:18:08.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.368+0000 7f15fc846740 1 Processor -- start 2024-04-16T16:18:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d41c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d43c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15fc846740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d43d900 0x55802d43dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15fc846740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55802d3f3f50 con 0x55802d43d900 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55802d310920 con 0x55802d421240 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55802d3fa500 con 0x55802d420e60 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15fc846740 10 client.0 _ll_register_callbacks cb 0x55802d310310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15f3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d43d900 0x55802d43dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15f3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d43d900 0x55802d43dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39776/0 (socket says 172.21.15.22:39776) 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15f3400640 1 -- 172.21.15.22:0/2106011153 learned_addr learned my addr 172.21.15.22:0/2106011153 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15f2a00640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d41c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.369+0000 7f15f2000640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d43c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f3400640 1 -- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 msgr2=0x55802d41c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f3400640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d41c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f3400640 1 -- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 msgr2=0x55802d43c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f3400640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d43c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f3400640 1 -- 172.21.15.22:0/2106011153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802d1336b0 con 0x55802d43d900 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f2a00640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d41c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f2000640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d43c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15f3400640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d43d900 0x55802d43dd80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f15ec011290 tx=0x7f15ec011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a37e8b3303e8187 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15d3e00640 1 -- 172.21.15.22:0/2106011153 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec019070 con 0x55802d43d900 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15d3e00640 1 -- 172.21.15.22:0/2106011153 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f15ec015870 con 0x55802d43d900 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.370+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15e4016ba0 con 0x55802d43d900 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15d3e00640 1 -- 172.21.15.22:0/2106011153 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f15ec024050 con 0x55802d43d900 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 10 client.5328 fetch_fsmap learned FSMap version 16 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55802d4394e0 con 0x55802d43d900 2024-04-16T16:18:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15d3e00640 1 -- 172.21.15.22:0/2106011153 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e4016ba0 con 0x55802d43d900 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15d3e00640 1 -- 172.21.15.22:0/2106011153 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f15ec027020 con 0x55802d43d900 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 10 client.5328 fetch_fsmap finished waiting for FSMap version 16 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 10 client.5328 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 20 client.5328 populate_metadata read hostname 'smithi022' 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d452c50 0x55802d43a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 4 client.5328 mds_command: new command op to 5118 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 --> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55802d2fcb70 con 0x55802d452c50 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.371+0000 7f15f2a00640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d452c50 0x55802d43a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.372+0000 7f15f2a00640 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d452c50 0x55802d43a550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b2044d85aa499 server_cookie=70f458602fdc67db in_seq=0 out_seq=0 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.372+0000 7f15d3e00640 10 client.5328 ms_handle_connect on v2:172.21.15.22:6834/430366264 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15d3e00640 1 -- 172.21.15.22:0/2106011153 <== mds.0 v2:172.21.15.22:6834/430366264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55802d2fcb70 con 0x55802d452c50 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15d3e00640 10 client.5328 handle_command_reply: tid=0 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 client.5328 shutdown 2024-04-16T16:18:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d43d900 msgr2=0x55802d43dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d43d900 0x55802d43dd80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f15ec011290 tx=0x7f15ec011750 comp rx=0 tx=0).stop 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 shutdown_connections 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d452c50 0x55802d43a550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d43d900 0x55802d43dd80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d43c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 --2- 172.21.15.22:0/2106011153 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d41c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15d3e00640 0 client.5328 ms_handle_reset on v2:172.21.15.22:6834/430366264 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.373+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 >> 172.21.15.22:0/2106011153 conn(0x55802d3fa080 msgr2=0x55802d43ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.374+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 shutdown_connections 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.374+0000 7f15fc846740 1 -- 172.21.15.22:0/2106011153 wait complete. 2024-04-16T16:18:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.374+0000 7f15fc846740 20 client.5328 trim_cache size 0 max 16384 2024-04-16T16:18:08.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.394+0000 7f15fc846740 1 Processor -- start 2024-04-16T16:18:08.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.394+0000 7f15fc846740 1 -- start start 2024-04-16T16:18:08.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d4427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15fc846740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d421240 0x55802d41f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d43d900 0x55802d41fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15fc846740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15f406ef60 con 0x55802d421240 2024-04-16T16:18:08.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15f41f5440 con 0x55802d43d900 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15f41f5a90 con 0x55802d420e60 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d421240 0x55802d41f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d421240 0x55802d41f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39790/0 (socket says 172.21.15.22:39790) 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2000640 1 -- 172.21.15.22:0/3167148804 learned_addr learned my addr 172.21.15.22:0/3167148804 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2a00640 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d4427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2000640 1 -- 172.21.15.22:0/3167148804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 msgr2=0x55802d4427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2000640 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d4427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2000640 1 -- 172.21.15.22:0/3167148804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d43d900 msgr2=0x55802d41fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.395+0000 7f15f2000640 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d43d900 0x55802d41fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.396+0000 7f15f2000640 1 -- 172.21.15.22:0/3167148804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802d3e6c20 con 0x55802d421240 2024-04-16T16:18:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.396+0000 7f15f2000640 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d421240 0x55802d41f4e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f15e00ac6d0 tx=0x7f15e007ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97645a4c1d6ae30 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.396+0000 7f15dea00640 1 -- 172.21.15.22:0/3167148804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0094070 con 0x55802d421240 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.396+0000 7f15dea00640 1 -- 172.21.15.22:0/3167148804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e00aa020 con 0x55802d421240 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.396+0000 7f15dea00640 1 -- 172.21.15.22:0/3167148804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e007c5d0 con 0x55802d421240 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 -- 172.21.15.22:0/3167148804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d421240 msgr2=0x55802d41f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d421240 0x55802d41f4e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f15e00ac6d0 tx=0x7f15e007ba10 comp rx=0 tx=0).stop 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 -- 172.21.15.22:0/3167148804 shutdown_connections 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d43d900 0x55802d41fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d421240 0x55802d41f4e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 --2- 172.21.15.22:0/3167148804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d420e60 0x55802d4427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 -- 172.21.15.22:0/3167148804 >> 172.21.15.22:0/3167148804 conn(0x55802d3fa080 msgr2=0x55802d43dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 -- 172.21.15.22:0/3167148804 shutdown_connections 2024-04-16T16:18:08.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.397+0000 7f15fc846740 1 -- 172.21.15.22:0/3167148804 wait complete. 2024-04-16T16:18:08.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.398+0000 7f15fc846740 1 -- start start 2024-04-16T16:18:08.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.398+0000 7f15fc846740 1 Processor -- start 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15fc846740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d3f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d3f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15fc846740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d43d900 0x55802d4513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15fc846740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55802d452ad0 con 0x55802d420e60 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55802d439880 con 0x55802d421240 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15fc846740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55802d453120 con 0x55802d43d900 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15fc846740 10 client.0 _ll_register_callbacks cb 0x7f15ec009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d3f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d3f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39798/0 (socket says 172.21.15.22:39798) 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15f2a00640 1 -- 172.21.15.22:0/2521952394 learned_addr learned my addr 172.21.15.22:0/2521952394 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15f2a00640 1 -- 172.21.15.22:0/2521952394 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d43d900 msgr2=0x55802d4513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.399+0000 7f15f2a00640 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d43d900 0x55802d4513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15f2a00640 1 -- 172.21.15.22:0/2521952394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 msgr2=0x55802d3f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15f2a00640 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d3f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15f2a00640 1 -- 172.21.15.22:0/2521952394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802d3f9db0 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15f2a00640 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d3f7a10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f15e40015f0 tx=0x7f15e4001470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dc8ac78ac69c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15d3e00640 1 -- 172.21.15.22:0/2521952394 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e400c7e0 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15d3e00640 1 -- 172.21.15.22:0/2521952394 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f15e4006d60 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15e00aa020 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15d3e00640 1 -- 172.21.15.22:0/2521952394 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f15e4033050 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15fc846740 10 client.5334 fetch_fsmap learned FSMap version 16 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.400+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55802d44d720 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15d3e00640 1 -- 172.21.15.22:0/2521952394 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e00aa020 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15d3e00640 1 -- 172.21.15.22:0/2521952394 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f15e4003970 con 0x55802d420e60 2024-04-16T16:18:08.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15fc846740 10 client.5334 fetch_fsmap finished waiting for FSMap version 16 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15fc846740 10 client.5334 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15fc846740 20 client.5334 populate_metadata read hostname 'smithi022' 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15fc846740 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d4b9a40 0x55802d4b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15fc846740 4 client.5334 mds_command: new command op to 5118 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 --> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] -- command(tid 0: {"prefix": "status"}) -- 0x55802d3643e0 con 0x55802d4b9a40 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.401+0000 7f15f2000640 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d4b9a40 0x55802d4b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15f2000640 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d4b9a40 0x55802d4b9e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0733a0c7805ef4c server_cookie=1e43f1a6844c6e53 in_seq=0 out_seq=0 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15d3e00640 10 client.5334 ms_handle_connect on v2:172.21.15.22:6834/430366264 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15d3e00640 1 -- 172.21.15.22:0/2521952394 <== mds.0 v2:172.21.15.22:6834/430366264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55802d3643e0 con 0x55802d4b9a40 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15d3e00640 10 client.5334 handle_command_reply: tid=0 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 client.5334 shutdown 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 msgr2=0x55802d3f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d3f7a10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f15e40015f0 tx=0x7f15e4001470 comp rx=0 tx=0).stop 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 shutdown_connections 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:6834/430366264,v1:172.21.15.22:6836/430366264] conn(0x55802d4b9a40 0x55802d4b9e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55802d43d900 0x55802d4513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55802d421240 0x55802d3f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 --2- 172.21.15.22:0/2521952394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802d420e60 0x55802d3f7a10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15d3e00640 0 client.5334 ms_handle_reset on v2:172.21.15.22:6834/430366264 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 >> 172.21.15.22:0/2521952394 conn(0x55802d3fa080 msgr2=0x55802d43dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 shutdown_connections 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.402+0000 7f15fc846740 1 -- 172.21.15.22:0/2521952394 wait complete. 2024-04-16T16:18:08.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15fc846740 20 client.5334 trim_cache size 0 max 16384 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf", 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5118, 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 11.91660134, 2024-04-16T16:18:08.407 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 16, 2024-04-16T16:18:08.408 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 34, 2024-04-16T16:18:08.408 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 34, 2024-04-16T16:18:08.408 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 21.039536639000001 2024-04-16T16:18:08.408 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15d406c8f0 msgr2=0x7f15d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15d406c8f0 0x7f15d406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15e40012e0 tx=0x7f15e4007d30 comp rx=0 tx=0).stop 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15f40cfcb0 msgr2=0x7f15f41f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15f40cfcb0 0x7f15f41f3e00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f15e0000c00 tx=0x7f15e0004730 comp rx=0 tx=0).stop 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 shutdown_connections 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15d406c8f0 0x7f15d406edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f415ec20 0x7f15f41f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15f40cfcb0 0x7f15f41f3e00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 --2- 172.21.15.22:0/3090958613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15f40ba770 0x7f15f415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.403+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 >> 172.21.15.22:0/3090958613 conn(0x7f15f4062620 msgr2=0x7f15f40b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.404+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 shutdown_connections 2024-04-16T16:18:08.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.404+0000 7f15f9c00640 1 -- 172.21.15.22:0/3090958613 wait complete. 2024-04-16T16:18:08.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:18:08.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.631+0000 7f4d74a00640 1 Processor -- start 2024-04-16T16:18:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.632+0000 7f4d74a00640 1 -- start start 2024-04-16T16:18:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.633+0000 7f4d74a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4d70163590 0x7f4d70164750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.633+0000 7f4d74a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d700d0670 0x7f4d700d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.633+0000 7f4d74a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700b01c0 con 0x7f4d700afde0 2024-04-16T16:18:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.633+0000 7f4d74a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700d1020 con 0x7f4d700d0670 2024-04-16T16:18:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.633+0000 7f4d74a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700b3790 con 0x7f4d70163590 2024-04-16T16:18:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d6e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d700d0670 0x7f4d700d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d6e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d700d0670 0x7f4d700d0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39808/0 (socket says 172.21.15.22:39808) 2024-04-16T16:18:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d6e800640 1 -- 172.21.15.22:0/1014407490 learned_addr learned my addr 172.21.15.22:0/1014407490 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d65400640 1 --2- 172.21.15.22:0/1014407490 >> v2:172.21.15.43:3300/0 conn(0x7f4d70163590 0x7f4d70164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d6e800640 1 -- 172.21.15.22:0/1014407490 >> v2:172.21.15.43:3300/0 conn(0x7f4d70163590 msgr2=0x7f4d70164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d6e800640 1 --2- 172.21.15.22:0/1014407490 >> v2:172.21.15.43:3300/0 conn(0x7f4d70163590 0x7f4d70164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d6e800640 1 -- 172.21.15.22:0/1014407490 >> v1:172.21.15.43:6789/0 conn(0x7f4d700afde0 legacy=0x7f4d700b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.634+0000 7f4d6e800640 1 -- 172.21.15.22:0/1014407490 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70163b00 con 0x7f4d700d0670 2024-04-16T16:18:08.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.636+0000 7f4d6e800640 1 --2- 172.21.15.22:0/1014407490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d700d0ae0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4d700631a0 tx=0x7f4d6802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc20f077dcc9130 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.636+0000 7f4d6d400640 1 -- 172.21.15.22:0/1014407490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6802ca80 con 0x7f4d700d0670 2024-04-16T16:18:08.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.636+0000 7f4d6d400640 1 -- 172.21.15.22:0/1014407490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6802cc20 con 0x7f4d700d0670 2024-04-16T16:18:08.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.636+0000 7f4d6d400640 1 -- 172.21.15.22:0/1014407490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d680343f0 con 0x7f4d700d0670 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 -- 172.21.15.22:0/1014407490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 msgr2=0x7f4d700d0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1014407490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d700d0ae0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4d700631a0 tx=0x7f4d6802bee0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 -- 172.21.15.22:0/1014407490 shutdown_connections 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1014407490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d700d0ae0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1014407490 >> v2:172.21.15.43:3300/0 conn(0x7f4d70163590 0x7f4d70164750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 -- 172.21.15.22:0/1014407490 >> 172.21.15.22:0/1014407490 conn(0x7f4d70062440 msgr2=0x7f4d70062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 -- 172.21.15.22:0/1014407490 shutdown_connections 2024-04-16T16:18:08.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.637+0000 7f4d74a00640 1 -- 172.21.15.22:0/1014407490 wait complete. 2024-04-16T16:18:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.639+0000 7f4d74a00640 1 Processor -- start 2024-04-16T16:18:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.639+0000 7f4d74a00640 1 -- start start 2024-04-16T16:18:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d74a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d700afde0 0x7f4d70150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d74a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d701fc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d74a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d70163590 0x7f4d701fc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d74a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701643a0 con 0x7f4d700d0670 2024-04-16T16:18:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d74a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701640c0 con 0x7f4d700afde0 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d74a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700b3c00 con 0x7f4d70163590 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d701fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d701fc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39812/0 (socket says 172.21.15.22:39812) 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 -- 172.21.15.22:0/1754337580 learned_addr learned my addr 172.21.15.22:0/1754337580 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d6de00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d700afde0 0x7f4d70150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 -- 172.21.15.22:0/1754337580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d70163590 msgr2=0x7f4d701fc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d70163590 0x7f4d701fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 -- 172.21.15.22:0/1754337580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d700afde0 msgr2=0x7f4d70150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d700afde0 0x7f4d70150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.640+0000 7f4d65400640 1 -- 172.21.15.22:0/1754337580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70159a70 con 0x7f4d700d0670 2024-04-16T16:18:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.641+0000 7f4d65400640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d701fc200 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800d5f0 tx=0x7f4d5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.641+0000 7f4d66a00640 1 -- 172.21.15.22:0/1754337580 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d580125f0 con 0x7f4d700d0670 2024-04-16T16:18:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.641+0000 7f4d66a00640 1 -- 172.21.15.22:0/1754337580 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d58019070 con 0x7f4d700d0670 2024-04-16T16:18:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.641+0000 7f4d66a00640 1 -- 172.21.15.22:0/1754337580 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d580129d0 con 0x7f4d700d0670 2024-04-16T16:18:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.641+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d701fcd70 con 0x7f4d700d0670 2024-04-16T16:18:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.641+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7015b510 con 0x7f4d700d0670 2024-04-16T16:18:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.642+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d700726c0 con 0x7f4d700d0670 2024-04-16T16:18:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.644+0000 7f4d66a00640 1 -- 172.21.15.22:0/1754337580 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d58012b70 con 0x7f4d700d0670 2024-04-16T16:18:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.644+0000 7f4d66a00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d4c06c8f0 0x7f4d4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.645+0000 7f4d66a00640 1 -- 172.21.15.22:0/1754337580 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4d5808be40 con 0x7f4d700d0670 2024-04-16T16:18:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.645+0000 7f4d6de00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d4c06c8f0 0x7f4d4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.645+0000 7f4d6de00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d4c06c8f0 0x7f4d4c06edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d60003d90 tx=0x7f4d60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:08.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.649+0000 7f4d66a00640 1 -- 172.21.15.22:0/1754337580 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d700726c0 con 0x7f4d700d0670 2024-04-16T16:18:08.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.899+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4d70163100 con 0x7f4d700d0670 2024-04-16T16:18:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.900+0000 7f4d66a00640 1 -- 172.21.15.22:0/1754337580 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f4d5805a260 con 0x7f4d700d0670 2024-04-16T16:18:08.900 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:18:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d4c06c8f0 msgr2=0x7f4d4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d4c06c8f0 0x7f4d4c06edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d60003d90 tx=0x7f4d60009040 comp rx=0 tx=0).stop 2024-04-16T16:18:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 msgr2=0x7f4d701fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d701fc200 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800d5f0 tx=0x7f4d5800dab0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 shutdown_connections 2024-04-16T16:18:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d4c06c8f0 0x7f4d4c06edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d70163590 0x7f4d701fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700d0670 0x7f4d701fc200 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 --2- 172.21.15.22:0/1754337580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d700afde0 0x7f4d70150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 >> 172.21.15.22:0/1754337580 conn(0x7f4d70062440 msgr2=0x7f4d70164fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 shutdown_connections 2024-04-16T16:18:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:08.903+0000 7f4d74a00640 1 -- 172.21.15.22:0/1754337580 wait complete. 2024-04-16T16:18:08.921 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-16T16:18:08.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:18:08.921 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-04-16T16:18:08.922 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T16:18:08.922 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T16:18:08.922 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-16T16:18:08.922 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-16T16:18:08.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:18:08.922 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:18:08.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:08.922 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-04-16T16:18:08.976 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:18:08.976 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:18:08.976 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:18:08.976 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:08.976 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-04-16T16:18:08.976 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:08.976 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42520sec preferred_lft 42520sec 2024-04-16T16:18:08.977 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ae:a4:6d:e3:ed:65 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::d864:8ff:fe17:e583/64 scope link 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:08.978 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ba:9d:95:17:f0:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::b89d:95ff:fe17:f073/64 scope link 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ae:a4:6d:e3:ed:65 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::aca4:6dff:fee3:ed65/64 scope link 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:08.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:08.979 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:18:09.072 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-04-16T16:18:09.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:09.077 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-04-16T16:18:09.134 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-04-16T16:18:09.134 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:18:09.134 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:18:09.134 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:18:09.135 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:18:09.137 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:18:09.137 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:18:09.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:18:09.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:18:09.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:18:09.137 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:18:09.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:18:09.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:18:09.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:09.400 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:18:09.450 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T16:18:09.450 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-16T16:18:09.450 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:18:09.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:09.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-04-16T16:18:09.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:18:09.540 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T16:18:09.597 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:18:09.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:18:09.597 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T16:18:09.652 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:18:09.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:09.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:18:09.799 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:18:09.799 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:18:09.799 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:18:09.822 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:18:09.822 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:18:09.822 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:18:09.822 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:18:09.822 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:18:09.848 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:18:09.848 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:18:09.848 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:18:09.849 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:18:09.849 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:18:09.849 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:18:09.849 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:18:09.849 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:18:09.852 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-16T16:18:09.852 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:18:09.852 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:18:09.852 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:18:09.852 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:18:09.856 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:18:09.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:09.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T16:18:09.936 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:18:10.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:18:10.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:18:10.079 INFO:teuthology.orchestra.run.smithi022.stdout:client4858 2024-04-16T16:18:10.080 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:10.080 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:10.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:18:10.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.360+0000 7f2735200640 1 Processor -- start 2024-04-16T16:18:10.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.360+0000 7f2735200640 1 -- start start 2024-04-16T16:18:10.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.362+0000 7f2735200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f273006dc80 0x7f27300d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.362+0000 7f2735200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27301606d0 con 0x7f27300d0b40 2024-04-16T16:18:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.362+0000 7f2735200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27301609b0 con 0x7f27300afd90 2024-04-16T16:18:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.362+0000 7f2735200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2730160480 con 0x7f273006dc80 2024-04-16T16:18:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.362+0000 7f272e800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f27300d0b40 0x7f273015ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40784/0 (socket says 172.21.15.22:40784) 2024-04-16T16:18:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.362+0000 7f272e800640 1 -- 172.21.15.22:0/1616800796 learned_addr learned my addr 172.21.15.22:0/1616800796 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272d400640 1 --2- 172.21.15.22:0/1616800796 >> v2:172.21.15.43:3300/0 conn(0x7f273006dc80 0x7f27300d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026212588 0 0) 0x7f27301606d0 con 0x7f27300d0b40 2024-04-16T16:18:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2714003520 con 0x7f27300d0b40 2024-04-16T16:18:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1849338252 0 0) 0x7f2714003520 con 0x7f27300d0b40 2024-04-16T16:18:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 >> v2:172.21.15.43:3300/0 conn(0x7f273006dc80 msgr2=0x7f27300d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 --2- 172.21.15.22:0/1616800796 >> v2:172.21.15.43:3300/0 conn(0x7f273006dc80 0x7f27300d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 >> v1:172.21.15.43:6789/0 conn(0x7f27300afd90 legacy=0x7f2730072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2730160c90 con 0x7f27300d0b40 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f27280019f0 con 0x7f27300d0b40 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 >> v1:172.21.15.22:6789/0 conn(0x7f27300d0b40 legacy=0x7f273015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27140052e0 0x7f271400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2730160480 con 0x7f27140052e0 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f271400c1b0 con 0x7f27140039b0 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.363+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f271400c3b0 con 0x7f2714004800 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272e800640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27140052e0 0x7f271400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272de00640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272d400640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272e800640 1 -- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2714004800 msgr2=0x7f2714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272e800640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272e800640 1 -- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140039b0 msgr2=0x7f2714003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272e800640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.364+0000 7f272e800640 1 -- 172.21.15.22:0/1616800796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2714003520 con 0x7f27140052e0 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.365+0000 7f272e800640 1 -- 172.21.15.22:0/1616800796 reap_dead start 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.365+0000 7f272e800640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27140052e0 0x7f271400b9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f272800a830 tx=0x7f2714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15da73439a213414 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272800a480 con 0x7f27140052e0 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2728034630 con 0x7f27140052e0 2024-04-16T16:18:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f272ca00640 1 -- 172.21.15.22:0/1616800796 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728034a00 con 0x7f27140052e0 2024-04-16T16:18:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f2735200640 1 -- 172.21.15.22:0/1616800796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27140052e0 msgr2=0x7f271400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f2735200640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27140052e0 0x7f271400b9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f272800a830 tx=0x7f2714005830 comp rx=0 tx=0).stop 2024-04-16T16:18:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f2735200640 1 -- 172.21.15.22:0/1616800796 shutdown_connections 2024-04-16T16:18:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f2735200640 1 --2- 172.21.15.22:0/1616800796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27140052e0 0x7f271400b9c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f2735200640 1 -- 172.21.15.22:0/1616800796 >> 172.21.15.22:0/1616800796 conn(0x7f2730062440 msgr2=0x7f2730062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.366+0000 7f2735200640 1 -- 172.21.15.22:0/1616800796 shutdown_connections 2024-04-16T16:18:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.367+0000 7f2735200640 1 -- 172.21.15.22:0/1616800796 wait complete. 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.368+0000 7f2735200640 1 Processor -- start 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.368+0000 7f2735200640 1 -- start start 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.369+0000 7f2735200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140052e0 0x7f27301515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.369+0000 7f2735200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f273013ae10 0x7f27300b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.369+0000 7f2735200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27300b4670 0x7f2730158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.369+0000 7f2735200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27300b0170 con 0x7f27300b4670 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.369+0000 7f2735200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f27300d0ff0 con 0x7f27140052e0 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.369+0000 7f2735200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f27300ce8a0 con 0x7f273013ae10 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27300b4670 0x7f2730158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27300b4670 0x7f2730158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46514/0 (socket says 172.21.15.22:46514) 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 -- 172.21.15.22:0/2356925451 learned_addr learned my addr 172.21.15.22:0/2356925451 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272d400640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f273013ae10 0x7f27300b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272de00640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140052e0 0x7f27301515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 -- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f273013ae10 msgr2=0x7f27300b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f273013ae10 0x7f27300b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 -- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140052e0 msgr2=0x7f27301515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140052e0 0x7f27301515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.370+0000 7f272e800640 1 -- 172.21.15.22:0/2356925451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2730153040 con 0x7f27300b4670 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.371+0000 7f272e800640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27300b4670 0x7f2730158cd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f272800a950 tx=0x7f2730160b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.371+0000 7f2726000640 1 -- 172.21.15.22:0/2356925451 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728039040 con 0x7f27300b4670 2024-04-16T16:18:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.371+0000 7f2726000640 1 -- 172.21.15.22:0/2356925451 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2728043070 con 0x7f27300b4670 2024-04-16T16:18:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.371+0000 7f2726000640 1 -- 172.21.15.22:0/2356925451 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272800a480 con 0x7f27300b4670 2024-04-16T16:18:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.371+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27300b4b70 con 0x7f27300b4670 2024-04-16T16:18:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.371+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27300b5130 con 0x7f27300b4670 2024-04-16T16:18:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.372+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2730153210 con 0x7f27300b4670 2024-04-16T16:18:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.374+0000 7f2726000640 1 -- 172.21.15.22:0/2356925451 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2728034630 con 0x7f27300b4670 2024-04-16T16:18:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.374+0000 7f2726000640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f271006c8f0 0x7f271006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.375+0000 7f2726000640 1 -- 172.21.15.22:0/2356925451 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f27280ad970 con 0x7f27300b4670 2024-04-16T16:18:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.375+0000 7f272de00640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f271006c8f0 0x7f271006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.375+0000 7f272de00640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f271006c8f0 0x7f271006edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2720005490 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:10.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.380+0000 7f2726000640 1 -- 172.21.15.22:0/2356925451 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f272807bd00 con 0x7f27300b4670 2024-04-16T16:18:10.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.630+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f273004fd90 con 0x7f27300b4670 2024-04-16T16:18:10.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.631+0000 7f2726000640 1 -- 172.21.15.22:0/2356925451 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f272807b600 con 0x7f27300b4670 2024-04-16T16:18:10.631 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:18:10.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f271006c8f0 msgr2=0x7f271006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:10.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f271006c8f0 0x7f271006edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2720005490 tx=0x7f2720009040 comp rx=0 tx=0).stop 2024-04-16T16:18:10.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27300b4670 msgr2=0x7f2730158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:10.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27300b4670 0x7f2730158cd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f272800a950 tx=0x7f2730160b80 comp rx=0 tx=0).stop 2024-04-16T16:18:10.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 shutdown_connections 2024-04-16T16:18:10.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f271006c8f0 0x7f271006edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27300b4670 0x7f2730158cd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f273013ae10 0x7f27300b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 --2- 172.21.15.22:0/2356925451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27140052e0 0x7f27301515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:10.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 >> 172.21.15.22:0/2356925451 conn(0x7f2730062440 msgr2=0x7f27300d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:10.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 shutdown_connections 2024-04-16T16:18:10.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:10.634+0000 7f2735200640 1 -- 172.21.15.22:0/2356925451 wait complete. 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:18:10.656 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:18:10.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:10.657 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-16T16:18:10.717 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:10.718 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42524sec preferred_lft 42524sec 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:18:10.719 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 36:10:94:e1:22:8d brd ff:ff:ff:ff:ff:ff 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::b4ad:c9ff:fedb:4436/64 scope link 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether ce:17:27:11:48:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::cc17:27ff:fe11:48db/64 scope link 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 36:10:94:e1:22:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::3410:94ff:fee1:228d/64 scope link 2024-04-16T16:18:10.720 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:18:10.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:10.721 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:18:10.814 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-16T16:18:10.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:10.819 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-16T16:18:10.876 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-16T16:18:10.876 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:18:10.876 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:18:10.876 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:18:10.876 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:18:10.877 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:18:10.877 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:18:10.877 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:18:10.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:18:10.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:18:10.878 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:18:10.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:18:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:18:11.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:18:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:18:11.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:11.141 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:18:11.192 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T16:18:11.192 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-16T16:18:11.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:18:11.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:11.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-16T16:18:11.290 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:18:11.291 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T16:18:11.349 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:18:11.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:18:11.349 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T16:18:11.403 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:18:11.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:11.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:18:11.558 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:18:11.559 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:18:11.559 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:18:11.581 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:18:11.581 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:18:11.581 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:18:11.581 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:18:11.581 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:18:11.615 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:18:11.618 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-16T16:18:11.618 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:18:11.618 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:18:11.618 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:18:11.618 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:18:11.622 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:18:11.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:11.622 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T16:18:11.714 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:18:11.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:18:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:18:11.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:18:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:18:11.842 INFO:teuthology.orchestra.run.smithi043.stdout:client4870 2024-04-16T16:18:11.842 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:18:11.842 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:11.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-16T16:18:12.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.133+0000 7f70a5800640 1 Processor -- start 2024-04-16T16:18:12.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.133+0000 7f70a5800640 1 -- start start 2024-04-16T16:18:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f70a5800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f70a0072e30 0x7f70a006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f70a5800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 0x7f70a00ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f70a5800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a006cf80 con 0x7f70a015c6e0 2024-04-16T16:18:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f70a5800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f70a006d260 con 0x7f70a0072e30 2024-04-16T16:18:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f70a5800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f70a006d540 con 0x7f70a00af930 2024-04-16T16:18:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f709fe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f70a015c6e0 0x7f70a0072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40790/0 (socket says 172.21.15.22:40790) 2024-04-16T16:18:12.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f709fe00640 1 -- 172.21.15.22:0/924937671 learned_addr learned my addr 172.21.15.22:0/924937671 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.135+0000 7f7097e00640 1 --2- 172.21.15.22:0/924937671 >> v2:172.21.15.43:3300/0 conn(0x7f70a0072e30 0x7f70a006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f70a4e00640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 0x7f70a00ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034499620 0 0) 0x7f70a006cf80 con 0x7f70a015c6e0 2024-04-16T16:18:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7084003520 con 0x7f70a015c6e0 2024-04-16T16:18:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 15102417 0 0) 0x7f7084003520 con 0x7f70a015c6e0 2024-04-16T16:18:12.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 msgr2=0x7f70a00ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 0x7f70a00ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 >> v2:172.21.15.43:3300/0 conn(0x7f70a0072e30 msgr2=0x7f70a006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 --2- 172.21.15.22:0/924937671 >> v2:172.21.15.43:3300/0 conn(0x7f70a0072e30 0x7f70a006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a006d820 con 0x7f70a015c6e0 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f7090001670 con 0x7f70a015c6e0 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 >> v1:172.21.15.22:6789/0 conn(0x7f70a015c6e0 legacy=0x7f70a0072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70840039b0 0x7f7084003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 0x7f7084004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7084004d40 0x7f70840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70a006d260 con 0x7f7084004d40 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f70a006d540 con 0x7f70840039b0 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.136+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f708400fdd0 con 0x7f70a00af930 2024-04-16T16:18:12.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f70a4e00640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7084004d40 0x7f70840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f709fe00640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70840039b0 0x7f7084003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f7097e00640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 0x7f7084004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f70a4e00640 1 -- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 msgr2=0x7f7084004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f70a4e00640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70a00af930 0x7f7084004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f70a4e00640 1 -- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70840039b0 msgr2=0x7f7084003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f70a4e00640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70840039b0 0x7f7084003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.137+0000 7f70a4e00640 1 -- 172.21.15.22:0/924937671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7084003520 con 0x7f7084004d40 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.138+0000 7f70a4e00640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7084004d40 0x7f70840051c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7098009fc0 tx=0x7f7084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8081125d3228d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.139+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098039070 con 0x7f7084004d40 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.139+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f709802cc20 con 0x7f7084004d40 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.139+0000 7f709f400640 1 -- 172.21.15.22:0/924937671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098009c10 con 0x7f7084004d40 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.139+0000 7f70a5800640 1 -- 172.21.15.22:0/924937671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7084004d40 msgr2=0x7f70840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.139+0000 7f70a5800640 1 --2- 172.21.15.22:0/924937671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7084004d40 0x7f70840051c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7098009fc0 tx=0x7f7084005830 comp rx=0 tx=0).stop 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.139+0000 7f70a4e00640 1 -- 172.21.15.22:0/924937671 reap_dead start 2024-04-16T16:18:12.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.139+0000 7f70a5800640 1 -- 172.21.15.22:0/924937671 shutdown_connections 2024-04-16T16:18:12.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.140+0000 7f70a5800640 1 -- 172.21.15.22:0/924937671 >> 172.21.15.22:0/924937671 conn(0x7f70a0062440 msgr2=0x7f70a0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:12.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.140+0000 7f70a5800640 1 -- 172.21.15.22:0/924937671 shutdown_connections 2024-04-16T16:18:12.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.140+0000 7f70a5800640 1 -- 172.21.15.22:0/924937671 wait complete. 2024-04-16T16:18:12.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.141+0000 7f70a5800640 1 Processor -- start 2024-04-16T16:18:12.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.142+0000 7f70a5800640 1 -- start start 2024-04-16T16:18:12.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.142+0000 7f70a5800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7084004d40 0x7f70a0157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.142+0000 7f70a5800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a014a150 0x7f70a00b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f70a5800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70a0149b90 0x7f70a01f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f70a5800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70a015cc40 con 0x7f70a014a150 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f70a5800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f70a015cac0 con 0x7f70a0149b90 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f70a5800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f70a00ce530 con 0x7f7084004d40 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a014a150 0x7f70a00b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a014a150 0x7f70a00b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46522/0 (socket says 172.21.15.22:46522) 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 -- 172.21.15.22:0/3932347031 learned_addr learned my addr 172.21.15.22:0/3932347031 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f709fe00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7084004d40 0x7f70a0157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f70a4e00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70a0149b90 0x7f70a01f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 -- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7084004d40 msgr2=0x7f70a0157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7084004d40 0x7f70a0157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 -- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70a0149b90 msgr2=0x7f70a01f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70a0149b90 0x7f70a01f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.143+0000 7f7097e00640 1 -- 172.21.15.22:0/3932347031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a01563a0 con 0x7f70a014a150 2024-04-16T16:18:12.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.144+0000 7f7097e00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a014a150 0x7f70a00b0d30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70880116d0 tx=0x7f7088011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:12.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.144+0000 7f709cc00640 1 -- 172.21.15.22:0/3932347031 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708800f9c0 con 0x7f70a014a150 2024-04-16T16:18:12.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.144+0000 7f709cc00640 1 -- 172.21.15.22:0/3932347031 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708800fb60 con 0x7f70a014a150 2024-04-16T16:18:12.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.144+0000 7f709cc00640 1 -- 172.21.15.22:0/3932347031 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088015460 con 0x7f70a014a150 2024-04-16T16:18:12.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.144+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a0156680 con 0x7f70a014a150 2024-04-16T16:18:12.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.144+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a0156c40 con 0x7f70a014a150 2024-04-16T16:18:12.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.146+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a0075f30 con 0x7f70a014a150 2024-04-16T16:18:12.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.147+0000 7f709cc00640 1 -- 172.21.15.22:0/3932347031 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7088015600 con 0x7f70a014a150 2024-04-16T16:18:12.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.148+0000 7f709cc00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f707c06c8f0 0x7f707c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.148+0000 7f709cc00640 1 -- 172.21.15.22:0/3932347031 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f708808c560 con 0x7f70a014a150 2024-04-16T16:18:12.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.148+0000 7f709fe00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f707c06c8f0 0x7f707c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.149+0000 7f709fe00640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f707c06c8f0 0x7f707c06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7090007d90 tx=0x7f7090009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:12.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.153+0000 7f709cc00640 1 -- 172.21.15.22:0/3932347031 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7088019030 con 0x7f70a014a150 2024-04-16T16:18:12.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.398+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f70a0063230 con 0x7f70a014a150 2024-04-16T16:18:12.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.594+0000 7f709cc00640 1 -- 172.21.15.22:0/3932347031 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) ==== 136+0+0 (secure 0 0 0) 0x7f708805a990 con 0x7f70a014a150 2024-04-16T16:18:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f707c06c8f0 msgr2=0x7f707c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f707c06c8f0 0x7f707c06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7090007d90 tx=0x7f7090009040 comp rx=0 tx=0).stop 2024-04-16T16:18:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a014a150 msgr2=0x7f70a00b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a014a150 0x7f70a00b0d30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70880116d0 tx=0x7f7088011b90 comp rx=0 tx=0).stop 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 shutdown_connections 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f707c06c8f0 0x7f707c06edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70a0149b90 0x7f70a01f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a014a150 0x7f70a00b0d30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 --2- 172.21.15.22:0/3932347031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7084004d40 0x7f70a0157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.598+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 >> 172.21.15.22:0/3932347031 conn(0x7f70a0062440 msgr2=0x7f70a0159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.599+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 shutdown_connections 2024-04-16T16:18:12.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.599+0000 7f70a5800640 1 -- 172.21.15.22:0/3932347031 wait complete. 2024-04-16T16:18:12.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-16T16:18:12.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.847+0000 7fa529a00640 1 Processor -- start 2024-04-16T16:18:12.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.847+0000 7fa529a00640 1 -- start start 2024-04-16T16:18:12.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.849+0000 7fa529a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa5240d09a0 0x7fa5240ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.849+0000 7fa529a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa52415cd90 0x7fa5240cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.849+0000 7fa529a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa52415d300 con 0x7fa52415a240 2024-04-16T16:18:12.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.849+0000 7fa529a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa52415d5e0 con 0x7fa52415cd90 2024-04-16T16:18:12.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.849+0000 7fa529a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa52415d8c0 con 0x7fa5240d09a0 2024-04-16T16:18:12.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa529000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa52415cd90 0x7fa5240cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa523400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa5240d09a0 0x7fa5240ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa529000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa52415cd90 0x7fa5240cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46526/0 (socket says 172.21.15.22:46526) 2024-04-16T16:18:12.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa529000640 1 -- 172.21.15.22:0/2335089693 learned_addr learned my addr 172.21.15.22:0/2335089693 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:12.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa529000640 1 -- 172.21.15.22:0/2335089693 >> v2:172.21.15.43:3300/0 conn(0x7fa5240d09a0 msgr2=0x7fa5240ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:12.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa529000640 1 --2- 172.21.15.22:0/2335089693 >> v2:172.21.15.43:3300/0 conn(0x7fa5240d09a0 0x7fa5240ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa529000640 1 -- 172.21.15.22:0/2335089693 >> v1:172.21.15.43:6789/0 conn(0x7fa52415a240 legacy=0x7fa5240d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.850+0000 7fa529000640 1 -- 172.21.15.22:0/2335089693 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52415dba0 con 0x7fa52415cd90 2024-04-16T16:18:12.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.852+0000 7fa529000640 1 --2- 172.21.15.22:0/2335089693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5240cedd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa5240b5a60 tx=0x7fa51c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bb54d1a28e6623 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:12.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.852+0000 7fa522a00640 1 -- 172.21.15.22:0/2335089693 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c02ca80 con 0x7fa52415cd90 2024-04-16T16:18:12.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.852+0000 7fa522a00640 1 -- 172.21.15.22:0/2335089693 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c02cc20 con 0x7fa52415cd90 2024-04-16T16:18:12.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.852+0000 7fa522a00640 1 -- 172.21.15.22:0/2335089693 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0343f0 con 0x7fa52415cd90 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 -- 172.21.15.22:0/2335089693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 msgr2=0x7fa5240cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 --2- 172.21.15.22:0/2335089693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5240cedd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa5240b5a60 tx=0x7fa51c02bee0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 -- 172.21.15.22:0/2335089693 shutdown_connections 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 --2- 172.21.15.22:0/2335089693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5240cedd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 --2- 172.21.15.22:0/2335089693 >> v2:172.21.15.43:3300/0 conn(0x7fa5240d09a0 0x7fa5240ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 -- 172.21.15.22:0/2335089693 >> 172.21.15.22:0/2335089693 conn(0x7fa524075070 msgr2=0x7fa524062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 -- 172.21.15.22:0/2335089693 shutdown_connections 2024-04-16T16:18:12.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.853+0000 7fa529a00640 1 -- 172.21.15.22:0/2335089693 wait complete. 2024-04-16T16:18:12.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.855+0000 7fa529a00640 1 Processor -- start 2024-04-16T16:18:12.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.855+0000 7fa529a00640 1 -- start start 2024-04-16T16:18:12.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.856+0000 7fa529a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5240d09a0 0x7fa524140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.856+0000 7fa529a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52415a240 0x7fa5241f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.856+0000 7fa529a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5241435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.856+0000 7fa529a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa524073120 con 0x7fa52415cd90 2024-04-16T16:18:12.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.856+0000 7fa529a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa524072fa0 con 0x7fa52415a240 2024-04-16T16:18:12.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.856+0000 7fa529a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa52415a620 con 0x7fa5240d09a0 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5241435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5241435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46540/0 (socket says 172.21.15.22:46540) 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 -- 172.21.15.22:0/595954636 learned_addr learned my addr 172.21.15.22:0/595954636 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa523e00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5240d09a0 0x7fa524140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa523400640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52415a240 0x7fa5241f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 -- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5240d09a0 msgr2=0x7fa524140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5240d09a0 0x7fa524140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 -- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52415a240 msgr2=0x7fa5241f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52415a240 0x7fa5241f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa529000640 1 -- 172.21.15.22:0/595954636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5241f46b0 con 0x7fa52415cd90 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.857+0000 7fa523400640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52415a240 0x7fa5241f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:12.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.858+0000 7fa529000640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5241435f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa51c02c4f0 tx=0x7fa51c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:12.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.858+0000 7fa51be00640 1 -- 172.21.15.22:0/595954636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c043020 con 0x7fa52415cd90 2024-04-16T16:18:12.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.858+0000 7fa51be00640 1 -- 172.21.15.22:0/595954636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c03e450 con 0x7fa52415cd90 2024-04-16T16:18:12.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.858+0000 7fa51be00640 1 -- 172.21.15.22:0/595954636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c009510 con 0x7fa52415cd90 2024-04-16T16:18:12.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.858+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa524144100 con 0x7fa52415cd90 2024-04-16T16:18:12.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.858+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5241f3970 con 0x7fa52415cd90 2024-04-16T16:18:12.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.859+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5241f3760 con 0x7fa52415cd90 2024-04-16T16:18:12.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.861+0000 7fa51be00640 1 -- 172.21.15.22:0/595954636 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa51c046020 con 0x7fa52415cd90 2024-04-16T16:18:12.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.862+0000 7fa51be00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa50406c8f0 0x7fa50406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:12.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.862+0000 7fa51be00640 1 -- 172.21.15.22:0/595954636 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa51c0ae2c0 con 0x7fa52415cd90 2024-04-16T16:18:12.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.862+0000 7fa523e00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa50406c8f0 0x7fa50406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:12.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.863+0000 7fa523e00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa50406c8f0 0x7fa50406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa514001640 tx=0x7fa514009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:12.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:12.867+0000 7fa51be00640 1 -- 172.21.15.22:0/595954636 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa51c04d030 con 0x7fa52415cd90 2024-04-16T16:18:13.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.099+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fa52415bda0 con 0x7fa50406c8f0 2024-04-16T16:18:13.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.101+0000 7fa51be00640 1 -- 172.21.15.22:0/595954636 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fa52415bda0 con 0x7fa50406c8f0 2024-04-16T16:18:13.101 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-04-16T16:18:13.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:18:13.101 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2024-04-16T16:18:13.101 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:13.101 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-04-16T16:18:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa50406c8f0 msgr2=0x7fa50406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa50406c8f0 0x7fa50406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa514001640 tx=0x7fa514009040 comp rx=0 tx=0).stop 2024-04-16T16:18:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 msgr2=0x7fa5241435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5241435f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa51c02c4f0 tx=0x7fa51c004a40 comp rx=0 tx=0).stop 2024-04-16T16:18:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 shutdown_connections 2024-04-16T16:18:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa50406c8f0 0x7fa50406edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa52415cd90 0x7fa5241435f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa52415a240 0x7fa5241f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 --2- 172.21.15.22:0/595954636 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5240d09a0 0x7fa524140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 >> 172.21.15.22:0/595954636 conn(0x7fa524075070 msgr2=0x7fa524062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 shutdown_connections 2024-04-16T16:18:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.104+0000 7fa529a00640 1 -- 172.21.15.22:0/595954636 wait complete. 2024-04-16T16:18:13.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T16:18:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.341+0000 7f2be6200640 1 Processor -- start 2024-04-16T16:18:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.341+0000 7f2be6200640 1 -- start start 2024-04-16T16:18:13.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2be6200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2be015c8d0 0x7f2be015db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2be6200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be0073420 con 0x7f2be00b2b30 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2be6200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be0073140 con 0x7f2be00727a0 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2be6200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2be015d080 con 0x7f2be015c8d0 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2bdf400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2be015c8d0 0x7f2be015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2bdf400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2be015c8d0 0x7f2be015db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46548/0 (socket says 172.21.15.22:46548) 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2bdf400640 1 -- 172.21.15.22:0/2030641407 learned_addr learned my addr 172.21.15.22:0/2030641407 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.343+0000 7f2bdfe00640 1 --1- 172.21.15.22:0/2030641407 >> v1:172.21.15.22:6789/0 conn(0x7f2be00b2b30 0x7f2be0071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40798/0 (socket says 172.21.15.22:40798) 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.344+0000 7f2bdf400640 1 -- 172.21.15.22:0/2030641407 >> v1:172.21.15.43:6789/0 conn(0x7f2be00727a0 legacy=0x7f2be00b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.344+0000 7f2bdf400640 1 -- 172.21.15.22:0/2030641407 >> v1:172.21.15.22:6789/0 conn(0x7f2be00b2b30 legacy=0x7f2be0071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.344+0000 7f2bdf400640 1 -- 172.21.15.22:0/2030641407 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be015d360 con 0x7f2be015c8d0 2024-04-16T16:18:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.345+0000 7f2bdf400640 1 --2- 172.21.15.22:0/2030641407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be015db60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009870 tx=0x7f2bd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f777917bb96356 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:13.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.345+0000 7f2bde000640 1 -- 172.21.15.22:0/2030641407 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0034070 con 0x7f2be015c8d0 2024-04-16T16:18:13.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.345+0000 7f2bde000640 1 -- 172.21.15.22:0/2030641407 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd0030860 con 0x7f2be015c8d0 2024-04-16T16:18:13.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.345+0000 7f2bde000640 1 -- 172.21.15.22:0/2030641407 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0030c30 con 0x7f2be015c8d0 2024-04-16T16:18:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.346+0000 7f2be6200640 1 -- 172.21.15.22:0/2030641407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 msgr2=0x7f2be015db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.346+0000 7f2be6200640 1 --2- 172.21.15.22:0/2030641407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be015db60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009870 tx=0x7f2bd002b9a0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.346+0000 7f2be6200640 1 -- 172.21.15.22:0/2030641407 shutdown_connections 2024-04-16T16:18:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.346+0000 7f2be6200640 1 --2- 172.21.15.22:0/2030641407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be015db60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.346+0000 7f2be6200640 1 -- 172.21.15.22:0/2030641407 >> 172.21.15.22:0/2030641407 conn(0x7f2be0062440 msgr2=0x7f2be0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.346+0000 7f2be6200640 1 -- 172.21.15.22:0/2030641407 shutdown_connections 2024-04-16T16:18:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.346+0000 7f2be6200640 1 -- 172.21.15.22:0/2030641407 wait complete. 2024-04-16T16:18:13.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.348+0000 7f2be6200640 1 Processor -- start 2024-04-16T16:18:13.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.348+0000 7f2be6200640 1 -- start start 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.349+0000 7f2be6200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2be00727a0 0x7f2be0149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.349+0000 7f2be6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be00b2b30 0x7f2be0148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2be6200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be0147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2be6200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2be015ce30 con 0x7f2be015c8d0 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2be6200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2be015ccb0 con 0x7f2be00b2b30 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2be6200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2be00d0310 con 0x7f2be00727a0 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be0147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be0147850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46556/0 (socket says 172.21.15.22:46556) 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 -- 172.21.15.22:0/2764137996 learned_addr learned my addr 172.21.15.22:0/2764137996 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdf400640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2be00727a0 0x7f2be0149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdea00640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be00b2b30 0x7f2be0148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 -- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2be00727a0 msgr2=0x7f2be0149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2be00727a0 0x7f2be0149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 -- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be00b2b30 msgr2=0x7f2be0148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be00b2b30 0x7f2be0148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdfe00640 1 -- 172.21.15.22:0/2764137996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be014a0b0 con 0x7f2be015c8d0 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.350+0000 7f2bdea00640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be00b2b30 0x7f2be0148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.351+0000 7f2bdfe00640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be0147850 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800c780 tx=0x7f2bd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.351+0000 7f2bd7400640 1 -- 172.21.15.22:0/2764137996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8017070 con 0x7f2be015c8d0 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.351+0000 7f2bd7400640 1 -- 172.21.15.22:0/2764137996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd800a640 con 0x7f2be015c8d0 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.351+0000 7f2bd7400640 1 -- 172.21.15.22:0/2764137996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800aa30 con 0x7f2be015c8d0 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.351+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be0148ad0 con 0x7f2be015c8d0 2024-04-16T16:18:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.351+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be0149090 con 0x7f2be015c8d0 2024-04-16T16:18:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.352+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be004fd90 con 0x7f2be015c8d0 2024-04-16T16:18:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.353+0000 7f2bd7400640 1 -- 172.21.15.22:0/2764137996 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bd801a070 con 0x7f2be015c8d0 2024-04-16T16:18:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.354+0000 7f2bd7400640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2bc006c920 0x7f2bc006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.354+0000 7f2bd7400640 1 -- 172.21.15.22:0/2764137996 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2bd808b080 con 0x7f2be015c8d0 2024-04-16T16:18:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.355+0000 7f2bdf400640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2bc006c920 0x7f2bc006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.356+0000 7f2bdf400640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2bc006c920 0x7f2bc006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0036000 tx=0x7f2bd003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:13.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.359+0000 7f2bd7400640 1 -- 172.21.15.22:0/2764137996 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bd8058e50 con 0x7f2be015c8d0 2024-04-16T16:18:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.570+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2be01497f0 con 0x7f2be015c8d0 2024-04-16T16:18:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.571+0000 7f2bd7400640 1 -- 172.21.15.22:0/2764137996 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f2bd805d150 con 0x7f2be015c8d0 2024-04-16T16:18:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2bc006c920 msgr2=0x7f2bc006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2bc006c920 0x7f2bc006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0036000 tx=0x7f2bd003b040 comp rx=0 tx=0).stop 2024-04-16T16:18:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 msgr2=0x7f2be0147850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be0147850 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800c780 tx=0x7f2bd800cc40 comp rx=0 tx=0).stop 2024-04-16T16:18:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 shutdown_connections 2024-04-16T16:18:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2bc006c920 0x7f2bc006ede0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2be015c8d0 0x7f2be0147850 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be00b2b30 0x7f2be0148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 --2- 172.21.15.22:0/2764137996 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2be00727a0 0x7f2be0149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 >> 172.21.15.22:0/2764137996 conn(0x7f2be0062440 msgr2=0x7f2be0159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 shutdown_connections 2024-04-16T16:18:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.574+0000 7f2be6200640 1 -- 172.21.15.22:0/2764137996 wait complete. 2024-04-16T16:18:13.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol25090 --mode=777 2024-04-16T16:18:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.823+0000 7f929f200640 1 Processor -- start 2024-04-16T16:18:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.823+0000 7f929f200640 1 -- start start 2024-04-16T16:18:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.824+0000 7f929f200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f92a00b6640 0x7f92a00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.824+0000 7f929f200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92a00b3b80 0x7f92a00d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.824+0000 7f929f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b6a20 0x7f92a00b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.824+0000 7f929f200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f92a00d3d20 con 0x7f92a00b3b80 2024-04-16T16:18:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.824+0000 7f929f200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f92a00cfee0 con 0x7f92a00b6640 2024-04-16T16:18:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.824+0000 7f929f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f92a00cfc00 con 0x7f92a00b6a20 2024-04-16T16:18:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92a00b3b80 0x7f92a00d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92a00b3b80 0x7f92a00d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46558/0 (socket says 172.21.15.22:46558) 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 -- 172.21.15.22:0/3810334057 learned_addr learned my addr 172.21.15.22:0/3810334057 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f929de00640 1 --2- 172.21.15.22:0/3810334057 >> v2:172.21.15.43:3300/0 conn(0x7f92a00b6640 0x7f92a00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f929e800640 1 --2- 172.21.15.22:0/3810334057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b6a20 0x7f92a00b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 -- 172.21.15.22:0/3810334057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b6a20 msgr2=0x7f92a00b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 --2- 172.21.15.22:0/3810334057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b6a20 0x7f92a00b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 -- 172.21.15.22:0/3810334057 >> v2:172.21.15.43:3300/0 conn(0x7f92a00b6640 msgr2=0x7f92a00cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 --2- 172.21.15.22:0/3810334057 >> v2:172.21.15.43:3300/0 conn(0x7f92a00b6640 0x7f92a00cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.825+0000 7f9297e00640 1 -- 172.21.15.22:0/3810334057 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a00d36d0 con 0x7f92a00b3b80 2024-04-16T16:18:13.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.827+0000 7f9297e00640 1 --2- 172.21.15.22:0/3810334057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b3b80 0x7f92a00d41b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f92a00725c0 tx=0x7f928802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15ef7d1de46dbd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:13.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.827+0000 7f929d400640 1 -- 172.21.15.22:0/3810334057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288035020 con 0x7f92a00b3b80 2024-04-16T16:18:13.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.827+0000 7f929d400640 1 -- 172.21.15.22:0/3810334057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9288031870 con 0x7f92a00b3b80 2024-04-16T16:18:13.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.827+0000 7f929d400640 1 -- 172.21.15.22:0/3810334057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288031c40 con 0x7f92a00b3b80 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 -- 172.21.15.22:0/3810334057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b3b80 msgr2=0x7f92a00d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 --2- 172.21.15.22:0/3810334057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b3b80 0x7f92a00d41b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f92a00725c0 tx=0x7f928802b910 comp rx=0 tx=0).stop 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 -- 172.21.15.22:0/3810334057 shutdown_connections 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 --2- 172.21.15.22:0/3810334057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b6a20 0x7f92a00b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 --2- 172.21.15.22:0/3810334057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b3b80 0x7f92a00d41b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 --2- 172.21.15.22:0/3810334057 >> v2:172.21.15.43:3300/0 conn(0x7f92a00b6640 0x7f92a00cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 -- 172.21.15.22:0/3810334057 >> 172.21.15.22:0/3810334057 conn(0x7f92a0062620 msgr2=0x7f92a0062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 -- 172.21.15.22:0/3810334057 shutdown_connections 2024-04-16T16:18:13.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.828+0000 7f929f200640 1 -- 172.21.15.22:0/3810334057 wait complete. 2024-04-16T16:18:13.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.830+0000 7f929f200640 1 Processor -- start 2024-04-16T16:18:13.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.830+0000 7f929f200640 1 -- start start 2024-04-16T16:18:13.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b3b80 0x7f92a01e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a00b6640 0x7f92a00b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b6a20 0x7f92a014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92a00b6eb0 con 0x7f92a00b6a20 2024-04-16T16:18:13.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92a00cf890 con 0x7f92a00b6640 2024-04-16T16:18:13.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f92a00b7f30 con 0x7f92a00b3b80 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b6a20 0x7f92a014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b6a20 0x7f92a014d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46572/0 (socket says 172.21.15.22:46572) 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929e800640 1 -- 172.21.15.22:0/1643577741 learned_addr learned my addr 172.21.15.22:0/1643577741 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f929de00640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b3b80 0x7f92a01e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.831+0000 7f9297e00640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a00b6640 0x7f92a00b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929e800640 1 -- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b3b80 msgr2=0x7f92a01e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929e800640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b3b80 0x7f92a01e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929e800640 1 -- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a00b6640 msgr2=0x7f92a00b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929e800640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a00b6640 0x7f92a00b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929e800640 1 -- 172.21.15.22:0/1643577741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a014eb90 con 0x7f92a00b6a20 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929e800640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b6a20 0x7f92a014d7c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9298007e40 tx=0x7f929800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f9296000640 1 -- 172.21.15.22:0/1643577741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298014620 con 0x7f92a00b6a20 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f9296000640 1 -- 172.21.15.22:0/1643577741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9298019070 con 0x7f92a00b6a20 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f9296000640 1 -- 172.21.15.22:0/1643577741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298014a20 con 0x7f92a00b6a20 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a014ee70 con 0x7f92a00b6a20 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.832+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a014f430 con 0x7f92a00b6a20 2024-04-16T16:18:13.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.834+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a0075f30 con 0x7f92a00b6a20 2024-04-16T16:18:13.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.835+0000 7f9296000640 1 -- 172.21.15.22:0/1643577741 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9298014bc0 con 0x7f92a00b6a20 2024-04-16T16:18:13.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.835+0000 7f9296000640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f927c06c8f0 0x7f927c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:13.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.836+0000 7f9296000640 1 -- 172.21.15.22:0/1643577741 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f929808c430 con 0x7f92a00b6a20 2024-04-16T16:18:13.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.836+0000 7f929de00640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f927c06c8f0 0x7f927c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:13.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.837+0000 7f929de00640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f927c06c8f0 0x7f927c06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9290006fd0 tx=0x7f9290008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:13.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:13.840+0000 7f9296000640 1 -- 172.21.15.22:0/1643577741 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9298011260 con 0x7f92a00b6a20 2024-04-16T16:18:14.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.074+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol25090", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f92a00cf670 con 0x7f927c06c8f0 2024-04-16T16:18:14.083 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:14.083+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:14.083 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:14.083+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:14.083 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:14.083+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:14.083 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:14.083+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:14.083 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:14.083+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:14.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.123+0000 7f9296000640 1 -- 172.21.15.22:0/1643577741 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f92a00cf670 con 0x7f927c06c8f0 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f927c06c8f0 msgr2=0x7f927c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f927c06c8f0 0x7f927c06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9290006fd0 tx=0x7f9290008040 comp rx=0 tx=0).stop 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b6a20 msgr2=0x7f92a014d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b6a20 0x7f92a014d7c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9298007e40 tx=0x7f929800e4b0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 shutdown_connections 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f927c06c8f0 0x7f927c06edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92a00b6a20 0x7f92a014d7c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a00b6640 0x7f92a00b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 --2- 172.21.15.22:0/1643577741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92a00b3b80 0x7f92a01e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 >> 172.21.15.22:0/1643577741 conn(0x7f92a0062620 msgr2=0x7f92a00b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 shutdown_connections 2024-04-16T16:18:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.126+0000 7f929f200640 1 -- 172.21.15.22:0/1643577741 wait complete. 2024-04-16T16:18:14.144 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol25090 2024-04-16T16:18:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.355+0000 7facbbe00640 1 Processor -- start 2024-04-16T16:18:14.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.356+0000 7facbbe00640 1 -- start start 2024-04-16T16:18:14.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.357+0000 7facbbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7facbc0b45c0 0x7facbc15f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:14.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.357+0000 7facbbe00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facbc160100 con 0x7facbc15c8d0 2024-04-16T16:18:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.357+0000 7facbbe00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facbc15fe20 con 0x7facbc155df0 2024-04-16T16:18:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.357+0000 7facbbe00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7facbc15c440 con 0x7facbc0b45c0 2024-04-16T16:18:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.358+0000 7facba000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7facbc0b45c0 0x7facbc15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.358+0000 7facbb400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7facbc15c8d0 0x7facbc06da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40800/0 (socket says 172.21.15.22:40800) 2024-04-16T16:18:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.358+0000 7facbb400640 1 -- 172.21.15.22:0/2467874952 learned_addr learned my addr 172.21.15.22:0/2467874952 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.358+0000 7facba000640 1 -- 172.21.15.22:0/2467874952 >> v1:172.21.15.43:6789/0 conn(0x7facbc155df0 legacy=0x7facbc0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.358+0000 7facba000640 1 -- 172.21.15.22:0/2467874952 >> v1:172.21.15.22:6789/0 conn(0x7facbc15c8d0 legacy=0x7facbc06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.359+0000 7facba000640 1 -- 172.21.15.22:0/2467874952 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc15bdf0 con 0x7facbc0b45c0 2024-04-16T16:18:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.358+0000 7facb9600640 1 -- 172.21.15.22:0/2467874952 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132446763 0 0) 0x7facb4001110 con 0x7facbc15c8d0 2024-04-16T16:18:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.360+0000 7facba000640 1 --2- 172.21.15.22:0/2467874952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc0b45c0 0x7facbc15f240 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faca40097a0 tx=0x7faca402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14e87320fe5013a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.360+0000 7facb9600640 1 -- 172.21.15.22:0/2467874952 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4034070 con 0x7facbc0b45c0 2024-04-16T16:18:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.360+0000 7facb9600640 1 -- 172.21.15.22:0/2467874952 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca4030610 con 0x7facbc0b45c0 2024-04-16T16:18:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.360+0000 7facb9600640 1 -- 172.21.15.22:0/2467874952 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca40309e0 con 0x7facbc0b45c0 2024-04-16T16:18:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.361+0000 7facbbe00640 1 -- 172.21.15.22:0/2467874952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc0b45c0 msgr2=0x7facbc15f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.361+0000 7facbbe00640 1 --2- 172.21.15.22:0/2467874952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc0b45c0 0x7facbc15f240 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faca40097a0 tx=0x7faca402b960 comp rx=0 tx=0).stop 2024-04-16T16:18:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.361+0000 7facbbe00640 1 -- 172.21.15.22:0/2467874952 shutdown_connections 2024-04-16T16:18:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.361+0000 7facbbe00640 1 --2- 172.21.15.22:0/2467874952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc0b45c0 0x7facbc15f240 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.361+0000 7facbbe00640 1 -- 172.21.15.22:0/2467874952 >> 172.21.15.22:0/2467874952 conn(0x7facbc075070 msgr2=0x7facbc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.361+0000 7facbbe00640 1 -- 172.21.15.22:0/2467874952 shutdown_connections 2024-04-16T16:18:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.361+0000 7facbbe00640 1 -- 172.21.15.22:0/2467874952 wait complete. 2024-04-16T16:18:14.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.363+0000 7facbbe00640 1 Processor -- start 2024-04-16T16:18:14.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.363+0000 7facbbe00640 1 -- start start 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facbc0b45c0 0x7facbc15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facbc155df0 0x7facbc0d0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc15c8d0 0x7facbc14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbbe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7facbc15f780 con 0x7facbc15c8d0 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7facbc0ccd70 con 0x7facbc0b45c0 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7facbc15f900 con 0x7facbc155df0 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc15c8d0 0x7facbc14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc15c8d0 0x7facbc14eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46604/0 (socket says 172.21.15.22:46604) 2024-04-16T16:18:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.364+0000 7facbb400640 1 -- 172.21.15.22:0/4020139553 learned_addr learned my addr 172.21.15.22:0/4020139553 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbaa00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facbc0b45c0 0x7facbc15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbb400640 1 -- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facbc155df0 msgr2=0x7facbc0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facba000640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facbc155df0 0x7facbc0d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbb400640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facbc155df0 0x7facbc0d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbb400640 1 -- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facbc0b45c0 msgr2=0x7facbc15afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbb400640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facbc0b45c0 0x7facbc15afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbb400640 1 -- 172.21.15.22:0/4020139553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc0d0c10 con 0x7facbc15c8d0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbb400640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc15c8d0 0x7facbc14eba0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7facb400c410 tx=0x7facb400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facb2a00640 1 -- 172.21.15.22:0/4020139553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40074e0 con 0x7facbc15c8d0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facb2a00640 1 -- 172.21.15.22:0/4020139553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb40047e0 con 0x7facbc15c8d0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facb2a00640 1 -- 172.21.15.22:0/4020139553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4004bd0 con 0x7facbc15c8d0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.365+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facbc0d0ef0 con 0x7facbc15c8d0 2024-04-16T16:18:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.366+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facbc15b510 con 0x7facbc15c8d0 2024-04-16T16:18:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.367+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facbc075f30 con 0x7facbc15c8d0 2024-04-16T16:18:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.368+0000 7facb2a00640 1 -- 172.21.15.22:0/4020139553 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facb4011070 con 0x7facbc15c8d0 2024-04-16T16:18:14.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.369+0000 7facb2a00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac9806c920 0x7fac9806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.369+0000 7facb2a00640 1 -- 172.21.15.22:0/4020139553 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7facb408b790 con 0x7facbc15c8d0 2024-04-16T16:18:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.369+0000 7facbaa00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac9806c920 0x7fac9806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.370+0000 7facbaa00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac9806c920 0x7fac9806ede0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7facac0012e0 tx=0x7facac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.373+0000 7facb2a00640 1 -- 172.21.15.22:0/4020139553 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7facbc160100 con 0x7facbc15c8d0 2024-04-16T16:18:14.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.613+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol25090", "target": ["mon-mgr", ""]}) -- 0x7facbc06d460 con 0x7fac9806c920 2024-04-16T16:18:14.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.628+0000 7facb2a00640 1 -- 172.21.15.22:0/4020139553 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7facbc06d460 con 0x7fac9806c920 2024-04-16T16:18:14.628 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4 2024-04-16T16:18:14.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac9806c920 msgr2=0x7fac9806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac9806c920 0x7fac9806ede0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7facac0012e0 tx=0x7facac009040 comp rx=0 tx=0).stop 2024-04-16T16:18:14.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc15c8d0 msgr2=0x7facbc14eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:14.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc15c8d0 0x7facbc14eba0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7facb400c410 tx=0x7facb400c8d0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 shutdown_connections 2024-04-16T16:18:14.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac9806c920 0x7fac9806ede0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facbc15c8d0 0x7facbc14eba0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facbc155df0 0x7facbc0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 --2- 172.21.15.22:0/4020139553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facbc0b45c0 0x7facbc15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:14.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 >> 172.21.15.22:0/4020139553 conn(0x7facbc075070 msgr2=0x7facbc0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:14.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 shutdown_connections 2024-04-16T16:18:14.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:14.631+0000 7facbbe00640 1 -- 172.21.15.22:0/4020139553 wait complete. 2024-04-16T16:18:14.650 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol25090 with 200 files each 1MB size under directory volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4 2024-04-16T16:18:14.650 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:14.650 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:14.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:14.703 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:14.820 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:14.821 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:14.821 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0490658 s, 21.4 MB/s 2024-04-16T16:18:14.822 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:14.823 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:14.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:14.878 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:14.964 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:14.965 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:14.965 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304349 s, 34.5 MB/s 2024-04-16T16:18:14.966 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:14.966 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:15.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:15.026 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:15.113 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309343 s, 33.9 MB/s 2024-04-16T16:18:15.116 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:15.116 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:15.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:15.176 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:15.262 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:15.263 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:15.263 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281524 s, 37.2 MB/s 2024-04-16T16:18:15.264 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:15.264 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:15.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:15.321 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:15.406 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:15.406 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:15.406 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273195 s, 38.4 MB/s 2024-04-16T16:18:15.408 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:15.408 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:15.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:15.468 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440655 s, 23.8 MB/s 2024-04-16T16:18:15.575 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:15.575 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:15.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:15.632 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273456 s, 38.3 MB/s 2024-04-16T16:18:15.716 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:15.717 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:15.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:15.775 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:15.867 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347049 s, 30.2 MB/s 2024-04-16T16:18:15.869 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:15.869 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:15.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:15.928 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.012 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.012 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251218 s, 41.7 MB/s 2024-04-16T16:18:16.013 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.014 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:16.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:16.073 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.165 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.165 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.165 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309229 s, 33.9 MB/s 2024-04-16T16:18:16.167 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.167 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:16.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:16.221 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.306 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.307 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.307 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288215 s, 36.4 MB/s 2024-04-16T16:18:16.308 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.308 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:16.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:16.362 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.442 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.443 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.443 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264814 s, 39.6 MB/s 2024-04-16T16:18:16.444 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.444 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:16.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:16.501 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.580 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.580 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.580 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251331 s, 41.7 MB/s 2024-04-16T16:18:16.581 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.582 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:16.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:16.638 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238965 s, 43.9 MB/s 2024-04-16T16:18:16.713 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.713 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:16.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:16.768 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.853 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.853 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.853 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027805 s, 37.7 MB/s 2024-04-16T16:18:16.855 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.855 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:16.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:16.916 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:16.996 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:16.996 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:16.996 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239563 s, 43.8 MB/s 2024-04-16T16:18:16.997 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:16.997 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:17.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:17.055 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025575 s, 41.0 MB/s 2024-04-16T16:18:17.144 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:17.144 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:17.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:17.203 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270151 s, 38.8 MB/s 2024-04-16T16:18:17.287 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:17.287 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:17.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:17.345 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209346 s, 50.1 MB/s 2024-04-16T16:18:17.422 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:17.422 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:17.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:17.476 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:17.579 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:17.579 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:17.579 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0473821 s, 22.1 MB/s 2024-04-16T16:18:17.581 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:17.581 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:17.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:17.636 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:17.716 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:17.716 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:17.716 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025471 s, 41.2 MB/s 2024-04-16T16:18:17.718 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:17.718 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:17.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:17.774 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:17.856 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:17.856 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:17.856 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280909 s, 37.3 MB/s 2024-04-16T16:18:17.858 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:17.858 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:17.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:17.916 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:18.006 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:18.006 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:18.006 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030313 s, 34.6 MB/s 2024-04-16T16:18:18.007 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:18.007 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:18.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:18.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:18.140 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:18.140 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:18.140 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250849 s, 41.8 MB/s 2024-04-16T16:18:18.142 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:18.142 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:18.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:18.196 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376871 s, 27.8 MB/s 2024-04-16T16:18:18.287 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:18.287 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:18.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:18.348 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:18.432 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:18.432 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:18.432 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277758 s, 37.8 MB/s 2024-04-16T16:18:18.434 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:18.434 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:18.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:18.493 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:18.576 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:18.576 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:18.576 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241488 s, 43.4 MB/s 2024-04-16T16:18:18.577 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:18.577 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:18.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:18.640 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316189 s, 33.2 MB/s 2024-04-16T16:18:18.728 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:18.728 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:18.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:18.785 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:18.867 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263555 s, 39.8 MB/s 2024-04-16T16:18:18.870 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:18.870 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:18.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:18.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:19.051 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:19.051 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:19.052 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025261 s, 41.5 MB/s 2024-04-16T16:18:19.054 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:19.054 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:19.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:19.112 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:19.210 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:19.210 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:19.210 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0409313 s, 25.6 MB/s 2024-04-16T16:18:19.212 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:19.212 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:19.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:19.272 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:19.354 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:19.354 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:19.354 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253839 s, 41.3 MB/s 2024-04-16T16:18:19.357 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:19.357 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:19.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:19.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:19.498 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:19.498 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:19.498 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222669 s, 47.1 MB/s 2024-04-16T16:18:19.500 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:19.500 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:19.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:19.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257101 s, 40.8 MB/s 2024-04-16T16:18:19.635 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:19.635 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:19.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:19.694 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:19.773 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:19.773 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:19.773 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245631 s, 42.7 MB/s 2024-04-16T16:18:19.775 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:19.775 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:19.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:19.834 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:19.915 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261726 s, 40.1 MB/s 2024-04-16T16:18:19.916 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:19.916 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:19.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:19.967 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:20.101 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319853 s, 32.8 MB/s 2024-04-16T16:18:20.103 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:20.103 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:20.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:20.161 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:20.248 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294952 s, 35.6 MB/s 2024-04-16T16:18:20.250 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:20.250 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:20.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:20.308 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269617 s, 38.9 MB/s 2024-04-16T16:18:20.392 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:20.393 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:20.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:20.448 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:20.534 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:20.534 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:20.534 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297344 s, 35.3 MB/s 2024-04-16T16:18:20.536 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:20.536 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:20.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:20.589 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:20.659 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:20.659 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:20.659 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224126 s, 46.8 MB/s 2024-04-16T16:18:20.660 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:20.661 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:20.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:20.717 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:20.803 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:20.803 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:20.803 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278468 s, 37.7 MB/s 2024-04-16T16:18:20.804 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:20.804 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:20.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:20.862 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:20.939 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:20.939 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:20.939 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224207 s, 46.8 MB/s 2024-04-16T16:18:20.941 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:20.941 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:21.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:21.001 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:21.085 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:21.085 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:21.085 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265624 s, 39.5 MB/s 2024-04-16T16:18:21.087 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:21.087 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:21.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:21.142 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:21.223 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:21.223 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:21.223 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243682 s, 43.0 MB/s 2024-04-16T16:18:21.225 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:21.225 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:21.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:21.283 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:21.367 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:21.367 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:21.367 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024465 s, 42.9 MB/s 2024-04-16T16:18:21.369 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:21.369 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:21.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:21.427 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:21.517 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:21.517 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:21.517 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033683 s, 31.1 MB/s 2024-04-16T16:18:21.519 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:21.519 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:21.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:21.576 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:21.658 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:21.658 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:21.658 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277162 s, 37.8 MB/s 2024-04-16T16:18:21.660 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:21.660 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:21.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:21.720 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:21.804 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:21.804 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:21.804 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265867 s, 39.4 MB/s 2024-04-16T16:18:21.806 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:21.806 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:21.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:21.863 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281597 s, 37.2 MB/s 2024-04-16T16:18:21.950 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:21.951 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.010 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:22.087 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:22.087 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:22.087 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024643 s, 42.6 MB/s 2024-04-16T16:18:22.089 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:22.089 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.146 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:22.234 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:22.234 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:22.234 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295799 s, 35.4 MB/s 2024-04-16T16:18:22.236 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:22.236 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.296 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:22.370 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:22.370 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:22.370 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230673 s, 45.5 MB/s 2024-04-16T16:18:22.372 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:22.372 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.425 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274015 s, 38.3 MB/s 2024-04-16T16:18:22.501 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:22.501 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024261 s, 43.2 MB/s 2024-04-16T16:18:22.630 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:22.631 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.685 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196307 s, 53.4 MB/s 2024-04-16T16:18:22.761 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:22.761 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.821 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:22.900 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:22.900 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:22.900 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224406 s, 46.7 MB/s 2024-04-16T16:18:22.902 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:22.902 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:22.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:22.960 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:23.040 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:23.040 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:23.040 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263607 s, 39.8 MB/s 2024-04-16T16:18:23.041 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:23.042 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:23.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:23.098 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:23.180 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:23.181 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219576 s, 47.8 MB/s 2024-04-16T16:18:23.182 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:23.183 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:23.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:23.240 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:23.332 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:23.333 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:23.333 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305852 s, 34.3 MB/s 2024-04-16T16:18:23.334 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:23.335 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:23.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:23.392 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:23.480 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:23.480 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:23.480 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289468 s, 36.2 MB/s 2024-04-16T16:18:23.482 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:23.482 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:23.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:23.541 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020919 s, 50.1 MB/s 2024-04-16T16:18:23.619 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:23.619 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:23.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:23.677 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:23.765 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:23.765 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:23.765 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254919 s, 41.1 MB/s 2024-04-16T16:18:23.767 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:23.767 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:23.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:23.825 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281311 s, 37.3 MB/s 2024-04-16T16:18:23.911 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:23.912 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:23.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:23.970 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316884 s, 33.1 MB/s 2024-04-16T16:18:24.062 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:24.062 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:24.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:24.120 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:24.204 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:24.205 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:24.205 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025197 s, 41.6 MB/s 2024-04-16T16:18:24.206 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:24.207 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:24.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:24.264 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253698 s, 41.3 MB/s 2024-04-16T16:18:24.352 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:24.353 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:24.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:24.410 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260302 s, 40.3 MB/s 2024-04-16T16:18:24.495 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:24.495 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:24.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:24.554 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:24.632 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:24.632 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:24.632 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226257 s, 46.3 MB/s 2024-04-16T16:18:24.634 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:24.634 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:24.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:24.691 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:24.775 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:24.775 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:24.775 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278576 s, 37.6 MB/s 2024-04-16T16:18:24.776 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:24.777 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:24.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:24.835 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028965 s, 36.2 MB/s 2024-04-16T16:18:24.921 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:24.922 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:24.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:24.979 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:25.060 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236351 s, 44.4 MB/s 2024-04-16T16:18:25.061 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:25.061 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:25.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:25.118 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:25.196 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:25.196 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:25.197 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239756 s, 43.7 MB/s 2024-04-16T16:18:25.198 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:25.198 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:25.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:25.250 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:25.341 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:25.342 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:25.342 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343983 s, 30.5 MB/s 2024-04-16T16:18:25.343 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:25.343 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:25.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:25.401 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:25.483 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:25.484 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:25.484 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267205 s, 39.2 MB/s 2024-04-16T16:18:25.485 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:25.485 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:25.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:25.543 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280976 s, 37.3 MB/s 2024-04-16T16:18:25.630 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:25.630 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:25.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:25.686 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277669 s, 37.8 MB/s 2024-04-16T16:18:25.773 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:25.773 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:25.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:25.828 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:25.915 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:25.915 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:25.915 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332818 s, 31.5 MB/s 2024-04-16T16:18:25.917 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:25.917 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:25.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:25.970 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254697 s, 41.2 MB/s 2024-04-16T16:18:26.051 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:26.051 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:26.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:26.108 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:26.191 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:26.191 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:26.192 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248513 s, 42.2 MB/s 2024-04-16T16:18:26.193 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:26.194 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:26.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:26.253 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:26.339 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:26.339 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:26.339 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026232 s, 40.0 MB/s 2024-04-16T16:18:26.341 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:26.341 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:26.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:26.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262419 s, 40.0 MB/s 2024-04-16T16:18:26.487 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:26.487 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:26.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:26.546 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:26.628 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:26.628 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:26.628 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252945 s, 41.5 MB/s 2024-04-16T16:18:26.630 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:26.630 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:26.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:26.687 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:26.768 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:26.768 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:26.768 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240692 s, 43.6 MB/s 2024-04-16T16:18:26.770 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:26.770 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:26.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:26.825 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281192 s, 37.3 MB/s 2024-04-16T16:18:26.908 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:26.908 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:26.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:26.966 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:27.052 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:27.052 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:27.052 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294405 s, 35.6 MB/s 2024-04-16T16:18:27.054 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:27.054 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:27.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:27.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:27.193 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:27.194 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:27.194 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268764 s, 39.0 MB/s 2024-04-16T16:18:27.195 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:27.195 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:27.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:27.251 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255424 s, 41.1 MB/s 2024-04-16T16:18:27.328 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:27.328 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:27.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:27.386 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:27.457 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:27.458 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:27.458 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209009 s, 50.2 MB/s 2024-04-16T16:18:27.459 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:27.459 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:27.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:27.511 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:27.587 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:27.587 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:27.587 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262887 s, 39.9 MB/s 2024-04-16T16:18:27.589 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:27.589 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:27.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:27.642 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:27.721 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:27.721 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:27.722 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229465 s, 45.7 MB/s 2024-04-16T16:18:27.723 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:27.723 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:27.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:27.783 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291654 s, 36.0 MB/s 2024-04-16T16:18:27.868 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:27.868 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:27.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:27.927 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.004 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.004 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.004 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220878 s, 47.5 MB/s 2024-04-16T16:18:28.006 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.006 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:28.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:28.064 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.149 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.149 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.149 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02852 s, 36.8 MB/s 2024-04-16T16:18:28.150 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.150 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:28.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:28.206 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.284 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.284 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.284 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237316 s, 44.2 MB/s 2024-04-16T16:18:28.286 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.286 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:28.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:28.343 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.421 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.422 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.422 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209737 s, 50.0 MB/s 2024-04-16T16:18:28.423 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.423 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:28.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:28.482 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.557 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.557 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.558 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01873 s, 56.0 MB/s 2024-04-16T16:18:28.559 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.559 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:28.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:28.613 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289104 s, 36.3 MB/s 2024-04-16T16:18:28.689 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.689 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:28.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:28.748 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.823 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.823 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.823 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217259 s, 48.3 MB/s 2024-04-16T16:18:28.825 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.825 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:28.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:28.885 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241525 s, 43.4 MB/s 2024-04-16T16:18:28.967 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:28.967 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.027 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:29.110 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:29.111 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:29.111 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024588 s, 42.6 MB/s 2024-04-16T16:18:29.113 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:29.113 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.171 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:29.255 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:29.255 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:29.255 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287103 s, 36.5 MB/s 2024-04-16T16:18:29.257 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:29.257 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.315 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:29.392 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:29.392 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:29.392 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229721 s, 45.6 MB/s 2024-04-16T16:18:29.393 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:29.393 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.449 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:29.530 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:29.530 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:29.530 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233659 s, 44.9 MB/s 2024-04-16T16:18:29.532 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:29.532 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.590 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:29.675 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:29.675 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:29.676 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259094 s, 40.5 MB/s 2024-04-16T16:18:29.677 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:29.677 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246161 s, 42.6 MB/s 2024-04-16T16:18:29.819 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:29.819 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.875 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197157 s, 53.2 MB/s 2024-04-16T16:18:29.942 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:29.942 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:29.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:29.995 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254253 s, 41.2 MB/s 2024-04-16T16:18:30.075 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:30.075 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:30.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:30.133 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:30.211 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:30.211 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:30.211 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222064 s, 47.2 MB/s 2024-04-16T16:18:30.213 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:30.213 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:30.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:30.266 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228827 s, 45.8 MB/s 2024-04-16T16:18:30.344 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:30.344 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:30.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:30.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271248 s, 38.7 MB/s 2024-04-16T16:18:30.488 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:30.488 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:30.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:30.547 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:30.626 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:30.626 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:30.626 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228966 s, 45.8 MB/s 2024-04-16T16:18:30.628 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:30.628 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:30.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:30.685 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:30.773 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:30.773 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:30.774 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299578 s, 35.0 MB/s 2024-04-16T16:18:30.779 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:30.779 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:30.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:30.838 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:30.918 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:30.918 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:30.919 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244194 s, 42.9 MB/s 2024-04-16T16:18:30.920 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:30.920 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:30.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:30.976 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:31.056 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:31.057 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:31.057 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247053 s, 42.4 MB/s 2024-04-16T16:18:31.058 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:31.058 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:31.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:31.114 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235111 s, 44.6 MB/s 2024-04-16T16:18:31.196 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:31.196 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:31.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:31.259 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:31.337 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:31.337 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:31.337 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213488 s, 49.1 MB/s 2024-04-16T16:18:31.339 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:31.339 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:31.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:31.398 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:31.478 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:31.478 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:31.478 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238879 s, 43.9 MB/s 2024-04-16T16:18:31.480 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:31.481 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:31.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:31.540 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:31.619 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:31.619 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:31.619 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235712 s, 44.5 MB/s 2024-04-16T16:18:31.621 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:31.621 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:31.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:31.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:31.763 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:31.763 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:31.763 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023741 s, 44.2 MB/s 2024-04-16T16:18:31.765 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:31.765 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:31.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:31.825 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290371 s, 36.1 MB/s 2024-04-16T16:18:31.916 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:31.916 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:31.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:31.974 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:32.055 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:32.055 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:32.055 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248277 s, 42.2 MB/s 2024-04-16T16:18:32.057 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:32.057 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:32.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:32.117 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:32.207 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:32.207 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268325 s, 39.1 MB/s 2024-04-16T16:18:32.208 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:32.208 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:32.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:32.269 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287345 s, 36.5 MB/s 2024-04-16T16:18:32.360 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:32.360 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:32.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:32.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:32.488 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:32.488 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:32.488 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228473 s, 45.9 MB/s 2024-04-16T16:18:32.490 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:32.490 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:32.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:32.543 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246935 s, 42.5 MB/s 2024-04-16T16:18:32.623 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:32.623 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:32.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:32.677 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:32.765 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:32.765 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:32.765 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317574 s, 33.0 MB/s 2024-04-16T16:18:32.767 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:32.767 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:32.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:32.824 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:32.905 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:32.905 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:32.905 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250567 s, 41.8 MB/s 2024-04-16T16:18:32.907 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:32.907 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:32.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:32.967 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:33.050 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:33.050 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:33.050 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281868 s, 37.2 MB/s 2024-04-16T16:18:33.052 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:33.052 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:33.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:33.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:33.192 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:33.192 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:33.193 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278895 s, 37.6 MB/s 2024-04-16T16:18:33.195 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:33.195 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:33.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:33.251 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:33.341 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:33.341 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:33.341 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345458 s, 30.4 MB/s 2024-04-16T16:18:33.343 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:33.343 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:33.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:33.401 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:33.481 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:33.481 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:33.481 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235104 s, 44.6 MB/s 2024-04-16T16:18:33.483 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:33.483 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:33.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:33.541 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:33.622 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:33.622 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:33.622 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241382 s, 43.4 MB/s 2024-04-16T16:18:33.624 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:33.624 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:33.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:33.681 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:33.768 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:33.768 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:33.769 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030287 s, 34.6 MB/s 2024-04-16T16:18:33.770 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:33.770 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:33.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:33.827 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:33.913 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:33.914 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:33.914 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292449 s, 35.9 MB/s 2024-04-16T16:18:33.915 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:33.915 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:33.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:33.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:34.058 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258634 s, 40.5 MB/s 2024-04-16T16:18:34.060 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:34.060 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:34.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:34.116 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:34.203 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:34.203 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:34.203 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321426 s, 32.6 MB/s 2024-04-16T16:18:34.205 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:34.205 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:34.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:34.261 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:34.345 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:34.345 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:34.345 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026341 s, 39.8 MB/s 2024-04-16T16:18:34.347 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:34.347 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:34.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:34.407 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:34.486 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021964 s, 47.7 MB/s 2024-04-16T16:18:34.489 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:34.489 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:34.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:34.546 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:34.627 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:34.627 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:34.627 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247606 s, 42.3 MB/s 2024-04-16T16:18:34.629 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:34.629 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:34.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:34.683 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:34.759 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:34.759 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:34.759 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248729 s, 42.2 MB/s 2024-04-16T16:18:34.760 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:34.761 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:34.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:34.820 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:34.901 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:34.901 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:34.902 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250022 s, 41.9 MB/s 2024-04-16T16:18:34.903 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:34.903 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:34.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:34.954 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.030 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.030 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.030 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232448 s, 45.1 MB/s 2024-04-16T16:18:35.031 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.032 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:35.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:35.087 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.173 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.173 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.173 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285379 s, 36.7 MB/s 2024-04-16T16:18:35.175 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.175 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:35.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:35.232 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.304 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.304 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.305 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019431 s, 54.0 MB/s 2024-04-16T16:18:35.306 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.306 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:35.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:35.361 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271591 s, 38.6 MB/s 2024-04-16T16:18:35.447 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.447 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:35.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:35.504 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.569 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.569 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.569 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147762 s, 71.0 MB/s 2024-04-16T16:18:35.571 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.571 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:35.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:35.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310195 s, 33.8 MB/s 2024-04-16T16:18:35.714 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.714 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:35.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:35.773 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248716 s, 42.2 MB/s 2024-04-16T16:18:35.854 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.854 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:35.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:35.914 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:35.993 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230773 s, 45.4 MB/s 2024-04-16T16:18:35.994 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:35.995 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:36.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:36.050 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:36.126 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:36.126 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:36.127 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218118 s, 48.1 MB/s 2024-04-16T16:18:36.128 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:36.128 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:36.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:36.184 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:36.263 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:36.263 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:36.263 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234745 s, 44.7 MB/s 2024-04-16T16:18:36.264 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:36.265 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:36.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:36.321 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:36.402 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:36.402 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:36.402 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251737 s, 41.7 MB/s 2024-04-16T16:18:36.404 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:36.404 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:36.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:36.463 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:36.547 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:36.548 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:36.548 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256199 s, 40.9 MB/s 2024-04-16T16:18:36.550 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:36.550 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:36.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:36.608 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:36.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:18:36.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:18:36.690 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:36.690 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:36.690 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025959 s, 40.4 MB/s 2024-04-16T16:18:36.692 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:36.692 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:36.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:36.784 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025627 s, 40.9 MB/s 2024-04-16T16:18:36.928 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:36.928 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:36.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:36.986 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:37.069 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:37.069 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:37.069 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025218 s, 41.6 MB/s 2024-04-16T16:18:37.072 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:37.072 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:37.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:37.130 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:37.222 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:37.222 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:37.223 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319767 s, 32.8 MB/s 2024-04-16T16:18:37.225 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:37.225 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:37.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:37.282 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:37.366 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:37.366 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:37.366 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269077 s, 39.0 MB/s 2024-04-16T16:18:37.368 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:37.368 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:37.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:37.421 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267995 s, 39.1 MB/s 2024-04-16T16:18:37.502 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:37.502 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:37.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:37.557 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:37.638 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:37.638 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:37.639 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239352 s, 43.8 MB/s 2024-04-16T16:18:37.640 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:37.640 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:37.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:37.699 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:37.778 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:37.778 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:37.778 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244436 s, 42.9 MB/s 2024-04-16T16:18:37.779 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:37.779 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:37.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:37.835 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222262 s, 47.2 MB/s 2024-04-16T16:18:37.914 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:37.914 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:37.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:37.970 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264277 s, 39.7 MB/s 2024-04-16T16:18:38.053 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:38.054 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:38.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:38.111 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:38.195 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:38.195 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:38.196 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027765 s, 37.8 MB/s 2024-04-16T16:18:38.197 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:38.197 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:38.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:38.253 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:38.333 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:38.333 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:38.333 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026489 s, 39.6 MB/s 2024-04-16T16:18:38.335 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:38.335 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:38.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:38.392 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:38.478 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:38.478 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:38.478 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303792 s, 34.5 MB/s 2024-04-16T16:18:38.480 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:38.480 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:38.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:38.539 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:38.616 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:38.616 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:38.616 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216476 s, 48.4 MB/s 2024-04-16T16:18:38.618 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:38.618 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:38.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:38.670 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279938 s, 37.5 MB/s 2024-04-16T16:18:38.802 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:38.802 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:38.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:38.859 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254375 s, 41.2 MB/s 2024-04-16T16:18:38.939 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:38.939 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:38.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:38.997 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021148 s, 49.6 MB/s 2024-04-16T16:18:39.079 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:39.079 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:39.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:39.133 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340305 s, 30.8 MB/s 2024-04-16T16:18:39.223 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:39.223 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:39.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:39.280 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:39.361 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:39.362 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:39.362 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255105 s, 41.1 MB/s 2024-04-16T16:18:39.363 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:39.363 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:39.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:39.422 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300329 s, 34.9 MB/s 2024-04-16T16:18:39.511 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:39.512 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:39.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:39.570 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:39.646 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:39.646 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:39.646 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019625 s, 53.4 MB/s 2024-04-16T16:18:39.647 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:39.647 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:39.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:39.704 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:39.782 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:39.782 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:39.782 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022941 s, 45.7 MB/s 2024-04-16T16:18:39.784 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:39.784 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:39.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:39.842 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:39.919 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240526 s, 43.6 MB/s 2024-04-16T16:18:39.921 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:39.921 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:39.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:39.976 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:40.052 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:40.053 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:40.053 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200523 s, 52.3 MB/s 2024-04-16T16:18:40.054 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:40.054 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:40.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:40.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:40.195 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:40.195 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:40.195 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303434 s, 34.6 MB/s 2024-04-16T16:18:40.197 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:40.197 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:40.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:40.253 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:40.329 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:40.329 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:40.329 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229989 s, 45.6 MB/s 2024-04-16T16:18:40.331 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:40.331 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:40.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:40.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258089 s, 40.6 MB/s 2024-04-16T16:18:40.470 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:40.471 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:40.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:40.529 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248844 s, 42.1 MB/s 2024-04-16T16:18:40.613 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:40.614 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:40.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:40.673 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:40.766 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:40.766 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:40.766 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347062 s, 30.2 MB/s 2024-04-16T16:18:40.767 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:40.768 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:40.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:40.823 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034238 s, 30.6 MB/s 2024-04-16T16:18:40.913 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:40.913 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:40.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:40.971 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:41.054 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:41.054 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:41.054 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238667 s, 43.9 MB/s 2024-04-16T16:18:41.055 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:41.055 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:41.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:41.111 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270915 s, 38.7 MB/s 2024-04-16T16:18:41.193 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:41.193 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:41.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:41.246 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:41.327 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274396 s, 38.2 MB/s 2024-04-16T16:18:41.329 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:41.329 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:41.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:41.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:41.468 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:41.468 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:41.468 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267783 s, 39.2 MB/s 2024-04-16T16:18:41.470 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:41.470 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:41.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:41.528 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:41.606 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:41.606 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:41.606 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234955 s, 44.6 MB/s 2024-04-16T16:18:41.607 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:41.607 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:41.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:41.664 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:41.743 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:41.743 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:41.743 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256161 s, 40.9 MB/s 2024-04-16T16:18:41.744 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:41.745 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:41.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:41.800 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:41.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:41.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:41.878 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221848 s, 47.3 MB/s 2024-04-16T16:18:41.880 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:41.880 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:41.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:41.936 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227132 s, 46.2 MB/s 2024-04-16T16:18:42.015 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.015 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:42.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:42.073 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239812 s, 43.7 MB/s 2024-04-16T16:18:42.154 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.154 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:42.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:42.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254052 s, 41.3 MB/s 2024-04-16T16:18:42.295 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.295 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:42.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:42.353 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.436 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.436 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.436 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245141 s, 42.8 MB/s 2024-04-16T16:18:42.438 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.438 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:42.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:42.489 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243717 s, 43.0 MB/s 2024-04-16T16:18:42.566 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.566 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:42.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:42.621 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.700 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.701 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.701 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263141 s, 39.8 MB/s 2024-04-16T16:18:42.703 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.703 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:42.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:42.763 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.849 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.849 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.849 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251702 s, 41.7 MB/s 2024-04-16T16:18:42.851 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.851 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:42.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:42.909 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:42.988 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:42.988 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:42.988 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264063 s, 39.7 MB/s 2024-04-16T16:18:42.990 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:18:42.990 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:18:43.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:43.047 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25090/7897728d-e6fe-42a9-8457-9581f2d002e4/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:18:43.134 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:18:43.134 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:18:43.134 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347717 s, 30.2 MB/s 2024-04-16T16:18:43.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol25090 subvol_snap87590 2024-04-16T16:18:43.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.364+0000 7f3a7be00640 1 Processor -- start 2024-04-16T16:18:43.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.364+0000 7f3a7be00640 1 -- start start 2024-04-16T16:18:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a7be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a7c06deb0 0x7f3a7c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a7be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c0b3540 con 0x7f3a7c0725d0 2024-04-16T16:18:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a7be00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c0b3820 con 0x7f3a7c0b4300 2024-04-16T16:18:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a7be00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3a7c0b3b00 con 0x7f3a7c06deb0 2024-04-16T16:18:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a7aa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3a7c0725d0 0x7f3a7c0729b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39786/0 (socket says 172.21.15.22:39786) 2024-04-16T16:18:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a7aa00640 1 -- 172.21.15.22:0/1806514721 learned_addr learned my addr 172.21.15.22:0/1806514721 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a73e00640 1 --2- 172.21.15.22:0/1806514721 >> v2:172.21.15.22:3300/0 conn(0x7f3a7c06deb0 0x7f3a7c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.366+0000 7f3a7a000640 1 -- 172.21.15.22:0/1806514721 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605172084 0 0) 0x7f3a7c0b3540 con 0x7f3a7c0725d0 2024-04-16T16:18:43.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.367+0000 7f3a7a000640 1 -- 172.21.15.22:0/1806514721 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a60003520 con 0x7f3a7c0725d0 2024-04-16T16:18:43.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.367+0000 7f3a73e00640 1 -- 172.21.15.22:0/1806514721 >> v1:172.21.15.43:6789/0 conn(0x7f3a7c0b4300 legacy=0x7f3a7c162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:43.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.367+0000 7f3a73e00640 1 -- 172.21.15.22:0/1806514721 >> v1:172.21.15.22:6789/0 conn(0x7f3a7c0725d0 legacy=0x7f3a7c0729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.367+0000 7f3a73e00640 1 -- 172.21.15.22:0/1806514721 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c0b3de0 con 0x7f3a7c06deb0 2024-04-16T16:18:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.368+0000 7f3a73e00640 1 --2- 172.21.15.22:0/1806514721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c06deb0 0x7f3a7c0b4e50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097d0 tx=0x7f3a6402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9829f7f776324d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.368+0000 7f3a7a000640 1 -- 172.21.15.22:0/1806514721 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a640315a0 con 0x7f3a7c06deb0 2024-04-16T16:18:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.368+0000 7f3a7a000640 1 -- 172.21.15.22:0/1806514721 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a64037070 con 0x7f3a7c06deb0 2024-04-16T16:18:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.368+0000 7f3a7a000640 1 -- 172.21.15.22:0/1806514721 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64031940 con 0x7f3a7c06deb0 2024-04-16T16:18:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.369+0000 7f3a7be00640 1 -- 172.21.15.22:0/1806514721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c06deb0 msgr2=0x7f3a7c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.369+0000 7f3a7be00640 1 --2- 172.21.15.22:0/1806514721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c06deb0 0x7f3a7c0b4e50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097d0 tx=0x7f3a6402b840 comp rx=0 tx=0).stop 2024-04-16T16:18:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.369+0000 7f3a7be00640 1 -- 172.21.15.22:0/1806514721 shutdown_connections 2024-04-16T16:18:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.369+0000 7f3a7be00640 1 --2- 172.21.15.22:0/1806514721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c06deb0 0x7f3a7c0b4e50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.369+0000 7f3a7be00640 1 -- 172.21.15.22:0/1806514721 >> 172.21.15.22:0/1806514721 conn(0x7f3a7c062440 msgr2=0x7f3a7c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.369+0000 7f3a7be00640 1 -- 172.21.15.22:0/1806514721 shutdown_connections 2024-04-16T16:18:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.369+0000 7f3a7be00640 1 -- 172.21.15.22:0/1806514721 wait complete. 2024-04-16T16:18:43.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.371+0000 7f3a7be00640 1 Processor -- start 2024-04-16T16:18:43.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.371+0000 7f3a7be00640 1 -- start start 2024-04-16T16:18:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.372+0000 7f3a7be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a7c06deb0 0x7f3a7c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.372+0000 7f3a7be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c0725d0 0x7f3a7c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.372+0000 7f3a7be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7c0b4300 0x7f3a7c158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.372+0000 7f3a7be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c0b48d0 con 0x7f3a7c0725d0 2024-04-16T16:18:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.372+0000 7f3a7be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c0b4750 con 0x7f3a7c0b4300 2024-04-16T16:18:43.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.372+0000 7f3a7be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7c0b4a50 con 0x7f3a7c06deb0 2024-04-16T16:18:43.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.372+0000 7f3a73e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c0725d0 0x7f3a7c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c0725d0 0x7f3a7c156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48094/0 (socket says 172.21.15.22:48094) 2024-04-16T16:18:43.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 -- 172.21.15.22:0/3268552381 learned_addr learned my addr 172.21.15.22:0/3268552381 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:43.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a7aa00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a7c06deb0 0x7f3a7c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a7b400640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7c0b4300 0x7f3a7c158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 -- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a7c06deb0 msgr2=0x7f3a7c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a7c06deb0 0x7f3a7c14c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 -- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7c0b4300 msgr2=0x7f3a7c158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7c0b4300 0x7f3a7c158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 -- 172.21.15.22:0/3268552381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c0b0ce0 con 0x7f3a7c0725d0 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a7aa00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a7c06deb0 0x7f3a7c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.373+0000 7f3a73e00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c0725d0 0x7f3a7c156a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097d0 tx=0x7f3a640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.374+0000 7f3a72a00640 1 -- 172.21.15.22:0/3268552381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64032630 con 0x7f3a7c0725d0 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.374+0000 7f3a72a00640 1 -- 172.21.15.22:0/3268552381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a640327d0 con 0x7f3a7c0725d0 2024-04-16T16:18:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.374+0000 7f3a72a00640 1 -- 172.21.15.22:0/3268552381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64032bc0 con 0x7f3a7c0725d0 2024-04-16T16:18:43.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.374+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7c0b0f80 con 0x7f3a7c0725d0 2024-04-16T16:18:43.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.374+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a7c0b1540 con 0x7f3a7c0725d0 2024-04-16T16:18:43.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.375+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7c075f30 con 0x7f3a7c0725d0 2024-04-16T16:18:43.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.376+0000 7f3a72a00640 1 -- 172.21.15.22:0/3268552381 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f3a6403b3f0 con 0x7f3a7c0725d0 2024-04-16T16:18:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.378+0000 7f3a72a00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a5806c9b0 0x7f3a5806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.378+0000 7f3a72a00640 1 -- 172.21.15.22:0/3268552381 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3a6402f030 con 0x7f3a7c0725d0 2024-04-16T16:18:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.378+0000 7f3a7aa00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a5806c9b0 0x7f3a5806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.379+0000 7f3a7aa00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a5806c9b0 0x7f3a5806ee70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c005880 tx=0x7f3a6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:43.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.383+0000 7f3a72a00640 1 -- 172.21.15.22:0/3268552381 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a64040070 con 0x7f3a7c0725d0 2024-04-16T16:18:43.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.631+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol25090", "snap_name": "subvol_snap87590", "target": ["mon-mgr", ""]}) -- 0x7f3a7c0b35e0 con 0x7f3a5806c9b0 2024-04-16T16:18:43.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.669+0000 7f3a72a00640 1 -- 172.21.15.22:0/3268552381 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3a7c0b35e0 con 0x7f3a5806c9b0 2024-04-16T16:18:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.673+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a5806c9b0 msgr2=0x7f3a5806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.673+0000 7f3a7be00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a5806c9b0 0x7f3a5806ee70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c005880 tx=0x7f3a6c009040 comp rx=0 tx=0).stop 2024-04-16T16:18:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.673+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c0725d0 msgr2=0x7f3a7c156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.673+0000 7f3a7be00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c0725d0 0x7f3a7c156a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097d0 tx=0x7f3a640046c0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.674+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 shutdown_connections 2024-04-16T16:18:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.674+0000 7f3a7be00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3a5806c9b0 0x7f3a5806ee70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.674+0000 7f3a7be00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7c0b4300 0x7f3a7c158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.674+0000 7f3a7be00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a7c0725d0 0x7f3a7c156a60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.674+0000 7f3a7be00640 1 --2- 172.21.15.22:0/3268552381 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a7c06deb0 0x7f3a7c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.674+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 >> 172.21.15.22:0/3268552381 conn(0x7f3a7c062440 msgr2=0x7f3a7c0729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:43.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.674+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 shutdown_connections 2024-04-16T16:18:43.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.675+0000 7f3a7be00640 1 -- 172.21.15.22:0/3268552381 wait complete. 2024-04-16T16:18:43.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2024-04-16T16:18:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.906+0000 7fb0c3200640 1 Processor -- start 2024-04-16T16:18:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.907+0000 7fb0c3200640 1 -- start start 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.908+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d0ca0 0x7fb0bc0b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.908+0000 7fb0c3200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb0bc0d4d00 0x7fb0bc0d5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.908+0000 7fb0c3200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0bc167210 con 0x7fb0bc162e60 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.908+0000 7fb0c3200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb0bc0d2420 con 0x7fb0bc0d4d00 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.908+0000 7fb0c3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc0d2700 con 0x7fb0bc0d0ca0 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c1e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb0bc162e60 0x7fb0bc166a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39796/0 (socket says 172.21.15.22:39796) 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c1e00640 1 -- 172.21.15.22:0/3406469505 learned_addr learned my addr 172.21.15.22:0/3406469505 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c2800640 1 --2- 172.21.15.22:0/3406469505 >> v2:172.21.15.22:3300/0 conn(0x7fb0bc0d4d00 0x7fb0bc0d5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c1400640 1 --2- 172.21.15.22:0/3406469505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d0ca0 0x7fb0bc0b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c0a00640 1 -- 172.21.15.22:0/3406469505 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2042476023 0 0) 0x7fb0bc167210 con 0x7fb0bc162e60 2024-04-16T16:18:43.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c0a00640 1 -- 172.21.15.22:0/3406469505 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a8003520 con 0x7fb0bc162e60 2024-04-16T16:18:43.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c2800640 1 -- 172.21.15.22:0/3406469505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d0ca0 msgr2=0x7fb0bc0b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:43.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c2800640 1 --2- 172.21.15.22:0/3406469505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d0ca0 0x7fb0bc0b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c2800640 1 -- 172.21.15.22:0/3406469505 >> v1:172.21.15.22:6789/0 conn(0x7fb0bc162e60 legacy=0x7fb0bc166a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.909+0000 7fb0c2800640 1 -- 172.21.15.22:0/3406469505 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc1674f0 con 0x7fb0bc0d4d00 2024-04-16T16:18:43.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.910+0000 7fb0c2800640 1 --2- 172.21.15.22:0/3406469505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc0d4d00 0x7fb0bc0d5190 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097a0 tx=0x7fb0b802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c64ce46cab2544d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:43.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c0a00640 1 -- 172.21.15.22:0/3406469505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8031780 con 0x7fb0bc0d4d00 2024-04-16T16:18:43.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c0a00640 1 -- 172.21.15.22:0/3406469505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b8037070 con 0x7fb0bc0d4d00 2024-04-16T16:18:43.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c0a00640 1 -- 172.21.15.22:0/3406469505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8031b40 con 0x7fb0bc0d4d00 2024-04-16T16:18:43.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c3200640 1 -- 172.21.15.22:0/3406469505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc0d4d00 msgr2=0x7fb0bc0d5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3406469505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc0d4d00 0x7fb0bc0d5190 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097a0 tx=0x7fb0b802b820 comp rx=0 tx=0).stop 2024-04-16T16:18:43.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c3200640 1 -- 172.21.15.22:0/3406469505 shutdown_connections 2024-04-16T16:18:43.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3406469505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc0d4d00 0x7fb0bc0d5190 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3406469505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d0ca0 0x7fb0bc0b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.911+0000 7fb0c3200640 1 -- 172.21.15.22:0/3406469505 >> 172.21.15.22:0/3406469505 conn(0x7fb0bc072460 msgr2=0x7fb0bc072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:43.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.912+0000 7fb0c3200640 1 -- 172.21.15.22:0/3406469505 shutdown_connections 2024-04-16T16:18:43.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.912+0000 7fb0c3200640 1 -- 172.21.15.22:0/3406469505 wait complete. 2024-04-16T16:18:43.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.913+0000 7fb0c3200640 1 Processor -- start 2024-04-16T16:18:43.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.914+0000 7fb0c3200640 1 -- start start 2024-04-16T16:18:43.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.914+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0bc0d0ca0 0x7fb0bc15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.914+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d4d00 0x7fb0bc0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.914+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc162e60 0x7fb0bc0b9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc0b7c70 con 0x7fb0bc162e60 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc0d1100 con 0x7fb0bc0d0ca0 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc163240 con 0x7fb0bc0d4d00 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc162e60 0x7fb0bc0b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc162e60 0x7fb0bc0b9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48116/0 (socket says 172.21.15.22:48116) 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 -- 172.21.15.22:0/3401277150 learned_addr learned my addr 172.21.15.22:0/3401277150 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c1e00640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0bc0d0ca0 0x7fb0bc15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c1400640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d4d00 0x7fb0bc0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 -- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d4d00 msgr2=0x7fb0bc0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d4d00 0x7fb0bc0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 -- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0bc0d0ca0 msgr2=0x7fb0bc15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0bc0d0ca0 0x7fb0bc15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.915+0000 7fb0c2800640 1 -- 172.21.15.22:0/3401277150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc15b400 con 0x7fb0bc162e60 2024-04-16T16:18:43.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.916+0000 7fb0c2800640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc162e60 0x7fb0bc0b9920 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80096f0 tx=0x7fb0b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:43.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.916+0000 7fb0b2000640 1 -- 172.21.15.22:0/3401277150 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8032610 con 0x7fb0bc162e60 2024-04-16T16:18:43.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.916+0000 7fb0b2000640 1 -- 172.21.15.22:0/3401277150 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80327b0 con 0x7fb0bc162e60 2024-04-16T16:18:43.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.916+0000 7fb0b2000640 1 -- 172.21.15.22:0/3401277150 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8032ba0 con 0x7fb0bc162e60 2024-04-16T16:18:43.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.916+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0bc0cc650 con 0x7fb0bc162e60 2024-04-16T16:18:43.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.916+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0bc1634c0 con 0x7fb0bc162e60 2024-04-16T16:18:43.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.918+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0bc075f30 con 0x7fb0bc162e60 2024-04-16T16:18:43.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.919+0000 7fb0b2000640 1 -- 172.21.15.22:0/3401277150 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fb0b804e440 con 0x7fb0bc162e60 2024-04-16T16:18:43.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.920+0000 7fb0b2000640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0a006c980 0x7fb0a006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:43.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.920+0000 7fb0b2000640 1 -- 172.21.15.22:0/3401277150 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb0b80ad910 con 0x7fb0bc162e60 2024-04-16T16:18:43.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.920+0000 7fb0c1e00640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0a006c980 0x7fb0a006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:43.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.921+0000 7fb0c1e00640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0a006c980 0x7fb0a006ee40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005c00 tx=0x7fb0b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:43.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:43.924+0000 7fb0b2000640 1 -- 172.21.15.22:0/3401277150 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0bc15b400 con 0x7fb0bc162e60 2024-04-16T16:18:44.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.130+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) -- 0x7fb0bc0cf3b0 con 0x7fb0bc162e60 2024-04-16T16:18:44.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.134+0000 7fb0b2000640 1 -- 172.21.15.22:0/3401277150 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v11)=0 v11) ==== 130+0+0 (secure 0 0 0) 0x7fb0b8040070 con 0x7fb0bc162e60 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.137+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0a006c980 msgr2=0x7fb0a006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.137+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0a006c980 0x7fb0a006ee40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005c00 tx=0x7fb0b4009040 comp rx=0 tx=0).stop 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.137+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc162e60 msgr2=0x7fb0bc0b9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.137+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc162e60 0x7fb0bc0b9920 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80096f0 tx=0x7fb0b80046c0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 shutdown_connections 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0a006c980 0x7fb0a006ee40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0bc162e60 0x7fb0bc0b9920 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0bc0d4d00 0x7fb0bc0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 --2- 172.21.15.22:0/3401277150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0bc0d0ca0 0x7fb0bc15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 >> 172.21.15.22:0/3401277150 conn(0x7fb0bc072460 msgr2=0x7fb0bc161f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:44.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 shutdown_connections 2024-04-16T16:18:44.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.138+0000 7fb0c3200640 1 -- 172.21.15.22:0/3401277150 wait complete. 2024-04-16T16:18:44.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol25090 subvol_snap87590 subvol_clone29220 2024-04-16T16:18:44.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.388+0000 7f91bee00640 1 Processor -- start 2024-04-16T16:18:44.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.389+0000 7f91bee00640 1 -- start start 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.390+0000 7f91bee00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b815c8d0 0x7f91b815db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.390+0000 7f91bee00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91b80727a0 0x7f91b80b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.390+0000 7f91bee00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b8073420 con 0x7f91b8072c00 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.390+0000 7f91bee00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f91b8073140 con 0x7f91b80727a0 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.390+0000 7f91bee00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91b815d080 con 0x7f91b815c8d0 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.391+0000 7f91b7400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91b80727a0 0x7f91b80b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.391+0000 7f91bce00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f91b8072c00 0x7f91b8071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39808/0 (socket says 172.21.15.22:39808) 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.391+0000 7f91bce00640 1 -- 172.21.15.22:0/3656289220 learned_addr learned my addr 172.21.15.22:0/3656289220 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.391+0000 7f91b7e00640 1 --2- 172.21.15.22:0/3656289220 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b815c8d0 0x7f91b815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.392+0000 7f91b7400640 1 -- 172.21.15.22:0/3656289220 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b815c8d0 msgr2=0x7f91b815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.392+0000 7f91b7400640 1 --2- 172.21.15.22:0/3656289220 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b815c8d0 0x7f91b815db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.392+0000 7f91b7400640 1 -- 172.21.15.22:0/3656289220 >> v1:172.21.15.22:6789/0 conn(0x7f91b8072c00 legacy=0x7f91b8071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.392+0000 7f91b7400640 1 -- 172.21.15.22:0/3656289220 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b815d360 con 0x7f91b80727a0 2024-04-16T16:18:44.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.393+0000 7f91b7400640 1 --2- 172.21.15.22:0/3656289220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b80727a0 0x7f91b80b2420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097a0 tx=0x7f91a002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6156dff297b77fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:44.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.393+0000 7f91b6a00640 1 -- 172.21.15.22:0/3656289220 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0035020 con 0x7f91b80727a0 2024-04-16T16:18:44.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.393+0000 7f91b6a00640 1 -- 172.21.15.22:0/3656289220 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0031810 con 0x7f91b80727a0 2024-04-16T16:18:44.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.393+0000 7f91b6a00640 1 -- 172.21.15.22:0/3656289220 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0031be0 con 0x7f91b80727a0 2024-04-16T16:18:44.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 -- 172.21.15.22:0/3656289220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b80727a0 msgr2=0x7f91b80b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 --2- 172.21.15.22:0/3656289220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b80727a0 0x7f91b80b2420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097a0 tx=0x7f91a002b8b0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 -- 172.21.15.22:0/3656289220 shutdown_connections 2024-04-16T16:18:44.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 --2- 172.21.15.22:0/3656289220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b80727a0 0x7f91b80b2420 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 --2- 172.21.15.22:0/3656289220 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b815c8d0 0x7f91b815db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 -- 172.21.15.22:0/3656289220 >> 172.21.15.22:0/3656289220 conn(0x7f91b8062440 msgr2=0x7f91b8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 -- 172.21.15.22:0/3656289220 shutdown_connections 2024-04-16T16:18:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.394+0000 7f91bee00640 1 -- 172.21.15.22:0/3656289220 wait complete. 2024-04-16T16:18:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.396+0000 7f91bee00640 1 Processor -- start 2024-04-16T16:18:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.396+0000 7f91bee00640 1 -- start start 2024-04-16T16:18:44.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b80727a0 0x7f91b80b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:44.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bee00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b8072c00 0x7f91b814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:44.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bee00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b815c8d0 0x7f91b80aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:44.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bee00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91b815ce30 con 0x7f91b815c8d0 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91b815ccb0 con 0x7f91b80727a0 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bee00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91b80d0310 con 0x7f91b8072c00 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b815c8d0 0x7f91b80aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b815c8d0 0x7f91b80aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48144/0 (socket says 172.21.15.22:48144) 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.397+0000 7f91bce00640 1 -- 172.21.15.22:0/898493400 learned_addr learned my addr 172.21.15.22:0/898493400 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91b7e00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b80727a0 0x7f91b80b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91bce00640 1 -- 172.21.15.22:0/898493400 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b8072c00 msgr2=0x7f91b814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91bce00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b8072c00 0x7f91b814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91bce00640 1 -- 172.21.15.22:0/898493400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b80727a0 msgr2=0x7f91b80b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91bce00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b80727a0 0x7f91b80b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91bce00640 1 -- 172.21.15.22:0/898493400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b80aa9c0 con 0x7f91b815c8d0 2024-04-16T16:18:44.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91bce00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b815c8d0 0x7f91b80aba60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f91b0001eb0 tx=0x7f91b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:44.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91afe00640 1 -- 172.21.15.22:0/898493400 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0017070 con 0x7f91b815c8d0 2024-04-16T16:18:44.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91afe00640 1 -- 172.21.15.22:0/898493400 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b0005ce0 con 0x7f91b815c8d0 2024-04-16T16:18:44.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b80aaca0 con 0x7f91b815c8d0 2024-04-16T16:18:44.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.398+0000 7f91afe00640 1 -- 172.21.15.22:0/898493400 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0007310 con 0x7f91b815c8d0 2024-04-16T16:18:44.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.399+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b80ab540 con 0x7f91b815c8d0 2024-04-16T16:18:44.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.400+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b80ab090 con 0x7f91b815c8d0 2024-04-16T16:18:44.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.401+0000 7f91afe00640 1 -- 172.21.15.22:0/898493400 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f91b001a070 con 0x7f91b815c8d0 2024-04-16T16:18:44.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.402+0000 7f91afe00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f919406c980 0x7f919406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:44.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.402+0000 7f91afe00640 1 -- 172.21.15.22:0/898493400 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f91b008b060 con 0x7f91b815c8d0 2024-04-16T16:18:44.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.402+0000 7f91b7e00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f919406c980 0x7f919406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:44.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.403+0000 7f91b7e00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f919406c980 0x7f919406ee40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009f30 tx=0x7f91a800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:44.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.406+0000 7f91afe00640 1 -- 172.21.15.22:0/898493400 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91b00593a0 con 0x7f91b815c8d0 2024-04-16T16:18:44.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.657+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol25090", "snap_name": "subvol_snap87590", "target_sub_name": "subvol_clone29220", "target": ["mon-mgr", ""]}) -- 0x7f91b80aae70 con 0x7f919406c980 2024-04-16T16:18:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.871+0000 7f91afe00640 1 -- 172.21.15.22:0/898493400 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f91b80aae70 con 0x7f919406c980 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f919406c980 msgr2=0x7f919406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f919406c980 0x7f919406ee40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009f30 tx=0x7f91a800b040 comp rx=0 tx=0).stop 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b815c8d0 msgr2=0x7f91b80aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b815c8d0 0x7f91b80aba60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f91b0001eb0 tx=0x7f91b000c890 comp rx=0 tx=0).stop 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 shutdown_connections 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f919406c980 0x7f919406ee40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b815c8d0 0x7f91b80aba60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b8072c00 0x7f91b814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 --2- 172.21.15.22:0/898493400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b80727a0 0x7f91b80b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 >> 172.21.15.22:0/898493400 conn(0x7f91b8062440 msgr2=0x7f91b81598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 shutdown_connections 2024-04-16T16:18:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:44.876+0000 7f91bee00640 1 -- 172.21.15.22:0/898493400 wait complete. 2024-04-16T16:18:44.878 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.879+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.878 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.879+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.878 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.879+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.878 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.879+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.878 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.879+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:18:44.900 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir ./volumes/_nogroup/subvol25090/.snap/subvol_snap87590) 2024-04-16T16:18:44.901 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.901+0000 7f04e6400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.901 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.901+0000 7f04e6400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.901 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.901+0000 7f04e6400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.901 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.901+0000 7f04e6400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.901 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:44.901+0000 7f04e6400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:44.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone29220 2024-04-16T16:18:45.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.192+0000 7f2148800640 1 Processor -- start 2024-04-16T16:18:45.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.193+0000 7f2148800640 1 -- start start 2024-04-16T16:18:45.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.194+0000 7f2148800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f214015fab0 0x7f214006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:45.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.194+0000 7f2148800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2140160060 con 0x7f214006e150 2024-04-16T16:18:45.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.194+0000 7f2148800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21400b4490 con 0x7f214015b750 2024-04-16T16:18:45.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.194+0000 7f2148800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f214006eaf0 con 0x7f214015fab0 2024-04-16T16:18:45.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2145400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f214006e150 0x7f214015f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39824/0 (socket says 172.21.15.22:39824) 2024-04-16T16:18:45.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2145400640 1 -- 172.21.15.22:0/1175245391 learned_addr learned my addr 172.21.15.22:0/1175245391 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:45.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2146800640 1 --2- 172.21.15.22:0/1175245391 >> v2:172.21.15.22:3300/0 conn(0x7f214015fab0 0x7f214006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:45.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2144a00640 1 -- 172.21.15.22:0/1175245391 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863638445 0 0) 0x7f2140160060 con 0x7f214006e150 2024-04-16T16:18:45.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2144a00640 1 -- 172.21.15.22:0/1175245391 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2128003520 con 0x7f214006e150 2024-04-16T16:18:45.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2146800640 1 -- 172.21.15.22:0/1175245391 >> v1:172.21.15.43:6789/0 conn(0x7f214015b750 legacy=0x7f21400b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:45.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2146800640 1 -- 172.21.15.22:0/1175245391 >> v1:172.21.15.22:6789/0 conn(0x7f214006e150 legacy=0x7f214015f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:45.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.195+0000 7f2146800640 1 -- 172.21.15.22:0/1175245391 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21400b4770 con 0x7f214015fab0 2024-04-16T16:18:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.196+0000 7f2146800640 1 --2- 172.21.15.22:0/1175245391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214015fab0 0x7f214006e5b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f213c009d90 tx=0x7f213c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d31b16a1e2890f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2144a00640 1 -- 172.21.15.22:0/1175245391 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c039070 con 0x7f214015fab0 2024-04-16T16:18:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2144a00640 1 -- 172.21.15.22:0/1175245391 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c02cc60 con 0x7f214015fab0 2024-04-16T16:18:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2144a00640 1 -- 172.21.15.22:0/1175245391 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c034660 con 0x7f214015fab0 2024-04-16T16:18:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2148800640 1 -- 172.21.15.22:0/1175245391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214015fab0 msgr2=0x7f214006e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2148800640 1 --2- 172.21.15.22:0/1175245391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214015fab0 0x7f214006e5b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f213c009d90 tx=0x7f213c02beb0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2148800640 1 -- 172.21.15.22:0/1175245391 shutdown_connections 2024-04-16T16:18:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2148800640 1 --2- 172.21.15.22:0/1175245391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214015fab0 0x7f214006e5b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.197+0000 7f2148800640 1 -- 172.21.15.22:0/1175245391 >> 172.21.15.22:0/1175245391 conn(0x7f2140062440 msgr2=0x7f2140062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.198+0000 7f2148800640 1 -- 172.21.15.22:0/1175245391 shutdown_connections 2024-04-16T16:18:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.198+0000 7f2148800640 1 -- 172.21.15.22:0/1175245391 wait complete. 2024-04-16T16:18:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.199+0000 7f2148800640 1 Processor -- start 2024-04-16T16:18:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.199+0000 7f2148800640 1 -- start start 2024-04-16T16:18:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.200+0000 7f2148800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214006e150 0x7f2140151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.200+0000 7f2148800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f214015b750 0x7f214015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.200+0000 7f2148800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f214015fab0 0x7f2140159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.200+0000 7f2148800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21400cd7a0 con 0x7f214006e150 2024-04-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.200+0000 7f2148800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21400b4ae0 con 0x7f214015fab0 2024-04-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.200+0000 7f2148800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f21400cd920 con 0x7f214015b750 2024-04-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214006e150 0x7f2140151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214006e150 0x7f2140151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48190/0 (socket says 172.21.15.22:48190) 2024-04-16T16:18:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 -- 172.21.15.22:0/1602684856 learned_addr learned my addr 172.21.15.22:0/1602684856 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 -- 172.21.15.22:0/1602684856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f214015b750 msgr2=0x7f214015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f214015b750 0x7f214015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 -- 172.21.15.22:0/1602684856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f214015fab0 msgr2=0x7f2140159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f214015fab0 0x7f2140159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 -- 172.21.15.22:0/1602684856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214015a1f0 con 0x7f214006e150 2024-04-16T16:18:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.201+0000 7f2145e00640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214006e150 0x7f2140151f90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f213400c450 tx=0x7f213400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.202+0000 7f213a000640 1 -- 172.21.15.22:0/1602684856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21340052d0 con 0x7f214006e150 2024-04-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.202+0000 7f213a000640 1 -- 172.21.15.22:0/1602684856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2134005470 con 0x7f214006e150 2024-04-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.202+0000 7f213a000640 1 -- 172.21.15.22:0/1602684856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134012870 con 0x7f214006e150 2024-04-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.202+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214015a4d0 con 0x7f214006e150 2024-04-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.202+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214015aa90 con 0x7f214006e150 2024-04-16T16:18:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.203+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214004fd90 con 0x7f214006e150 2024-04-16T16:18:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.204+0000 7f213a000640 1 -- 172.21.15.22:0/1602684856 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f2134012a10 con 0x7f214006e150 2024-04-16T16:18:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.205+0000 7f213a000640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f212006c9b0 0x7f212006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.205+0000 7f213a000640 1 -- 172.21.15.22:0/1602684856 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f213408b730 con 0x7f214006e150 2024-04-16T16:18:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.205+0000 7f2145400640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f212006c9b0 0x7f212006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.206+0000 7f2145400640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f212006c9b0 0x7f212006ee70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f214015b020 tx=0x7f212c007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:45.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.210+0000 7f213a000640 1 -- 172.21.15.22:0/1602684856 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2134059c00 con 0x7f214006e150 2024-04-16T16:18:45.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.455+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone29220", "target": ["mon-mgr", ""]}) -- 0x7f21400b5180 con 0x7f212006c9b0 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.468+0000 7f213a000640 1 -- 172.21.15.22:0/1602684856 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7f21400b5180 con 0x7f212006c9b0 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "pending", 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol25090", 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap87590" 2024-04-16T16:18:45.468 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:45.469 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:45.469 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:18:45.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f212006c9b0 msgr2=0x7f212006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:45.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f212006c9b0 0x7f212006ee70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f214015b020 tx=0x7f212c007930 comp rx=0 tx=0).stop 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214006e150 msgr2=0x7f2140151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214006e150 0x7f2140151f90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f213400c450 tx=0x7f213400c910 comp rx=0 tx=0).stop 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 shutdown_connections 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f212006c9b0 0x7f212006ee70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f214015fab0 0x7f2140159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f214015b750 0x7f214015e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 --2- 172.21.15.22:0/1602684856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f214006e150 0x7f2140151f90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 >> 172.21.15.22:0/1602684856 conn(0x7f2140062440 msgr2=0x7f21400ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 shutdown_connections 2024-04-16T16:18:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:45.471+0000 7f2148800640 1 -- 172.21.15.22:0/1602684856 wait complete. 2024-04-16T16:18:46.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone29220 2024-04-16T16:18:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.731+0000 7fce7ea00640 1 Processor -- start 2024-04-16T16:18:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.732+0000 7fce7ea00640 1 -- start start 2024-04-16T16:18:46.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.734+0000 7fce7ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce780b33a0 0x7fce78070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.734+0000 7fce7ea00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce780715c0 con 0x7fce780b4fa0 2024-04-16T16:18:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.734+0000 7fce7ea00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce780718a0 con 0x7fce7815fe30 2024-04-16T16:18:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.734+0000 7fce7ea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fce78071360 con 0x7fce780b33a0 2024-04-16T16:18:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.734+0000 7fce7d600640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fce780b4fa0 0x7fce7815f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39832/0 (socket says 172.21.15.22:39832) 2024-04-16T16:18:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.734+0000 7fce7d600640 1 -- 172.21.15.22:0/3831370270 learned_addr learned my addr 172.21.15.22:0/3831370270 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:46.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce7e000640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce780b33a0 0x7fce78070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2349238645 0 0) 0x7fce780715c0 con 0x7fce780b4fa0 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce60003520 con 0x7fce780b4fa0 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2420613656 0 0) 0x7fce60003520 con 0x7fce780b4fa0 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce780b33a0 msgr2=0x7fce78070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce780b33a0 0x7fce78070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 >> v1:172.21.15.43:6789/0 conn(0x7fce7815fe30 legacy=0x7fce780ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce78071b80 con 0x7fce780b4fa0 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fce6c001670 con 0x7fce780b4fa0 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 >> v1:172.21.15.22:6789/0 conn(0x7fce780b4fa0 legacy=0x7fce7815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce600039e0 0x7fce60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce60004800 0x7fce60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce600051c0 0x7fce6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fce78071360 con 0x7fce600051c0 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fce6000c090 con 0x7fce600039e0 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fce6000c290 con 0x7fce60004800 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.735+0000 7fce7e000640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce780b33a0 0x7fce78070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7e000640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce600051c0 0x7fce6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7d600640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce600039e0 0x7fce60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7cc00640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce60004800 0x7fce60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7e000640 1 -- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce60004800 msgr2=0x7fce60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7e000640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce60004800 0x7fce60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7e000640 1 -- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce600039e0 msgr2=0x7fce60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7e000640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce600039e0 0x7fce60003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:46.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.736+0000 7fce7e000640 1 -- 172.21.15.22:0/3831370270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce60003520 con 0x7fce600051c0 2024-04-16T16:18:46.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.737+0000 7fce7e000640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce600051c0 0x7fce6000b9c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fce780b3780 tx=0x7fce60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810570f9146462dd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:46.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70032070 con 0x7fce600051c0 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce70030070 con 0x7fce600051c0 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce77e00640 1 -- 172.21.15.22:0/3831370270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70009b50 con 0x7fce600051c0 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce7ea00640 1 -- 172.21.15.22:0/3831370270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce600051c0 msgr2=0x7fce6000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce7ea00640 1 --2- 172.21.15.22:0/3831370270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce600051c0 0x7fce6000b9c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fce780b3780 tx=0x7fce60005830 comp rx=0 tx=0).stop 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce7e000640 1 -- 172.21.15.22:0/3831370270 reap_dead start 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce7ea00640 1 -- 172.21.15.22:0/3831370270 shutdown_connections 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.738+0000 7fce7ea00640 1 -- 172.21.15.22:0/3831370270 >> 172.21.15.22:0/3831370270 conn(0x7fce78075070 msgr2=0x7fce78062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.739+0000 7fce7ea00640 1 -- 172.21.15.22:0/3831370270 shutdown_connections 2024-04-16T16:18:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.739+0000 7fce7ea00640 1 -- 172.21.15.22:0/3831370270 wait complete. 2024-04-16T16:18:46.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.740+0000 7fce7ea00640 1 Processor -- start 2024-04-16T16:18:46.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.741+0000 7fce7ea00640 1 -- start start 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce600051c0 0x7fce780d0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce7814bae0 0x7fce7806e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce781e5f70 0x7fce781e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7ea00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fce780b5380 con 0x7fce781e5f70 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7ea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fce780ce630 con 0x7fce7814bae0 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7ea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fce780b5500 con 0x7fce600051c0 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce781e5f70 0x7fce781e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce781e5f70 0x7fce781e63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48220/0 (socket says 172.21.15.22:48220) 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 -- 172.21.15.22:0/525183422 learned_addr learned my addr 172.21.15.22:0/525183422 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7d600640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce600051c0 0x7fce780d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7cc00640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce7814bae0 0x7fce7806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 -- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce600051c0 msgr2=0x7fce780d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce600051c0 0x7fce780d0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 -- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce7814bae0 msgr2=0x7fce7806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce7814bae0 0x7fce7806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.742+0000 7fce7e000640 1 -- 172.21.15.22:0/525183422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7806eea0 con 0x7fce781e5f70 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.743+0000 7fce7e000640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce781e5f70 0x7fce781e63f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fce7002c6f0 tx=0x7fce70004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.743+0000 7fce75600640 1 -- 172.21.15.22:0/525183422 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70004440 con 0x7fce781e5f70 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.743+0000 7fce75600640 1 -- 172.21.15.22:0/525183422 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce700045e0 con 0x7fce781e5f70 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.743+0000 7fce75600640 1 -- 172.21.15.22:0/525183422 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70037460 con 0x7fce781e5f70 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.743+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7806ce50 con 0x7fce781e5f70 2024-04-16T16:18:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.743+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7806d410 con 0x7fce781e5f70 2024-04-16T16:18:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.744+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce78075f30 con 0x7fce781e5f70 2024-04-16T16:18:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.746+0000 7fce75600640 1 -- 172.21.15.22:0/525183422 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7fce70037600 con 0x7fce781e5f70 2024-04-16T16:18:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.747+0000 7fce75600640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fce5806caa0 0x7fce5806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.747+0000 7fce75600640 1 -- 172.21.15.22:0/525183422 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fce700ad900 con 0x7fce781e5f70 2024-04-16T16:18:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.747+0000 7fce7d600640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fce5806caa0 0x7fce5806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.748+0000 7fce7d600640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fce5806caa0 0x7fce5806ef60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000fb0 tx=0x7fce6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:46.752+0000 7fce75600640 1 -- 172.21.15.22:0/525183422 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce7007ba50 con 0x7fce781e5f70 2024-04-16T16:18:47.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.000+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone29220", "target": ["mon-mgr", ""]}) -- 0x7fce780d0c80 con 0x7fce5806caa0 2024-04-16T16:18:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.011+0000 7fce75600640 1 -- 172.21.15.22:0/525183422 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7fce780d0c80 con 0x7fce5806caa0 2024-04-16T16:18:47.011 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:18:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:18:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "pending", 2024-04-16T16:18:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:18:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:18:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol25090", 2024-04-16T16:18:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap87590" 2024-04-16T16:18:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:47.012 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:18:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fce5806caa0 msgr2=0x7fce5806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fce5806caa0 0x7fce5806ef60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000fb0 tx=0x7fce6c009040 comp rx=0 tx=0).stop 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce781e5f70 msgr2=0x7fce781e63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce781e5f70 0x7fce781e63f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fce7002c6f0 tx=0x7fce70004ab0 comp rx=0 tx=0).stop 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 shutdown_connections 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fce5806caa0 0x7fce5806ef60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce781e5f70 0x7fce781e63f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce7814bae0 0x7fce7806e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 --2- 172.21.15.22:0/525183422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce600051c0 0x7fce780d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 >> 172.21.15.22:0/525183422 conn(0x7fce78075070 msgr2=0x7fce78062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.014+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 shutdown_connections 2024-04-16T16:18:47.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:47.015+0000 7fce7ea00640 1 -- 172.21.15.22:0/525183422 wait complete. 2024-04-16T16:18:48.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone29220 2024-04-16T16:18:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.274+0000 7f36a7200640 1 Processor -- start 2024-04-16T16:18:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.274+0000 7f36a7200640 1 -- start start 2024-04-16T16:18:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.275+0000 7f36a7200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f36a006cab0 0x7f36a006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.275+0000 7f36a7200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36a00d33e0 0x7f36a00cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.275+0000 7f36a7200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a006eb30 con 0x7f36a015ee90 2024-04-16T16:18:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.275+0000 7f36a7200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f36a00d1eb0 con 0x7f36a00d33e0 2024-04-16T16:18:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.275+0000 7f36a7200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f36a00d18f0 con 0x7f36a006cab0 2024-04-16T16:18:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.276+0000 7f36a5200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36a00d33e0 0x7f36a00cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.276+0000 7f36a5200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36a00d33e0 0x7f36a00cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48236/0 (socket says 172.21.15.22:48236) 2024-04-16T16:18:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.276+0000 7f36a5200640 1 -- 172.21.15.22:0/282721460 learned_addr learned my addr 172.21.15.22:0/282721460 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.276+0000 7f369f400640 1 --2- 172.21.15.22:0/282721460 >> v2:172.21.15.43:3300/0 conn(0x7f36a006cab0 0x7f36a006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.276+0000 7f36a5200640 1 -- 172.21.15.22:0/282721460 >> v2:172.21.15.43:3300/0 conn(0x7f36a006cab0 msgr2=0x7f36a006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.277+0000 7f36a5200640 1 --2- 172.21.15.22:0/282721460 >> v2:172.21.15.43:3300/0 conn(0x7f36a006cab0 0x7f36a006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.277+0000 7f36a5200640 1 -- 172.21.15.22:0/282721460 >> v1:172.21.15.43:6789/0 conn(0x7f36a015ee90 legacy=0x7f36a006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.277+0000 7f36a5200640 1 -- 172.21.15.22:0/282721460 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a00d1bd0 con 0x7f36a00d33e0 2024-04-16T16:18:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.277+0000 7f369f400640 1 --2- 172.21.15.22:0/282721460 >> v2:172.21.15.43:3300/0 conn(0x7f36a006cab0 0x7f36a006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.278+0000 7f36a5200640 1 --2- 172.21.15.22:0/282721460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a00d33e0 0x7f36a00cd4d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f36a00b5480 tx=0x7f369802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a83c0a7d5ad6e7a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.278+0000 7f369ea00640 1 -- 172.21.15.22:0/282721460 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369802ca80 con 0x7f36a00d33e0 2024-04-16T16:18:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.278+0000 7f369ea00640 1 -- 172.21.15.22:0/282721460 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369802cc20 con 0x7f36a00d33e0 2024-04-16T16:18:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.278+0000 7f369ea00640 1 -- 172.21.15.22:0/282721460 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980343f0 con 0x7f36a00d33e0 2024-04-16T16:18:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 -- 172.21.15.22:0/282721460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a00d33e0 msgr2=0x7f36a00cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 --2- 172.21.15.22:0/282721460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a00d33e0 0x7f36a00cd4d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f36a00b5480 tx=0x7f369802bee0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 -- 172.21.15.22:0/282721460 shutdown_connections 2024-04-16T16:18:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 --2- 172.21.15.22:0/282721460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a00d33e0 0x7f36a00cd4d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 --2- 172.21.15.22:0/282721460 >> v2:172.21.15.43:3300/0 conn(0x7f36a006cab0 0x7f36a006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 -- 172.21.15.22:0/282721460 >> 172.21.15.22:0/282721460 conn(0x7f36a00d28c0 msgr2=0x7f36a00d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 -- 172.21.15.22:0/282721460 shutdown_connections 2024-04-16T16:18:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.279+0000 7f36a7200640 1 -- 172.21.15.22:0/282721460 wait complete. 2024-04-16T16:18:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.281+0000 7f36a7200640 1 Processor -- start 2024-04-16T16:18:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.281+0000 7f36a7200640 1 -- start start 2024-04-16T16:18:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.282+0000 7f36a7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36a006cab0 0x7f36a015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.282+0000 7f36a7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36a00d33e0 0x7f36a00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.282+0000 7f36a7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a015ee90 0x7f36a00cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.282+0000 7f36a7200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f36a015f270 con 0x7f36a015ee90 2024-04-16T16:18:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.282+0000 7f36a7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36a00d15c0 con 0x7f36a00d33e0 2024-04-16T16:18:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.282+0000 7f36a7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36a015adf0 con 0x7f36a006cab0 2024-04-16T16:18:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a015ee90 0x7f36a00cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a015ee90 0x7f36a00cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48246/0 (socket says 172.21.15.22:48246) 2024-04-16T16:18:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 -- 172.21.15.22:0/636247205 learned_addr learned my addr 172.21.15.22:0/636247205 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f369f400640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36a00d33e0 0x7f36a00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f369fe00640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36a006cab0 0x7f36a015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 -- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36a006cab0 msgr2=0x7f36a015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36a006cab0 0x7f36a015bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 -- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36a00d33e0 msgr2=0x7f36a00cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36a00d33e0 0x7f36a00cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.283+0000 7f36a5200640 1 -- 172.21.15.22:0/636247205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a00cade0 con 0x7f36a015ee90 2024-04-16T16:18:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.284+0000 7f36a5200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a015ee90 0x7f36a00cc010 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3698036040 tx=0x7f3698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.284+0000 7f3697e00640 1 -- 172.21.15.22:0/636247205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698043020 con 0x7f36a015ee90 2024-04-16T16:18:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.284+0000 7f3697e00640 1 -- 172.21.15.22:0/636247205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369803e450 con 0x7f36a015ee90 2024-04-16T16:18:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.284+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a015b0b0 con 0x7f36a015ee90 2024-04-16T16:18:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.284+0000 7f3697e00640 1 -- 172.21.15.22:0/636247205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698009510 con 0x7f36a015ee90 2024-04-16T16:18:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.284+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a015b670 con 0x7f36a015ee90 2024-04-16T16:18:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.285+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a004fd90 con 0x7f36a015ee90 2024-04-16T16:18:48.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.286+0000 7f3697e00640 1 -- 172.21.15.22:0/636247205 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f3698046020 con 0x7f36a015ee90 2024-04-16T16:18:48.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.287+0000 7f3697e00640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f367c06caa0 0x7f367c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:48.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.288+0000 7f3697e00640 1 -- 172.21.15.22:0/636247205 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f36980ae7d0 con 0x7f36a015ee90 2024-04-16T16:18:48.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.288+0000 7f369fe00640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f367c06caa0 0x7f367c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:48.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.289+0000 7f369fe00640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f367c06caa0 0x7f367c06ef60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3690003d90 tx=0x7f3690009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:48.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.292+0000 7f3697e00640 1 -- 172.21.15.22:0/636247205 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f369804d030 con 0x7f36a015ee90 2024-04-16T16:18:48.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.536+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone29220", "target": ["mon-mgr", ""]}) -- 0x7f36a00c9c40 con 0x7f367c06caa0 2024-04-16T16:18:48.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.547+0000 7f3697e00640 1 -- 172.21.15.22:0/636247205 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7f36a00c9c40 con 0x7f367c06caa0 2024-04-16T16:18:48.547 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:18:48.547 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:18:48.547 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "pending", 2024-04-16T16:18:48.547 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:18:48.547 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:18:48.548 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol25090", 2024-04-16T16:18:48.548 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap87590" 2024-04-16T16:18:48.548 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:48.548 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:48.548 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f367c06caa0 msgr2=0x7f367c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f367c06caa0 0x7f367c06ef60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3690003d90 tx=0x7f3690009040 comp rx=0 tx=0).stop 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a015ee90 msgr2=0x7f36a00cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a015ee90 0x7f36a00cc010 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3698036040 tx=0x7f3698004a40 comp rx=0 tx=0).stop 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 shutdown_connections 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f367c06caa0 0x7f367c06ef60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36a015ee90 0x7f36a00cc010 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36a00d33e0 0x7f36a00cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 --2- 172.21.15.22:0/636247205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36a006cab0 0x7f36a015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:48.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 >> 172.21.15.22:0/636247205 conn(0x7f36a00d28c0 msgr2=0x7f36a015dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:48.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 shutdown_connections 2024-04-16T16:18:48.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:48.550+0000 7f36a7200640 1 -- 172.21.15.22:0/636247205 wait complete. 2024-04-16T16:18:49.570 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone29220 2024-04-16T16:18:49.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.805+0000 7fd51b800640 1 Processor -- start 2024-04-16T16:18:49.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.806+0000 7fd51b800640 1 -- start start 2024-04-16T16:18:49.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.807+0000 7fd51b800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5140cfb10 0x7fd5140cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.807+0000 7fd51b800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd514162d00 0x7fd514163170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.807+0000 7fd51b800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd514163a30 con 0x7fd5140b3d60 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.807+0000 7fd51b800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd5140d04e0 con 0x7fd5140cfb10 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.807+0000 7fd51b800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd5140d2f70 con 0x7fd514162d00 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd513e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5140cfb10 0x7fd5140cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd513e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5140cfb10 0x7fd5140cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48252/0 (socket says 172.21.15.22:48252) 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd513e00640 1 -- 172.21.15.22:0/3578288117 learned_addr learned my addr 172.21.15.22:0/3578288117 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd519800640 1 --2- 172.21.15.22:0/3578288117 >> v2:172.21.15.43:3300/0 conn(0x7fd514162d00 0x7fd514163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd513e00640 1 -- 172.21.15.22:0/3578288117 >> v2:172.21.15.43:3300/0 conn(0x7fd514162d00 msgr2=0x7fd514163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:49.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd513e00640 1 --2- 172.21.15.22:0/3578288117 >> v2:172.21.15.43:3300/0 conn(0x7fd514162d00 0x7fd514163170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:49.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd513e00640 1 -- 172.21.15.22:0/3578288117 >> v1:172.21.15.43:6789/0 conn(0x7fd5140b3d60 legacy=0x7fd5140d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:49.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.808+0000 7fd513e00640 1 -- 172.21.15.22:0/3578288117 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140d3250 con 0x7fd5140cfb10 2024-04-16T16:18:49.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.809+0000 7fd513e00640 1 --2- 172.21.15.22:0/3578288117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140cffa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b76e0 tx=0x7fd50002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1e11be77c7f9e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:49.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.810+0000 7fd513400640 1 -- 172.21.15.22:0/3578288117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50002e070 con 0x7fd5140cfb10 2024-04-16T16:18:49.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.810+0000 7fd513400640 1 -- 172.21.15.22:0/3578288117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd500037070 con 0x7fd5140cfb10 2024-04-16T16:18:49.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.810+0000 7fd513400640 1 -- 172.21.15.22:0/3578288117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500031a00 con 0x7fd5140cfb10 2024-04-16T16:18:49.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.810+0000 7fd51b800640 1 -- 172.21.15.22:0/3578288117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 msgr2=0x7fd5140cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:49.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.810+0000 7fd51b800640 1 --2- 172.21.15.22:0/3578288117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140cffa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b76e0 tx=0x7fd50002b880 comp rx=0 tx=0).stop 2024-04-16T16:18:49.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.811+0000 7fd51b800640 1 -- 172.21.15.22:0/3578288117 shutdown_connections 2024-04-16T16:18:49.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.811+0000 7fd51b800640 1 --2- 172.21.15.22:0/3578288117 >> v2:172.21.15.43:3300/0 conn(0x7fd514162d00 0x7fd514163170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:49.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.811+0000 7fd51b800640 1 --2- 172.21.15.22:0/3578288117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140cffa0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:49.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.811+0000 7fd51b800640 1 -- 172.21.15.22:0/3578288117 >> 172.21.15.22:0/3578288117 conn(0x7fd514062860 msgr2=0x7fd514062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:49.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.811+0000 7fd51b800640 1 -- 172.21.15.22:0/3578288117 shutdown_connections 2024-04-16T16:18:49.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.811+0000 7fd51b800640 1 -- 172.21.15.22:0/3578288117 wait complete. 2024-04-16T16:18:49.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.813+0000 7fd51b800640 1 Processor -- start 2024-04-16T16:18:49.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.813+0000 7fd51b800640 1 -- start start 2024-04-16T16:18:49.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd51b800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5140b3d60 0x7fd5140b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:49.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd51b800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:49.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd51b800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd514162d00 0x7fd5140cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd51b800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5140b4140 con 0x7fd5140cfb10 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd51b800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5140d3810 con 0x7fd514162d00 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd51b800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd5141636b0 con 0x7fd5140b3d60 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd513e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd513e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48256/0 (socket says 172.21.15.22:48256) 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd513e00640 1 -- 172.21.15.22:0/3285698229 learned_addr learned my addr 172.21.15.22:0/3285698229 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.815+0000 7fd519800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd514162d00 0x7fd5140cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd518e00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5140b3d60 0x7fd5140b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd513e00640 1 -- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5140b3d60 msgr2=0x7fd5140b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd513e00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5140b3d60 0x7fd5140b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd513e00640 1 -- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd514162d00 msgr2=0x7fd5140cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd513e00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd514162d00 0x7fd5140cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd513e00640 1 -- 172.21.15.22:0/3285698229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140b74b0 con 0x7fd5140cfb10 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd519800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd514162d00 0x7fd5140cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd518e00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5140b3d60 0x7fd5140b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd513e00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140b6f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd500000c00 tx=0x7fd5000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:49.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd510c00640 1 -- 172.21.15.22:0/3285698229 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500032670 con 0x7fd5140cfb10 2024-04-16T16:18:49.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd510c00640 1 -- 172.21.15.22:0/3285698229 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd500032850 con 0x7fd5140cfb10 2024-04-16T16:18:49.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd510c00640 1 -- 172.21.15.22:0/3285698229 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500032c40 con 0x7fd5140cfb10 2024-04-16T16:18:49.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.816+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5141f69f0 con 0x7fd5140cfb10 2024-04-16T16:18:49.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.817+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5141f6fb0 con 0x7fd5140cfb10 2024-04-16T16:18:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.818+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51404fd90 con 0x7fd5140cfb10 2024-04-16T16:18:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.819+0000 7fd510c00640 1 -- 172.21.15.22:0/3285698229 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7fd50004c060 con 0x7fd5140cfb10 2024-04-16T16:18:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.820+0000 7fd510c00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd4f406cad0 0x7fd4f406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.820+0000 7fd510c00640 1 -- 172.21.15.22:0/3285698229 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd5000adad0 con 0x7fd5140cfb10 2024-04-16T16:18:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.820+0000 7fd518e00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd4f406cad0 0x7fd4f406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.821+0000 7fd518e00640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd4f406cad0 0x7fd4f406ef90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b8650 tx=0x7fd504009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:49.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:49.824+0000 7fd510c00640 1 -- 172.21.15.22:0/3285698229 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5140b74b0 con 0x7fd5140cfb10 2024-04-16T16:18:50.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:50.095+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone29220", "target": ["mon-mgr", ""]}) -- 0x7fd5140d29f0 con 0x7fd4f406cad0 2024-04-16T16:18:52.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.408+0000 7fd510c00640 1 -- 172.21.15.22:0/3285698229 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+169 (secure 0 0 0) 0x7fd5140d29f0 con 0x7fd4f406cad0 2024-04-16T16:18:52.407 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:18:52.407 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:18:52.407 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "in-progress", 2024-04-16T16:18:52.407 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:18:52.407 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:18:52.408 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol25090", 2024-04-16T16:18:52.408 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap87590" 2024-04-16T16:18:52.408 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:52.408 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:52.408 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:18:52.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd4f406cad0 msgr2=0x7fd4f406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:52.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd4f406cad0 0x7fd4f406ef90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b8650 tx=0x7fd504009040 comp rx=0 tx=0).stop 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 msgr2=0x7fd5140b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140b6f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd500000c00 tx=0x7fd5000046c0 comp rx=0 tx=0).stop 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 shutdown_connections 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd4f406cad0 0x7fd4f406ef90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd514162d00 0x7fd5140cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5140cfb10 0x7fd5140b6f70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 --2- 172.21.15.22:0/3285698229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5140b3d60 0x7fd5140b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.411+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 >> 172.21.15.22:0/3285698229 conn(0x7fd514062860 msgr2=0x7fd5140c8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.412+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 shutdown_connections 2024-04-16T16:18:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:52.412+0000 7fd51b800640 1 -- 172.21.15.22:0/3285698229 wait complete. 2024-04-16T16:18:53.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone29220 2024-04-16T16:18:53.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.668+0000 7fab97600640 1 Processor -- start 2024-04-16T16:18:53.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.668+0000 7fab97600640 1 -- start start 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab97600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9006e150 0x7fab9006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab97600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab9015f3a0 0x7fab9015f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab97600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab90160060 con 0x7fab9015b750 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab97600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fab9006eaf0 con 0x7fab9015f3a0 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab97600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fab900b4ae0 con 0x7fab9006e150 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab95600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab9015f3a0 0x7fab9015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab95600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab9015f3a0 0x7fab9015f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33952/0 (socket says 172.21.15.22:33952) 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.670+0000 7fab95600640 1 -- 172.21.15.22:0/223961459 learned_addr learned my addr 172.21.15.22:0/223961459 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:53.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.671+0000 7fab8fe00640 1 --2- 172.21.15.22:0/223961459 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9006e150 0x7fab9006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:53.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.671+0000 7fab95600640 1 -- 172.21.15.22:0/223961459 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9006e150 msgr2=0x7fab9006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:53.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.671+0000 7fab95600640 1 --2- 172.21.15.22:0/223961459 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9006e150 0x7fab9006e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:53.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.671+0000 7fab95600640 1 -- 172.21.15.22:0/223961459 >> v1:172.21.15.43:6789/0 conn(0x7fab9015b750 legacy=0x7fab900b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:53.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.671+0000 7fab95600640 1 -- 172.21.15.22:0/223961459 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab900b4490 con 0x7fab9015f3a0 2024-04-16T16:18:53.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.672+0000 7fab95600640 1 --2- 172.21.15.22:0/223961459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9015f3a0 0x7fab9015f830 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fab88009e50 tx=0x7fab8802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457ef7358f3523d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:53.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.672+0000 7fab8f400640 1 -- 172.21.15.22:0/223961459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8802c9e0 con 0x7fab9015f3a0 2024-04-16T16:18:53.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.672+0000 7fab8f400640 1 -- 172.21.15.22:0/223961459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8802cb80 con 0x7fab9015f3a0 2024-04-16T16:18:53.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.672+0000 7fab8f400640 1 -- 172.21.15.22:0/223961459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab880343f0 con 0x7fab9015f3a0 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 -- 172.21.15.22:0/223961459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9015f3a0 msgr2=0x7fab9015f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 --2- 172.21.15.22:0/223961459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9015f3a0 0x7fab9015f830 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fab88009e50 tx=0x7fab8802be40 comp rx=0 tx=0).stop 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 -- 172.21.15.22:0/223961459 shutdown_connections 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 --2- 172.21.15.22:0/223961459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9015f3a0 0x7fab9015f830 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 --2- 172.21.15.22:0/223961459 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9006e150 0x7fab9006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 -- 172.21.15.22:0/223961459 >> 172.21.15.22:0/223961459 conn(0x7fab90062440 msgr2=0x7fab90062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 -- 172.21.15.22:0/223961459 shutdown_connections 2024-04-16T16:18:53.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.673+0000 7fab97600640 1 -- 172.21.15.22:0/223961459 wait complete. 2024-04-16T16:18:53.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.675+0000 7fab97600640 1 Processor -- start 2024-04-16T16:18:53.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.675+0000 7fab97600640 1 -- start start 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.676+0000 7fab97600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9006e150 0x7fab90153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.676+0000 7fab97600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9015b750 0x7fab90152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.676+0000 7fab97600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab9015f3a0 0x7fab90158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.676+0000 7fab97600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fab9015bb30 con 0x7fab9006e150 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.676+0000 7fab97600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab9015fd70 con 0x7fab9015f3a0 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.676+0000 7fab97600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fab9015bcb0 con 0x7fab9015b750 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9006e150 0x7fab90153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9006e150 0x7fab90153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33956/0 (socket says 172.21.15.22:33956) 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 -- 172.21.15.22:0/3503317645 learned_addr learned my addr 172.21.15.22:0/3503317645 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:53.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab8fe00640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9015b750 0x7fab90152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab95600640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab9015f3a0 0x7fab90158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 -- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9015b750 msgr2=0x7fab90152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9015b750 0x7fab90152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 -- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab9015f3a0 msgr2=0x7fab90158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab9015f3a0 0x7fab90158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.677+0000 7fab94c00640 1 -- 172.21.15.22:0/3503317645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab901596d0 con 0x7fab9006e150 2024-04-16T16:18:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.678+0000 7fab94c00640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9006e150 0x7fab90153430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab8400c440 tx=0x7fab8400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.678+0000 7fab8cc00640 1 -- 172.21.15.22:0/3503317645 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84017070 con 0x7fab9006e150 2024-04-16T16:18:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.678+0000 7fab8cc00640 1 -- 172.21.15.22:0/3503317645 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab840035f0 con 0x7fab9006e150 2024-04-16T16:18:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.678+0000 7fab8cc00640 1 -- 172.21.15.22:0/3503317645 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab840039e0 con 0x7fab9006e150 2024-04-16T16:18:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.678+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab901599b0 con 0x7fab9006e150 2024-04-16T16:18:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.678+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab90157b80 con 0x7fab9006e150 2024-04-16T16:18:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.679+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9004fd90 con 0x7fab9006e150 2024-04-16T16:18:53.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.680+0000 7fab8cc00640 1 -- 172.21.15.22:0/3503317645 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7fab84003b80 con 0x7fab9006e150 2024-04-16T16:18:53.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.681+0000 7fab8cc00640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fab7006caa0 0x7fab7006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:53.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.681+0000 7fab8cc00640 1 -- 172.21.15.22:0/3503317645 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5765+0+0 (secure 0 0 0) 0x7fab8408b240 con 0x7fab9006e150 2024-04-16T16:18:53.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.682+0000 7fab8fe00640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fab7006caa0 0x7fab7006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:53.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.682+0000 7fab8fe00640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fab7006caa0 0x7fab7006ef60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab7c006fd0 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.686+0000 7fab8cc00640 1 -- 172.21.15.22:0/3503317645 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab840593a0 con 0x7fab9006e150 2024-04-16T16:18:53.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:53.935+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone29220", "target": ["mon-mgr", ""]}) -- 0x7fab90062ca0 con 0x7fab7006caa0 2024-04-16T16:18:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.410+0000 7fab8cc00640 1 -- 172.21.15.22:0/3503317645 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+272 (secure 0 0 0) 0x7fab90062ca0 con 0x7fab7006caa0 2024-04-16T16:18:57.409 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "failed", 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol25090", 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap87590" 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:18:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: "failure": { 2024-04-16T16:18:57.411 INFO:teuthology.orchestra.run.smithi022.stdout: "errno": "2", 2024-04-16T16:18:57.411 INFO:teuthology.orchestra.run.smithi022.stdout: "error_msg": "snapshot 'subvol_snap87590' does not exist" 2024-04-16T16:18:57.411 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:57.411 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:57.411 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.413+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fab7006caa0 msgr2=0x7fab7006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.413+0000 7fab97600640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fab7006caa0 0x7fab7006ef60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab7c006fd0 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.413+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9006e150 msgr2=0x7fab90153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.413+0000 7fab97600640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9006e150 0x7fab90153430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab8400c440 tx=0x7fab8400c900 comp rx=0 tx=0).stop 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 shutdown_connections 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fab7006caa0 0x7fab7006ef60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab9015f3a0 0x7fab90158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab9015b750 0x7fab90152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 --2- 172.21.15.22:0/3503317645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab9006e150 0x7fab90153430 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 >> 172.21.15.22:0/3503317645 conn(0x7fab90062440 msgr2=0x7fab900cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 shutdown_connections 2024-04-16T16:18:57.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.414+0000 7fab97600640 1 -- 172.21.15.22:0/3503317645 wait complete. 2024-04-16T16:18:57.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone29220 2024-04-16T16:18:57.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.668+0000 7fb4db000640 1 Processor -- start 2024-04-16T16:18:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.669+0000 7fb4db000640 1 -- start start 2024-04-16T16:18:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.670+0000 7fb4db000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d415ecb0 0x7fb4d40cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.670+0000 7fb4db000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb4d40d0140 0x7fb4d40d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.670+0000 7fb4db000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d415f090 con 0x7fb4d40d2070 2024-04-16T16:18:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.670+0000 7fb4db000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d40d4430 con 0x7fb4d40d0140 2024-04-16T16:18:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.670+0000 7fb4db000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d40d24b0 con 0x7fb4d415ecb0 2024-04-16T16:18:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4cbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb4d40d0140 0x7fb4d40d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4cbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb4d40d0140 0x7fb4d40d1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33964/0 (socket says 172.21.15.22:33964) 2024-04-16T16:18:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4cbe00640 1 -- 172.21.15.22:0/1950340896 learned_addr learned my addr 172.21.15.22:0/1950340896 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4d3e00640 1 --2- 172.21.15.22:0/1950340896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d415ecb0 0x7fb4d40cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4cbe00640 1 -- 172.21.15.22:0/1950340896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d415ecb0 msgr2=0x7fb4d40cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4cbe00640 1 --2- 172.21.15.22:0/1950340896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d415ecb0 0x7fb4d40cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4cbe00640 1 -- 172.21.15.22:0/1950340896 >> v1:172.21.15.43:6789/0 conn(0x7fb4d40d2070 legacy=0x7fb4d40d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.671+0000 7fb4cbe00640 1 -- 172.21.15.22:0/1950340896 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d40d48c0 con 0x7fb4d40d0140 2024-04-16T16:18:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.672+0000 7fb4cbe00640 1 --2- 172.21.15.22:0/1950340896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d40d0140 0x7fb4d40d1b30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40d5c50 tx=0x7fb4bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320b7f52597abbfb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4d3400640 1 -- 172.21.15.22:0/1950340896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0315a0 con 0x7fb4d40d0140 2024-04-16T16:18:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4d3400640 1 -- 172.21.15.22:0/1950340896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc037070 con 0x7fb4d40d0140 2024-04-16T16:18:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4d3400640 1 -- 172.21.15.22:0/1950340896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc031960 con 0x7fb4d40d0140 2024-04-16T16:18:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4db000640 1 -- 172.21.15.22:0/1950340896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d40d0140 msgr2=0x7fb4d40d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4db000640 1 --2- 172.21.15.22:0/1950340896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d40d0140 0x7fb4d40d1b30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40d5c50 tx=0x7fb4bc02b840 comp rx=0 tx=0).stop 2024-04-16T16:18:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4db000640 1 -- 172.21.15.22:0/1950340896 shutdown_connections 2024-04-16T16:18:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4db000640 1 --2- 172.21.15.22:0/1950340896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d40d0140 0x7fb4d40d1b30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4db000640 1 --2- 172.21.15.22:0/1950340896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d415ecb0 0x7fb4d40cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.673+0000 7fb4db000640 1 -- 172.21.15.22:0/1950340896 >> 172.21.15.22:0/1950340896 conn(0x7fb4d4072460 msgr2=0x7fb4d4072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.674+0000 7fb4db000640 1 -- 172.21.15.22:0/1950340896 shutdown_connections 2024-04-16T16:18:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.674+0000 7fb4db000640 1 -- 172.21.15.22:0/1950340896 wait complete. 2024-04-16T16:18:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.675+0000 7fb4db000640 1 Processor -- start 2024-04-16T16:18:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.675+0000 7fb4db000640 1 -- start start 2024-04-16T16:18:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.676+0000 7fb4db000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d40d0140 0x7fb4d41580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.676+0000 7fb4db000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4d40d2070 0x7fb4d415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.676+0000 7fb4db000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d415ecb0 0x7fb4d414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.676+0000 7fb4db000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d40d3de0 con 0x7fb4d415ecb0 2024-04-16T16:18:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.676+0000 7fb4db000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d40d3b00 con 0x7fb4d40d2070 2024-04-16T16:18:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.676+0000 7fb4db000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d40d40c0 con 0x7fb4d40d0140 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d415ecb0 0x7fb4d414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d415ecb0 0x7fb4d414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33974/0 (socket says 172.21.15.22:33974) 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 -- 172.21.15.22:0/3341863749 learned_addr learned my addr 172.21.15.22:0/3341863749 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d3e00640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d40d0140 0x7fb4d41580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 -- 172.21.15.22:0/3341863749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d40d0140 msgr2=0x7fb4d41580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d40d0140 0x7fb4d41580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 -- 172.21.15.22:0/3341863749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4d40d2070 msgr2=0x7fb4d415fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4d40d2070 0x7fb4d415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 -- 172.21.15.22:0/3341863749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d414b4e0 con 0x7fb4d415ecb0 2024-04-16T16:18:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.677+0000 7fb4d9000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d415ecb0 0x7fb4d414afa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c780 tx=0x7fb4cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.678+0000 7fb4d0c00640 1 -- 172.21.15.22:0/3341863749 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc004b60 con 0x7fb4d415ecb0 2024-04-16T16:18:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.678+0000 7fb4d0c00640 1 -- 172.21.15.22:0/3341863749 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4cc004d00 con 0x7fb4d415ecb0 2024-04-16T16:18:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.678+0000 7fb4d0c00640 1 -- 172.21.15.22:0/3341863749 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc00aa90 con 0x7fb4d415ecb0 2024-04-16T16:18:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.678+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d4160480 con 0x7fb4d415ecb0 2024-04-16T16:18:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.678+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d4160a40 con 0x7fb4d415ecb0 2024-04-16T16:18:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.679+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d404fd90 con 0x7fb4d415ecb0 2024-04-16T16:18:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.680+0000 7fb4d0c00640 1 -- 172.21.15.22:0/3341863749 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7fb4cc00ac30 con 0x7fb4d415ecb0 2024-04-16T16:18:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.682+0000 7fb4d0c00640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4b006caa0 0x7fb4b006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.682+0000 7fb4d0c00640 1 -- 172.21.15.22:0/3341863749 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7fb4cc08c180 con 0x7fb4d415ecb0 2024-04-16T16:18:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.682+0000 7fb4d3e00640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4b006caa0 0x7fb4b006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.683+0000 7fb4d3e00640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4b006caa0 0x7fb4b006ef60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.687+0000 7fb4d0c00640 1 -- 172.21.15.22:0/3341863749 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4cc020070 con 0x7fb4d415ecb0 2024-04-16T16:18:57.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.932+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone29220", "target": ["mon-mgr", ""]}) -- 0x7fb4d41611c0 con 0x7fb4b006caa0 2024-04-16T16:18:57.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.945+0000 7fb4d0c00640 1 -- 172.21.15.22:0/3341863749 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+272 (secure 0 0 0) 0x7fb4d41611c0 con 0x7fb4b006caa0 2024-04-16T16:18:57.944 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:18:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:18:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "failed", 2024-04-16T16:18:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:18:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:18:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol25090", 2024-04-16T16:18:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap87590" 2024-04-16T16:18:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:18:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "failure": { 2024-04-16T16:18:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "errno": "2", 2024-04-16T16:18:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "error_msg": "snapshot 'subvol_snap87590' does not exist" 2024-04-16T16:18:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:18:57.945 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4b006caa0 msgr2=0x7fb4b006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4b006caa0 0x7fb4b006ef60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c4008040 comp rx=0 tx=0).stop 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d415ecb0 msgr2=0x7fb4d414afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d415ecb0 0x7fb4d414afa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c780 tx=0x7fb4cc00cc40 comp rx=0 tx=0).stop 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 shutdown_connections 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb4b006caa0 0x7fb4b006ef60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4d415ecb0 0x7fb4d414afa0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4d40d2070 0x7fb4d415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 --2- 172.21.15.22:0/3341863749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb4d40d0140 0x7fb4d41580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:57.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.947+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 >> 172.21.15.22:0/3341863749 conn(0x7fb4d4072460 msgr2=0x7fb4d40b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:57.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.948+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 shutdown_connections 2024-04-16T16:18:57.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:57.948+0000 7fb4db000640 1 -- 172.21.15.22:0/3341863749 wait complete. 2024-04-16T16:18:57.965 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone29220 --force 2024-04-16T16:18:58.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.191+0000 7ff30da00640 1 Processor -- start 2024-04-16T16:18:58.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.192+0000 7ff30da00640 1 -- start start 2024-04-16T16:18:58.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.193+0000 7ff30da00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff30815c8d0 0x7ff30815db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.193+0000 7ff30da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080727a0 0x7ff3080b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.193+0000 7ff30da00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff308073420 con 0x7ff308072c00 2024-04-16T16:18:58.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.193+0000 7ff30da00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff308073140 con 0x7ff30815c8d0 2024-04-16T16:18:58.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.193+0000 7ff30da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff30815d080 con 0x7ff3080727a0 2024-04-16T16:18:58.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.194+0000 7ff307400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff308072c00 0x7ff308071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54168/0 (socket says 172.21.15.22:54168) 2024-04-16T16:18:58.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.194+0000 7ff307400640 1 -- 172.21.15.22:0/1407125005 learned_addr learned my addr 172.21.15.22:0/1407125005 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:58.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.194+0000 7ff306000640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080727a0 0x7ff3080b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.194+0000 7ff306a00640 1 --2- 172.21.15.22:0/1407125005 >> v2:172.21.15.43:3300/0 conn(0x7ff30815c8d0 0x7ff30815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2733211795 0 0) 0x7ff308073420 con 0x7ff308072c00 2024-04-16T16:18:58.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2ec003520 con 0x7ff308072c00 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2034386526 0 0) 0x7ff2ec003520 con 0x7ff308072c00 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080727a0 msgr2=0x7ff3080b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080727a0 0x7ff3080b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 >> v2:172.21.15.43:3300/0 conn(0x7ff30815c8d0 msgr2=0x7ff30815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 --2- 172.21.15.22:0/1407125005 >> v2:172.21.15.43:3300/0 conn(0x7ff30815c8d0 0x7ff30815db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30815d360 con 0x7ff308072c00 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7ff300001690 con 0x7ff308072c00 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 >> v1:172.21.15.22:6789/0 conn(0x7ff308072c00 legacy=0x7ff308071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff2ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec004800 0x7ff2ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080727a0 0x7ff2ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff308073140 con 0x7ff2ec0039b0 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff30815d080 con 0x7ff2ec004800 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.195+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec00b9c0 con 0x7ff3080727a0 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.196+0000 7ff306a00640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff2ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.196+0000 7ff306a00640 1 -- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080727a0 msgr2=0x7ff2ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.196+0000 7ff306a00640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080727a0 0x7ff2ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.196+0000 7ff306000640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec004800 0x7ff2ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.196+0000 7ff306a00640 1 -- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec004800 msgr2=0x7ff2ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.196+0000 7ff306a00640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec004800 0x7ff2ec004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.196+0000 7ff306a00640 1 -- 172.21.15.22:0/1407125005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec003520 con 0x7ff2ec0039b0 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.197+0000 7ff306a00640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff2ec003dd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009fc0 tx=0x7ff2ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9bb0333a2db699 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8039070 con 0x7ff2ec0039b0 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f802cc60 con 0x7ff2ec0039b0 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff305600640 1 -- 172.21.15.22:0/1407125005 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8009c10 con 0x7ff2ec0039b0 2024-04-16T16:18:58.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff30da00640 1 -- 172.21.15.22:0/1407125005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 msgr2=0x7ff2ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff30da00640 1 --2- 172.21.15.22:0/1407125005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff2ec003dd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009fc0 tx=0x7ff2ec005830 comp rx=0 tx=0).stop 2024-04-16T16:18:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff307400640 1 -- 172.21.15.22:0/1407125005 reap_dead start 2024-04-16T16:18:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff30da00640 1 -- 172.21.15.22:0/1407125005 shutdown_connections 2024-04-16T16:18:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff30da00640 1 -- 172.21.15.22:0/1407125005 >> 172.21.15.22:0/1407125005 conn(0x7ff308062440 msgr2=0x7ff308062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff30da00640 1 -- 172.21.15.22:0/1407125005 shutdown_connections 2024-04-16T16:18:58.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.198+0000 7ff30da00640 1 -- 172.21.15.22:0/1407125005 wait complete. 2024-04-16T16:18:58.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.200+0000 7ff30da00640 1 Processor -- start 2024-04-16T16:18:58.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.200+0000 7ff30da00640 1 -- start start 2024-04-16T16:18:58.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.201+0000 7ff30da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff30815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.201+0000 7ff30da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080b55c0 0x7ff308146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.201+0000 7ff30da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3080ae860 0x7ff3080aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.201+0000 7ff30da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff30815ce30 con 0x7ff2ec0039b0 2024-04-16T16:18:58.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.201+0000 7ff30da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff30815ccb0 con 0x7ff3080ae860 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.201+0000 7ff30da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff3080d0310 con 0x7ff3080b55c0 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff30815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff30815db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33994/0 (socket says 172.21.15.22:33994) 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 -- 172.21.15.22:0/34590423 learned_addr learned my addr 172.21.15.22:0/34590423 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306000640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080b55c0 0x7ff308146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff307400640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3080ae860 0x7ff3080aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 -- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080b55c0 msgr2=0x7ff308146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080b55c0 0x7ff308146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 -- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3080ae860 msgr2=0x7ff3080aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3080ae860 0x7ff3080aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 -- 172.21.15.22:0/34590423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30815e370 con 0x7ff2ec0039b0 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306000640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080b55c0 0x7ff308146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff307400640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3080ae860 0x7ff3080aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.202+0000 7ff306a00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff30815db60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e230 tx=0x7ff2f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.203+0000 7ff2fea00640 1 -- 172.21.15.22:0/34590423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8039050 con 0x7ff2ec0039b0 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.203+0000 7ff2fea00640 1 -- 172.21.15.22:0/34590423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f803a040 con 0x7ff2ec0039b0 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.203+0000 7ff2fea00640 1 -- 172.21.15.22:0/34590423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8009c10 con 0x7ff2ec0039b0 2024-04-16T16:18:58.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.203+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30815e0a0 con 0x7ff2ec0039b0 2024-04-16T16:18:58.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.203+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff308149930 con 0x7ff2ec0039b0 2024-04-16T16:18:58.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.204+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30804fd90 con 0x7ff2ec0039b0 2024-04-16T16:18:58.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.205+0000 7ff2fea00640 1 -- 172.21.15.22:0/34590423 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7ff2f8047030 con 0x7ff2ec0039b0 2024-04-16T16:18:58.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.206+0000 7ff2fea00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2e406cad0 0x7ff2e406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.206+0000 7ff2fea00640 1 -- 172.21.15.22:0/34590423 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7ff2f80ae130 con 0x7ff2ec0039b0 2024-04-16T16:18:58.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.206+0000 7ff306000640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2e406cad0 0x7ff2e406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.207+0000 7ff306000640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2e406cad0 0x7ff2e406ef90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3080b0520 tx=0x7ff2f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:58.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.210+0000 7ff2fea00640 1 -- 172.21.15.22:0/34590423 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2f804e060 con 0x7ff2ec0039b0 2024-04-16T16:18:58.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.453+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone29220", "force": true, "target": ["mon-mgr", ""]}) -- 0x7ff3080af220 con 0x7ff2e406cad0 2024-04-16T16:18:58.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.484+0000 7ff2fea00640 1 -- 172.21.15.22:0/34590423 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff3080af220 con 0x7ff2e406cad0 2024-04-16T16:18:58.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2e406cad0 msgr2=0x7ff2e406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2e406cad0 0x7ff2e406ef90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3080b0520 tx=0x7ff2f0008040 comp rx=0 tx=0).stop 2024-04-16T16:18:58.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 msgr2=0x7ff30815db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff30815db60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e230 tx=0x7ff2f8009750 comp rx=0 tx=0).stop 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 shutdown_connections 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2e406cad0 0x7ff2e406ef90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3080ae860 0x7ff3080aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3080b55c0 0x7ff308146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 --2- 172.21.15.22:0/34590423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec0039b0 0x7ff30815db60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 >> 172.21.15.22:0/34590423 conn(0x7ff308062440 msgr2=0x7ff308159620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 shutdown_connections 2024-04-16T16:18:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.487+0000 7ff30da00640 1 -- 172.21.15.22:0/34590423 wait complete. 2024-04-16T16:18:58.491 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.492+0000 7f04e2800640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.491 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.492+0000 7f04e2800640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.491 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.492+0000 7f04e2800640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.491 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.492+0000 7f04e2800640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.491 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.492+0000 7f04e2800640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol25090 2024-04-16T16:18:58.514 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.516+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.514 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.516+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.515 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.516+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.515 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.516+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.515 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:18:58.516+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:18:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.707+0000 7f235fc00640 1 Processor -- start 2024-04-16T16:18:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.708+0000 7f235fc00640 1 -- start start 2024-04-16T16:18:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.709+0000 7f235fc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 0x7f23580b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.709+0000 7f235fc00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f23580b2960 0x7f2358071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.709+0000 7f235fc00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2358073420 con 0x7f235815c8d0 2024-04-16T16:18:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.709+0000 7f235fc00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f23580b2db0 con 0x7f23580b2960 2024-04-16T16:18:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.709+0000 7f235fc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2358072eb0 con 0x7f235815db60 2024-04-16T16:18:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.710+0000 7f235d200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f235815c8d0 0x7f23580727a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54178/0 (socket says 172.21.15.22:54178) 2024-04-16T16:18:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.710+0000 7f235d200640 1 -- 172.21.15.22:0/3282898428 learned_addr learned my addr 172.21.15.22:0/3282898428 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:18:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.710+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353702232 0 0) 0x7f2358073420 con 0x7f235815c8d0 2024-04-16T16:18:58.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.710+0000 7f235dc00640 1 --2- 172.21.15.22:0/3282898428 >> v2:172.21.15.43:3300/0 conn(0x7f23580b2960 0x7f2358071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.710+0000 7f2357e00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 0x7f23580b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.710+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2340003520 con 0x7f235815c8d0 2024-04-16T16:18:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2756961004 0 0) 0x7f2340003520 con 0x7f235815c8d0 2024-04-16T16:18:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 msgr2=0x7f23580b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 0x7f23580b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 >> v2:172.21.15.43:3300/0 conn(0x7f23580b2960 msgr2=0x7f2358071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 --2- 172.21.15.22:0/3282898428 >> v2:172.21.15.43:3300/0 conn(0x7f23580b2960 0x7f2358071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2358073140 con 0x7f235815c8d0 2024-04-16T16:18:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f234c001670 con 0x7f235815c8d0 2024-04-16T16:18:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 >> v1:172.21.15.22:6789/0 conn(0x7f235815c8d0 legacy=0x7f23580727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 0x7f23400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2340004030 0x7f2340004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004d40 0x7f23400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f23580b2db0 con 0x7f2340004030 2024-04-16T16:18:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2358072eb0 con 0x7f2340004d40 2024-04-16T16:18:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f234000bb20 con 0x7f235815db60 2024-04-16T16:18:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.711+0000 7f2357e00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2340004030 0x7f2340004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f235d200640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 0x7f23400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f235dc00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004d40 0x7f23400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f2357e00640 1 -- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 msgr2=0x7f23400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f2357e00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815db60 0x7f23400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f2357e00640 1 -- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004d40 msgr2=0x7f23400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:18:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f2357e00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004d40 0x7f23400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f2357e00640 1 -- 172.21.15.22:0/3282898428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2340003520 con 0x7f2340004030 2024-04-16T16:18:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.712+0000 7f235dc00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004d40 0x7f23400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:18:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.713+0000 7f2357e00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2340004030 0x7f2340004800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f234400ba30 tx=0x7f2340005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f23f142e4da6e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.713+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344036020 con 0x7f2340004030 2024-04-16T16:18:58.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.713+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2344032640 con 0x7f2340004030 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.713+0000 7f2357400640 1 -- 172.21.15.22:0/3282898428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234400b600 con 0x7f2340004030 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.714+0000 7f235fc00640 1 -- 172.21.15.22:0/3282898428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2340004030 msgr2=0x7f2340004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.714+0000 7f235fc00640 1 --2- 172.21.15.22:0/3282898428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2340004030 0x7f2340004800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f234400ba30 tx=0x7f2340005830 comp rx=0 tx=0).stop 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.714+0000 7f235dc00640 1 -- 172.21.15.22:0/3282898428 reap_dead start 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.714+0000 7f235fc00640 1 -- 172.21.15.22:0/3282898428 shutdown_connections 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.714+0000 7f235fc00640 1 -- 172.21.15.22:0/3282898428 >> 172.21.15.22:0/3282898428 conn(0x7f2358062440 msgr2=0x7f2358062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.714+0000 7f235fc00640 1 -- 172.21.15.22:0/3282898428 shutdown_connections 2024-04-16T16:18:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.714+0000 7f235fc00640 1 -- 172.21.15.22:0/3282898428 wait complete. 2024-04-16T16:18:58.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.716+0000 7f235fc00640 1 Processor -- start 2024-04-16T16:18:58.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.716+0000 7f235fc00640 1 -- start start 2024-04-16T16:18:58.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.717+0000 7f235fc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004030 0x7f235814b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.717+0000 7f235fc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235815e530 0x7f23580aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.717+0000 7f235fc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815e9b0 0x7f23580ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.717+0000 7f235fc00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f235815d640 con 0x7f235815e530 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.717+0000 7f235fc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f235815d360 con 0x7f2340004030 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.717+0000 7f235fc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f235815ccb0 con 0x7f235815e9b0 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.717+0000 7f2357e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235815e530 0x7f23580aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235815e530 0x7f23580aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34060/0 (socket says 172.21.15.22:34060) 2024-04-16T16:18:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 -- 172.21.15.22:0/2862215474 learned_addr learned my addr 172.21.15.22:0/2862215474 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f235dc00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815e9b0 0x7f23580ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 -- 172.21.15.22:0/2862215474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815e9b0 msgr2=0x7f23580ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815e9b0 0x7f23580ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 -- 172.21.15.22:0/2862215474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004030 msgr2=0x7f235814b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004030 0x7f235814b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 -- 172.21.15.22:0/2862215474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235815ef80 con 0x7f235815e530 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.718+0000 7f2357e00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235815e530 0x7f23580aae10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f234402bf90 tx=0x7f2344004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:58.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.719+0000 7f2354c00640 1 -- 172.21.15.22:0/2862215474 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344041070 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.719+0000 7f2354c00640 1 -- 172.21.15.22:0/2862215474 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2344030a50 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.719+0000 7f2354c00640 1 -- 172.21.15.22:0/2862215474 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344036040 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.719+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235815f260 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.719+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235815f820 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.720+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2358159000 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.721+0000 7f2354c00640 1 -- 172.21.15.22:0/2862215474 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f2344039020 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.722+0000 7f2354c00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f233806cad0 0x7f233806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.722+0000 7f2354c00640 1 -- 172.21.15.22:0/2862215474 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f23440ae140 con 0x7f235815e530 2024-04-16T16:18:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.722+0000 7f235d200640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f233806cad0 0x7f233806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:18:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.723+0000 7f235d200640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f233806cad0 0x7f233806ef90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f234c005990 tx=0x7f234c000f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:18:58.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.726+0000 7f2354c00640 1 -- 172.21.15.22:0/2862215474 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2358159000 con 0x7f235815e530 2024-04-16T16:18:58.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.962+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol25090", "target": ["mon-mgr", ""]}) -- 0x7f235804fd90 con 0x7f233806cad0 2024-04-16T16:18:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:58.996+0000 7f2354c00640 1 -- 172.21.15.22:0/2862215474 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f235804fd90 con 0x7f233806cad0 2024-04-16T16:18:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f233806cad0 msgr2=0x7f233806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f233806cad0 0x7f233806ef90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f234c005990 tx=0x7f234c000f50 comp rx=0 tx=0).stop 2024-04-16T16:18:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235815e530 msgr2=0x7f23580aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:18:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235815e530 0x7f23580aae10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f234402bf90 tx=0x7f2344004730 comp rx=0 tx=0).stop 2024-04-16T16:18:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 shutdown_connections 2024-04-16T16:18:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f233806cad0 0x7f233806ef90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f235815e9b0 0x7f23580ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235815e530 0x7f23580aae10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 --2- 172.21.15.22:0/2862215474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2340004030 0x7f235814b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:18:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.000+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 >> 172.21.15.22:0/2862215474 conn(0x7f2358062440 msgr2=0x7f23581588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:18:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.001+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 shutdown_connections 2024-04-16T16:18:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59.001+0000 7f235fc00640 1 -- 172.21.15.22:0/2862215474 wait complete. 2024-04-16T16:18:59.022 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-16T16:18:59.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:18:59.173 INFO:teuthology.orchestra.run.smithi022.stdout:3 2024-04-16T16:18:59.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:18:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:19:04.184 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-16T16:19:04.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:19:04.309 INFO:teuthology.orchestra.run.smithi022.stdout:2 2024-04-16T16:19:04.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:19:04.320 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T16:19:04.320 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:19:04.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:19:04.583 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T16:19:04.583 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:19:04.583 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:04.583 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:04.645 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:04.645 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:04.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:04.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.930+0000 7ff1a5e00640 1 Processor -- start 2024-04-16T16:19:04.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.930+0000 7ff1a5e00640 1 -- start start 2024-04-16T16:19:04.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.932+0000 7ff1a5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a00cc810 0x7ff1a006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:04.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.932+0000 7ff1a5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1a006ee80 0x7ff1a015c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:04.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.932+0000 7ff1a5e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a006d160 con 0x7ff1a006eaa0 2024-04-16T16:19:04.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.932+0000 7ff1a5e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a006cf10 con 0x7ff1a006ee80 2024-04-16T16:19:04.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.932+0000 7ff1a5e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a006d440 con 0x7ff1a00cc810 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.932+0000 7ff1a5400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1a006ee80 0x7ff1a015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff1a5400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff1a006ee80 0x7ff1a015c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41210/0 (socket says 172.21.15.22:41210) 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff1a5400640 1 -- 172.21.15.22:0/1986771900 learned_addr learned my addr 172.21.15.22:0/1986771900 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff19fe00640 1 --2- 172.21.15.22:0/1986771900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a00cc810 0x7ff1a006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff1a5400640 1 -- 172.21.15.22:0/1986771900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a00cc810 msgr2=0x7ff1a006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff1a5400640 1 --2- 172.21.15.22:0/1986771900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a00cc810 0x7ff1a006df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff1a5400640 1 -- 172.21.15.22:0/1986771900 >> v1:172.21.15.43:6789/0 conn(0x7ff1a006eaa0 legacy=0x7ff1a00b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff1a5400640 1 -- 172.21.15.22:0/1986771900 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a006d720 con 0x7ff1a006ee80 2024-04-16T16:19:04.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.933+0000 7ff19fe00640 1 --2- 172.21.15.22:0/1986771900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a00cc810 0x7ff1a006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:04.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.934+0000 7ff1a5400640 1 --2- 172.21.15.22:0/1986771900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015c200 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff198009e50 tx=0x7ff19802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9853eb9afa0cfca server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:04.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.934+0000 7ff19f400640 1 -- 172.21.15.22:0/1986771900 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19802ca70 con 0x7ff1a006ee80 2024-04-16T16:19:04.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff19f400640 1 -- 172.21.15.22:0/1986771900 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19802cc10 con 0x7ff1a006ee80 2024-04-16T16:19:04.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff19f400640 1 -- 172.21.15.22:0/1986771900 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980343f0 con 0x7ff1a006ee80 2024-04-16T16:19:04.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff1a5e00640 1 -- 172.21.15.22:0/1986771900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 msgr2=0x7ff1a015c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:04.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/1986771900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015c200 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff198009e50 tx=0x7ff19802bed0 comp rx=0 tx=0).stop 2024-04-16T16:19:04.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff1a5e00640 1 -- 172.21.15.22:0/1986771900 shutdown_connections 2024-04-16T16:19:04.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/1986771900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015c200 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:04.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/1986771900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a00cc810 0x7ff1a006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:04.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff1a5e00640 1 -- 172.21.15.22:0/1986771900 >> 172.21.15.22:0/1986771900 conn(0x7ff1a0062440 msgr2=0x7ff1a0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:04.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.935+0000 7ff1a5e00640 1 -- 172.21.15.22:0/1986771900 shutdown_connections 2024-04-16T16:19:04.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.936+0000 7ff1a5e00640 1 -- 172.21.15.22:0/1986771900 wait complete. 2024-04-16T16:19:04.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.937+0000 7ff1a5e00640 1 Processor -- start 2024-04-16T16:19:04.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.937+0000 7ff1a5e00640 1 -- start start 2024-04-16T16:19:04.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.938+0000 7ff1a5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a006eaa0 0x7ff1a0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:04.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.938+0000 7ff1a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.938+0000 7ff1a5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1a00cc810 0x7ff1a015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.938+0000 7ff1a5e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a015c740 con 0x7ff1a006ee80 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.938+0000 7ff1a5e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a006e440 con 0x7ff1a00cc810 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.938+0000 7ff1a5e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a015c8c0 con 0x7ff1a006eaa0 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41218/0 (socket says 172.21.15.22:41218) 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 -- 172.21.15.22:0/2349146121 learned_addr learned my addr 172.21.15.22:0/2349146121 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff1a5400640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1a00cc810 0x7ff1a015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff1a4a00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a006eaa0 0x7ff1a0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 -- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a006eaa0 msgr2=0x7ff1a0152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a006eaa0 0x7ff1a0152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:04.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 -- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1a00cc810 msgr2=0x7ff1a015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:04.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1a00cc810 0x7ff1a015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:04.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.939+0000 7ff19fe00640 1 -- 172.21.15.22:0/2349146121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a0153220 con 0x7ff1a006ee80 2024-04-16T16:19:04.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.940+0000 7ff19fe00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015f350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c7f0 tx=0x7ff18c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:04.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.940+0000 7ff19cc00640 1 -- 172.21.15.22:0/2349146121 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c015070 con 0x7ff1a006ee80 2024-04-16T16:19:04.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.940+0000 7ff19cc00640 1 -- 172.21.15.22:0/2349146121 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff18c007820 con 0x7ff1a006ee80 2024-04-16T16:19:04.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.940+0000 7ff19cc00640 1 -- 172.21.15.22:0/2349146121 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c007bd0 con 0x7ff1a006ee80 2024-04-16T16:19:04.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.940+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a0153500 con 0x7ff1a006ee80 2024-04-16T16:19:04.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.940+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a01537e0 con 0x7ff1a006ee80 2024-04-16T16:19:04.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.941+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a0075f30 con 0x7ff1a006ee80 2024-04-16T16:19:04.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.942+0000 7ff19cc00640 1 -- 172.21.15.22:0/2349146121 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7ff18c018070 con 0x7ff1a006ee80 2024-04-16T16:19:04.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.943+0000 7ff19cc00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff18006cbf0 0x7ff18006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.943+0000 7ff19cc00640 1 -- 172.21.15.22:0/2349146121 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7ff18c08c220 con 0x7ff1a006ee80 2024-04-16T16:19:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.944+0000 7ff1a4a00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff18006cbf0 0x7ff18006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.944+0000 7ff1a4a00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff18006cbf0 0x7ff18006f0b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff194004ea0 tx=0x7ff194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:04.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:04.948+0000 7ff19cc00640 1 -- 172.21.15.22:0/2349146121 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff18c05a190 con 0x7ff1a006ee80 2024-04-16T16:19:05.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.160+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1a00b4b70 con 0x7ff1a006ee80 2024-04-16T16:19:05.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.163+0000 7ff19cc00640 1 -- 172.21.15.22:0/2349146121 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16614 (secure 0 0 0) 0x7ff18c059a90 con 0x7ff1a006ee80 2024-04-16T16:19:05.162 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:05.163 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:18:57.479051+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:05.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff18006cbf0 msgr2=0x7ff18006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff18006cbf0 0x7ff18006f0b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff194004ea0 tx=0x7ff194009040 comp rx=0 tx=0).stop 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 msgr2=0x7ff1a015f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015f350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c7f0 tx=0x7ff18c00ccb0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 shutdown_connections 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff18006cbf0 0x7ff18006f0b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1a00cc810 0x7ff1a015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1a006ee80 0x7ff1a015f350 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 --2- 172.21.15.22:0/2349146121 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1a006eaa0 0x7ff1a0152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 >> 172.21.15.22:0/2349146121 conn(0x7ff1a0062440 msgr2=0x7ff1a0071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.166+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 shutdown_connections 2024-04-16T16:19:05.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.167+0000 7ff1a5e00640 1 -- 172.21.15.22:0/2349146121 wait complete. 2024-04-16T16:19:05.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:17:53.871511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:17:54.933724+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:19:05.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:19:05.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.412+0000 7f6f13200640 1 Processor -- start 2024-04-16T16:19:05.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.413+0000 7f6f13200640 1 -- start start 2024-04-16T16:19:05.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.414+0000 7f6f13200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f140cfca0 0x7f6f140d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.414+0000 7f6f13200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6f140d1cc0 0x7f6f140b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.414+0000 7f6f13200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f140d3ed0 con 0x7f6f1415eb40 2024-04-16T16:19:05.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.414+0000 7f6f13200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6f140d2130 con 0x7f6f140d1cc0 2024-04-16T16:19:05.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.414+0000 7f6f13200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140d41b0 con 0x7f6f140cfca0 2024-04-16T16:19:05.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.415+0000 7f6f12800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6f140d1cc0 0x7f6f140b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.415+0000 7f6f11400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f140cfca0 0x7f6f140d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.415+0000 7f6f12800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6f140d1cc0 0x7f6f140b82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:35972/0 (socket says 172.21.15.22:35972) 2024-04-16T16:19:05.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.415+0000 7f6f12800640 1 -- 172.21.15.22:0/1498338591 learned_addr learned my addr 172.21.15.22:0/1498338591 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:05.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.416+0000 7f6f11400640 1 -- 172.21.15.22:0/1498338591 >> v2:172.21.15.43:3300/0 conn(0x7f6f140d1cc0 msgr2=0x7f6f140b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:05.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.416+0000 7f6f11400640 1 --2- 172.21.15.22:0/1498338591 >> v2:172.21.15.43:3300/0 conn(0x7f6f140d1cc0 0x7f6f140b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.416+0000 7f6f11400640 1 -- 172.21.15.22:0/1498338591 >> v1:172.21.15.43:6789/0 conn(0x7f6f1415eb40 legacy=0x7f6f140d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.416+0000 7f6f11400640 1 -- 172.21.15.22:0/1498338591 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140d4490 con 0x7f6f140cfca0 2024-04-16T16:19:05.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.416+0000 7f6f12800640 1 --2- 172.21.15.22:0/1498338591 >> v2:172.21.15.43:3300/0 conn(0x7f6f140d1cc0 0x7f6f140b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:19:05.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.418+0000 7f6f11400640 1 --2- 172.21.15.22:0/1498338591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f140cfca0 0x7f6f140d1780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097a0 tx=0x7f6efc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6681655dd847d6ea server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:05.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.418+0000 7f6f10a00640 1 -- 172.21.15.22:0/1498338591 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc035020 con 0x7f6f140cfca0 2024-04-16T16:19:05.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f10a00640 1 -- 172.21.15.22:0/1498338591 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc031830 con 0x7f6f140cfca0 2024-04-16T16:19:05.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f10a00640 1 -- 172.21.15.22:0/1498338591 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc031c00 con 0x7f6f140cfca0 2024-04-16T16:19:05.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f13200640 1 -- 172.21.15.22:0/1498338591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f140cfca0 msgr2=0x7f6f140d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f13200640 1 --2- 172.21.15.22:0/1498338591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f140cfca0 0x7f6f140d1780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097a0 tx=0x7f6efc02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f13200640 1 -- 172.21.15.22:0/1498338591 shutdown_connections 2024-04-16T16:19:05.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f13200640 1 --2- 172.21.15.22:0/1498338591 >> v2:172.21.15.43:3300/0 conn(0x7f6f140d1cc0 0x7f6f140b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f13200640 1 --2- 172.21.15.22:0/1498338591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f140cfca0 0x7f6f140d1780 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f13200640 1 -- 172.21.15.22:0/1498338591 >> 172.21.15.22:0/1498338591 conn(0x7f6f14072460 msgr2=0x7f6f14072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:05.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.419+0000 7f6f13200640 1 -- 172.21.15.22:0/1498338591 shutdown_connections 2024-04-16T16:19:05.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.420+0000 7f6f13200640 1 -- 172.21.15.22:0/1498338591 wait complete. 2024-04-16T16:19:05.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.421+0000 7f6f13200640 1 Processor -- start 2024-04-16T16:19:05.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.421+0000 7f6f13200640 1 -- start start 2024-04-16T16:19:05.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.422+0000 7f6f13200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f140cfca0 0x7f6f141f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.422+0000 7f6f13200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f140d1cc0 0x7f6f140cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.422+0000 7f6f13200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1415eb40 0x7f6f140cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.422+0000 7f6f13200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140b7b50 con 0x7f6f140cfca0 2024-04-16T16:19:05.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.422+0000 7f6f13200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140b79d0 con 0x7f6f140d1cc0 2024-04-16T16:19:05.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.422+0000 7f6f13200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140b87f0 con 0x7f6f1415eb40 2024-04-16T16:19:05.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f140cfca0 0x7f6f141f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f140cfca0 0x7f6f141f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41234/0 (socket says 172.21.15.22:41234) 2024-04-16T16:19:05.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 -- 172.21.15.22:0/3313548266 learned_addr learned my addr 172.21.15.22:0/3313548266 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f12800640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1415eb40 0x7f6f140cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11400640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f140d1cc0 0x7f6f140cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 -- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1415eb40 msgr2=0x7f6f140cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1415eb40 0x7f6f140cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 -- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f140d1cc0 msgr2=0x7f6f140cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f140d1cc0 0x7f6f140cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 -- 172.21.15.22:0/3313548266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f141617b0 con 0x7f6f140cfca0 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f12800640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1415eb40 0x7f6f140cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.423+0000 7f6f11e00640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f140cfca0 0x7f6f141f7970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400c3f0 tx=0x7f6f0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.424+0000 7f6f0a000640 1 -- 172.21.15.22:0/3313548266 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f040052d0 con 0x7f6f140cfca0 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.424+0000 7f6f0a000640 1 -- 172.21.15.22:0/3313548266 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f04005490 con 0x7f6f140cfca0 2024-04-16T16:19:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.424+0000 7f6f0a000640 1 -- 172.21.15.22:0/3313548266 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04007260 con 0x7f6f140cfca0 2024-04-16T16:19:05.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.424+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f14161a90 con 0x7f6f140cfca0 2024-04-16T16:19:05.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.424+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1415f2a0 con 0x7f6f140cfca0 2024-04-16T16:19:05.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.425+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f14075f30 con 0x7f6f140cfca0 2024-04-16T16:19:05.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.426+0000 7f6f0a000640 1 -- 172.21.15.22:0/3313548266 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f6f04007400 con 0x7f6f140cfca0 2024-04-16T16:19:05.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.427+0000 7f6f0a000640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ef006cbc0 0x7f6ef006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.427+0000 7f6f0a000640 1 -- 172.21.15.22:0/3313548266 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f6f0408b600 con 0x7f6f140cfca0 2024-04-16T16:19:05.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.427+0000 7f6f11400640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ef006cbc0 0x7f6ef006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.428+0000 7f6f11400640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ef006cbc0 0x7f6ef006f080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6efc036000 tx=0x7f6efc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:05.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.433+0000 7f6f0a000640 1 -- 172.21.15.22:0/3313548266 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f040595a0 con 0x7f6f140cfca0 2024-04-16T16:19:05.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.642+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f1415df40 con 0x7f6f140cfca0 2024-04-16T16:19:05.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.643+0000 7f6f0a000640 1 -- 172.21.15.22:0/3313548266 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7f6f04058ea0 con 0x7f6f140cfca0 2024-04-16T16:19:05.648 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:19:05.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ef006cbc0 msgr2=0x7f6ef006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ef006cbc0 0x7f6ef006f080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6efc036000 tx=0x7f6efc008030 comp rx=0 tx=0).stop 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f140cfca0 msgr2=0x7f6f141f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f140cfca0 0x7f6f141f7970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400c3f0 tx=0x7f6f0400c8b0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 shutdown_connections 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ef006cbc0 0x7f6ef006f080 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1415eb40 0x7f6f140cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f140d1cc0 0x7f6f140cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 --2- 172.21.15.22:0/3313548266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f140cfca0 0x7f6f141f7970 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 >> 172.21.15.22:0/3313548266 conn(0x7f6f14072460 msgr2=0x7f6f140ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 shutdown_connections 2024-04-16T16:19:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.646+0000 7f6f13200640 1 -- 172.21.15.22:0/3313548266 wait complete. 2024-04-16T16:19:05.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:19:05.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.897+0000 7f9baa200640 1 Processor -- start 2024-04-16T16:19:05.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.897+0000 7f9baa200640 1 -- start start 2024-04-16T16:19:05.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.898+0000 7f9baa200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9ba40cfcc0 0x7f9ba40d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.898+0000 7f9baa200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 0x7f9ba40b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.898+0000 7f9baa200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba40d3ef0 con 0x7f9ba415eb60 2024-04-16T16:19:05.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.898+0000 7f9baa200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba40d2130 con 0x7f9ba40cfcc0 2024-04-16T16:19:05.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.898+0000 7f9baa200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40d41d0 con 0x7f9ba40d1ce0 2024-04-16T16:19:05.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.899+0000 7f9ba8e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9ba415eb60 0x7f9ba40d35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45468/0 (socket says 172.21.15.22:45468) 2024-04-16T16:19:05.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.899+0000 7f9ba8e00640 1 -- 172.21.15.22:0/1093164324 learned_addr learned my addr 172.21.15.22:0/1093164324 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.899+0000 7f9ba3e00640 1 --2- 172.21.15.22:0/1093164324 >> v2:172.21.15.43:3300/0 conn(0x7f9ba40cfcc0 0x7f9ba40d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.899+0000 7f9ba9800640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 0x7f9ba40b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.899+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31534373 0 0) 0x7f9ba40d3ef0 con 0x7f9ba415eb60 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.899+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b8c003520 con 0x7f9ba415eb60 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4015247963 0 0) 0x7f9b8c003520 con 0x7f9ba415eb60 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 msgr2=0x7f9ba40b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 0x7f9ba40b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 >> v2:172.21.15.43:3300/0 conn(0x7f9ba40cfcc0 msgr2=0x7f9ba40d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 --2- 172.21.15.22:0/1093164324 >> v2:172.21.15.43:3300/0 conn(0x7f9ba40cfcc0 0x7f9ba40d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba40d44b0 con 0x7f9ba415eb60 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f9b98001670 con 0x7f9ba415eb60 2024-04-16T16:19:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 >> v1:172.21.15.22:6789/0 conn(0x7f9ba415eb60 legacy=0x7f9ba40d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b8c0039b0 0x7f9b8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 0x7f9b8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c004d40 0x7f9b8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40d2130 con 0x7f9b8c0039b0 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40d41d0 con 0x7f9b8c004d40 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8c00ba70 con 0x7f9ba40d1ce0 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.900+0000 7f9ba8e00640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b8c0039b0 0x7f9b8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.901+0000 7f9ba9800640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c004d40 0x7f9b8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.901+0000 7f9ba3e00640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 0x7f9b8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.901+0000 7f9ba8e00640 1 -- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 msgr2=0x7f9b8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.901+0000 7f9ba8e00640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba40d1ce0 0x7f9b8c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.901+0000 7f9ba8e00640 1 -- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c004d40 msgr2=0x7f9b8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.901+0000 7f9ba8e00640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c004d40 0x7f9b8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.901+0000 7f9ba8e00640 1 -- 172.21.15.22:0/1093164324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8c003520 con 0x7f9b8c0039b0 2024-04-16T16:19:05.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.902+0000 7f9ba8e00640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b8c0039b0 0x7f9b8c003dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c240 tx=0x7f9b8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c163b499ec4017ba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.902+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98007d50 con 0x7f9b8c0039b0 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.902+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b98030070 con 0x7f9b8c0039b0 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.902+0000 7f9ba3400640 1 -- 172.21.15.22:0/1093164324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9802cd80 con 0x7f9b8c0039b0 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.903+0000 7f9baa200640 1 -- 172.21.15.22:0/1093164324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b8c0039b0 msgr2=0x7f9b8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.903+0000 7f9baa200640 1 --2- 172.21.15.22:0/1093164324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b8c0039b0 0x7f9b8c003dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c240 tx=0x7f9b8c005830 comp rx=0 tx=0).stop 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.903+0000 7f9ba9800640 1 -- 172.21.15.22:0/1093164324 reap_dead start 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.903+0000 7f9baa200640 1 -- 172.21.15.22:0/1093164324 shutdown_connections 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.903+0000 7f9baa200640 1 -- 172.21.15.22:0/1093164324 >> 172.21.15.22:0/1093164324 conn(0x7f9ba4072460 msgr2=0x7f9ba4072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.903+0000 7f9baa200640 1 -- 172.21.15.22:0/1093164324 shutdown_connections 2024-04-16T16:19:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.903+0000 7f9baa200640 1 -- 172.21.15.22:0/1093164324 wait complete. 2024-04-16T16:19:05.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.906+0000 7f9baa200640 1 Processor -- start 2024-04-16T16:19:05.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.907+0000 7f9baa200640 1 -- start start 2024-04-16T16:19:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9baa200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c0039b0 0x7f9ba414cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9baa200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba415fe40 0x7f9ba41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9baa200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ba40c9e20 0x7f9ba40ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9baa200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40b7b70 con 0x7f9ba40c9e20 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9baa200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40b79f0 con 0x7f9b8c0039b0 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9baa200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40b82d0 con 0x7f9ba415fe40 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9ba9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ba40c9e20 0x7f9ba40ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9ba9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ba40c9e20 0x7f9ba40ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41258/0 (socket says 172.21.15.22:41258) 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.908+0000 7f9ba9800640 1 -- 172.21.15.22:0/3585570093 learned_addr learned my addr 172.21.15.22:0/3585570093 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba8e00640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c0039b0 0x7f9ba414cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba3e00640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba415fe40 0x7f9ba41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba9800640 1 -- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba415fe40 msgr2=0x7f9ba41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba9800640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba415fe40 0x7f9ba41602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba9800640 1 -- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c0039b0 msgr2=0x7f9ba414cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba9800640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c0039b0 0x7f9ba414cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba9800640 1 -- 172.21.15.22:0/3585570093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba41f8d20 con 0x7f9ba40c9e20 2024-04-16T16:19:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.909+0000 7f9ba9800640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ba40c9e20 0x7f9ba40ca2a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40d2bb0 tx=0x7f9b9c009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.910+0000 7f9ba0c00640 1 -- 172.21.15.22:0/3585570093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c007cf0 con 0x7f9ba40c9e20 2024-04-16T16:19:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.910+0000 7f9ba0c00640 1 -- 172.21.15.22:0/3585570093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c019070 con 0x7f9ba40c9e20 2024-04-16T16:19:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.910+0000 7f9ba0c00640 1 -- 172.21.15.22:0/3585570093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c014650 con 0x7f9ba40c9e20 2024-04-16T16:19:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.910+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba41608e0 con 0x7f9ba40c9e20 2024-04-16T16:19:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.911+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba41f8240 con 0x7f9ba40c9e20 2024-04-16T16:19:05.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.912+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba4075f30 con 0x7f9ba40c9e20 2024-04-16T16:19:05.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.913+0000 7f9ba0c00640 1 -- 172.21.15.22:0/3585570093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f9b9c0147f0 con 0x7f9ba40c9e20 2024-04-16T16:19:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.914+0000 7f9ba0c00640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9b8406cbf0 0x7f9b8406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.914+0000 7f9ba0c00640 1 -- 172.21.15.22:0/3585570093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f9b9c08c5e0 con 0x7f9ba40c9e20 2024-04-16T16:19:05.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.914+0000 7f9ba8e00640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9b8406cbf0 0x7f9b8406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:05.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.915+0000 7f9ba8e00640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9b8406cbf0 0x7f9b8406f0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9b98034000 tx=0x7f9b98007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:05.918+0000 7f9ba0c00640 1 -- 172.21.15.22:0/3585570093 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b9c05a5e0 con 0x7f9ba40c9e20 2024-04-16T16:19:06.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.169+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9ba4068f70 con 0x7f9ba40c9e20 2024-04-16T16:19:06.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.171+0000 7f9ba0c00640 1 -- 172.21.15.22:0/3585570093 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) ==== 104+0+11 (secure 0 0 0) 0x7f9b9c059ee0 con 0x7f9ba40c9e20 2024-04-16T16:19:06.169 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.173+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9b8406cbf0 msgr2=0x7f9b8406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.173+0000 7f9baa200640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9b8406cbf0 0x7f9b8406f0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9b98034000 tx=0x7f9b98007000 comp rx=0 tx=0).stop 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.173+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ba40c9e20 msgr2=0x7f9ba40ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.173+0000 7f9baa200640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ba40c9e20 0x7f9ba40ca2a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40d2bb0 tx=0x7f9b9c009d20 comp rx=0 tx=0).stop 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 shutdown_connections 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9b8406cbf0 0x7f9b8406f0b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ba40c9e20 0x7f9ba40ca2a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ba415fe40 0x7f9ba41602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 --2- 172.21.15.22:0/3585570093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c0039b0 0x7f9ba414cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 >> 172.21.15.22:0/3585570093 conn(0x7f9ba4072460 msgr2=0x7f9ba40d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 shutdown_connections 2024-04-16T16:19:06.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.174+0000 7f9baa200640 1 -- 172.21.15.22:0/3585570093 wait complete. 2024-04-16T16:19:06.193 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:19:06.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.420+0000 7f6386400640 1 Processor -- start 2024-04-16T16:19:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.420+0000 7f6386400640 1 -- start start 2024-04-16T16:19:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.421+0000 7f6386400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f638015ee90 0x7f638006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.421+0000 7f6386400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63800d33e0 0x7f638006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.421+0000 7f6386400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638006eb30 con 0x7f638006c8e0 2024-04-16T16:19:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.422+0000 7f6386400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f638006cd40 con 0x7f638015ee90 2024-04-16T16:19:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.422+0000 7f6386400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f63800d1eb0 con 0x7f63800d33e0 2024-04-16T16:19:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.422+0000 7f637f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f638015ee90 0x7f638006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.422+0000 7f637f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f638015ee90 0x7f638006bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41264/0 (socket says 172.21.15.22:41264) 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.422+0000 7f637fe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f638006c8e0 0x7f63800cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45480/0 (socket says 172.21.15.22:45480) 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.422+0000 7f637f400640 1 -- 172.21.15.22:0/546095643 learned_addr learned my addr 172.21.15.22:0/546095643 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.422+0000 7f637ea00640 1 --2- 172.21.15.22:0/546095643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63800d33e0 0x7f638006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.423+0000 7f637f400640 1 -- 172.21.15.22:0/546095643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63800d33e0 msgr2=0x7f638006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.423+0000 7f637f400640 1 --2- 172.21.15.22:0/546095643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63800d33e0 0x7f638006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.423+0000 7f637f400640 1 -- 172.21.15.22:0/546095643 >> v1:172.21.15.22:6789/0 conn(0x7f638006c8e0 legacy=0x7f63800cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.423+0000 7f637f400640 1 -- 172.21.15.22:0/546095643 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63800d18f0 con 0x7f638015ee90 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.423+0000 7f637e000640 1 -- 172.21.15.22:0/546095643 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338831828 0 0) 0x7f638006eb30 con 0x7f638006c8e0 2024-04-16T16:19:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.423+0000 7f637ea00640 1 --2- 172.21.15.22:0/546095643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63800d33e0 0x7f638006c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:19:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.424+0000 7f637f400640 1 --2- 172.21.15.22:0/546095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638006bcc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6370009870 tx=0x7f637002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f328497de88bfe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.424+0000 7f637e000640 1 -- 172.21.15.22:0/546095643 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370034070 con 0x7f638015ee90 2024-04-16T16:19:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.424+0000 7f637e000640 1 -- 172.21.15.22:0/546095643 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6370030840 con 0x7f638015ee90 2024-04-16T16:19:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.424+0000 7f637e000640 1 -- 172.21.15.22:0/546095643 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370030c10 con 0x7f638015ee90 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 -- 172.21.15.22:0/546095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 msgr2=0x7f638006bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 --2- 172.21.15.22:0/546095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638006bcc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6370009870 tx=0x7f637002b980 comp rx=0 tx=0).stop 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 -- 172.21.15.22:0/546095643 shutdown_connections 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 --2- 172.21.15.22:0/546095643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63800d33e0 0x7f638006c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 --2- 172.21.15.22:0/546095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638006bcc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 -- 172.21.15.22:0/546095643 >> 172.21.15.22:0/546095643 conn(0x7f63800d28c0 msgr2=0x7f63800d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 -- 172.21.15.22:0/546095643 shutdown_connections 2024-04-16T16:19:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.425+0000 7f6386400640 1 -- 172.21.15.22:0/546095643 wait complete. 2024-04-16T16:19:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.427+0000 7f6386400640 1 Processor -- start 2024-04-16T16:19:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.427+0000 7f6386400640 1 -- start start 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.428+0000 7f6386400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638006c8e0 0x7f6380159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.428+0000 7f6386400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63800d33e0 0x7f63800c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.428+0000 7f6386400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.428+0000 7f6386400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63800d15c0 con 0x7f638015ee90 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.428+0000 7f6386400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f63800ccfb0 con 0x7f63800d33e0 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.428+0000 7f6386400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f638015f270 con 0x7f638006c8e0 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.428+0000 7f637fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41270/0 (socket says 172.21.15.22:41270) 2024-04-16T16:19:06.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 -- 172.21.15.22:0/1122518749 learned_addr learned my addr 172.21.15.22:0/1122518749 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637ea00640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63800d33e0 0x7f63800c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637f400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638006c8e0 0x7f6380159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 -- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638006c8e0 msgr2=0x7f6380159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638006c8e0 0x7f6380159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 -- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63800d33e0 msgr2=0x7f63800c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63800d33e0 0x7f63800c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 -- 172.21.15.22:0/1122518749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63801e66d0 con 0x7f638015ee90 2024-04-16T16:19:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637ea00640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63800d33e0 0x7f63800c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637f400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638006c8e0 0x7f6380159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.429+0000 7f637fe00640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638015b7d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f637800c730 tx=0x7f637800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.430+0000 7f6377400640 1 -- 172.21.15.22:0/1122518749 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378018070 con 0x7f638015ee90 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.430+0000 7f6377400640 1 -- 172.21.15.22:0/1122518749 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637800ce40 con 0x7f638015ee90 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.430+0000 7f6377400640 1 -- 172.21.15.22:0/1122518749 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637800a800 con 0x7f638015ee90 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.430+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63801e6970 con 0x7f638015ee90 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.430+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63801e7450 con 0x7f638015ee90 2024-04-16T16:19:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.431+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638006d020 con 0x7f638015ee90 2024-04-16T16:19:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.432+0000 7f6377400640 1 -- 172.21.15.22:0/1122518749 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f637800a9a0 con 0x7f638015ee90 2024-04-16T16:19:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.433+0000 7f6377400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f635c06cbc0 0x7f635c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.433+0000 7f6377400640 1 -- 172.21.15.22:0/1122518749 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f637808b690 con 0x7f638015ee90 2024-04-16T16:19:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.433+0000 7f637f400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f635c06cbc0 0x7f635c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.434+0000 7f637f400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f635c06cbc0 0x7f635c06f080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6370036000 tx=0x7f637003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.437+0000 7f6377400640 1 -- 172.21.15.22:0/1122518749 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f638006d020 con 0x7f638015ee90 2024-04-16T16:19:06.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.656+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f638004fd90 con 0x7f638015ee90 2024-04-16T16:19:06.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.656+0000 7f6377400640 1 -- 172.21.15.22:0/1122518749 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) ==== 100+0+11 (secure 0 0 0) 0x7f6378059670 con 0x7f638015ee90 2024-04-16T16:19:06.655 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:19:06.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f635c06cbc0 msgr2=0x7f635c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f635c06cbc0 0x7f635c06f080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6370036000 tx=0x7f637003b040 comp rx=0 tx=0).stop 2024-04-16T16:19:06.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 msgr2=0x7f638015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638015b7d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f637800c730 tx=0x7f637800cbf0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 shutdown_connections 2024-04-16T16:19:06.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f635c06cbc0 0x7f635c06f080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638015ee90 0x7f638015b7d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63800d33e0 0x7f63800c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 --2- 172.21.15.22:0/1122518749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638006c8e0 0x7f6380159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 >> 172.21.15.22:0/1122518749 conn(0x7f63800d28c0 msgr2=0x7f63800b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:06.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 shutdown_connections 2024-04-16T16:19:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.659+0000 7f6386400640 1 -- 172.21.15.22:0/1122518749 wait complete. 2024-04-16T16:19:06.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:19:06.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:19:06.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:19:06.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.901+0000 7fa175e00640 1 Processor -- start 2024-04-16T16:19:06.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.901+0000 7fa175e00640 1 -- start start 2024-04-16T16:19:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.902+0000 7fa175e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa17006da70 0x7fa1700ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.902+0000 7fa175e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa170071a10 con 0x7fa17006f9f0 2024-04-16T16:19:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.902+0000 7fa175e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa170071cf0 con 0x7fa17015ee10 2024-04-16T16:19:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.902+0000 7fa175e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa170072620 con 0x7fa17006da70 2024-04-16T16:19:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.902+0000 7fa16ea00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa17006da70 0x7fa1700ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.902+0000 7fa16f400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa17006f9f0 0x7fa170072ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45482/0 (socket says 172.21.15.22:45482) 2024-04-16T16:19:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.902+0000 7fa16f400640 1 -- 172.21.15.22:0/3461301406 learned_addr learned my addr 172.21.15.22:0/3461301406 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.903+0000 7fa16ea00640 1 -- 172.21.15.22:0/3461301406 >> v1:172.21.15.43:6789/0 conn(0x7fa17015ee10 legacy=0x7fa17006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.903+0000 7fa16ea00640 1 -- 172.21.15.22:0/3461301406 >> v1:172.21.15.22:6789/0 conn(0x7fa17006f9f0 legacy=0x7fa170072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.903+0000 7fa16ea00640 1 -- 172.21.15.22:0/3461301406 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa170071fd0 con 0x7fa17006da70 2024-04-16T16:19:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.904+0000 7fa16ea00640 1 --2- 172.21.15.22:0/3461301406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006da70 0x7fa1700ade00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa1600097a0 tx=0x7fa16002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985a8936de6536b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:06.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.904+0000 7fa16e000640 1 -- 172.21.15.22:0/3461301406 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160034070 con 0x7fa17006da70 2024-04-16T16:19:06.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.904+0000 7fa16e000640 1 -- 172.21.15.22:0/3461301406 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa160030610 con 0x7fa17006da70 2024-04-16T16:19:06.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.904+0000 7fa16e000640 1 -- 172.21.15.22:0/3461301406 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1600309e0 con 0x7fa17006da70 2024-04-16T16:19:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.905+0000 7fa175e00640 1 -- 172.21.15.22:0/3461301406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006da70 msgr2=0x7fa1700ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.905+0000 7fa175e00640 1 --2- 172.21.15.22:0/3461301406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006da70 0x7fa1700ade00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa1600097a0 tx=0x7fa16002b960 comp rx=0 tx=0).stop 2024-04-16T16:19:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.905+0000 7fa175e00640 1 -- 172.21.15.22:0/3461301406 shutdown_connections 2024-04-16T16:19:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.905+0000 7fa175e00640 1 --2- 172.21.15.22:0/3461301406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006da70 0x7fa1700ade00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.905+0000 7fa175e00640 1 -- 172.21.15.22:0/3461301406 >> 172.21.15.22:0/3461301406 conn(0x7fa1700b2b20 msgr2=0x7fa1700b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.905+0000 7fa175e00640 1 -- 172.21.15.22:0/3461301406 shutdown_connections 2024-04-16T16:19:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.905+0000 7fa175e00640 1 -- 172.21.15.22:0/3461301406 wait complete. 2024-04-16T16:19:06.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.907+0000 7fa175e00640 1 Processor -- start 2024-04-16T16:19:06.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.907+0000 7fa175e00640 1 -- start start 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.908+0000 7fa175e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa17006da70 0x7fa1701f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.908+0000 7fa175e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006f9f0 0x7fa17009c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.908+0000 7fa175e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa17015ee10 0x7fa17015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.908+0000 7fa175e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa17006fea0 con 0x7fa17006f9f0 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.908+0000 7fa175e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa1700b6050 con 0x7fa17015ee10 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.908+0000 7fa175e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa170070020 con 0x7fa17006da70 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006f9f0 0x7fa17009c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006f9f0 0x7fa17009c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41282/0 (socket says 172.21.15.22:41282) 2024-04-16T16:19:06.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 -- 172.21.15.22:0/3829163001 learned_addr learned my addr 172.21.15.22:0/3829163001 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa16f400640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa17015ee10 0x7fa17015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa16ea00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa17006da70 0x7fa1701f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 -- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa17006da70 msgr2=0x7fa1701f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa17006da70 0x7fa1701f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 -- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa17015ee10 msgr2=0x7fa17015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa17015ee10 0x7fa17015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 -- 172.21.15.22:0/3829163001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17009cce0 con 0x7fa17006f9f0 2024-04-16T16:19:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.909+0000 7fa167e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006f9f0 0x7fa17009c400 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa15800c440 tx=0x7fa15800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:06.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.910+0000 7fa167400640 1 -- 172.21.15.22:0/3829163001 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1580052d0 con 0x7fa17006f9f0 2024-04-16T16:19:06.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.910+0000 7fa167400640 1 -- 172.21.15.22:0/3829163001 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa158005470 con 0x7fa17006f9f0 2024-04-16T16:19:06.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.910+0000 7fa167400640 1 -- 172.21.15.22:0/3829163001 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa158007260 con 0x7fa17006f9f0 2024-04-16T16:19:06.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.910+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17009cfc0 con 0x7fa17006f9f0 2024-04-16T16:19:06.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.910+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17015b000 con 0x7fa17006f9f0 2024-04-16T16:19:06.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.911+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17004fd90 con 0x7fa17006f9f0 2024-04-16T16:19:06.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.912+0000 7fa167400640 1 -- 172.21.15.22:0/3829163001 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fa158007400 con 0x7fa17006f9f0 2024-04-16T16:19:06.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.913+0000 7fa167400640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa14c06cbf0 0x7fa14c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:06.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.913+0000 7fa167400640 1 -- 172.21.15.22:0/3829163001 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7fa15808b3b0 con 0x7fa17006f9f0 2024-04-16T16:19:06.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.914+0000 7fa16ea00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa14c06cbf0 0x7fa14c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:06.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.914+0000 7fa16ea00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa14c06cbf0 0x7fa14c06f0b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa160036000 tx=0x7fa16003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:06.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:06.918+0000 7fa167400640 1 -- 172.21.15.22:0/3829163001 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1580594c0 con 0x7fa17006f9f0 2024-04-16T16:19:07.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.125+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa170160400 con 0x7fa17006f9f0 2024-04-16T16:19:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.125+0000 7fa167400640 1 -- 172.21.15.22:0/3829163001 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) ==== 80+0+0 (secure 0 0 0) 0x7fa158058dc0 con 0x7fa17006f9f0 2024-04-16T16:19:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:19:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa14c06cbf0 msgr2=0x7fa14c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa14c06cbf0 0x7fa14c06f0b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa160036000 tx=0x7fa16003b040 comp rx=0 tx=0).stop 2024-04-16T16:19:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006f9f0 msgr2=0x7fa17009c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006f9f0 0x7fa17009c400 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa15800c440 tx=0x7fa15800c900 comp rx=0 tx=0).stop 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 shutdown_connections 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa14c06cbf0 0x7fa14c06f0b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa17015ee10 0x7fa17015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa17006f9f0 0x7fa17009c400 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 --2- 172.21.15.22:0/3829163001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa17006da70 0x7fa1701f49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 >> 172.21.15.22:0/3829163001 conn(0x7fa1700b2b20 msgr2=0x7fa17015f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 shutdown_connections 2024-04-16T16:19:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.128+0000 7fa175e00640 1 -- 172.21.15.22:0/3829163001 wait complete. 2024-04-16T16:19:07.144 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-16T16:19:07.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:07.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-16T16:19:07.313 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:19:07.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:07.314 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T16:19:07.364 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:19:07.364 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:19:07.364 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:07.404 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:19:07.404 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:07.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.702+0000 7f0a7ae00640 1 Processor -- start 2024-04-16T16:19:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.703+0000 7f0a7ae00640 1 -- start start 2024-04-16T16:19:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.704+0000 7f0a7ae00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a740d2160 0x7f0a74062440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.704+0000 7f0a7ae00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7415ff30 con 0x7f0a7415f950 2024-04-16T16:19:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.704+0000 7f0a7ae00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a741629d0 con 0x7f0a741634b0 2024-04-16T16:19:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.704+0000 7f0a7ae00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7415cc40 con 0x7f0a740d2160 2024-04-16T16:19:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.705+0000 7f0a73e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a740d2160 0x7f0a74062440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.705+0000 7f0a73e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a740d2160 0x7f0a74062440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41288/0 (socket says 172.21.15.22:41288) 2024-04-16T16:19:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.705+0000 7f0a73e00640 1 -- 172.21.15.22:0/1694933804 learned_addr learned my addr 172.21.15.22:0/1694933804 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.705+0000 7f0a73e00640 1 -- 172.21.15.22:0/1694933804 >> v1:172.21.15.43:6789/0 conn(0x7f0a741634b0 legacy=0x7f0a7415f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.705+0000 7f0a73e00640 1 -- 172.21.15.22:0/1694933804 >> v1:172.21.15.22:6789/0 conn(0x7f0a7415f950 legacy=0x7f0a74160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.705+0000 7f0a73e00640 1 -- 172.21.15.22:0/1694933804 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74162cb0 con 0x7f0a740d2160 2024-04-16T16:19:07.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.706+0000 7f0a73e00640 1 --2- 172.21.15.22:0/1694933804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a74062440 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009870 tx=0x7f0a6402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbd60a997370967 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:07.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.707+0000 7f0a72a00640 1 -- 172.21.15.22:0/1694933804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64034070 con 0x7f0a740d2160 2024-04-16T16:19:07.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.707+0000 7f0a72a00640 1 -- 172.21.15.22:0/1694933804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a64030860 con 0x7f0a740d2160 2024-04-16T16:19:07.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.707+0000 7f0a72a00640 1 -- 172.21.15.22:0/1694933804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64030c30 con 0x7f0a740d2160 2024-04-16T16:19:07.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.707+0000 7f0a7ae00640 1 -- 172.21.15.22:0/1694933804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 msgr2=0x7f0a74062440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.707+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/1694933804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a74062440 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009870 tx=0x7f0a6402b9a0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.708+0000 7f0a7ae00640 1 -- 172.21.15.22:0/1694933804 shutdown_connections 2024-04-16T16:19:07.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.708+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/1694933804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a74062440 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.708+0000 7f0a7ae00640 1 -- 172.21.15.22:0/1694933804 >> 172.21.15.22:0/1694933804 conn(0x7f0a740b3510 msgr2=0x7f0a740b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:07.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.708+0000 7f0a7ae00640 1 -- 172.21.15.22:0/1694933804 shutdown_connections 2024-04-16T16:19:07.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.708+0000 7f0a7ae00640 1 -- 172.21.15.22:0/1694933804 wait complete. 2024-04-16T16:19:07.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.709+0000 7f0a7ae00640 1 Processor -- start 2024-04-16T16:19:07.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.710+0000 7f0a7ae00640 1 -- start start 2024-04-16T16:19:07.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a7ae00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a7414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:07.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a7ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0a7415f950 0x7f0a7415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:07.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a7ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a741634b0 0x7f0a7415acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:07.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a7ae00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74062980 con 0x7f0a740d2160 2024-04-16T16:19:07.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a7ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0a740d2540 con 0x7f0a741634b0 2024-04-16T16:19:07.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a7ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0a74062b00 con 0x7f0a7415f950 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a7414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a7414c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41300/0 (socket says 172.21.15.22:41300) 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 -- 172.21.15.22:0/3563780100 learned_addr learned my addr 172.21.15.22:0/3563780100 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 -- 172.21.15.22:0/3563780100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0a7415f950 msgr2=0x7f0a7415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0a7415f950 0x7f0a7415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 -- 172.21.15.22:0/3563780100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a741634b0 msgr2=0x7f0a7415acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a741634b0 0x7f0a7415acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.711+0000 7f0a73e00640 1 -- 172.21.15.22:0/3563780100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a740b52f0 con 0x7f0a740d2160 2024-04-16T16:19:07.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.712+0000 7f0a73e00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a7414c420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0a64000c00 tx=0x7f0a64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.712+0000 7f0a6be00640 1 -- 172.21.15.22:0/3563780100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64048070 con 0x7f0a740d2160 2024-04-16T16:19:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.712+0000 7f0a6be00640 1 -- 172.21.15.22:0/3563780100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a64039d90 con 0x7f0a740d2160 2024-04-16T16:19:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.712+0000 7f0a6be00640 1 -- 172.21.15.22:0/3563780100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64034040 con 0x7f0a740d2160 2024-04-16T16:19:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.712+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a740b5590 con 0x7f0a740d2160 2024-04-16T16:19:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.712+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7415b3c0 con 0x7f0a740d2160 2024-04-16T16:19:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.713+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7404fd90 con 0x7f0a740d2160 2024-04-16T16:19:07.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.714+0000 7f0a6be00640 1 -- 172.21.15.22:0/3563780100 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f0a6404b070 con 0x7f0a740d2160 2024-04-16T16:19:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.715+0000 7f0a6be00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0a5006cbc0 0x7f0a5006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.715+0000 7f0a6be00640 1 -- 172.21.15.22:0/3563780100 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f0a640ae2f0 con 0x7f0a740d2160 2024-04-16T16:19:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.715+0000 7f0a73400640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0a5006cbc0 0x7f0a5006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.716+0000 7f0a73400640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0a5006cbc0 0x7f0a5006f080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b6530 tx=0x7f0a5c009230 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.720+0000 7f0a6be00640 1 -- 172.21.15.22:0/3563780100 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a6407c260 con 0x7f0a740d2160 2024-04-16T16:19:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.920+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a741619f0 con 0x7f0a740d2160 2024-04-16T16:19:07.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.922+0000 7f0a6be00640 1 -- 172.21.15.22:0/3563780100 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16614 (secure 0 0 0) 0x7f0a6407bb60 con 0x7f0a740d2160 2024-04-16T16:19:07.921 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:07.921 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:18:57.479051+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.924+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0a5006cbc0 msgr2=0x7f0a5006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.924+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0a5006cbc0 0x7f0a5006f080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b6530 tx=0x7f0a5c009230 comp rx=0 tx=0).stop 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.924+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 msgr2=0x7f0a7414c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.924+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a7414c420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0a64000c00 tx=0x7f0a64004730 comp rx=0 tx=0).stop 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 shutdown_connections 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0a5006cbc0 0x7f0a5006f080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a741634b0 0x7f0a7415acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0a7415f950 0x7f0a7415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 --2- 172.21.15.22:0/3563780100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a740d2160 0x7f0a7414c420 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 >> 172.21.15.22:0/3563780100 conn(0x7f0a740b3510 msgr2=0x7f0a740b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 shutdown_connections 2024-04-16T16:19:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:07.925+0000 7f0a7ae00640 1 -- 172.21.15.22:0/3563780100 wait complete. 2024-04-16T16:19:07.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:17:53.871511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:17:54.933724+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:19:07.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:19:08.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.164+0000 7ff03ce00640 1 Processor -- start 2024-04-16T16:19:08.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.165+0000 7ff03ce00640 1 -- start start 2024-04-16T16:19:08.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.166+0000 7ff03ce00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff0380cbe40 0x7ff038163440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.166+0000 7ff03ce00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03815ff50 con 0x7ff0380cc220 2024-04-16T16:19:08.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.166+0000 7ff03ce00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff038162960 con 0x7ff03806c370 2024-04-16T16:19:08.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.166+0000 7ff03ce00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff038160230 con 0x7ff0380cbe40 2024-04-16T16:19:08.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.167+0000 7ff037400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff0380cbe40 0x7ff038163440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.167+0000 7ff037400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff0380cbe40 0x7ff038163440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41316/0 (socket says 172.21.15.22:41316) 2024-04-16T16:19:08.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.167+0000 7ff037400640 1 -- 172.21.15.22:0/2913766383 learned_addr learned my addr 172.21.15.22:0/2913766383 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:08.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.167+0000 7ff036a00640 1 --1- 172.21.15.22:0/2913766383 >> v1:172.21.15.22:6789/0 conn(0x7ff0380cc220 0x7ff03806bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45496/0 (socket says 172.21.15.22:45496) 2024-04-16T16:19:08.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.167+0000 7ff037400640 1 -- 172.21.15.22:0/2913766383 >> v1:172.21.15.43:6789/0 conn(0x7ff03806c370 legacy=0x7ff03815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:08.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.167+0000 7ff037400640 1 -- 172.21.15.22:0/2913766383 >> v1:172.21.15.22:6789/0 conn(0x7ff0380cc220 legacy=0x7ff03806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.167+0000 7ff037400640 1 -- 172.21.15.22:0/2913766383 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff038162c40 con 0x7ff0380cbe40 2024-04-16T16:19:08.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.169+0000 7ff037400640 1 --2- 172.21.15.22:0/2913766383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cbe40 0x7ff038163440 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff0381603b0 tx=0x7ff02802bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8ecf6389689051 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:08.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.169+0000 7ff036000640 1 -- 172.21.15.22:0/2913766383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02802c820 con 0x7ff0380cbe40 2024-04-16T16:19:08.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.169+0000 7ff036000640 1 -- 172.21.15.22:0/2913766383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02802c9c0 con 0x7ff0380cbe40 2024-04-16T16:19:08.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.169+0000 7ff036000640 1 -- 172.21.15.22:0/2913766383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02802cd90 con 0x7ff0380cbe40 2024-04-16T16:19:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.170+0000 7ff03ce00640 1 -- 172.21.15.22:0/2913766383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cbe40 msgr2=0x7ff038163440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.170+0000 7ff03ce00640 1 --2- 172.21.15.22:0/2913766383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cbe40 0x7ff038163440 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff0381603b0 tx=0x7ff02802bd00 comp rx=0 tx=0).stop 2024-04-16T16:19:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.170+0000 7ff03ce00640 1 -- 172.21.15.22:0/2913766383 shutdown_connections 2024-04-16T16:19:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.170+0000 7ff03ce00640 1 --2- 172.21.15.22:0/2913766383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cbe40 0x7ff038163440 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.170+0000 7ff03ce00640 1 -- 172.21.15.22:0/2913766383 >> 172.21.15.22:0/2913766383 conn(0x7ff0380d1950 msgr2=0x7ff0380d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.170+0000 7ff03ce00640 1 -- 172.21.15.22:0/2913766383 shutdown_connections 2024-04-16T16:19:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.170+0000 7ff03ce00640 1 -- 172.21.15.22:0/2913766383 wait complete. 2024-04-16T16:19:08.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.172+0000 7ff03ce00640 1 Processor -- start 2024-04-16T16:19:08.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.172+0000 7ff03ce00640 1 -- start start 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff03ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03806c370 0x7ff0380c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff03ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0380cbe40 0x7ff0381e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff03ce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cc220 0x7ff0381e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff03ce00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff03815fad0 con 0x7ff0380cc220 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff03ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff03815f950 con 0x7ff03806c370 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff03ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff03815fc50 con 0x7ff0380cbe40 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff037e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cc220 0x7ff0381e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff037e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cc220 0x7ff0381e9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41328/0 (socket says 172.21.15.22:41328) 2024-04-16T16:19:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.173+0000 7ff037e00640 1 -- 172.21.15.22:0/1155531819 learned_addr learned my addr 172.21.15.22:0/1155531819 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff037e00640 1 -- 172.21.15.22:0/1155531819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0380cbe40 msgr2=0x7ff0381e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff037e00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0380cbe40 0x7ff0381e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff037e00640 1 -- 172.21.15.22:0/1155531819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03806c370 msgr2=0x7ff0380c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff037e00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03806c370 0x7ff0380c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff037e00640 1 -- 172.21.15.22:0/1155531819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0380c8c60 con 0x7ff0380cc220 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff037e00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cc220 0x7ff0381e9760 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c3e0 tx=0x7ff03000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff02f400640 1 -- 172.21.15.22:0/1155531819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030011790 con 0x7ff0380cc220 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff02f400640 1 -- 172.21.15.22:0/1155531819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff030017070 con 0x7ff0380cc220 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff02f400640 1 -- 172.21.15.22:0/1155531819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030011bb0 con 0x7ff0380cc220 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0380ae9a0 con 0x7ff0380cc220 2024-04-16T16:19:08.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.174+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0380aef60 con 0x7ff0380cc220 2024-04-16T16:19:08.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.176+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0381622d0 con 0x7ff0380cc220 2024-04-16T16:19:08.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.177+0000 7ff02f400640 1 -- 172.21.15.22:0/1155531819 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7ff03001c460 con 0x7ff0380cc220 2024-04-16T16:19:08.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.177+0000 7ff02f400640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff01406cbc0 0x7ff01406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.178+0000 7ff02f400640 1 -- 172.21.15.22:0/1155531819 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7ff03008bd30 con 0x7ff0380cc220 2024-04-16T16:19:08.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.178+0000 7ff037400640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff01406cbc0 0x7ff01406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.178+0000 7ff037400640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff01406cbc0 0x7ff01406f080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff028035000 tx=0x7ff02802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:08.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.182+0000 7ff02f400640 1 -- 172.21.15.22:0/1155531819 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0381622d0 con 0x7ff0380cc220 2024-04-16T16:19:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.376+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff0380cdbd0 con 0x7ff0380cc220 2024-04-16T16:19:08.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.376+0000 7ff02f400640 1 -- 172.21.15.22:0/1155531819 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7ff030090070 con 0x7ff0380cc220 2024-04-16T16:19:08.375 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:19:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.378+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff01406cbc0 msgr2=0x7ff01406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.378+0000 7ff03ce00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff01406cbc0 0x7ff01406f080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff028035000 tx=0x7ff02802e000 comp rx=0 tx=0).stop 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.378+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cc220 msgr2=0x7ff0381e9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.378+0000 7ff03ce00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cc220 0x7ff0381e9760 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c3e0 tx=0x7ff03000c8a0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 shutdown_connections 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff01406cbc0 0x7ff01406f080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0380cc220 0x7ff0381e9760 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0380cbe40 0x7ff0381e85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 --2- 172.21.15.22:0/1155531819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03806c370 0x7ff0380c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 >> 172.21.15.22:0/1155531819 conn(0x7ff0380d1950 msgr2=0x7ff038161bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 shutdown_connections 2024-04-16T16:19:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.379+0000 7ff03ce00640 1 -- 172.21.15.22:0/1155531819 wait complete. 2024-04-16T16:19:08.397 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:19:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.629+0000 7fa75aa00640 1 Processor -- start 2024-04-16T16:19:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.630+0000 7fa75aa00640 1 -- start start 2024-04-16T16:19:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.631+0000 7fa75aa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7540b3df0 0x7fa7540ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.631+0000 7fa75aa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa7540cee70 0x7fa75415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.631+0000 7fa75aa00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75406e500 con 0x7fa7541462e0 2024-04-16T16:19:08.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.631+0000 7fa75aa00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa75406e2b0 con 0x7fa7540b3df0 2024-04-16T16:19:08.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.631+0000 7fa75aa00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa75406e7e0 con 0x7fa7540cee70 2024-04-16T16:19:08.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa758c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7540b3df0 0x7fa7540ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa758c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7540b3df0 0x7fa7540ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41336/0 (socket says 172.21.15.22:41336) 2024-04-16T16:19:08.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa758c00640 1 -- 172.21.15.22:0/2037887715 learned_addr learned my addr 172.21.15.22:0/2037887715 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa758c00640 1 -- 172.21.15.22:0/2037887715 >> v2:172.21.15.43:3300/0 conn(0x7fa7540cee70 msgr2=0x7fa75415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa75a000640 1 --2- 172.21.15.22:0/2037887715 >> v2:172.21.15.43:3300/0 conn(0x7fa7540cee70 0x7fa75415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa758c00640 1 --2- 172.21.15.22:0/2037887715 >> v2:172.21.15.43:3300/0 conn(0x7fa7540cee70 0x7fa75415cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa758c00640 1 -- 172.21.15.22:0/2037887715 >> v1:172.21.15.43:6789/0 conn(0x7fa7541462e0 legacy=0x7fa7540b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.632+0000 7fa758c00640 1 -- 172.21.15.22:0/2037887715 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75406eac0 con 0x7fa7540b3df0 2024-04-16T16:19:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.633+0000 7fa758c00640 1 --2- 172.21.15.22:0/2037887715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540b3df0 0x7fa7540ce930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa75406f8e0 tx=0x7fa74002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7038f2d314b9e559 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa753e00640 1 -- 172.21.15.22:0/2037887715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740035020 con 0x7fa7540b3df0 2024-04-16T16:19:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa753e00640 1 -- 172.21.15.22:0/2037887715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740031870 con 0x7fa7540b3df0 2024-04-16T16:19:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa753e00640 1 -- 172.21.15.22:0/2037887715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740031c40 con 0x7fa7540b3df0 2024-04-16T16:19:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa75aa00640 1 -- 172.21.15.22:0/2037887715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540b3df0 msgr2=0x7fa7540ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2037887715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540b3df0 0x7fa7540ce930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa75406f8e0 tx=0x7fa74002b910 comp rx=0 tx=0).stop 2024-04-16T16:19:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa75aa00640 1 -- 172.21.15.22:0/2037887715 shutdown_connections 2024-04-16T16:19:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2037887715 >> v2:172.21.15.43:3300/0 conn(0x7fa7540cee70 0x7fa75415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2037887715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540b3df0 0x7fa7540ce930 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa75aa00640 1 -- 172.21.15.22:0/2037887715 >> 172.21.15.22:0/2037887715 conn(0x7fa754074e60 msgr2=0x7fa75406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.634+0000 7fa75aa00640 1 -- 172.21.15.22:0/2037887715 shutdown_connections 2024-04-16T16:19:08.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.635+0000 7fa75aa00640 1 -- 172.21.15.22:0/2037887715 wait complete. 2024-04-16T16:19:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.636+0000 7fa75aa00640 1 Processor -- start 2024-04-16T16:19:08.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.636+0000 7fa75aa00640 1 -- start start 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.637+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7540b3df0 0x7fa75413a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.637+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540cee70 0x7fa7541e7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.637+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7541462e0 0x7fa75413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.637+0000 7fa75aa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7540cf280 con 0x7fa7540cee70 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.637+0000 7fa75aa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa75406f2c0 con 0x7fa7541462e0 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.637+0000 7fa75aa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa7540cf400 con 0x7fa7540b3df0 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540cee70 0x7fa7541e7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540cee70 0x7fa7541e7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41344/0 (socket says 172.21.15.22:41344) 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 -- 172.21.15.22:0/2053516466 learned_addr learned my addr 172.21.15.22:0/2053516466 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa759600640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7540b3df0 0x7fa75413a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa75a000640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7541462e0 0x7fa75413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 -- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7540b3df0 msgr2=0x7fa75413a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7540b3df0 0x7fa75413a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 -- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7541462e0 msgr2=0x7fa75413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7541462e0 0x7fa75413cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.638+0000 7fa758c00640 1 -- 172.21.15.22:0/2053516466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75413ae40 con 0x7fa7540cee70 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.639+0000 7fa758c00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540cee70 0x7fa7541e7ed0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa74002b950 tx=0x7fa7400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.639+0000 7fa751600640 1 -- 172.21.15.22:0/2053516466 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740040070 con 0x7fa7540cee70 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.639+0000 7fa751600640 1 -- 172.21.15.22:0/2053516466 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa74003a420 con 0x7fa7540cee70 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.639+0000 7fa751600640 1 -- 172.21.15.22:0/2053516466 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740035040 con 0x7fa7540cee70 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.639+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75413b120 con 0x7fa7540cee70 2024-04-16T16:19:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.639+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75413b6e0 con 0x7fa7540cee70 2024-04-16T16:19:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.640+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa754075f30 con 0x7fa7540cee70 2024-04-16T16:19:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.642+0000 7fa751600640 1 -- 172.21.15.22:0/2053516466 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fa740038020 con 0x7fa7540cee70 2024-04-16T16:19:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.642+0000 7fa751600640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa73406cbc0 0x7fa73406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.643+0000 7fa751600640 1 -- 172.21.15.22:0/2053516466 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7fa7400ae030 con 0x7fa7540cee70 2024-04-16T16:19:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.643+0000 7fa759600640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa73406cbc0 0x7fa73406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.644+0000 7fa759600640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa73406cbc0 0x7fa73406f080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa748006fd0 tx=0x7fa748008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.647+0000 7fa751600640 1 -- 172.21.15.22:0/2053516466 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa74007c0b0 con 0x7fa7540cee70 2024-04-16T16:19:08.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.851+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa7541598e0 con 0x7fa7540cee70 2024-04-16T16:19:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.852+0000 7fa751600640 1 -- 172.21.15.22:0/2053516466 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) ==== 104+0+11 (secure 0 0 0) 0x7fa74007b9b0 con 0x7fa7540cee70 2024-04-16T16:19:08.850 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:19:08.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa73406cbc0 msgr2=0x7fa73406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa73406cbc0 0x7fa73406f080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa748006fd0 tx=0x7fa748008040 comp rx=0 tx=0).stop 2024-04-16T16:19:08.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540cee70 msgr2=0x7fa7541e7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:08.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540cee70 0x7fa7541e7ed0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa74002b950 tx=0x7fa7400046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 shutdown_connections 2024-04-16T16:19:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa73406cbc0 0x7fa73406f080 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7541462e0 0x7fa75413cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7540cee70 0x7fa7541e7ed0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 --2- 172.21.15.22:0/2053516466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7540b3df0 0x7fa75413a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.854+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 >> 172.21.15.22:0/2053516466 conn(0x7fa754074e60 msgr2=0x7fa754144c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.855+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 shutdown_connections 2024-04-16T16:19:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:08.855+0000 7fa75aa00640 1 -- 172.21.15.22:0/2053516466 wait complete. 2024-04-16T16:19:08.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:19:09.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.088+0000 7fe026e00640 1 Processor -- start 2024-04-16T16:19:09.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.089+0000 7fe026e00640 1 -- start start 2024-04-16T16:19:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.090+0000 7fe026e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 0x7fe0200d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.090+0000 7fe026e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02006ce50 con 0x7fe02015e9c0 2024-04-16T16:19:09.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.091+0000 7fe026e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02006d0f0 con 0x7fe0200b3780 2024-04-16T16:19:09.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.091+0000 7fe026e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe0200d0ab0 con 0x7fe0200d0110 2024-04-16T16:19:09.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.091+0000 7fe025a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe02015e9c0 0x7fe020162fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45502/0 (socket says 172.21.15.22:45502) 2024-04-16T16:19:09.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.091+0000 7fe025a00640 1 -- 172.21.15.22:0/2651036653 learned_addr learned my addr 172.21.15.22:0/2651036653 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.091+0000 7fe025000640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 0x7fe0200d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.091+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458771437 0 0) 0x7fe02006ce50 con 0x7fe02015e9c0 2024-04-16T16:19:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.091+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe008003520 con 0x7fe02015e9c0 2024-04-16T16:19:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2091178446 0 0) 0x7fe008003520 con 0x7fe02015e9c0 2024-04-16T16:19:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 msgr2=0x7fe0200d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 0x7fe0200d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 >> v1:172.21.15.43:6789/0 conn(0x7fe0200b3780 legacy=0x7fe0200b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02006d3d0 con 0x7fe02015e9c0 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fe014001670 con 0x7fe02015e9c0 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 >> v1:172.21.15.22:6789/0 conn(0x7fe02015e9c0 legacy=0x7fe020162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 0x7fe0080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe008004010 0x7fe008004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe008004d40 0x7fe0080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe00800bb50 con 0x7fe008004010 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe00800bd00 con 0x7fe008004d40 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe00800bf00 con 0x7fe0200d0110 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.092+0000 7fe025000640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe008004010 0x7fe008004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe025a00640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 0x7fe0080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe025000640 1 -- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 msgr2=0x7fe0080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:09.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe026400640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe008004d40 0x7fe0080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe025000640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0200d0110 0x7fe0080039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe025000640 1 -- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe008004d40 msgr2=0x7fe0080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:09.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe025000640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe008004d40 0x7fe0080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe025000640 1 -- 172.21.15.22:0/2651036653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe008003520 con 0x7fe008004010 2024-04-16T16:19:09.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.093+0000 7fe026400640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe008004d40 0x7fe0080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.094+0000 7fe025000640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe008004010 0x7fe008004800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00ba30 tx=0x7fe008005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a39cf5ba9d26126 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c036020 con 0x7fe008004010 2024-04-16T16:19:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c032640 con 0x7fe008004010 2024-04-16T16:19:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe01fe00640 1 -- 172.21.15.22:0/2651036653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00b600 con 0x7fe008004010 2024-04-16T16:19:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe026e00640 1 -- 172.21.15.22:0/2651036653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe008004010 msgr2=0x7fe008004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe026e00640 1 --2- 172.21.15.22:0/2651036653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe008004010 0x7fe008004800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00ba30 tx=0x7fe008005830 comp rx=0 tx=0).stop 2024-04-16T16:19:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe026400640 1 -- 172.21.15.22:0/2651036653 reap_dead start 2024-04-16T16:19:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe026e00640 1 -- 172.21.15.22:0/2651036653 shutdown_connections 2024-04-16T16:19:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe026e00640 1 -- 172.21.15.22:0/2651036653 >> 172.21.15.22:0/2651036653 conn(0x7fe020075070 msgr2=0x7fe020062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe026e00640 1 -- 172.21.15.22:0/2651036653 shutdown_connections 2024-04-16T16:19:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.095+0000 7fe026e00640 1 -- 172.21.15.22:0/2651036653 wait complete. 2024-04-16T16:19:09.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.097+0000 7fe026e00640 1 Processor -- start 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.097+0000 7fe026e00640 1 -- start start 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.098+0000 7fe026e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe008004010 0x7fe020147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.098+0000 7fe026e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0201609b0 0x7fe0200b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.098+0000 7fe026e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0201547d0 0x7fe0200b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.098+0000 7fe026e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe02006dc70 con 0x7fe0201547d0 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.098+0000 7fe026e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe02006d990 con 0x7fe0201609b0 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.098+0000 7fe026e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe02015eda0 con 0x7fe008004010 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0201547d0 0x7fe0200b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0201547d0 0x7fe0200b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41368/0 (socket says 172.21.15.22:41368) 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 -- 172.21.15.22:0/62811660 learned_addr learned my addr 172.21.15.22:0/62811660 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe025a00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe008004010 0x7fe020147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe025000640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0201609b0 0x7fe0200b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 -- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe008004010 msgr2=0x7fe020147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe008004010 0x7fe020147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 -- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0201609b0 msgr2=0x7fe0200b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0201609b0 0x7fe0200b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 -- 172.21.15.22:0/62811660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe020160e90 con 0x7fe0201547d0 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.099+0000 7fe026400640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0201547d0 0x7fe0200b26e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe020063160 tx=0x7fe01800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.100+0000 7fe01d600640 1 -- 172.21.15.22:0/62811660 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018006d50 con 0x7fe0201547d0 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.100+0000 7fe01d600640 1 -- 172.21.15.22:0/62811660 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe018003970 con 0x7fe0201547d0 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.100+0000 7fe01d600640 1 -- 172.21.15.22:0/62811660 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018003da0 con 0x7fe0201547d0 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.100+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe020161170 con 0x7fe0201547d0 2024-04-16T16:19:09.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.100+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe020161730 con 0x7fe0201547d0 2024-04-16T16:19:09.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.101+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe020075f30 con 0x7fe0201547d0 2024-04-16T16:19:09.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.102+0000 7fe01d600640 1 -- 172.21.15.22:0/62811660 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fe01801b020 con 0x7fe0201547d0 2024-04-16T16:19:09.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.103+0000 7fe01d600640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe00006cbf0 0x7fe00006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.103+0000 7fe01d600640 1 -- 172.21.15.22:0/62811660 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7fe01808bc70 con 0x7fe0201547d0 2024-04-16T16:19:09.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.103+0000 7fe025a00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe00006cbf0 0x7fe00006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.104+0000 7fe025a00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe00006cbf0 0x7fe00006f0b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe014001eb0 tx=0x7fe014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:09.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.107+0000 7fe01d600640 1 -- 172.21.15.22:0/62811660 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe018059ca0 con 0x7fe0201547d0 2024-04-16T16:19:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.311+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe0200b4af0 con 0x7fe0201547d0 2024-04-16T16:19:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.312+0000 7fe01d600640 1 -- 172.21.15.22:0/62811660 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) ==== 100+0+11 (secure 0 0 0) 0x7fe0180595a0 con 0x7fe0201547d0 2024-04-16T16:19:09.311 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe00006cbf0 msgr2=0x7fe00006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe00006cbf0 0x7fe00006f0b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe014001eb0 tx=0x7fe014009040 comp rx=0 tx=0).stop 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0201547d0 msgr2=0x7fe0200b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0201547d0 0x7fe0200b26e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe020063160 tx=0x7fe01800dc00 comp rx=0 tx=0).stop 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 shutdown_connections 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe00006cbf0 0x7fe00006f0b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0201547d0 0x7fe0200b26e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0201609b0 0x7fe0200b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 --2- 172.21.15.22:0/62811660 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe008004010 0x7fe020147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 >> 172.21.15.22:0/62811660 conn(0x7fe020075070 msgr2=0x7fe02015d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:09.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 shutdown_connections 2024-04-16T16:19:09.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.315+0000 7fe026e00640 1 -- 172.21.15.22:0/62811660 wait complete. 2024-04-16T16:19:09.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:19:09.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.560+0000 7ff641200640 1 Processor -- start 2024-04-16T16:19:09.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.560+0000 7ff641200640 1 -- start start 2024-04-16T16:19:09.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.562+0000 7ff641200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff63c0afa60 0x7ff63c15be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.562+0000 7ff641200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.562+0000 7ff641200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff63c160310 con 0x7ff63c0afe40 2024-04-16T16:19:09.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.562+0000 7ff641200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff63c15c3d0 con 0x7ff63c0afa60 2024-04-16T16:19:09.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.562+0000 7ff641200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff63c15c6a0 con 0x7ff63c06e170 2024-04-16T16:19:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.563+0000 7ff63a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.563+0000 7ff639e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff63c0afa60 0x7ff63c15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.563+0000 7ff63a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c0b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:60042/0 (socket says 172.21.15.22:60042) 2024-04-16T16:19:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.563+0000 7ff63a800640 1 -- 172.21.15.22:0/2380579529 learned_addr learned my addr 172.21.15.22:0/2380579529 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.564+0000 7ff63a800640 1 -- 172.21.15.22:0/2380579529 >> v2:172.21.15.43:3300/0 conn(0x7ff63c0afa60 msgr2=0x7ff63c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.564+0000 7ff63a800640 1 --2- 172.21.15.22:0/2380579529 >> v2:172.21.15.43:3300/0 conn(0x7ff63c0afa60 0x7ff63c15be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.564+0000 7ff63a800640 1 -- 172.21.15.22:0/2380579529 >> v1:172.21.15.43:6789/0 conn(0x7ff63c0afe40 legacy=0x7ff63c15fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.564+0000 7ff63a800640 1 -- 172.21.15.22:0/2380579529 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c15c980 con 0x7ff63c06e170 2024-04-16T16:19:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.565+0000 7ff63a800640 1 --2- 172.21.15.22:0/2380579529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c0b4230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff634009e50 tx=0x7ff63402e170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db06b00abc07f556 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.570+0000 7ff639400640 1 -- 172.21.15.22:0/2380579529 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63402ed10 con 0x7ff63c06e170 2024-04-16T16:19:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.570+0000 7ff639400640 1 -- 172.21.15.22:0/2380579529 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6340363f0 con 0x7ff63c06e170 2024-04-16T16:19:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.570+0000 7ff639400640 1 -- 172.21.15.22:0/2380579529 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6340367c0 con 0x7ff63c06e170 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 -- 172.21.15.22:0/2380579529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 msgr2=0x7ff63c0b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 --2- 172.21.15.22:0/2380579529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c0b4230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff634009e50 tx=0x7ff63402e170 comp rx=0 tx=0).stop 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 -- 172.21.15.22:0/2380579529 shutdown_connections 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 --2- 172.21.15.22:0/2380579529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c0b4230 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 --2- 172.21.15.22:0/2380579529 >> v2:172.21.15.43:3300/0 conn(0x7ff63c0afa60 0x7ff63c15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 -- 172.21.15.22:0/2380579529 >> 172.21.15.22:0/2380579529 conn(0x7ff63c062440 msgr2=0x7ff63c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 -- 172.21.15.22:0/2380579529 shutdown_connections 2024-04-16T16:19:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.571+0000 7ff641200640 1 -- 172.21.15.22:0/2380579529 wait complete. 2024-04-16T16:19:09.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.573+0000 7ff641200640 1 Processor -- start 2024-04-16T16:19:09.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.573+0000 7ff641200640 1 -- start start 2024-04-16T16:19:09.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.574+0000 7ff641200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c14cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff641200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff63c0afa60 0x7ff63c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff641200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c0afe40 0x7ff63c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff641200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c0b4770 con 0x7ff63c0afa60 2024-04-16T16:19:09.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff641200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c15f6e0 con 0x7ff63c0afe40 2024-04-16T16:19:09.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff641200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff63c0b48f0 con 0x7ff63c06e170 2024-04-16T16:19:09.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff63c0afa60 0x7ff63c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff63c0afa60 0x7ff63c15b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41384/0 (socket says 172.21.15.22:41384) 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 -- 172.21.15.22:0/3622516321 learned_addr learned my addr 172.21.15.22:0/3622516321 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff639e00640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c14cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff63a800640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c0afe40 0x7ff63c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 -- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 msgr2=0x7ff63c14cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c14cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 -- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c0afe40 msgr2=0x7ff63c14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c0afe40 0x7ff63c14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff631400640 1 -- 172.21.15.22:0/3622516321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c0cdc40 con 0x7ff63c0afa60 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.575+0000 7ff639e00640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c14cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.576+0000 7ff631400640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff63c0afa60 0x7ff63c15b6d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff62400c3c0 tx=0x7ff62400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:09.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.576+0000 7ff632a00640 1 -- 172.21.15.22:0/3622516321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6240052d0 con 0x7ff63c0afa60 2024-04-16T16:19:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.576+0000 7ff632a00640 1 -- 172.21.15.22:0/3622516321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff624005490 con 0x7ff63c0afa60 2024-04-16T16:19:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.576+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c0cdf20 con 0x7ff63c0afa60 2024-04-16T16:19:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.576+0000 7ff632a00640 1 -- 172.21.15.22:0/3622516321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624007260 con 0x7ff63c0afa60 2024-04-16T16:19:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.576+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c0ce4e0 con 0x7ff63c0afa60 2024-04-16T16:19:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.578+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63c04fd90 con 0x7ff63c0afa60 2024-04-16T16:19:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.579+0000 7ff632a00640 1 -- 172.21.15.22:0/3622516321 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7ff624007400 con 0x7ff63c0afa60 2024-04-16T16:19:09.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.580+0000 7ff632a00640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff61806cbc0 0x7ff61806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:09.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.580+0000 7ff632a00640 1 -- 172.21.15.22:0/3622516321 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7ff62408b500 con 0x7ff63c0afa60 2024-04-16T16:19:09.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.580+0000 7ff639e00640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff61806cbc0 0x7ff61806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:09.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.581+0000 7ff639e00640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff61806cbc0 0x7ff61806f080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0b2d80 tx=0x7ff62c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:09.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.584+0000 7ff632a00640 1 -- 172.21.15.22:0/3622516321 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff624059570 con 0x7ff63c0afa60 2024-04-16T16:19:09.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.802+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff63c0722c0 con 0x7ff63c0afa60 2024-04-16T16:19:09.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.803+0000 7ff632a00640 1 -- 172.21.15.22:0/3622516321 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) ==== 80+0+0 (secure 0 0 0) 0x7ff624058e70 con 0x7ff63c0afa60 2024-04-16T16:19:09.802 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:19:09.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff61806cbc0 msgr2=0x7ff61806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff61806cbc0 0x7ff61806f080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0b2d80 tx=0x7ff62c008040 comp rx=0 tx=0).stop 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff63c0afa60 msgr2=0x7ff63c15b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff63c0afa60 0x7ff63c15b6d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff62400c3c0 tx=0x7ff62400c880 comp rx=0 tx=0).stop 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 shutdown_connections 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff61806cbc0 0x7ff61806f080 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c0afe40 0x7ff63c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff63c0afa60 0x7ff63c15b6d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 --2- 172.21.15.22:0/3622516321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff63c06e170 0x7ff63c14cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 >> 172.21.15.22:0/3622516321 conn(0x7ff63c062440 msgr2=0x7ff63c0718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:09.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 shutdown_connections 2024-04-16T16:19:09.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:09.806+0000 7ff641200640 1 -- 172.21.15.22:0/3622516321 wait complete. 2024-04-16T16:19:09.826 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-16T16:19:09.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:09.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-16T16:19:09.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:19:09.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:09.948 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T16:19:10.004 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:19:10.005 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:10.005 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:10.065 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:19:10.065 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:19:10.065 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:19:10.065 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:10.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:19:10.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:19:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.358+0000 7f7cb4400640 1 Processor -- start 2024-04-16T16:19:10.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.358+0000 7f7cb4400640 1 -- start start 2024-04-16T16:19:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.359+0000 7f7cb4400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cac15ee00 0x7f7cac0b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.360+0000 7f7cb4400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15f1e0 0x7f7cac0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.360+0000 7f7cb4400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cac0b74c0 con 0x7f7cac0d4550 2024-04-16T16:19:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.360+0000 7f7cb4400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7cac0b8de0 con 0x7f7cac15ee00 2024-04-16T16:19:10.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.360+0000 7f7cb4400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7cac0d2b20 con 0x7f7cac15f1e0 2024-04-16T16:19:10.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.361+0000 7f7cb1000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15f1e0 0x7f7cac0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.361+0000 7f7cb1a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cac15ee00 0x7f7cac0b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.361+0000 7f7cb2400640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7cac0d4550 0x7f7cac0cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:35790/0 (socket says 172.21.15.22:35790) 2024-04-16T16:19:10.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.361+0000 7f7cb2400640 1 -- 172.21.15.22:0/2141496235 learned_addr learned my addr 172.21.15.22:0/2141496235 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:10.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.361+0000 7f7cb1000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15f1e0 0x7f7cac0d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:33386/0 (socket says 172.21.15.22:33386) 2024-04-16T16:19:10.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.362+0000 7f7cb1a00640 1 -- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15f1e0 msgr2=0x7f7cac0d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:10.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.362+0000 7f7cb1a00640 1 --2- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15f1e0 0x7f7cac0d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.362+0000 7f7cb1a00640 1 -- 172.21.15.22:0/2141496235 >> v1:172.21.15.43:6789/0 conn(0x7f7cac0d4550 legacy=0x7f7cac0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.362+0000 7f7cb1a00640 1 -- 172.21.15.22:0/2141496235 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac0d2e00 con 0x7f7cac15ee00 2024-04-16T16:19:10.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.362+0000 7f7cb1000640 1 --2- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15f1e0 0x7f7cac0d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:19:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.363+0000 7f7cb1a00640 1 --2- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15ee00 0x7f7cac0b6f80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00097a0 tx=0x7f7ca002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceccd75d996e7e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.364+0000 7f7cabe00640 1 -- 172.21.15.22:0/2141496235 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0031780 con 0x7f7cac15ee00 2024-04-16T16:19:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.364+0000 7f7cabe00640 1 -- 172.21.15.22:0/2141496235 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca0037070 con 0x7f7cac15ee00 2024-04-16T16:19:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.364+0000 7f7cabe00640 1 -- 172.21.15.22:0/2141496235 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0031b40 con 0x7f7cac15ee00 2024-04-16T16:19:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.364+0000 7f7cb4400640 1 -- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15ee00 msgr2=0x7f7cac0b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.364+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15ee00 0x7f7cac0b6f80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00097a0 tx=0x7f7ca002b820 comp rx=0 tx=0).stop 2024-04-16T16:19:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.365+0000 7f7cb4400640 1 -- 172.21.15.22:0/2141496235 shutdown_connections 2024-04-16T16:19:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.365+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15f1e0 0x7f7cac0d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.365+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2141496235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15ee00 0x7f7cac0b6f80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.365+0000 7f7cb4400640 1 -- 172.21.15.22:0/2141496235 >> 172.21.15.22:0/2141496235 conn(0x7f7cac062440 msgr2=0x7f7cac062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.365+0000 7f7cb4400640 1 -- 172.21.15.22:0/2141496235 shutdown_connections 2024-04-16T16:19:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.365+0000 7f7cb4400640 1 -- 172.21.15.22:0/2141496235 wait complete. 2024-04-16T16:19:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.367+0000 7f7cb4400640 1 Processor -- start 2024-04-16T16:19:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.367+0000 7f7cb4400640 1 -- start start 2024-04-16T16:19:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.368+0000 7f7cb4400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cac0d4550 0x7f7cac14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.368+0000 7f7cb4400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15ee00 0x7f7cac0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.368+0000 7f7cb4400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15f1e0 0x7f7cac14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.368+0000 7f7cb4400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac0d36a0 con 0x7f7cac0d4550 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.368+0000 7f7cb4400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac0d33c0 con 0x7f7cac15f1e0 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.368+0000 7f7cb4400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7cac0d3bc0 con 0x7f7cac15ee00 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cac0d4550 0x7f7cac14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cac0d4550 0x7f7cac14ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45814/0 (socket says 172.21.15.22:45814) 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 -- 172.21.15.22:0/2347186016 learned_addr learned my addr 172.21.15.22:0/2347186016 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb2400640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15f1e0 0x7f7cac14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1000640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15ee00 0x7f7cac0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 -- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15ee00 msgr2=0x7f7cac0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15ee00 0x7f7cac0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 -- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15f1e0 msgr2=0x7f7cac14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15f1e0 0x7f7cac14f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.369+0000 7f7cb1a00640 1 -- 172.21.15.22:0/2347186016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac14f470 con 0x7f7cac0d4550 2024-04-16T16:19:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.370+0000 7f7cb1a00640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cac0d4550 0x7f7cac14ef30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00097a0 tx=0x7f7ca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.370+0000 7f7ca9600640 1 -- 172.21.15.22:0/2347186016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0032610 con 0x7f7cac0d4550 2024-04-16T16:19:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.370+0000 7f7ca9600640 1 -- 172.21.15.22:0/2347186016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00327b0 con 0x7f7cac0d4550 2024-04-16T16:19:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.370+0000 7f7ca9600640 1 -- 172.21.15.22:0/2347186016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0032b80 con 0x7f7cac0d4550 2024-04-16T16:19:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.370+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cac160920 con 0x7f7cac0d4550 2024-04-16T16:19:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.370+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac160ee0 con 0x7f7cac0d4550 2024-04-16T16:19:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.371+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cac04fd90 con 0x7f7cac0d4550 2024-04-16T16:19:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.372+0000 7f7ca9600640 1 -- 172.21.15.22:0/2347186016 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f7ca004c060 con 0x7f7cac0d4550 2024-04-16T16:19:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.373+0000 7f7ca9600640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c8c06cbc0 0x7f7c8c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.373+0000 7f7ca9600640 1 -- 172.21.15.22:0/2347186016 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f7ca00ad6f0 con 0x7f7cac0d4550 2024-04-16T16:19:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.374+0000 7f7cb1000640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c8c06cbc0 0x7f7c8c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.374+0000 7f7cb1000640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c8c06cbc0 0x7f7c8c06f080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009560 tx=0x7f7c98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.378+0000 7f7ca9600640 1 -- 172.21.15.22:0/2347186016 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7cac14f470 con 0x7f7cac0d4550 2024-04-16T16:19:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.623+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cac0b4320 con 0x7f7cac0d4550 2024-04-16T16:19:10.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.624+0000 7f7ca9600640 1 -- 172.21.15.22:0/2347186016 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7f7ca0040070 con 0x7f7cac0d4550 2024-04-16T16:19:10.623 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:10.623 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/2477236609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2477236609},{"type":"v1","addr":"172.21.15.43:6834","nonce":2477236609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2059330399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2059330399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2059330399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/4293003845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":4293003845},{"type":"v1","addr":"172.21.15.22:6837","nonce":4293003845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:17:55.963504+0000","modified":"2024-04-16T16:17:59.021268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6836/430366264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":430366264},{"type":"v1","addr":"172.21.15.22:6836","nonce":430366264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5118,"qdb_cluster":[5118]},"id":2}]} 2024-04-16T16:19:10.623 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2024-04-16T16:19:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.626+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c8c06cbc0 msgr2=0x7f7c8c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.626+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c8c06cbc0 0x7f7c8c06f080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009560 tx=0x7f7c98008040 comp rx=0 tx=0).stop 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.626+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cac0d4550 msgr2=0x7f7cac14ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.626+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cac0d4550 0x7f7cac14ef30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00097a0 tx=0x7f7ca00046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.626+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 shutdown_connections 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.627+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c8c06cbc0 0x7f7c8c06f080 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.627+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cac15f1e0 0x7f7cac14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.627+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cac15ee00 0x7f7cac0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.627+0000 7f7cb4400640 1 --2- 172.21.15.22:0/2347186016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cac0d4550 0x7f7cac14ef30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.627+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 >> 172.21.15.22:0/2347186016 conn(0x7f7cac062440 msgr2=0x7f7cac15de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.627+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 shutdown_connections 2024-04-16T16:19:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.627+0000 7f7cb4400640 1 -- 172.21.15.22:0/2347186016 wait complete. 2024-04-16T16:19:10.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:10.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.871+0000 7f2b03400640 1 Processor -- start 2024-04-16T16:19:10.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.871+0000 7f2b03400640 1 -- start start 2024-04-16T16:19:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.873+0000 7f2b03400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2afc0d0d10 0x7f2afc167600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.873+0000 7f2b03400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2afc1606d0 con 0x7f2afc06dc80 2024-04-16T16:19:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.873+0000 7f2b03400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2afc1609b0 con 0x7f2afc0afd90 2024-04-16T16:19:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.873+0000 7f2b03400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2afc160480 con 0x7f2afc0d0d10 2024-04-16T16:19:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.873+0000 7f2b01400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2afc0d0d10 0x7f2afc167600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.873+0000 7f2afbe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2afc06dc80 0x7f2afc0d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55988/0 (socket says 172.21.15.22:55988) 2024-04-16T16:19:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.873+0000 7f2afbe00640 1 -- 172.21.15.22:0/10559733 learned_addr learned my addr 172.21.15.22:0/10559733 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.874+0000 7f2b01400640 1 -- 172.21.15.22:0/10559733 >> v1:172.21.15.43:6789/0 conn(0x7f2afc0afd90 legacy=0x7f2afc072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.874+0000 7f2b01400640 1 -- 172.21.15.22:0/10559733 >> v1:172.21.15.22:6789/0 conn(0x7f2afc06dc80 legacy=0x7f2afc0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.874+0000 7f2afb400640 1 -- 172.21.15.22:0/10559733 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157316577 0 0) 0x7f2afc1606d0 con 0x7f2afc06dc80 2024-04-16T16:19:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.874+0000 7f2b01400640 1 -- 172.21.15.22:0/10559733 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc160c90 con 0x7f2afc0d0d10 2024-04-16T16:19:10.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.875+0000 7f2b01400640 1 --2- 172.21.15.22:0/10559733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc0d0d10 0x7f2afc167600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2afc160600 tx=0x7f2af402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e9f39ecd4c8a28 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:10.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.875+0000 7f2afb400640 1 -- 172.21.15.22:0/10559733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4039070 con 0x7f2afc0d0d10 2024-04-16T16:19:10.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.875+0000 7f2afb400640 1 -- 172.21.15.22:0/10559733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af402cbf0 con 0x7f2afc0d0d10 2024-04-16T16:19:10.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.875+0000 7f2afb400640 1 -- 172.21.15.22:0/10559733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4034440 con 0x7f2afc0d0d10 2024-04-16T16:19:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.876+0000 7f2b03400640 1 -- 172.21.15.22:0/10559733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc0d0d10 msgr2=0x7f2afc167600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.876+0000 7f2b03400640 1 --2- 172.21.15.22:0/10559733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc0d0d10 0x7f2afc167600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2afc160600 tx=0x7f2af402be40 comp rx=0 tx=0).stop 2024-04-16T16:19:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.876+0000 7f2b03400640 1 -- 172.21.15.22:0/10559733 shutdown_connections 2024-04-16T16:19:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.876+0000 7f2b03400640 1 --2- 172.21.15.22:0/10559733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc0d0d10 0x7f2afc167600 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.876+0000 7f2b03400640 1 -- 172.21.15.22:0/10559733 >> 172.21.15.22:0/10559733 conn(0x7f2afc062440 msgr2=0x7f2afc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.876+0000 7f2b03400640 1 -- 172.21.15.22:0/10559733 shutdown_connections 2024-04-16T16:19:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.876+0000 7f2b03400640 1 -- 172.21.15.22:0/10559733 wait complete. 2024-04-16T16:19:10.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.878+0000 7f2b03400640 1 Processor -- start 2024-04-16T16:19:10.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.878+0000 7f2b03400640 1 -- start start 2024-04-16T16:19:10.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.879+0000 7f2b03400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc06dc80 0x7f2afc0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.879+0000 7f2b03400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2afc0afd90 0x7f2afc151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.879+0000 7f2b03400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2afc0d0d10 0x7f2afc152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.879+0000 7f2b03400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc073220 con 0x7f2afc06dc80 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.879+0000 7f2b03400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc0b0170 con 0x7f2afc0d0d10 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.879+0000 7f2b03400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc0ce8a0 con 0x7f2afc0afd90 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.879+0000 7f2b00a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc06dc80 0x7f2afc0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc06dc80 0x7f2afc0b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45824/0 (socket says 172.21.15.22:45824) 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 -- 172.21.15.22:0/4127735431 learned_addr learned my addr 172.21.15.22:0/4127735431 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b01400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2afc0d0d10 0x7f2afc152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2afbe00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2afc0afd90 0x7f2afc151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 -- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2afc0afd90 msgr2=0x7f2afc151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2afc0afd90 0x7f2afc151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 -- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2afc0d0d10 msgr2=0x7f2afc152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2afc0d0d10 0x7f2afc152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:10.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 -- 172.21.15.22:0/4127735431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc1f2580 con 0x7f2afc06dc80 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b01400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2afc0d0d10 0x7f2afc152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2afbe00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2afc0afd90 0x7f2afc151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.880+0000 7f2b00a00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc06dc80 0x7f2afc0b15b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c430 tx=0x7f2af000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.881+0000 7f2af8c00640 1 -- 172.21.15.22:0/4127735431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011790 con 0x7f2afc06dc80 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.881+0000 7f2af8c00640 1 -- 172.21.15.22:0/4127735431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0017070 con 0x7f2afc06dc80 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.881+0000 7f2af8c00640 1 -- 172.21.15.22:0/4127735431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011bb0 con 0x7f2afc06dc80 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.881+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc1f3300 con 0x7f2afc06dc80 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.881+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc1f2b00 con 0x7f2afc06dc80 2024-04-16T16:19:10.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.882+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2afc1f2300 con 0x7f2afc06dc80 2024-04-16T16:19:10.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.883+0000 7f2af8c00640 1 -- 172.21.15.22:0/4127735431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f2af001c460 con 0x7f2afc06dc80 2024-04-16T16:19:10.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.884+0000 7f2af8c00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2adc06cbc0 0x7f2adc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:10.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.884+0000 7f2af8c00640 1 -- 172.21.15.22:0/4127735431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f2af008be20 con 0x7f2afc06dc80 2024-04-16T16:19:10.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.884+0000 7f2afbe00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2adc06cbc0 0x7f2adc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:10.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.885+0000 7f2afbe00640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2adc06cbc0 0x7f2adc06f080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0aeaa0 tx=0x7f2ae8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:10.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:10.888+0000 7f2af8c00640 1 -- 172.21.15.22:0/4127735431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2afc1f2300 con 0x7f2afc06dc80 2024-04-16T16:19:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.098+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2afc04fd90 con 0x7f2afc06dc80 2024-04-16T16:19:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.100+0000 7f2af8c00640 1 -- 172.21.15.22:0/4127735431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16614 (secure 0 0 0) 0x7f2af0059f30 con 0x7f2afc06dc80 2024-04-16T16:19:11.100 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:11.100 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:18:57.479051+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2adc06cbc0 msgr2=0x7f2adc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2adc06cbc0 0x7f2adc06f080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0aeaa0 tx=0x7f2ae8009040 comp rx=0 tx=0).stop 2024-04-16T16:19:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc06dc80 msgr2=0x7f2afc0b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc06dc80 0x7f2afc0b15b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c430 tx=0x7f2af000c8f0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 shutdown_connections 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2adc06cbc0 0x7f2adc06f080 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2afc0d0d10 0x7f2afc152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2afc0afd90 0x7f2afc151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 --2- 172.21.15.22:0/4127735431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2afc06dc80 0x7f2afc0b15b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.103+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 >> 172.21.15.22:0/4127735431 conn(0x7f2afc062440 msgr2=0x7f2afc158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.104+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 shutdown_connections 2024-04-16T16:19:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.104+0000 7f2b03400640 1 -- 172.21.15.22:0/4127735431 wait complete. 2024-04-16T16:19:11.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:17:53.871511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:17:54.933724+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:19:11.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:19:11.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.338+0000 7fe40be00640 1 Processor -- start 2024-04-16T16:19:11.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.338+0000 7fe40be00640 1 -- start start 2024-04-16T16:19:11.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.339+0000 7fe40be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe40c1527b0 0x7fe40c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.339+0000 7fe40be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c071640 con 0x7fe40c06e610 2024-04-16T16:19:11.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.340+0000 7fe40be00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c071920 con 0x7fe40c070df0 2024-04-16T16:19:11.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.340+0000 7fe40be00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe40c15cd90 con 0x7fe40c1527b0 2024-04-16T16:19:11.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.340+0000 7fe40aa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe40c1527b0 0x7fe40c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.340+0000 7fe40b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe40c06e610 0x7fe40c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56004/0 (socket says 172.21.15.22:56004) 2024-04-16T16:19:11.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.340+0000 7fe40aa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe40c1527b0 0x7fe40c15bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45840/0 (socket says 172.21.15.22:45840) 2024-04-16T16:19:11.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.340+0000 7fe40b400640 1 -- 172.21.15.22:0/3128219364 learned_addr learned my addr 172.21.15.22:0/3128219364 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:11.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.341+0000 7fe40aa00640 1 -- 172.21.15.22:0/3128219364 >> v1:172.21.15.43:6789/0 conn(0x7fe40c070df0 legacy=0x7fe40c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.341+0000 7fe40aa00640 1 -- 172.21.15.22:0/3128219364 >> v1:172.21.15.22:6789/0 conn(0x7fe40c06e610 legacy=0x7fe40c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.341+0000 7fe40aa00640 1 -- 172.21.15.22:0/3128219364 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c071c00 con 0x7fe40c1527b0 2024-04-16T16:19:11.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.342+0000 7fe40aa00640 1 --2- 172.21.15.22:0/3128219364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c15bbd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0097a0 tx=0x7fe3fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fae2bdba904464 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:11.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.342+0000 7fe409600640 1 -- 172.21.15.22:0/3128219364 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc034070 con 0x7fe40c1527b0 2024-04-16T16:19:11.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.342+0000 7fe409600640 1 -- 172.21.15.22:0/3128219364 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3fc030610 con 0x7fe40c1527b0 2024-04-16T16:19:11.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.342+0000 7fe409600640 1 -- 172.21.15.22:0/3128219364 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0309e0 con 0x7fe40c1527b0 2024-04-16T16:19:11.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.342+0000 7fe40be00640 1 -- 172.21.15.22:0/3128219364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 msgr2=0x7fe40c15bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.342+0000 7fe40be00640 1 --2- 172.21.15.22:0/3128219364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c15bbd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0097a0 tx=0x7fe3fc02b960 comp rx=0 tx=0).stop 2024-04-16T16:19:11.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.343+0000 7fe40be00640 1 -- 172.21.15.22:0/3128219364 shutdown_connections 2024-04-16T16:19:11.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.343+0000 7fe40be00640 1 --2- 172.21.15.22:0/3128219364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c15bbd0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.343+0000 7fe40be00640 1 -- 172.21.15.22:0/3128219364 >> 172.21.15.22:0/3128219364 conn(0x7fe40c062440 msgr2=0x7fe40c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:11.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.343+0000 7fe40be00640 1 -- 172.21.15.22:0/3128219364 shutdown_connections 2024-04-16T16:19:11.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.343+0000 7fe40be00640 1 -- 172.21.15.22:0/3128219364 wait complete. 2024-04-16T16:19:11.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.344+0000 7fe40be00640 1 Processor -- start 2024-04-16T16:19:11.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.345+0000 7fe40be00640 1 -- start start 2024-04-16T16:19:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe40c06e610 0x7fe40c135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe40c070df0 0x7fe40c150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c071400 con 0x7fe40c1527b0 2024-04-16T16:19:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c071280 con 0x7fe40c06e610 2024-04-16T16:19:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c0b4560 con 0x7fe40c070df0 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c06d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45856/0 (socket says 172.21.15.22:45856) 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 -- 172.21.15.22:0/3971918081 learned_addr learned my addr 172.21.15.22:0/3971918081 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40aa00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe40c06e610 0x7fe40c135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40a000640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe40c070df0 0x7fe40c150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 -- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe40c070df0 msgr2=0x7fe40c150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe40c070df0 0x7fe40c150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 -- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe40c06e610 msgr2=0x7fe40c135b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe40c06e610 0x7fe40c135b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40b400640 1 -- 172.21.15.22:0/3971918081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c14fc40 con 0x7fe40c1527b0 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.346+0000 7fe40a000640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe40c070df0 0x7fe40c150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.347+0000 7fe40b400640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c06d8b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe40400cbc0 tx=0x7fe40400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.347+0000 7fe402a00640 1 -- 172.21.15.22:0/3971918081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404017070 con 0x7fe40c1527b0 2024-04-16T16:19:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.347+0000 7fe402a00640 1 -- 172.21.15.22:0/3971918081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40400ad40 con 0x7fe40c1527b0 2024-04-16T16:19:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.347+0000 7fe402a00640 1 -- 172.21.15.22:0/3971918081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404012600 con 0x7fe40c1527b0 2024-04-16T16:19:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.347+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40c14ff20 con 0x7fe40c1527b0 2024-04-16T16:19:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.347+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40c1504e0 con 0x7fe40c1527b0 2024-04-16T16:19:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.349+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40c1506e0 con 0x7fe40c1527b0 2024-04-16T16:19:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.350+0000 7fe402a00640 1 -- 172.21.15.22:0/3971918081 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fe40401a070 con 0x7fe40c1527b0 2024-04-16T16:19:11.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.350+0000 7fe402a00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe3ec06cc10 0x7fe3ec06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.351+0000 7fe402a00640 1 -- 172.21.15.22:0/3971918081 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7fe40408bb40 con 0x7fe40c1527b0 2024-04-16T16:19:11.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.351+0000 7fe40aa00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe3ec06cc10 0x7fe3ec06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.351+0000 7fe40aa00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe3ec06cc10 0x7fe3ec06f0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc036000 tx=0x7fe3fc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:11.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.355+0000 7fe402a00640 1 -- 172.21.15.22:0/3971918081 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe40c1506e0 con 0x7fe40c1527b0 2024-04-16T16:19:11.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.557+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe40c0b4c10 con 0x7fe40c1527b0 2024-04-16T16:19:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.559+0000 7fe402a00640 1 -- 172.21.15.22:0/3971918081 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fe404059740 con 0x7fe40c1527b0 2024-04-16T16:19:11.557 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:19:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.561+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe3ec06cc10 msgr2=0x7fe3ec06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.561+0000 7fe40be00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe3ec06cc10 0x7fe3ec06f0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc036000 tx=0x7fe3fc03b040 comp rx=0 tx=0).stop 2024-04-16T16:19:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.561+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 msgr2=0x7fe40c06d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.561+0000 7fe40be00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c06d8b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe40400cbc0 tx=0x7fe40400a430 comp rx=0 tx=0).stop 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 shutdown_connections 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe3ec06cc10 0x7fe3ec06f0d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c1527b0 0x7fe40c06d8b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe40c070df0 0x7fe40c150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 --2- 172.21.15.22:0/3971918081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe40c06e610 0x7fe40c135b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 >> 172.21.15.22:0/3971918081 conn(0x7fe40c062440 msgr2=0x7fe40c14eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 shutdown_connections 2024-04-16T16:19:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.562+0000 7fe40be00640 1 -- 172.21.15.22:0/3971918081 wait complete. 2024-04-16T16:19:11.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:19:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.800+0000 7f0d83200640 1 Processor -- start 2024-04-16T16:19:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.800+0000 7f0d83200640 1 -- start start 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d83200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d840b33a0 0x7f0d84070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d83200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d840715c0 con 0x7f0d8415fe30 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d83200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d840718a0 con 0x7f0d840b4fa0 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d83200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0d84071360 con 0x7f0d840b33a0 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d82800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d840b33a0 0x7f0d84070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d81400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0d8415fe30 0x7f0d840ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56010/0 (socket says 172.21.15.22:56010) 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d81400640 1 -- 172.21.15.22:0/3951225224 learned_addr learned my addr 172.21.15.22:0/3951225224 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.802+0000 7f0d82800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d840b33a0 0x7f0d84070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45862/0 (socket says 172.21.15.22:45862) 2024-04-16T16:19:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.803+0000 7f0d82800640 1 -- 172.21.15.22:0/3951225224 >> v1:172.21.15.43:6789/0 conn(0x7f0d840b4fa0 legacy=0x7f0d8415f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.803+0000 7f0d82800640 1 -- 172.21.15.22:0/3951225224 >> v1:172.21.15.22:6789/0 conn(0x7f0d8415fe30 legacy=0x7f0d840ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.803+0000 7f0d82800640 1 -- 172.21.15.22:0/3951225224 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d84071b80 con 0x7f0d840b33a0 2024-04-16T16:19:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.803+0000 7f0d80a00640 1 -- 172.21.15.22:0/3951225224 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323164251 0 0) 0x7f0d840715c0 con 0x7f0d8415fe30 2024-04-16T16:19:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.804+0000 7f0d82800640 1 --2- 172.21.15.22:0/3951225224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d84070e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009d90 tx=0x7f0d7c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a09dec753dc4198 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.804+0000 7f0d80a00640 1 -- 172.21.15.22:0/3951225224 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c039070 con 0x7f0d840b33a0 2024-04-16T16:19:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.804+0000 7f0d80a00640 1 -- 172.21.15.22:0/3951225224 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7c02cc60 con 0x7f0d840b33a0 2024-04-16T16:19:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.804+0000 7f0d80a00640 1 -- 172.21.15.22:0/3951225224 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c034660 con 0x7f0d840b33a0 2024-04-16T16:19:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.805+0000 7f0d83200640 1 -- 172.21.15.22:0/3951225224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 msgr2=0x7f0d84070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.805+0000 7f0d83200640 1 --2- 172.21.15.22:0/3951225224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d84070e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009d90 tx=0x7f0d7c02beb0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.805+0000 7f0d83200640 1 -- 172.21.15.22:0/3951225224 shutdown_connections 2024-04-16T16:19:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.805+0000 7f0d83200640 1 --2- 172.21.15.22:0/3951225224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d84070e20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.805+0000 7f0d83200640 1 -- 172.21.15.22:0/3951225224 >> 172.21.15.22:0/3951225224 conn(0x7f0d84075070 msgr2=0x7f0d84062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.805+0000 7f0d83200640 1 -- 172.21.15.22:0/3951225224 shutdown_connections 2024-04-16T16:19:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.805+0000 7f0d83200640 1 -- 172.21.15.22:0/3951225224 wait complete. 2024-04-16T16:19:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.807+0000 7f0d83200640 1 Processor -- start 2024-04-16T16:19:11.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.807+0000 7f0d83200640 1 -- start start 2024-04-16T16:19:11.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d83200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d841e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d83200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d840b4fa0 0x7f0d840cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d83200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d8415fe30 0x7f0d841f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d83200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0d840b5380 con 0x7f0d840b33a0 2024-04-16T16:19:11.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d83200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d840ce630 con 0x7f0d840b4fa0 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d83200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0d840b5500 con 0x7f0d8415fe30 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d81e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d841e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d81e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d841e9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45870/0 (socket says 172.21.15.22:45870) 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.808+0000 7f0d81e00640 1 -- 172.21.15.22:0/986733768 learned_addr learned my addr 172.21.15.22:0/986733768 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81400640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d840b4fa0 0x7f0d840cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81e00640 1 -- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d8415fe30 msgr2=0x7f0d841f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81e00640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d8415fe30 0x7f0d841f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81e00640 1 -- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d840b4fa0 msgr2=0x7f0d840cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81e00640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d840b4fa0 0x7f0d840cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81e00640 1 -- 172.21.15.22:0/986733768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d841f8560 con 0x7f0d840b33a0 2024-04-16T16:19:11.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81400640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d840b4fa0 0x7f0d840cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:11.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d81e00640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d841e9af0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c430 tx=0x7f0d7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:11.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d7a000640 1 -- 172.21.15.22:0/986733768 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011790 con 0x7f0d840b33a0 2024-04-16T16:19:11.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d7a000640 1 -- 172.21.15.22:0/986733768 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d74017070 con 0x7f0d840b33a0 2024-04-16T16:19:11.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d841f8840 con 0x7f0d840b33a0 2024-04-16T16:19:11.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.809+0000 7f0d7a000640 1 -- 172.21.15.22:0/986733768 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011bb0 con 0x7f0d840b33a0 2024-04-16T16:19:11.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.810+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d841e95d0 con 0x7f0d840b33a0 2024-04-16T16:19:11.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.811+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d84075f30 con 0x7f0d840b33a0 2024-04-16T16:19:11.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.812+0000 7f0d7a000640 1 -- 172.21.15.22:0/986733768 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f0d7401c460 con 0x7f0d840b33a0 2024-04-16T16:19:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.813+0000 7f0d7a000640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d6406cbc0 0x7f0d6406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.813+0000 7f0d7a000640 1 -- 172.21.15.22:0/986733768 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f0d7408be80 con 0x7f0d840b33a0 2024-04-16T16:19:11.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.813+0000 7f0d81400640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d6406cbc0 0x7f0d6406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:11.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.814+0000 7f0d81400640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d6406cbc0 0x7f0d6406f080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ccdb0 tx=0x7f0d70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:11.817+0000 7f0d7a000640 1 -- 172.21.15.22:0/986733768 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d74059f90 con 0x7f0d840b33a0 2024-04-16T16:19:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.024+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0d841ea0f0 con 0x7f0d840b33a0 2024-04-16T16:19:12.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.025+0000 7f0d7a000640 1 -- 172.21.15.22:0/986733768 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) ==== 104+0+11 (secure 0 0 0) 0x7f0d74059890 con 0x7f0d840b33a0 2024-04-16T16:19:12.023 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:19:12.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.027+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d6406cbc0 msgr2=0x7f0d6406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.027+0000 7f0d83200640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d6406cbc0 0x7f0d6406f080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ccdb0 tx=0x7f0d70009040 comp rx=0 tx=0).stop 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.027+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 msgr2=0x7f0d841e9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.027+0000 7f0d83200640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d841e9af0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c430 tx=0x7f0d7400c8f0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 shutdown_connections 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0d6406cbc0 0x7f0d6406f080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d8415fe30 0x7f0d841f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d840b4fa0 0x7f0d840cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 --2- 172.21.15.22:0/986733768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d840b33a0 0x7f0d841e9af0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 >> 172.21.15.22:0/986733768 conn(0x7f0d84075070 msgr2=0x7f0d840b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 shutdown_connections 2024-04-16T16:19:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.028+0000 7f0d83200640 1 -- 172.21.15.22:0/986733768 wait complete. 2024-04-16T16:19:12.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:19:12.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.276+0000 7f22f1c00640 1 Processor -- start 2024-04-16T16:19:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.276+0000 7f22f1c00640 1 -- start start 2024-04-16T16:19:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.277+0000 7f22f1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec0d1eb0 0x7f22ec169560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.277+0000 7f22f1c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ec0d3ef0 con 0x7f22ec0cfcc0 2024-04-16T16:19:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.277+0000 7f22f1c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ec0d41d0 con 0x7f22ec15eb60 2024-04-16T16:19:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.277+0000 7f22f1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f22ec0d44b0 con 0x7f22ec0d1eb0 2024-04-16T16:19:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.278+0000 7f22eb400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f22ec0cfcc0 0x7f22ec0d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56026/0 (socket says 172.21.15.22:56026) 2024-04-16T16:19:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.278+0000 7f22eb400640 1 -- 172.21.15.22:0/1052143615 learned_addr learned my addr 172.21.15.22:0/1052143615 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:12.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.278+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955999476 0 0) 0x7f22ec0d3ef0 con 0x7f22ec0cfcc0 2024-04-16T16:19:12.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.278+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d0003520 con 0x7f22ec0cfcc0 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.278+0000 7f22f1200640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec0d1eb0 0x7f22ec169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2340060927 0 0) 0x7f22d0003520 con 0x7f22ec0cfcc0 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec0d1eb0 msgr2=0x7f22ec169560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec0d1eb0 0x7f22ec169560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 >> v1:172.21.15.43:6789/0 conn(0x7f22ec15eb60 legacy=0x7f22ec0d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec0b7db0 con 0x7f22ec0cfcc0 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f22d4001670 con 0x7f22ec0cfcc0 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 >> v1:172.21.15.22:6789/0 conn(0x7f22ec0cfcc0 legacy=0x7f22ec0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec0d1eb0 0x7f22d00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d0004060 0x7f22d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004d40 0x7f22d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec0d44b0 con 0x7f22d0004060 2024-04-16T16:19:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22d000bc00 con 0x7f22d0004d40 2024-04-16T16:19:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f22d000be00 con 0x7f22ec0d1eb0 2024-04-16T16:19:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.279+0000 7f22eb400640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d0004060 0x7f22d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.280+0000 7f22eb400640 1 -- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec0d1eb0 msgr2=0x7f22d00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.280+0000 7f22eb400640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec0d1eb0 0x7f22d00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.280+0000 7f22eb400640 1 -- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004d40 msgr2=0x7f22d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.280+0000 7f22eb400640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004d40 0x7f22d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.280+0000 7f22eb400640 1 -- 172.21.15.22:0/1052143615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d0003520 con 0x7f22d0004060 2024-04-16T16:19:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.281+0000 7f22eb400640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d0004060 0x7f22d0004800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f22d400c190 tx=0x7f22d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f5b69bd57a5e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.281+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4007c60 con 0x7f22d0004060 2024-04-16T16:19:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.281+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d4030070 con 0x7f22d0004060 2024-04-16T16:19:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.281+0000 7f22eaa00640 1 -- 172.21.15.22:0/1052143615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4005d90 con 0x7f22d0004060 2024-04-16T16:19:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.281+0000 7f22f1c00640 1 -- 172.21.15.22:0/1052143615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d0004060 msgr2=0x7f22d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.282+0000 7f22f1c00640 1 --2- 172.21.15.22:0/1052143615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d0004060 0x7f22d0004800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f22d400c190 tx=0x7f22d0005830 comp rx=0 tx=0).stop 2024-04-16T16:19:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.282+0000 7f22f1200640 1 -- 172.21.15.22:0/1052143615 reap_dead start 2024-04-16T16:19:12.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.282+0000 7f22f1c00640 1 -- 172.21.15.22:0/1052143615 shutdown_connections 2024-04-16T16:19:12.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.282+0000 7f22f1c00640 1 -- 172.21.15.22:0/1052143615 >> 172.21.15.22:0/1052143615 conn(0x7f22ec072460 msgr2=0x7f22ec072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:12.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.282+0000 7f22f1c00640 1 -- 172.21.15.22:0/1052143615 shutdown_connections 2024-04-16T16:19:12.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.282+0000 7f22f1c00640 1 -- 172.21.15.22:0/1052143615 wait complete. 2024-04-16T16:19:12.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.284+0000 7f22f1c00640 1 Processor -- start 2024-04-16T16:19:12.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.284+0000 7f22f1c00640 1 -- start start 2024-04-16T16:19:12.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.285+0000 7f22f1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004060 0x7f22ec156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.285+0000 7f22f1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec157910 0x7f22ec0b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.285+0000 7f22f1c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22ec157d90 0x7f22ec0b8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.285+0000 7f22f1c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec0b9460 con 0x7f22ec157d90 2024-04-16T16:19:12.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.285+0000 7f22f1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec0b92e0 con 0x7f22d0004060 2024-04-16T16:19:12.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f22ec0b95e0 con 0x7f22ec157910 2024-04-16T16:19:12.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22ec157d90 0x7f22ec0b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22ec157d90 0x7f22ec0b8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45880/0 (socket says 172.21.15.22:45880) 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 -- 172.21.15.22:0/3642800892 learned_addr learned my addr 172.21.15.22:0/3642800892 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22eb400640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec157910 0x7f22ec0b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22ebe00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004060 0x7f22ec156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 -- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec157910 msgr2=0x7f22ec0b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec157910 0x7f22ec0b81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 -- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004060 msgr2=0x7f22ec156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004060 0x7f22ec156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22f1200640 1 -- 172.21.15.22:0/3642800892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec158620 con 0x7f22ec157d90 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.286+0000 7f22ebe00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004060 0x7f22ec156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:12.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.287+0000 7f22f1200640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22ec157d90 0x7f22ec0b8710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0b6810 tx=0x7f22e400d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:12.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.287+0000 7f22e3e00640 1 -- 172.21.15.22:0/3642800892 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e40125f0 con 0x7f22ec157d90 2024-04-16T16:19:12.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.287+0000 7f22e3e00640 1 -- 172.21.15.22:0/3642800892 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e4019070 con 0x7f22ec157d90 2024-04-16T16:19:12.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.287+0000 7f22e3e00640 1 -- 172.21.15.22:0/3642800892 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e40129d0 con 0x7f22ec157d90 2024-04-16T16:19:12.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.287+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec1f9060 con 0x7f22ec157d90 2024-04-16T16:19:12.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.287+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec156e30 con 0x7f22ec157d90 2024-04-16T16:19:12.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.288+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec075f30 con 0x7f22ec157d90 2024-04-16T16:19:12.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.289+0000 7f22e3e00640 1 -- 172.21.15.22:0/3642800892 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f22e4012b70 con 0x7f22ec157d90 2024-04-16T16:19:12.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.290+0000 7f22e3e00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f22c806cbf0 0x7f22c806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.290+0000 7f22e3e00640 1 -- 172.21.15.22:0/3642800892 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f22e408c020 con 0x7f22ec157d90 2024-04-16T16:19:12.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.291+0000 7f22ebe00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f22c806cbf0 0x7f22c806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.291+0000 7f22ebe00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f22c806cbf0 0x7f22c806f0b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22dc001da0 tx=0x7f22dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:12.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.295+0000 7f22e3e00640 1 -- 172.21.15.22:0/3642800892 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22ec158620 con 0x7f22ec157d90 2024-04-16T16:19:12.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.492+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f22ec068f70 con 0x7f22ec157d90 2024-04-16T16:19:12.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.493+0000 7f22e3e00640 1 -- 172.21.15.22:0/3642800892 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) ==== 100+0+11 (secure 0 0 0) 0x7f22e405a0a0 con 0x7f22ec157d90 2024-04-16T16:19:12.492 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:19:12.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f22c806cbf0 msgr2=0x7f22c806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f22c806cbf0 0x7f22c806f0b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22dc001da0 tx=0x7f22dc009040 comp rx=0 tx=0).stop 2024-04-16T16:19:12.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22ec157d90 msgr2=0x7f22ec0b8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22ec157d90 0x7f22ec0b8710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0b6810 tx=0x7f22e400d8a0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 shutdown_connections 2024-04-16T16:19:12.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f22c806cbf0 0x7f22c806f0b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22ec157d90 0x7f22ec0b8710 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22ec157910 0x7f22ec0b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 --2- 172.21.15.22:0/3642800892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d0004060 0x7f22ec156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 >> 172.21.15.22:0/3642800892 conn(0x7f22ec072460 msgr2=0x7f22ec0b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:12.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 shutdown_connections 2024-04-16T16:19:12.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.495+0000 7f22f1c00640 1 -- 172.21.15.22:0/3642800892 wait complete. 2024-04-16T16:19:12.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:19:12.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.732+0000 7fbd66c00640 1 Processor -- start 2024-04-16T16:19:12.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.732+0000 7fbd66c00640 1 -- start start 2024-04-16T16:19:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.734+0000 7fbd66c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbd6015b790 0x7fbd6015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.734+0000 7fbd66c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbd600728c0 0x7fbd600d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.734+0000 7fbd66c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.734+0000 7fbd66c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbd60072430 con 0x7fbd6015b790 2024-04-16T16:19:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.734+0000 7fbd66c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbd60071b00 con 0x7fbd600728c0 2024-04-16T16:19:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.734+0000 7fbd66c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd60071de0 con 0x7fbd600cc7c0 2024-04-16T16:19:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbd6015b790 0x7fbd6015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbd6015b790 0x7fbd6015fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45882/0 (socket says 172.21.15.22:45882) 2024-04-16T16:19:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 -- 172.21.15.22:0/73600317 learned_addr learned my addr 172.21.15.22:0/73600317 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd64e00640 1 --2- 172.21.15.22:0/73600317 >> v2:172.21.15.43:3300/0 conn(0x7fbd600728c0 0x7fbd600d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd66200640 1 --2- 172.21.15.22:0/73600317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 -- 172.21.15.22:0/73600317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 msgr2=0x7fbd600d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 --2- 172.21.15.22:0/73600317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 -- 172.21.15.22:0/73600317 >> v2:172.21.15.43:3300/0 conn(0x7fbd600728c0 msgr2=0x7fbd600d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 --2- 172.21.15.22:0/73600317 >> v2:172.21.15.43:3300/0 conn(0x7fbd600728c0 0x7fbd600d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.735+0000 7fbd65800640 1 -- 172.21.15.22:0/73600317 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600720c0 con 0x7fbd6015b790 2024-04-16T16:19:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.737+0000 7fbd65800640 1 --2- 172.21.15.22:0/73600317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd6015b790 0x7fbd6015fd50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbd6015f2a0 tx=0x7fbd5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f549c389a681e55 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:12.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.737+0000 7fbd5fe00640 1 -- 172.21.15.22:0/73600317 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54035020 con 0x7fbd6015b790 2024-04-16T16:19:12.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.737+0000 7fbd5fe00640 1 -- 172.21.15.22:0/73600317 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54031870 con 0x7fbd6015b790 2024-04-16T16:19:12.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd5fe00640 1 -- 172.21.15.22:0/73600317 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54031c40 con 0x7fbd6015b790 2024-04-16T16:19:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 -- 172.21.15.22:0/73600317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd6015b790 msgr2=0x7fbd6015fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 --2- 172.21.15.22:0/73600317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd6015b790 0x7fbd6015fd50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbd6015f2a0 tx=0x7fbd5402b910 comp rx=0 tx=0).stop 2024-04-16T16:19:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 -- 172.21.15.22:0/73600317 shutdown_connections 2024-04-16T16:19:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 --2- 172.21.15.22:0/73600317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 --2- 172.21.15.22:0/73600317 >> v2:172.21.15.43:3300/0 conn(0x7fbd600728c0 0x7fbd600d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 --2- 172.21.15.22:0/73600317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd6015b790 0x7fbd6015fd50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 -- 172.21.15.22:0/73600317 >> 172.21.15.22:0/73600317 conn(0x7fbd60062440 msgr2=0x7fbd60062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.738+0000 7fbd66c00640 1 -- 172.21.15.22:0/73600317 shutdown_connections 2024-04-16T16:19:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.739+0000 7fbd66c00640 1 -- 172.21.15.22:0/73600317 wait complete. 2024-04-16T16:19:12.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.740+0000 7fbd66c00640 1 Processor -- start 2024-04-16T16:19:12.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.741+0000 7fbd66c00640 1 -- start start 2024-04-16T16:19:12.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.741+0000 7fbd66c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd600728c0 0x7fbd600cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd60152190 0x7fbd60148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6006cf10 con 0x7fbd60152190 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600afde0 con 0x7fbd600728c0 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6006d090 con 0x7fbd600cc7c0 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd60152190 0x7fbd60148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd60152190 0x7fbd60148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45890/0 (socket says 172.21.15.22:45890) 2024-04-16T16:19:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 -- 172.21.15.22:0/3617196465 learned_addr learned my addr 172.21.15.22:0/3617196465 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd65800640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd600728c0 0x7fbd600cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd64e00640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 -- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 msgr2=0x7fbd600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 -- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd600728c0 msgr2=0x7fbd600cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd600728c0 0x7fbd600cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.742+0000 7fbd66200640 1 -- 172.21.15.22:0/3617196465 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600b2ea0 con 0x7fbd60152190 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.743+0000 7fbd66200640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd60152190 0x7fbd60148020 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009cb0 tx=0x7fbd5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.743+0000 7fbd5d600640 1 -- 172.21.15.22:0/3617196465 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58018020 con 0x7fbd60152190 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.743+0000 7fbd5d600640 1 -- 172.21.15.22:0/3617196465 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58014480 con 0x7fbd60152190 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.743+0000 7fbd5d600640 1 -- 172.21.15.22:0/3617196465 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58014870 con 0x7fbd60152190 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.743+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd60134c00 con 0x7fbd60152190 2024-04-16T16:19:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.743+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd600b28e0 con 0x7fbd60152190 2024-04-16T16:19:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.744+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd60075f30 con 0x7fbd60152190 2024-04-16T16:19:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.745+0000 7fbd5d600640 1 -- 172.21.15.22:0/3617196465 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fbd58005d10 con 0x7fbd60152190 2024-04-16T16:19:12.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.746+0000 7fbd5d600640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd4006cbc0 0x7fbd4006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:12.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.746+0000 7fbd5d600640 1 -- 172.21.15.22:0/3617196465 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7fbd5808ced0 con 0x7fbd60152190 2024-04-16T16:19:12.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.746+0000 7fbd65800640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd4006cbc0 0x7fbd4006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:12.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.747+0000 7fbd65800640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd4006cbc0 0x7fbd4006f080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd54036000 tx=0x7fbd54008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.751+0000 7fbd5d600640 1 -- 172.21.15.22:0/3617196465 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd58022030 con 0x7fbd60152190 2024-04-16T16:19:12.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.987+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd600cff80 con 0x7fbd60152190 2024-04-16T16:19:12.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.988+0000 7fbd5d600640 1 -- 172.21.15.22:0/3617196465 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7fbd58010040 con 0x7fbd60152190 2024-04-16T16:19:12.987 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:12.987 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/2477236609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2477236609},{"type":"v1","addr":"172.21.15.43:6834","nonce":2477236609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2059330399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2059330399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2059330399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/4293003845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":4293003845},{"type":"v1","addr":"172.21.15.22:6837","nonce":4293003845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:17:55.963504+0000","modified":"2024-04-16T16:17:59.021268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6836/430366264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":430366264},{"type":"v1","addr":"172.21.15.22:6836","nonce":430366264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5118,"qdb_cluster":[5118]},"id":2}]} 2024-04-16T16:19:12.988 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2024-04-16T16:19:12.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd4006cbc0 msgr2=0x7fbd4006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd4006cbc0 0x7fbd4006f080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd54036000 tx=0x7fbd54008030 comp rx=0 tx=0).stop 2024-04-16T16:19:12.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd60152190 msgr2=0x7fbd60148020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd60152190 0x7fbd60148020 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009cb0 tx=0x7fbd5800c490 comp rx=0 tx=0).stop 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 shutdown_connections 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd4006cbc0 0x7fbd4006f080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd60152190 0x7fbd60148020 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd600cc7c0 0x7fbd600b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 --2- 172.21.15.22:0/3617196465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd600728c0 0x7fbd600cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 >> 172.21.15.22:0/3617196465 conn(0x7fbd60062440 msgr2=0x7fbd600ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 shutdown_connections 2024-04-16T16:19:12.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:12.991+0000 7fbd66c00640 1 -- 172.21.15.22:0/3617196465 wait complete. 2024-04-16T16:19:13.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.222+0000 7f9142800640 1 Processor -- start 2024-04-16T16:19:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.222+0000 7f9142800640 1 -- start start 2024-04-16T16:19:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9142800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c06eaa0 0x7f913c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9142800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f913c0cc810 0x7f913c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9142800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913c06d160 con 0x7f913c06ee80 2024-04-16T16:19:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9142800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f913c06cf10 con 0x7f913c0cc810 2024-04-16T16:19:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9142800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f913c06d440 con 0x7f913c06eaa0 2024-04-16T16:19:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9141e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f913c06ee80 0x7f913c15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56028/0 (socket says 172.21.15.22:56028) 2024-04-16T16:19:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9141e00640 1 -- 172.21.15.22:0/2240222966 learned_addr learned my addr 172.21.15.22:0/2240222966 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9140a00640 1 --2- 172.21.15.22:0/2240222966 >> v2:172.21.15.43:3300/0 conn(0x7f913c0cc810 0x7f913c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f9141400640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c06eaa0 0x7f913c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.224+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526122844 0 0) 0x7f913c06d160 con 0x7f913c06ee80 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9124003520 con 0x7f913c06ee80 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2611144414 0 0) 0x7f9124003520 con 0x7f913c06ee80 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c06eaa0 msgr2=0x7f913c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c06eaa0 0x7f913c0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 >> v2:172.21.15.43:3300/0 conn(0x7f913c0cc810 msgr2=0x7f913c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 --2- 172.21.15.22:0/2240222966 >> v2:172.21.15.43:3300/0 conn(0x7f913c0cc810 0x7f913c06df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c06d720 con 0x7f913c06ee80 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f91340019f0 con 0x7f913c06ee80 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 >> v1:172.21.15.22:6789/0 conn(0x7f913c06ee80 legacy=0x7f913c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f9124003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9124004800 0x7f9124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c06eaa0 0x7f91240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f913c06cf10 con 0x7f91240039b0 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f913c06d440 con 0x7f9124004800 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f912400b9c0 con 0x7f913c06eaa0 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.225+0000 7f9141400640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f9124003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.226+0000 7f9140a00640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9124004800 0x7f9124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.226+0000 7f9141400640 1 -- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c06eaa0 msgr2=0x7f91240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.226+0000 7f9141400640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c06eaa0 0x7f91240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.226+0000 7f9141400640 1 -- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9124004800 msgr2=0x7f9124004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:13.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.226+0000 7f9141400640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9124004800 0x7f9124004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.226+0000 7f9141400640 1 -- 172.21.15.22:0/2240222966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9124003520 con 0x7f91240039b0 2024-04-16T16:19:13.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.226+0000 7f9140a00640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9124004800 0x7f9124004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.227+0000 7f9141400640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f9124003dd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9130009ac0 tx=0x7f9124005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260b291c3543e06a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.227+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130039070 con 0x7f91240039b0 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.227+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913002c710 con 0x7f91240039b0 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.227+0000 7f913be00640 1 -- 172.21.15.22:0/2240222966 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130009690 con 0x7f91240039b0 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.228+0000 7f9142800640 1 -- 172.21.15.22:0/2240222966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 msgr2=0x7f9124003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.228+0000 7f9142800640 1 --2- 172.21.15.22:0/2240222966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f9124003dd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9130009ac0 tx=0x7f9124005830 comp rx=0 tx=0).stop 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.228+0000 7f9141e00640 1 -- 172.21.15.22:0/2240222966 reap_dead start 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.228+0000 7f9142800640 1 -- 172.21.15.22:0/2240222966 shutdown_connections 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.228+0000 7f9142800640 1 -- 172.21.15.22:0/2240222966 >> 172.21.15.22:0/2240222966 conn(0x7f913c062440 msgr2=0x7f913c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:13.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.228+0000 7f9142800640 1 -- 172.21.15.22:0/2240222966 shutdown_connections 2024-04-16T16:19:13.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.228+0000 7f9142800640 1 -- 172.21.15.22:0/2240222966 wait complete. 2024-04-16T16:19:13.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.230+0000 7f9142800640 1 Processor -- start 2024-04-16T16:19:13.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.230+0000 7f9142800640 1 -- start start 2024-04-16T16:19:13.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9142800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f913c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9142800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c158eb0 0x7f913c1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9142800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c159d40 0x7f913c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9142800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f913c15c910 con 0x7f91240039b0 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9142800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f913c06e440 con 0x7f913c158eb0 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9142800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f913c15ca90 con 0x7f913c159d40 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f913c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f913c1544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45896/0 (socket says 172.21.15.22:45896) 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 -- 172.21.15.22:0/1077891460 learned_addr learned my addr 172.21.15.22:0/1077891460 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 -- 172.21.15.22:0/1077891460 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c159d40 msgr2=0x7f913c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c159d40 0x7f913c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 -- 172.21.15.22:0/1077891460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c158eb0 msgr2=0x7f913c1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c158eb0 0x7f913c1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.231+0000 7f9141400640 1 -- 172.21.15.22:0/1077891460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c159590 con 0x7f91240039b0 2024-04-16T16:19:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.232+0000 7f9141400640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f913c1544b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9130037040 tx=0x7f9130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.232+0000 7f9139600640 1 -- 172.21.15.22:0/1077891460 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130042020 con 0x7f91240039b0 2024-04-16T16:19:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.232+0000 7f9139600640 1 -- 172.21.15.22:0/1077891460 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913003a040 con 0x7f91240039b0 2024-04-16T16:19:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.232+0000 7f9139600640 1 -- 172.21.15.22:0/1077891460 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130039070 con 0x7f91240039b0 2024-04-16T16:19:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.232+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913c159870 con 0x7f91240039b0 2024-04-16T16:19:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.232+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913c1517e0 con 0x7f91240039b0 2024-04-16T16:19:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.234+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913c075f30 con 0x7f91240039b0 2024-04-16T16:19:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.235+0000 7f9139600640 1 -- 172.21.15.22:0/1077891460 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f9130045020 con 0x7f91240039b0 2024-04-16T16:19:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.236+0000 7f9139600640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f911c06cbf0 0x7f911c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.236+0000 7f9139600640 1 -- 172.21.15.22:0/1077891460 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f91300ad3b0 con 0x7f91240039b0 2024-04-16T16:19:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.236+0000 7f9140a00640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f911c06cbf0 0x7f911c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.237+0000 7f9140a00640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f911c06cbf0 0x7f911c06f0b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9128009980 tx=0x7f9128008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:13.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.241+0000 7f9139600640 1 -- 172.21.15.22:0/1077891460 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f913004c070 con 0x7f91240039b0 2024-04-16T16:19:13.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.443+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f913c154c20 con 0x7f91240039b0 2024-04-16T16:19:13.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.446+0000 7f9139600640 1 -- 172.21.15.22:0/1077891460 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16614 (secure 0 0 0) 0x7f913007b500 con 0x7f91240039b0 2024-04-16T16:19:13.445 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:13.446 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:18:57.479051+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:13.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f911c06cbf0 msgr2=0x7f911c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f911c06cbf0 0x7f911c06f0b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9128009980 tx=0x7f9128008040 comp rx=0 tx=0).stop 2024-04-16T16:19:13.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 msgr2=0x7f913c1544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f913c1544b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9130037040 tx=0x7f9130004730 comp rx=0 tx=0).stop 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 shutdown_connections 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f911c06cbf0 0x7f911c06f0b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f913c159d40 0x7f913c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c158eb0 0x7f913c1512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 --2- 172.21.15.22:0/1077891460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91240039b0 0x7f913c1544b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.449+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 >> 172.21.15.22:0/1077891460 conn(0x7f913c062440 msgr2=0x7f913c151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.450+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 shutdown_connections 2024-04-16T16:19:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.450+0000 7f9142800640 1 -- 172.21.15.22:0/1077891460 wait complete. 2024-04-16T16:19:13.466 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T16:19:13.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:19:13.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.683+0000 7f7666400640 1 Processor -- start 2024-04-16T16:19:13.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.684+0000 7f7666400640 1 -- start start 2024-04-16T16:19:13.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.685+0000 7f7666400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76601478c0 0x7f7660163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.685+0000 7f7666400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76600ae860 0x7f76600d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.686+0000 7f7666400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76600af0b0 con 0x7f76600d0a80 2024-04-16T16:19:13.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.686+0000 7f7666400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f76600d0ef0 con 0x7f76600ae860 2024-04-16T16:19:13.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.686+0000 7f7666400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f76600af950 con 0x7f76601478c0 2024-04-16T16:19:13.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.686+0000 7f765ea00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76600ae860 0x7f76600d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.686+0000 7f765f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76601478c0 0x7f7660163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765ea00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76600ae860 0x7f76600d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:54802/0 (socket says 172.21.15.22:54802) 2024-04-16T16:19:13.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765ea00640 1 -- 172.21.15.22:0/2852962941 learned_addr learned my addr 172.21.15.22:0/2852962941 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:13.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765f400640 1 --2- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76601478c0 0x7f7660163340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:33492/0 (socket says 172.21.15.22:33492) 2024-04-16T16:19:13.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765ea00640 1 -- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76601478c0 msgr2=0x7f7660163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:13.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765ea00640 1 --2- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76601478c0 0x7f7660163340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765ea00640 1 -- 172.21.15.22:0/2852962941 >> v1:172.21.15.43:6789/0 conn(0x7f76600d0a80 legacy=0x7f76600b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765ea00640 1 -- 172.21.15.22:0/2852962941 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76600af390 con 0x7f76600ae860 2024-04-16T16:19:13.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.687+0000 7f765f400640 1 --2- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76601478c0 0x7f7660163340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:19:13.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.689+0000 7f765ea00640 1 --2- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 0x7f76600d0540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f764c0098a0 tx=0x7f764c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce21ad58d18a9bc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:13.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f765e000640 1 -- 172.21.15.22:0/2852962941 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c035020 con 0x7f76600ae860 2024-04-16T16:19:13.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f765e000640 1 -- 172.21.15.22:0/2852962941 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c031640 con 0x7f76600ae860 2024-04-16T16:19:13.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f765e000640 1 -- 172.21.15.22:0/2852962941 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c02d040 con 0x7f76600ae860 2024-04-16T16:19:13.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f7666400640 1 -- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 msgr2=0x7f76600d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f7666400640 1 --2- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 0x7f76600d0540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f764c0098a0 tx=0x7f764c02b8f0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f7666400640 1 -- 172.21.15.22:0/2852962941 shutdown_connections 2024-04-16T16:19:13.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f7666400640 1 --2- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 0x7f76600d0540 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f7666400640 1 --2- 172.21.15.22:0/2852962941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76601478c0 0x7f7660163340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.690+0000 7f7666400640 1 -- 172.21.15.22:0/2852962941 >> 172.21.15.22:0/2852962941 conn(0x7f7660062440 msgr2=0x7f7660062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:13.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.691+0000 7f7666400640 1 -- 172.21.15.22:0/2852962941 shutdown_connections 2024-04-16T16:19:13.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.691+0000 7f7666400640 1 -- 172.21.15.22:0/2852962941 wait complete. 2024-04-16T16:19:13.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.693+0000 7f7666400640 1 Processor -- start 2024-04-16T16:19:13.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.693+0000 7f7666400640 1 -- start start 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.694+0000 7f7666400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 0x7f76601422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.694+0000 7f7666400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76600d0a80 0x7f76600cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.694+0000 7f7666400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76601478c0 0x7f7660156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.694+0000 7f7666400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76600aeca0 con 0x7f76601478c0 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.694+0000 7f7666400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7660147ca0 con 0x7f76600ae860 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.694+0000 7f7666400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f76600aee20 con 0x7f76600d0a80 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76601478c0 0x7f7660156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76601478c0 0x7f7660156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45898/0 (socket says 172.21.15.22:45898) 2024-04-16T16:19:13.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 -- 172.21.15.22:0/2551629675 learned_addr learned my addr 172.21.15.22:0/2551629675 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765f400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 0x7f76601422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765ea00640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76600d0a80 0x7f76600cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 -- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76600d0a80 msgr2=0x7f76600cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76600d0a80 0x7f76600cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 -- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 msgr2=0x7f76601422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 0x7f76601422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.695+0000 7f765fe00640 1 -- 172.21.15.22:0/2551629675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7660142af0 con 0x7f76601478c0 2024-04-16T16:19:13.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.696+0000 7f765fe00640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76601478c0 0x7f7660156d50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f765800c730 tx=0x7f765800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:13.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.696+0000 7f7657400640 1 -- 172.21.15.22:0/2551629675 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658016020 con 0x7f76601478c0 2024-04-16T16:19:13.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.696+0000 7f7657400640 1 -- 172.21.15.22:0/2551629675 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7658006d50 con 0x7f76601478c0 2024-04-16T16:19:13.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.696+0000 7f7657400640 1 -- 172.21.15.22:0/2551629675 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658003bb0 con 0x7f76601478c0 2024-04-16T16:19:13.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.696+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7660142dd0 con 0x7f76601478c0 2024-04-16T16:19:13.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.696+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7660143390 con 0x7f76601478c0 2024-04-16T16:19:13.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.698+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766004fd90 con 0x7f76601478c0 2024-04-16T16:19:13.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.698+0000 7f7657400640 1 -- 172.21.15.22:0/2551629675 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f76580050d0 con 0x7f76601478c0 2024-04-16T16:19:13.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.700+0000 7f7657400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f764006cbc0 0x7f764006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:13.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.700+0000 7f7657400640 1 -- 172.21.15.22:0/2551629675 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f765808bb30 con 0x7f76601478c0 2024-04-16T16:19:13.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.700+0000 7f765f400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f764006cbc0 0x7f764006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:13.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.701+0000 7f765f400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f764006cbc0 0x7f764006f080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7650009a30 tx=0x7f7650008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.705+0000 7f7657400640 1 -- 172.21.15.22:0/2551629675 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7658020020 con 0x7f76601478c0 2024-04-16T16:19:13.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.954+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76600b48c0 con 0x7f76601478c0 2024-04-16T16:19:13.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.956+0000 7f7657400640 1 -- 172.21.15.22:0/2551629675 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7f7658059c80 con 0x7f76601478c0 2024-04-16T16:19:13.955 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:13.955 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/2477236609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2477236609},{"type":"v1","addr":"172.21.15.43:6834","nonce":2477236609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2059330399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2059330399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2059330399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/4293003845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":4293003845},{"type":"v1","addr":"172.21.15.22:6837","nonce":4293003845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:17:55.963504+0000","modified":"2024-04-16T16:17:59.021268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6836/430366264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":430366264},{"type":"v1","addr":"172.21.15.22:6836","nonce":430366264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5118,"qdb_cluster":[5118]},"id":2}]} 2024-04-16T16:19:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f764006cbc0 msgr2=0x7f764006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f764006cbc0 0x7f764006f080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7650009a30 tx=0x7f7650008040 comp rx=0 tx=0).stop 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76601478c0 msgr2=0x7f7660156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76601478c0 0x7f7660156d50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f765800c730 tx=0x7f765800cb30 comp rx=0 tx=0).stop 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 shutdown_connections 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f764006cbc0 0x7f764006f080 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76601478c0 0x7f7660156d50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76600d0a80 0x7f76600cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 --2- 172.21.15.22:0/2551629675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76600ae860 0x7f76601422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 >> 172.21.15.22:0/2551629675 conn(0x7f7660062440 msgr2=0x7f766006de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:13.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 shutdown_connections 2024-04-16T16:19:13.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:13.959+0000 7f7666400640 1 -- 172.21.15.22:0/2551629675 wait complete. 2024-04-16T16:19:13.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:19:14.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.197+0000 7fac79000640 1 Processor -- start 2024-04-16T16:19:14.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.198+0000 7fac79000640 1 -- start start 2024-04-16T16:19:14.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.199+0000 7fac79000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fac74162e60 0x7fac7406caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.199+0000 7fac79000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac740b37f0 con 0x7fac740cf5f0 2024-04-16T16:19:14.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.199+0000 7fac79000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac74163420 con 0x7fac740b3bc0 2024-04-16T16:19:14.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.199+0000 7fac79000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fac74162560 con 0x7fac74162e60 2024-04-16T16:19:14.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.199+0000 7fac73400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fac740cf5f0 0x7fac74162750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56038/0 (socket says 172.21.15.22:56038) 2024-04-16T16:19:14.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.199+0000 7fac73400640 1 -- 172.21.15.22:0/824722548 learned_addr learned my addr 172.21.15.22:0/824722548 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:14.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.199+0000 7fac73e00640 1 --2- 172.21.15.22:0/824722548 >> v2:172.21.15.22:3300/0 conn(0x7fac74162e60 0x7fac7406caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.200+0000 7fac73e00640 1 -- 172.21.15.22:0/824722548 >> v1:172.21.15.43:6789/0 conn(0x7fac740b3bc0 legacy=0x7fac740b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:14.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.200+0000 7fac73e00640 1 -- 172.21.15.22:0/824722548 >> v1:172.21.15.22:6789/0 conn(0x7fac740cf5f0 legacy=0x7fac74162750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.200+0000 7fac73e00640 1 -- 172.21.15.22:0/824722548 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac740cf9d0 con 0x7fac74162e60 2024-04-16T16:19:14.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.200+0000 7fac72000640 1 -- 172.21.15.22:0/824722548 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474771956 0 0) 0x7fac740b37f0 con 0x7fac740cf5f0 2024-04-16T16:19:14.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.201+0000 7fac73e00640 1 --2- 172.21.15.22:0/824722548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac74162e60 0x7fac7406caf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097a0 tx=0x7fac6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90952b66208aaf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:14.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.201+0000 7fac72000640 1 -- 172.21.15.22:0/824722548 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c035020 con 0x7fac74162e60 2024-04-16T16:19:14.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.201+0000 7fac72000640 1 -- 172.21.15.22:0/824722548 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c031830 con 0x7fac74162e60 2024-04-16T16:19:14.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.201+0000 7fac72000640 1 -- 172.21.15.22:0/824722548 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c031c00 con 0x7fac74162e60 2024-04-16T16:19:14.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.202+0000 7fac79000640 1 -- 172.21.15.22:0/824722548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac74162e60 msgr2=0x7fac7406caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.202+0000 7fac79000640 1 --2- 172.21.15.22:0/824722548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac74162e60 0x7fac7406caf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097a0 tx=0x7fac6c02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.202+0000 7fac79000640 1 -- 172.21.15.22:0/824722548 shutdown_connections 2024-04-16T16:19:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.202+0000 7fac79000640 1 --2- 172.21.15.22:0/824722548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac74162e60 0x7fac7406caf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.202+0000 7fac79000640 1 -- 172.21.15.22:0/824722548 >> 172.21.15.22:0/824722548 conn(0x7fac740d2720 msgr2=0x7fac740d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.202+0000 7fac79000640 1 -- 172.21.15.22:0/824722548 shutdown_connections 2024-04-16T16:19:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.202+0000 7fac79000640 1 -- 172.21.15.22:0/824722548 wait complete. 2024-04-16T16:19:14.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.204+0000 7fac79000640 1 Processor -- start 2024-04-16T16:19:14.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.204+0000 7fac79000640 1 -- start start 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac79000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac740b3bc0 0x7fac74156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac79000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac740cf5f0 0x7fac740b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac79000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac74162e60 0x7fac740b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac79000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fac740d1a00 con 0x7fac740b3bc0 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac79000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac7406c660 con 0x7fac74162e60 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac79000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fac740d1b80 con 0x7fac740cf5f0 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac73400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac740b3bc0 0x7fac74156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac73400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac740b3bc0 0x7fac74156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45922/0 (socket says 172.21.15.22:45922) 2024-04-16T16:19:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.205+0000 7fac73400640 1 -- 172.21.15.22:0/52772803 learned_addr learned my addr 172.21.15.22:0/52772803 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac72a00640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac740cf5f0 0x7fac740b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac73400640 1 -- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac740cf5f0 msgr2=0x7fac740b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac73e00640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac74162e60 0x7fac740b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac73400640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac740cf5f0 0x7fac740b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac73400640 1 -- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac74162e60 msgr2=0x7fac740b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac73400640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac74162e60 0x7fac740b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac73400640 1 -- 172.21.15.22:0/52772803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac740b7970 con 0x7fac740b3bc0 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac73400640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac740b3bc0 0x7fac74156310 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fac6400cc40 tx=0x7fac6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac6b400640 1 -- 172.21.15.22:0/52772803 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64017070 con 0x7fac740b3bc0 2024-04-16T16:19:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.206+0000 7fac6b400640 1 -- 172.21.15.22:0/52772803 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6400ce50 con 0x7fac740b3bc0 2024-04-16T16:19:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.207+0000 7fac6b400640 1 -- 172.21.15.22:0/52772803 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64012640 con 0x7fac740b3bc0 2024-04-16T16:19:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.207+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac740b61f0 con 0x7fac740b3bc0 2024-04-16T16:19:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.207+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac740b5710 con 0x7fac740b3bc0 2024-04-16T16:19:14.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.208+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7406cad0 con 0x7fac740b3bc0 2024-04-16T16:19:14.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.209+0000 7fac6b400640 1 -- 172.21.15.22:0/52772803 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fac6401a070 con 0x7fac740b3bc0 2024-04-16T16:19:14.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.210+0000 7fac6b400640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac5406cbc0 0x7fac5406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.210+0000 7fac6b400640 1 -- 172.21.15.22:0/52772803 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7fac6408c040 con 0x7fac740b3bc0 2024-04-16T16:19:14.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.210+0000 7fac72a00640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac5406cbc0 0x7fac5406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.211+0000 7fac72a00640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac5406cbc0 0x7fac5406f080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fac741f9300 tx=0x7fac60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:14.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.214+0000 7fac6b400640 1 -- 172.21.15.22:0/52772803 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac64059f50 con 0x7fac740b3bc0 2024-04-16T16:19:14.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.458+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac74075f30 con 0x7fac740b3bc0 2024-04-16T16:19:14.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.459+0000 7fac6b400640 1 -- 172.21.15.22:0/52772803 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7fac64059850 con 0x7fac740b3bc0 2024-04-16T16:19:14.458 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:14.459 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/2477236609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2477236609},{"type":"v1","addr":"172.21.15.43:6834","nonce":2477236609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2059330399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2059330399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2059330399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/4293003845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":4293003845},{"type":"v1","addr":"172.21.15.22:6837","nonce":4293003845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:17:55.963504+0000","modified":"2024-04-16T16:17:59.021268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6836/430366264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":430366264},{"type":"v1","addr":"172.21.15.22:6836","nonce":430366264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5118,"qdb_cluster":[5118]},"id":2}]} 2024-04-16T16:19:14.459 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac5406cbc0 msgr2=0x7fac5406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac5406cbc0 0x7fac5406f080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fac741f9300 tx=0x7fac60009040 comp rx=0 tx=0).stop 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac740b3bc0 msgr2=0x7fac74156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac740b3bc0 0x7fac74156310 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fac6400cc40 tx=0x7fac6400a430 comp rx=0 tx=0).stop 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 shutdown_connections 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fac5406cbc0 0x7fac5406f080 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac74162e60 0x7fac740b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac740cf5f0 0x7fac740b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 --2- 172.21.15.22:0/52772803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac740b3bc0 0x7fac74156310 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 >> 172.21.15.22:0/52772803 conn(0x7fac740d2720 msgr2=0x7fac7406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 shutdown_connections 2024-04-16T16:19:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.462+0000 7fac79000640 1 -- 172.21.15.22:0/52772803 wait complete. 2024-04-16T16:19:14.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:14.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.680+0000 7f7ec1c00640 1 Processor -- start 2024-04-16T16:19:14.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.680+0000 7f7ec1c00640 1 -- start start 2024-04-16T16:19:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.682+0000 7f7ec1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ebc15b790 0x7f7ebc15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.682+0000 7f7ec1c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ebc071b00 con 0x7f7ebc0d0b80 2024-04-16T16:19:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.682+0000 7f7ec1c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ebc071de0 con 0x7f7ebc0728c0 2024-04-16T16:19:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.682+0000 7f7ec1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc072430 con 0x7f7ebc15b790 2024-04-16T16:19:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.682+0000 7f7ec1200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7ebc0d0b80 0x7f7ebc06cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56042/0 (socket says 172.21.15.22:56042) 2024-04-16T16:19:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.682+0000 7f7ec1200640 1 -- 172.21.15.22:0/3505001982 learned_addr learned my addr 172.21.15.22:0/3505001982 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ebc15b790 0x7f7ebc15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131420071 0 0) 0x7f7ebc071b00 con 0x7f7ebc0d0b80 2024-04-16T16:19:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ea0003520 con 0x7f7ebc0d0b80 2024-04-16T16:19:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1370420926 0 0) 0x7f7ea0003520 con 0x7f7ebc0d0b80 2024-04-16T16:19:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ebc15b790 msgr2=0x7f7ebc15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ebc15b790 0x7f7ebc15fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 >> v1:172.21.15.43:6789/0 conn(0x7f7ebc0728c0 legacy=0x7f7ebc0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc0720c0 con 0x7f7ebc0d0b80 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f7eb40019f0 con 0x7f7ebc0d0b80 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 >> v1:172.21.15.22:6789/0 conn(0x7f7ebc0d0b80 legacy=0x7f7ebc06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ea00039e0 0x7f7ea0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ea0004800 0x7f7ea0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ebc15b790 0x7f7ea0005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc072430 con 0x7f7ea00039e0 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea000dd60 con 0x7f7ea0004800 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.683+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea000df60 con 0x7f7ebc15b790 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.684+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ea00039e0 0x7f7ea0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.684+0000 7f7ebbe00640 1 -- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ebc15b790 msgr2=0x7f7ea0005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.684+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ebc15b790 0x7f7ea0005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.684+0000 7f7ebbe00640 1 -- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ea0004800 msgr2=0x7f7ea0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.684+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ea0004800 0x7f7ea0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.684+0000 7f7ebbe00640 1 -- 172.21.15.22:0/3505001982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0003520 con 0x7f7ea00039e0 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.685+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ea00039e0 0x7f7ea0003e00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ba30 tx=0x7f7ea0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b9462eca7de20 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.685+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac036020 con 0x7f7ea00039e0 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.685+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac032680 con 0x7f7ea00039e0 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.685+0000 7f7ebaa00640 1 -- 172.21.15.22:0/3505001982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00b600 con 0x7f7ea00039e0 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.686+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3505001982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ea00039e0 msgr2=0x7f7ea0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.686+0000 7f7ec1c00640 1 --2- 172.21.15.22:0/3505001982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ea00039e0 0x7f7ea0003e00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ba30 tx=0x7f7ea0005830 comp rx=0 tx=0).stop 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.686+0000 7f7ec1200640 1 -- 172.21.15.22:0/3505001982 reap_dead start 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.686+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3505001982 shutdown_connections 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.686+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3505001982 >> 172.21.15.22:0/3505001982 conn(0x7f7ebc062440 msgr2=0x7f7ebc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.686+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3505001982 shutdown_connections 2024-04-16T16:19:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.686+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3505001982 wait complete. 2024-04-16T16:19:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.688+0000 7f7ec1c00640 1 Processor -- start 2024-04-16T16:19:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.688+0000 7f7ec1c00640 1 -- start start 2024-04-16T16:19:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ea00039e0 0x7f7ebc0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ebc15cdd0 0x7f7ebc15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ebc159e20 0x7f7ebc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0cc7c0 con 0x7f7ebc159e20 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0afde0 con 0x7f7ebc15cdd0 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc0cc940 con 0x7f7ea00039e0 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ebc159e20 0x7f7ebc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ebc159e20 0x7f7ebc15a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45946/0 (socket says 172.21.15.22:45946) 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1200640 1 -- 172.21.15.22:0/3750892222 learned_addr learned my addr 172.21.15.22:0/3750892222 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ea00039e0 0x7f7ebc0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ebb400640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ebc15cdd0 0x7f7ebc15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1200640 1 -- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ea00039e0 msgr2=0x7f7ebc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1200640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ea00039e0 0x7f7ebc0b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.689+0000 7f7ec1200640 1 -- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ebc15cdd0 msgr2=0x7f7ebc15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7ec1200640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ebc15cdd0 0x7f7ebc15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7ec1200640 1 -- 172.21.15.22:0/3750892222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc15d990 con 0x7f7ebc159e20 2024-04-16T16:19:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ea00039e0 0x7f7ebc0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7ebb400640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ebc15cdd0 0x7f7ebc15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7ec1200640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ebc159e20 0x7f7ebc15a2a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc06f9e0 tx=0x7f7eb400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7eb3e00640 1 -- 172.21.15.22:0/3750892222 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb400a5b0 con 0x7f7ebc159e20 2024-04-16T16:19:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7eb3e00640 1 -- 172.21.15.22:0/3750892222 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb400a750 con 0x7f7ebc159e20 2024-04-16T16:19:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ebc15dc70 con 0x7f7ebc159e20 2024-04-16T16:19:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7eb3e00640 1 -- 172.21.15.22:0/3750892222 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb400ab60 con 0x7f7ebc159e20 2024-04-16T16:19:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.690+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ebc15e230 con 0x7f7ebc159e20 2024-04-16T16:19:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.691+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ebc075f30 con 0x7f7ebc159e20 2024-04-16T16:19:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.693+0000 7f7eb3e00640 1 -- 172.21.15.22:0/3750892222 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f7eb4011070 con 0x7f7ebc159e20 2024-04-16T16:19:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.693+0000 7f7eb3e00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e9c06cbf0 0x7f7e9c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.694+0000 7f7eb3e00640 1 -- 172.21.15.22:0/3750892222 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f7eb408bae0 con 0x7f7ebc159e20 2024-04-16T16:19:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.694+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e9c06cbf0 0x7f7e9c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:14.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.694+0000 7f7ebbe00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e9c06cbf0 0x7f7e9c06f0b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7eac037000 tx=0x7f7eac030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:14.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.698+0000 7f7eb3e00640 1 -- 172.21.15.22:0/3750892222 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7eb401a060 con 0x7f7ebc159e20 2024-04-16T16:19:14.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.905+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ebc157090 con 0x7f7ebc159e20 2024-04-16T16:19:14.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.907+0000 7f7eb3e00640 1 -- 172.21.15.22:0/3750892222 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16614 (secure 0 0 0) 0x7f7eb40593e0 con 0x7f7ebc159e20 2024-04-16T16:19:14.906 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:14.906 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":36,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:18:57.479051+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:17:53.871511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T16:17:54.933724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:14.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e9c06cbf0 msgr2=0x7f7e9c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e9c06cbf0 0x7f7e9c06f0b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7eac037000 tx=0x7f7eac030000 comp rx=0 tx=0).stop 2024-04-16T16:19:14.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ebc159e20 msgr2=0x7f7ebc15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:14.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ebc159e20 0x7f7ebc15a2a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc06f9e0 tx=0x7f7eb400cf00 comp rx=0 tx=0).stop 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 shutdown_connections 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e9c06cbf0 0x7f7e9c06f0b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ebc159e20 0x7f7ebc15a2a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ebc15cdd0 0x7f7ebc15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 --2- 172.21.15.22:0/3750892222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ea00039e0 0x7f7ebc0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 >> 172.21.15.22:0/3750892222 conn(0x7f7ebc062440 msgr2=0x7f7ebc0af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.909+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 shutdown_connections 2024-04-16T16:19:14.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:14.910+0000 7f7ec1c00640 1 -- 172.21.15.22:0/3750892222 wait complete. 2024-04-16T16:19:14.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T16:19:15.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.156+0000 7f87d7000640 1 Processor -- start 2024-04-16T16:19:15.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.156+0000 7f87d7000640 1 -- start start 2024-04-16T16:19:15.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.157+0000 7f87d7000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f87d015eb30 0x7f87d00d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.157+0000 7f87d7000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87d00d1770 0x7f87d00d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.157+0000 7f87d7000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.157+0000 7f87d7000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f87d00d4650 con 0x7f87d00d1770 2024-04-16T16:19:15.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.157+0000 7f87d7000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f87d00d1be0 con 0x7f87d015eb30 2024-04-16T16:19:15.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.157+0000 7f87d7000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f87d015ef10 con 0x7f87d00d2de0 2024-04-16T16:19:15.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87d00d1770 0x7f87d00d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87d00d1770 0x7f87d00d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45962/0 (socket says 172.21.15.22:45962) 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 -- 172.21.15.22:0/1639522133 learned_addr learned my addr 172.21.15.22:0/1639522133 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5c00640 1 --2- 172.21.15.22:0/1639522133 >> v2:172.21.15.43:3300/0 conn(0x7f87d015eb30 0x7f87d00d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d6600640 1 --2- 172.21.15.22:0/1639522133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 -- 172.21.15.22:0/1639522133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 msgr2=0x7f87d00b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 --2- 172.21.15.22:0/1639522133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 -- 172.21.15.22:0/1639522133 >> v2:172.21.15.43:3300/0 conn(0x7f87d015eb30 msgr2=0x7f87d00d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 --2- 172.21.15.22:0/1639522133 >> v2:172.21.15.43:3300/0 conn(0x7f87d015eb30 0x7f87d00d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.158+0000 7f87d5200640 1 -- 172.21.15.22:0/1639522133 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d00d35b0 con 0x7f87d00d1770 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.160+0000 7f87d5200640 1 --2- 172.21.15.22:0/1639522133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d00d1770 0x7f87d00d28a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f87d00d1200 tx=0x7f87bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708eadb18c21c582 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.160+0000 7f87cfe00640 1 -- 172.21.15.22:0/1639522133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc035020 con 0x7f87d00d1770 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.160+0000 7f87cfe00640 1 -- 172.21.15.22:0/1639522133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc031870 con 0x7f87d00d1770 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.160+0000 7f87cfe00640 1 -- 172.21.15.22:0/1639522133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc031c40 con 0x7f87d00d1770 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.160+0000 7f87d7000640 1 -- 172.21.15.22:0/1639522133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d00d1770 msgr2=0x7f87d00d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.160+0000 7f87d7000640 1 --2- 172.21.15.22:0/1639522133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d00d1770 0x7f87d00d28a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f87d00d1200 tx=0x7f87bc02b910 comp rx=0 tx=0).stop 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.161+0000 7f87d7000640 1 -- 172.21.15.22:0/1639522133 shutdown_connections 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.161+0000 7f87d7000640 1 --2- 172.21.15.22:0/1639522133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.161+0000 7f87d7000640 1 --2- 172.21.15.22:0/1639522133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d00d1770 0x7f87d00d28a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.161+0000 7f87d7000640 1 --2- 172.21.15.22:0/1639522133 >> v2:172.21.15.43:3300/0 conn(0x7f87d015eb30 0x7f87d00d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.161+0000 7f87d7000640 1 -- 172.21.15.22:0/1639522133 >> 172.21.15.22:0/1639522133 conn(0x7f87d0072670 msgr2=0x7f87d0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:15.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.161+0000 7f87d7000640 1 -- 172.21.15.22:0/1639522133 shutdown_connections 2024-04-16T16:19:15.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.161+0000 7f87d7000640 1 -- 172.21.15.22:0/1639522133 wait complete. 2024-04-16T16:19:15.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.162+0000 7f87d7000640 1 Processor -- start 2024-04-16T16:19:15.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.163+0000 7f87d7000640 1 -- start start 2024-04-16T16:19:15.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.163+0000 7f87d7000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87d00d1770 0x7f87d01567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.163+0000 7f87d7000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d7000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d015eb30 0x7f87d00b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d7000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87d00d3e50 con 0x7f87d015eb30 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d7000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f87d00d3b70 con 0x7f87d00d1770 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d7000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f87d00d4130 con 0x7f87d00d2de0 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d015eb30 0x7f87d00b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d015eb30 0x7f87d00b8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45970/0 (socket says 172.21.15.22:45970) 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 -- 172.21.15.22:0/1318721333 learned_addr learned my addr 172.21.15.22:0/1318721333 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d5c00640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87d00d1770 0x7f87d01567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d5200640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 -- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 msgr2=0x7f87d00b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 -- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87d00d1770 msgr2=0x7f87d01567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87d00d1770 0x7f87d01567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.164+0000 7f87d6600640 1 -- 172.21.15.22:0/1318721333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d00b5430 con 0x7f87d015eb30 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.165+0000 7f87d6600640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d015eb30 0x7f87d00b8960 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f87c8007e40 tx=0x7f87c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.165+0000 7f87cd600640 1 -- 172.21.15.22:0/1318721333 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8014620 con 0x7f87d015eb30 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.165+0000 7f87cd600640 1 -- 172.21.15.22:0/1318721333 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c8019070 con 0x7f87d015eb30 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.165+0000 7f87cd600640 1 -- 172.21.15.22:0/1318721333 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8014a20 con 0x7f87d015eb30 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.165+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d00b5710 con 0x7f87d015eb30 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.165+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d0159be0 con 0x7f87d015eb30 2024-04-16T16:19:15.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.166+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d01604a0 con 0x7f87d015eb30 2024-04-16T16:19:15.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.167+0000 7f87cd600640 1 -- 172.21.15.22:0/1318721333 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f87c8014bc0 con 0x7f87d015eb30 2024-04-16T16:19:15.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.168+0000 7f87cd600640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87b006cbc0 0x7f87b006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.168+0000 7f87cd600640 1 -- 172.21.15.22:0/1318721333 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5737+0+0 (secure 0 0 0) 0x7f87c808c870 con 0x7f87d015eb30 2024-04-16T16:19:15.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.169+0000 7f87d5c00640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87b006cbc0 0x7f87b006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.170+0000 7f87d5c00640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87b006cbc0 0x7f87b006f080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87c4006fd0 tx=0x7f87c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:15.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.173+0000 7f87cd600640 1 -- 172.21.15.22:0/1318721333 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87d01604a0 con 0x7f87d015eb30 2024-04-16T16:19:15.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.427+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f87d0075f30 con 0x7f87d015eb30 2024-04-16T16:19:15.427 INFO:tasks.ceph.mon.a.smithi022.stderr:2024-04-16T16:19:15.428+0000 7f6a16800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T16:19:15.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.431+0000 7f87cd600640 1 -- 172.21.15.22:0/1318721333 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f87c805a980 con 0x7f87d015eb30 2024-04-16T16:19:15.430 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87b006cbc0 msgr2=0x7f87b006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87b006cbc0 0x7f87b006f080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87c4006fd0 tx=0x7f87c4008040 comp rx=0 tx=0).stop 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d015eb30 msgr2=0x7f87d00b8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d015eb30 0x7f87d00b8960 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f87c8007e40 tx=0x7f87c800e4b0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 shutdown_connections 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f87b006cbc0 0x7f87b006f080 secure :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87c4006fd0 tx=0x7f87c4008040 comp rx=0 tx=0).stop 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87d015eb30 0x7f87d00b8960 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f87d00d2de0 0x7f87d00b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 --2- 172.21.15.22:0/1318721333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87d00d1770 0x7f87d01567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.435+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 >> 172.21.15.22:0/1318721333 conn(0x7f87d0072670 msgr2=0x7f87d0161430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.436+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 shutdown_connections 2024-04-16T16:19:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.436+0000 7f87d7000640 1 -- 172.21.15.22:0/1318721333 wait complete. 2024-04-16T16:19:15.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T16:19:15.515 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2024-04-16T16:19:15.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.659+0000 7f81fce00640 1 Processor -- start 2024-04-16T16:19:15.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.659+0000 7f81fce00640 1 -- start start 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.660+0000 7f81fce00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81f815b750 0x7f81f80b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.660+0000 7f81fce00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f81f815fab0 0x7f81f806e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.660+0000 7f81fce00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f8160060 con 0x7f81f806e150 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.660+0000 7f81fce00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f81f806eaf0 con 0x7f81f815b750 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.660+0000 7f81fce00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80b4ae0 con 0x7f81f815fab0 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81f815b750 0x7f81f80b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81f815b750 0x7f81f80b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45986/0 (socket says 172.21.15.22:45986) 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f5e00640 1 -- 172.21.15.22:0/3825731020 learned_addr learned my addr 172.21.15.22:0/3825731020 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f6800640 1 --2- 172.21.15.22:0/3825731020 >> v2:172.21.15.43:3300/0 conn(0x7f81f815fab0 0x7f81f806e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f5e00640 1 -- 172.21.15.22:0/3825731020 >> v2:172.21.15.43:3300/0 conn(0x7f81f815fab0 msgr2=0x7f81f806e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f5e00640 1 --2- 172.21.15.22:0/3825731020 >> v2:172.21.15.43:3300/0 conn(0x7f81f815fab0 0x7f81f806e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f5e00640 1 -- 172.21.15.22:0/3825731020 >> v1:172.21.15.43:6789/0 conn(0x7f81f806e150 legacy=0x7f81f815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:15.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f5e00640 1 -- 172.21.15.22:0/3825731020 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f80b4490 con 0x7f81f815b750 2024-04-16T16:19:15.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.661+0000 7f81f6800640 1 --2- 172.21.15.22:0/3825731020 >> v2:172.21.15.43:3300/0 conn(0x7f81f815fab0 0x7f81f806e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:15.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.662+0000 7f81f5e00640 1 --2- 172.21.15.22:0/3825731020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815b750 0x7f81f80b4f70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f81f80b4c60 tx=0x7f81e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3930fb00989a8d9b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:15.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81f5400640 1 -- 172.21.15.22:0/3825731020 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8035020 con 0x7f81f815b750 2024-04-16T16:19:15.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81f5400640 1 -- 172.21.15.22:0/3825731020 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e8031870 con 0x7f81f815b750 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81f5400640 1 -- 172.21.15.22:0/3825731020 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8031c40 con 0x7f81f815b750 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81fce00640 1 -- 172.21.15.22:0/3825731020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815b750 msgr2=0x7f81f80b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81fce00640 1 --2- 172.21.15.22:0/3825731020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815b750 0x7f81f80b4f70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f81f80b4c60 tx=0x7f81e802b910 comp rx=0 tx=0).stop 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81fce00640 1 -- 172.21.15.22:0/3825731020 shutdown_connections 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81fce00640 1 --2- 172.21.15.22:0/3825731020 >> v2:172.21.15.43:3300/0 conn(0x7f81f815fab0 0x7f81f806e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.663+0000 7f81fce00640 1 --2- 172.21.15.22:0/3825731020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815b750 0x7f81f80b4f70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.664+0000 7f81fce00640 1 -- 172.21.15.22:0/3825731020 >> 172.21.15.22:0/3825731020 conn(0x7f81f8062440 msgr2=0x7f81f8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.664+0000 7f81fce00640 1 -- 172.21.15.22:0/3825731020 shutdown_connections 2024-04-16T16:19:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.664+0000 7f81fce00640 1 -- 172.21.15.22:0/3825731020 wait complete. 2024-04-16T16:19:15.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.666+0000 7f81fce00640 1 Processor -- start 2024-04-16T16:19:15.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.666+0000 7f81fce00640 1 -- start start 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81fce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81f806e150 0x7f81f81467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81fce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f815b750 0x7f81f814efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81fce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815fab0 0x7f81f815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81fce00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81f815bb30 con 0x7f81f815fab0 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81fce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81f80b54b0 con 0x7f81f815b750 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81fce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f81f815bcb0 con 0x7f81f806e150 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815fab0 0x7f81f815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815fab0 0x7f81f815e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45996/0 (socket says 172.21.15.22:45996) 2024-04-16T16:19:15.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.667+0000 7f81f6800640 1 -- 172.21.15.22:0/1885640219 learned_addr learned my addr 172.21.15.22:0/1885640219 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f5e00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81f806e150 0x7f81f81467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f6800640 1 -- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81f806e150 msgr2=0x7f81f81467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f6800640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81f806e150 0x7f81f81467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81efe00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f815b750 0x7f81f814efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f6800640 1 -- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f815b750 msgr2=0x7f81f814efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:15.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f6800640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f815b750 0x7f81f814efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f6800640 1 -- 172.21.15.22:0/1885640219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f8145730 con 0x7f81f815fab0 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f5e00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81f806e150 0x7f81f81467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81efe00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f815b750 0x7f81f814efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.668+0000 7f81f6800640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815fab0 0x7f81f815e710 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f81f000cd50 tx=0x7f81f000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.669+0000 7f81ee000640 1 -- 172.21.15.22:0/1885640219 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f000f680 con 0x7f81f815fab0 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.669+0000 7f81ee000640 1 -- 172.21.15.22:0/1885640219 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f000f840 con 0x7f81f815fab0 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.669+0000 7f81ee000640 1 -- 172.21.15.22:0/1885640219 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f000fc30 con 0x7f81f815fab0 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.669+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f8145a10 con 0x7f81f815fab0 2024-04-16T16:19:15.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.669+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f8145fd0 con 0x7f81f815fab0 2024-04-16T16:19:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.670+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f804fd90 con 0x7f81f815fab0 2024-04-16T16:19:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.671+0000 7f81ee000640 1 -- 172.21.15.22:0/1885640219 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f81f000e3e0 con 0x7f81f815fab0 2024-04-16T16:19:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.672+0000 7f81ee000640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f81d406cbc0 0x7f81d406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:15.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.672+0000 7f81ee000640 1 -- 172.21.15.22:0/1885640219 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5795+0+0 (secure 0 0 0) 0x7f81f008cfa0 con 0x7f81f815fab0 2024-04-16T16:19:15.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.672+0000 7f81f5e00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f81d406cbc0 0x7f81d406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:15.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.673+0000 7f81f5e00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f81d406cbc0 0x7f81d406f080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f81e8036000 tx=0x7f81e8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:15.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.677+0000 7f81ee000640 1 -- 172.21.15.22:0/1885640219 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81f0014030 con 0x7f81f815fab0 2024-04-16T16:19:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:15.925+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f81f80cced0 con 0x7f81f815fab0 2024-04-16T16:19:16.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.435+0000 7f81ee000640 1 -- 172.21.15.22:0/1885640219 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f81f005ae80 con 0x7f81f815fab0 2024-04-16T16:19:16.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f81d406cbc0 msgr2=0x7f81d406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:16.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f81d406cbc0 0x7f81d406f080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f81e8036000 tx=0x7f81e8008030 comp rx=0 tx=0).stop 2024-04-16T16:19:16.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815fab0 msgr2=0x7f81f815e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815fab0 0x7f81f815e710 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f81f000cd50 tx=0x7f81f000a650 comp rx=0 tx=0).stop 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 shutdown_connections 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f81d406cbc0 0x7f81d406f080 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81f815fab0 0x7f81f815e710 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81f815b750 0x7f81f814efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 --2- 172.21.15.22:0/1885640219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81f806e150 0x7f81f81467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.440+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 >> 172.21.15.22:0/1885640219 conn(0x7f81f8062440 msgr2=0x7f81f80cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.441+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 shutdown_connections 2024-04-16T16:19:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.441+0000 7f81fce00640 1 -- 172.21.15.22:0/1885640219 wait complete. 2024-04-16T16:19:16.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T16:19:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.709+0000 7fd433e00640 1 Processor -- start 2024-04-16T16:19:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.709+0000 7fd433e00640 1 -- start start 2024-04-16T16:19:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.710+0000 7fd433e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd434156d50 0x7fd43415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.710+0000 7fd433e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd43406e3e0 0x7fd43406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd433e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43406cfa0 con 0x7fd4340b5ac0 2024-04-16T16:19:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd433e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd43406d280 con 0x7fd434156d50 2024-04-16T16:19:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd433e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd43406d560 con 0x7fd43406e3e0 2024-04-16T16:19:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd432a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd434156d50 0x7fd43415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd433400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd4340b5ac0 0x7fd434072310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56048/0 (socket says 172.21.15.22:56048) 2024-04-16T16:19:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd433400640 1 -- 172.21.15.22:0/2978524314 learned_addr learned my addr 172.21.15.22:0/2978524314 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd432000640 1 --2- 172.21.15.22:0/2978524314 >> v2:172.21.15.43:3300/0 conn(0x7fd43406e3e0 0x7fd43406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.711+0000 7fd432a00640 1 -- 172.21.15.22:0/2978524314 >> v2:172.21.15.43:3300/0 conn(0x7fd43406e3e0 msgr2=0x7fd43406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.712+0000 7fd432a00640 1 --2- 172.21.15.22:0/2978524314 >> v2:172.21.15.43:3300/0 conn(0x7fd43406e3e0 0x7fd43406e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.712+0000 7fd432a00640 1 -- 172.21.15.22:0/2978524314 >> v1:172.21.15.22:6789/0 conn(0x7fd4340b5ac0 legacy=0x7fd434072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.712+0000 7fd431600640 1 -- 172.21.15.22:0/2978524314 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401363204 0 0) 0x7fd43406cfa0 con 0x7fd4340b5ac0 2024-04-16T16:19:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.712+0000 7fd432a00640 1 -- 172.21.15.22:0/2978524314 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43406d840 con 0x7fd434156d50 2024-04-16T16:19:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.713+0000 7fd432a00640 1 --2- 172.21.15.22:0/2978524314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd434156d50 0x7fd43415cd80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd43415a9a0 tx=0x7fd42402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d90afad55b9531a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.713+0000 7fd431600640 1 -- 172.21.15.22:0/2978524314 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424038070 con 0x7fd434156d50 2024-04-16T16:19:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.713+0000 7fd431600640 1 -- 172.21.15.22:0/2978524314 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd424031710 con 0x7fd434156d50 2024-04-16T16:19:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.713+0000 7fd431600640 1 -- 172.21.15.22:0/2978524314 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424031ae0 con 0x7fd434156d50 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 -- 172.21.15.22:0/2978524314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd434156d50 msgr2=0x7fd43415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 --2- 172.21.15.22:0/2978524314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd434156d50 0x7fd43415cd80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd43415a9a0 tx=0x7fd42402b7b0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 -- 172.21.15.22:0/2978524314 shutdown_connections 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 --2- 172.21.15.22:0/2978524314 >> v2:172.21.15.43:3300/0 conn(0x7fd43406e3e0 0x7fd43406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 --2- 172.21.15.22:0/2978524314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd434156d50 0x7fd43415cd80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 -- 172.21.15.22:0/2978524314 >> 172.21.15.22:0/2978524314 conn(0x7fd4340b2110 msgr2=0x7fd4340b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 -- 172.21.15.22:0/2978524314 shutdown_connections 2024-04-16T16:19:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.714+0000 7fd433e00640 1 -- 172.21.15.22:0/2978524314 wait complete. 2024-04-16T16:19:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.715+0000 7fd433e00640 1 Processor -- start 2024-04-16T16:19:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.716+0000 7fd433e00640 1 -- start start 2024-04-16T16:19:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.716+0000 7fd433e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd43406e3e0 0x7fd4341e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd433e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340b5ac0 0x7fd4341e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd433e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd434156d50 0x7fd4341e6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd433e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340b6070 con 0x7fd4340b5ac0 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd433e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340b5ef0 con 0x7fd43406e3e0 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd433e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340b61f0 con 0x7fd434156d50 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340b5ac0 0x7fd4341e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340b5ac0 0x7fd4341e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46008/0 (socket says 172.21.15.22:46008) 2024-04-16T16:19:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 -- 172.21.15.22:0/2984265894 learned_addr learned my addr 172.21.15.22:0/2984265894 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:16.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 -- 172.21.15.22:0/2984265894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd434156d50 msgr2=0x7fd4341e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:16.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd434156d50 0x7fd4341e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 -- 172.21.15.22:0/2984265894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd43406e3e0 msgr2=0x7fd4341e7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:16.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432a00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd43406e3e0 0x7fd4341e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:16.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd43406e3e0 0x7fd4341e7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.717+0000 7fd432000640 1 -- 172.21.15.22:0/2984265894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4341e8460 con 0x7fd4340b5ac0 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.718+0000 7fd432000640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340b5ac0 0x7fd4341e6200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd42000d800 tx=0x7fd42000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.718+0000 7fd42aa00640 1 -- 172.21.15.22:0/2984265894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42000b6c0 con 0x7fd4340b5ac0 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.718+0000 7fd42aa00640 1 -- 172.21.15.22:0/2984265894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd420019070 con 0x7fd4340b5ac0 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.718+0000 7fd42aa00640 1 -- 172.21.15.22:0/2984265894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42000ba80 con 0x7fd4340b5ac0 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.718+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4341e6e80 con 0x7fd4340b5ac0 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.718+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4341e7440 con 0x7fd4340b5ac0 2024-04-16T16:19:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.719+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd434075570 con 0x7fd4340b5ac0 2024-04-16T16:19:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.720+0000 7fd42aa00640 1 -- 172.21.15.22:0/2984265894 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fd42000bc20 con 0x7fd4340b5ac0 2024-04-16T16:19:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.721+0000 7fd42aa00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd41406cbc0 0x7fd41406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.721+0000 7fd42aa00640 1 -- 172.21.15.22:0/2984265894 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5795+0+0 (secure 0 0 0) 0x7fd42008c540 con 0x7fd4340b5ac0 2024-04-16T16:19:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.721+0000 7fd432a00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd41406cbc0 0x7fd41406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.722+0000 7fd432a00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd41406cbc0 0x7fd41406f080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd424035000 tx=0x7fd424008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:16.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.726+0000 7fd42aa00640 1 -- 172.21.15.22:0/2984265894 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd434075570 con 0x7fd4340b5ac0 2024-04-16T16:19:16.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:16.938+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd434075f30 con 0x7fd4340b5ac0 2024-04-16T16:19:17.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.615+0000 7fd42aa00640 1 -- 172.21.15.22:0/2984265894 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) ==== 181+0+0 (secure 0 0 0) 0x7fd42005a580 con 0x7fd4340b5ac0 2024-04-16T16:19:17.615 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-04-16T16:19:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.619+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd41406cbc0 msgr2=0x7fd41406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.619+0000 7fd433e00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd41406cbc0 0x7fd41406f080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd424035000 tx=0x7fd424008030 comp rx=0 tx=0).stop 2024-04-16T16:19:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340b5ac0 msgr2=0x7fd4341e6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340b5ac0 0x7fd4341e6200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd42000d800 tx=0x7fd42000dcc0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 shutdown_connections 2024-04-16T16:19:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd41406cbc0 0x7fd41406f080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd434156d50 0x7fd4341e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4340b5ac0 0x7fd4341e6200 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 --2- 172.21.15.22:0/2984265894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd43406e3e0 0x7fd4341e7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 >> 172.21.15.22:0/2984265894 conn(0x7fd4340b2110 msgr2=0x7fd4340cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 shutdown_connections 2024-04-16T16:19:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.620+0000 7fd433e00640 1 -- 172.21.15.22:0/2984265894 wait complete. 2024-04-16T16:19:17.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T16:19:17.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.869+0000 7f8186a00640 1 Processor -- start 2024-04-16T16:19:17.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.869+0000 7f8186a00640 1 -- start start 2024-04-16T16:19:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.871+0000 7f8186a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8180159240 0x7f818015bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.871+0000 7f8186a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81800b41f0 con 0x7f818006e690 2024-04-16T16:19:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.871+0000 7f8186a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818015cd20 con 0x7f81800b3d70 2024-04-16T16:19:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.871+0000 7f8186a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8180159620 con 0x7f8180159240 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f8185600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8180159240 0x7f818015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f8185600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8180159240 0x7f818015bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46022/0 (socket says 172.21.15.22:46022) 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f8185600640 1 -- 172.21.15.22:0/790687633 learned_addr learned my addr 172.21.15.22:0/790687633 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f8186000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f818006e690 0x7f8180071150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56064/0 (socket says 172.21.15.22:56064) 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f8185600640 1 -- 172.21.15.22:0/790687633 >> v1:172.21.15.43:6789/0 conn(0x7f81800b3d70 legacy=0x7f818006df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f8185600640 1 -- 172.21.15.22:0/790687633 >> v1:172.21.15.22:6789/0 conn(0x7f818006e690 legacy=0x7f8180071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f8185600640 1 -- 172.21.15.22:0/790687633 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81800b4490 con 0x7f8180159240 2024-04-16T16:19:17.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.872+0000 7f817fe00640 1 -- 172.21.15.22:0/790687633 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212495227 0 0) 0x7f81800b41f0 con 0x7f818006e690 2024-04-16T16:19:17.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.873+0000 7f8185600640 1 --2- 172.21.15.22:0/790687633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f818015bc10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f81740098a0 tx=0x7f817402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aa4d3cc8c1970b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:17.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f817fe00640 1 -- 172.21.15.22:0/790687633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817402f830 con 0x7f8180159240 2024-04-16T16:19:17.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f817fe00640 1 -- 172.21.15.22:0/790687633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817402f9d0 con 0x7f8180159240 2024-04-16T16:19:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f817fe00640 1 -- 172.21.15.22:0/790687633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817402fda0 con 0x7f8180159240 2024-04-16T16:19:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f8186a00640 1 -- 172.21.15.22:0/790687633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 msgr2=0x7f818015bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f8186a00640 1 --2- 172.21.15.22:0/790687633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f818015bc10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f81740098a0 tx=0x7f817402ba10 comp rx=0 tx=0).stop 2024-04-16T16:19:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f8186a00640 1 -- 172.21.15.22:0/790687633 shutdown_connections 2024-04-16T16:19:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f8186a00640 1 --2- 172.21.15.22:0/790687633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f818015bc10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.874+0000 7f8186a00640 1 -- 172.21.15.22:0/790687633 >> 172.21.15.22:0/790687633 conn(0x7f8180062440 msgr2=0x7f8180062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.875+0000 7f8186a00640 1 -- 172.21.15.22:0/790687633 shutdown_connections 2024-04-16T16:19:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.875+0000 7f8186a00640 1 -- 172.21.15.22:0/790687633 wait complete. 2024-04-16T16:19:17.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.876+0000 7f8186a00640 1 Processor -- start 2024-04-16T16:19:17.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.877+0000 7f8186a00640 1 -- start start 2024-04-16T16:19:17.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818006e690 0x7f8180141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:17.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81800b3d70 0x7f81800cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f81800cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81800b4d30 con 0x7f8180159240 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81800b4a50 con 0x7f818006e690 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f81800b5010 con 0x7f81800b3d70 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f81800cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f81800cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46036/0 (socket says 172.21.15.22:46036) 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186000640 1 -- 172.21.15.22:0/2383961710 learned_addr learned my addr 172.21.15.22:0/2383961710 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8185600640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818006e690 0x7f8180141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8186000640 1 -- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81800b3d70 msgr2=0x7f81800cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.878+0000 7f8184c00640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81800b3d70 0x7f81800cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8186000640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81800b3d70 0x7f81800cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8186000640 1 -- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818006e690 msgr2=0x7f8180141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8186000640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818006e690 0x7f8180141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:17.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8186000640 1 -- 172.21.15.22:0/2383961710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81800d06a0 con 0x7f8180159240 2024-04-16T16:19:17.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8185600640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818006e690 0x7f8180141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:17.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8186000640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f81800cfe70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f817800c700 tx=0x7f817800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:17.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f817d600640 1 -- 172.21.15.22:0/2383961710 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817800ce10 con 0x7f8180159240 2024-04-16T16:19:17.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f817d600640 1 -- 172.21.15.22:0/2383961710 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817800a640 con 0x7f8180159240 2024-04-16T16:19:17.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f817d600640 1 -- 172.21.15.22:0/2383961710 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817800aa90 con 0x7f8180159240 2024-04-16T16:19:17.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81800d0980 con 0x7f8180159240 2024-04-16T16:19:17.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.879+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81800d0f40 con 0x7f8180159240 2024-04-16T16:19:17.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.880+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81800d0410 con 0x7f8180159240 2024-04-16T16:19:17.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.882+0000 7f817d600640 1 -- 172.21.15.22:0/2383961710 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f817800ac30 con 0x7f8180159240 2024-04-16T16:19:17.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.883+0000 7f817d600640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f816006cbc0 0x7f816006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:17.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.883+0000 7f817d600640 1 -- 172.21.15.22:0/2383961710 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5357+0+0 (secure 0 0 0) 0x7f817808bdd0 con 0x7f8180159240 2024-04-16T16:19:17.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.883+0000 7f8185600640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f816006cbc0 0x7f816006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:17.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.884+0000 7f8185600640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f816006cbc0 0x7f816006f080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8174036000 tx=0x7f8174039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:17.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:17.888+0000 7f817d600640 1 -- 172.21.15.22:0/2383961710 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8178059fd0 con 0x7f8180159240 2024-04-16T16:19:18.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.095+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81800b3900 con 0x7f8180159240 2024-04-16T16:19:18.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.626+0000 7f817d600640 1 -- 172.21.15.22:0/2383961710 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) ==== 169+0+0 (secure 0 0 0) 0x7f81780598d0 con 0x7f8180159240 2024-04-16T16:19:18.625 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f816006cbc0 msgr2=0x7f816006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f816006cbc0 0x7f816006f080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8174036000 tx=0x7f8174039040 comp rx=0 tx=0).stop 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 msgr2=0x7f81800cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f81800cfe70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f817800c700 tx=0x7f817800cbc0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 shutdown_connections 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f816006cbc0 0x7f816006f080 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8180159240 0x7f81800cfe70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81800b3d70 0x7f81800cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 --2- 172.21.15.22:0/2383961710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818006e690 0x7f8180141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 >> 172.21.15.22:0/2383961710 conn(0x7f8180062440 msgr2=0x7f818015afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:18.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 shutdown_connections 2024-04-16T16:19:18.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.631+0000 7f8186a00640 1 -- 172.21.15.22:0/2383961710 wait complete. 2024-04-16T16:19:18.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2024-04-16T16:19:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.890+0000 7fc6c2200640 1 Processor -- start 2024-04-16T16:19:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.890+0000 7fc6c2200640 1 -- start start 2024-04-16T16:19:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.892+0000 7fc6c2200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6bc0cc830 0x7fc6bc0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.892+0000 7fc6c2200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6bc15cc20 con 0x7fc6bc0d0a10 2024-04-16T16:19:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.892+0000 7fc6c2200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6bc06dda0 con 0x7fc6bc15c840 2024-04-16T16:19:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.892+0000 7fc6c2200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc6bc0ce390 con 0x7fc6bc0cc830 2024-04-16T16:19:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.893+0000 7fc6bbe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc6bc0d0a10 0x7fc6bc0cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56070/0 (socket says 172.21.15.22:56070) 2024-04-16T16:19:18.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.893+0000 7fc6bbe00640 1 -- 172.21.15.22:0/3862498906 learned_addr learned my addr 172.21.15.22:0/3862498906 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:18.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.893+0000 7fc6c1800640 1 --2- 172.21.15.22:0/3862498906 >> v2:172.21.15.43:3300/0 conn(0x7fc6bc0cc830 0x7fc6bc0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:18.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.893+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243700180 0 0) 0x7fc6a8001110 con 0x7fc6bc0d0a10 2024-04-16T16:19:18.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.893+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a0003520 con 0x7fc6bc0d0a10 2024-04-16T16:19:18.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.893+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2300139148 0 0) 0x7fc6a0003520 con 0x7fc6bc0d0a10 2024-04-16T16:19:18.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 >> v2:172.21.15.43:3300/0 conn(0x7fc6bc0cc830 msgr2=0x7fc6bc0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 --2- 172.21.15.22:0/3862498906 >> v2:172.21.15.43:3300/0 conn(0x7fc6bc0cc830 0x7fc6bc0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 >> v1:172.21.15.43:6789/0 conn(0x7fc6bc15c840 legacy=0x7fc6bc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc06d800 con 0x7fc6bc0d0a10 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fc6a8001840 con 0x7fc6bc0d0a10 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 >> v1:172.21.15.22:6789/0 conn(0x7fc6bc0d0a10 legacy=0x7fc6bc0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6a00051c0 0x7fc6a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a000c090 con 0x7fc6a0003a00 2024-04-16T16:19:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a000c240 con 0x7fc6a0004800 2024-04-16T16:19:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a000c440 con 0x7fc6a00051c0 2024-04-16T16:19:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6c0e00640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.894+0000 7fc6bbe00640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.895+0000 7fc6c0e00640 1 -- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6a00051c0 msgr2=0x7fc6a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.895+0000 7fc6c0e00640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6a00051c0 0x7fc6a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.895+0000 7fc6c0e00640 1 -- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a0004800 msgr2=0x7fc6a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.895+0000 7fc6c0e00640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.895+0000 7fc6c0e00640 1 -- 172.21.15.22:0/3862498906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a0003520 con 0x7fc6a0003a00 2024-04-16T16:19:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.895+0000 7fc6c1800640 1 -- 172.21.15.22:0/3862498906 reap_dead start 2024-04-16T16:19:18.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.895+0000 7fc6bbe00640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a0004800 0x7fc6a0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:18.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.896+0000 7fc6c0e00640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6a0003e20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac001e50 tx=0x7fc6a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770075cea26c7b80 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.896+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac001a70 con 0x7fc6a0003a00 2024-04-16T16:19:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.896+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac003b70 con 0x7fc6a0003a00 2024-04-16T16:19:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.896+0000 7fc6bb400640 1 -- 172.21.15.22:0/3862498906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0050d0 con 0x7fc6a0003a00 2024-04-16T16:19:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.897+0000 7fc6c2200640 1 -- 172.21.15.22:0/3862498906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 msgr2=0x7fc6a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.897+0000 7fc6c2200640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6a0003e20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac001e50 tx=0x7fc6a0005830 comp rx=0 tx=0).stop 2024-04-16T16:19:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.897+0000 7fc6c2200640 1 -- 172.21.15.22:0/3862498906 shutdown_connections 2024-04-16T16:19:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.897+0000 7fc6c2200640 1 --2- 172.21.15.22:0/3862498906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6a0003e20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.897+0000 7fc6c2200640 1 -- 172.21.15.22:0/3862498906 >> 172.21.15.22:0/3862498906 conn(0x7fc6bc062440 msgr2=0x7fc6bc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.897+0000 7fc6c2200640 1 -- 172.21.15.22:0/3862498906 shutdown_connections 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.897+0000 7fc6c2200640 1 -- 172.21.15.22:0/3862498906 wait complete. 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.899+0000 7fc6c2200640 1 Processor -- start 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.899+0000 7fc6c2200640 1 -- start start 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c2200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6bc149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6bc15ce00 0x7fc6bc15f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6bc15d280 0x7fc6bc15f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c2200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0ce8a0 con 0x7fc6a0003a00 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0ce5c0 con 0x7fc6bc15d280 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc0ceb80 con 0x7fc6bc15ce00 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c0e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6bc149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c0e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6bc149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46062/0 (socket says 172.21.15.22:46062) 2024-04-16T16:19:18.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.900+0000 7fc6c0e00640 1 -- 172.21.15.22:0/2173282499 learned_addr learned my addr 172.21.15.22:0/2173282499 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6bbe00640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6bc15ce00 0x7fc6bc15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6c0e00640 1 -- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6bc15ce00 msgr2=0x7fc6bc15f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6c0e00640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6bc15ce00 0x7fc6bc15f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6c0e00640 1 -- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6bc15d280 msgr2=0x7fc6bc15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6c1800640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6bc15d280 0x7fc6bc15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6c0e00640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6bc15d280 0x7fc6bc15f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6c0e00640 1 -- 172.21.15.22:0/2173282499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc15d7e0 con 0x7fc6a0003a00 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6c0e00640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6bc149270 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac001f40 tx=0x7fc6ac0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6b8c00640 1 -- 172.21.15.22:0/2173282499 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac003970 con 0x7fc6a0003a00 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.901+0000 7fc6b8c00640 1 -- 172.21.15.22:0/2173282499 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac006b50 con 0x7fc6a0003a00 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.902+0000 7fc6b8c00640 1 -- 172.21.15.22:0/2173282499 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac007030 con 0x7fc6a0003a00 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.902+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc15dac0 con 0x7fc6a0003a00 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.902+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc15e080 con 0x7fc6a0003a00 2024-04-16T16:19:18.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.903+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6bc075f30 con 0x7fc6a0003a00 2024-04-16T16:19:18.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.904+0000 7fc6b8c00640 1 -- 172.21.15.22:0/2173282499 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fc6ac0071d0 con 0x7fc6a0003a00 2024-04-16T16:19:18.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.905+0000 7fc6b8c00640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc69c06cbc0 0x7fc69c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:18.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.905+0000 7fc6b8c00640 1 -- 172.21.15.22:0/2173282499 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fc6ac0ad710 con 0x7fc6a0003a00 2024-04-16T16:19:18.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.905+0000 7fc6bbe00640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc69c06cbc0 0x7fc69c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:18.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.906+0000 7fc6bbe00640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc69c06cbc0 0x7fc69c06f080 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001eb0 tx=0x7fc6a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:18.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:18.909+0000 7fc6b8c00640 1 -- 172.21.15.22:0/2173282499 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6ac033020 con 0x7fc6a0003a00 2024-04-16T16:19:19.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.128+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) -- 0x7fc6bc06dfb0 con 0x7fc6a0003a00 2024-04-16T16:19:19.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.134+0000 7fc6b8c00640 1 -- 172.21.15.22:0/2173282499 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7fc6ac07b9a0 con 0x7fc6a0003a00 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc69c06cbc0 msgr2=0x7fc69c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc69c06cbc0 0x7fc69c06f080 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001eb0 tx=0x7fc6a8009040 comp rx=0 tx=0).stop 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 msgr2=0x7fc6bc149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6bc149270 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac001f40 tx=0x7fc6ac0014a0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 shutdown_connections 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc69c06cbc0 0x7fc69c06f080 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6bc15d280 0x7fc6bc15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6bc15ce00 0x7fc6bc15f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 --2- 172.21.15.22:0/2173282499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6a0003a00 0x7fc6bc149270 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.137+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 >> 172.21.15.22:0/2173282499 conn(0x7fc6bc062440 msgr2=0x7fc6bc0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:19.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.138+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 shutdown_connections 2024-04-16T16:19:19.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.138+0000 7fc6c2200640 1 -- 172.21.15.22:0/2173282499 wait complete. 2024-04-16T16:19:19.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-16T16:19:19.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.367+0000 7f80b4a00640 1 Processor -- start 2024-04-16T16:19:19.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.367+0000 7f80b4a00640 1 -- start start 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80b4a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f80b015eb60 0x7f80b00cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80b4a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80b00d35f0 0x7f80b00d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80b4a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b00d3ef0 con 0x7f80b00d3a60 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80b4a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f80b00d41d0 con 0x7f80b00d35f0 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80b4a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f80b00d44b0 con 0x7f80b015eb60 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80ade00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80b00d35f0 0x7f80b00d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80ade00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80b00d35f0 0x7f80b00d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46072/0 (socket says 172.21.15.22:46072) 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.369+0000 7f80ade00640 1 -- 172.21.15.22:0/1402468336 learned_addr learned my addr 172.21.15.22:0/1402468336 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.370+0000 7f80ae800640 1 --2- 172.21.15.22:0/1402468336 >> v2:172.21.15.43:3300/0 conn(0x7f80b015eb60 0x7f80b00cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.370+0000 7f80ade00640 1 -- 172.21.15.22:0/1402468336 >> v2:172.21.15.43:3300/0 conn(0x7f80b015eb60 msgr2=0x7f80b00cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.370+0000 7f80ade00640 1 --2- 172.21.15.22:0/1402468336 >> v2:172.21.15.43:3300/0 conn(0x7f80b015eb60 0x7f80b00cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.370+0000 7f80ade00640 1 -- 172.21.15.22:0/1402468336 >> v1:172.21.15.43:6789/0 conn(0x7f80b00d3a60 legacy=0x7f80b00d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:19.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.370+0000 7f80ade00640 1 -- 172.21.15.22:0/1402468336 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b00b7db0 con 0x7f80b00d35f0 2024-04-16T16:19:19.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.371+0000 7f80ade00640 1 --2- 172.21.15.22:0/1402468336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b00d17a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f80b00d47b0 tx=0x7f809c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f236ecf22190f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:19.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80ad400640 1 -- 172.21.15.22:0/1402468336 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c035020 con 0x7f80b00d35f0 2024-04-16T16:19:19.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80ad400640 1 -- 172.21.15.22:0/1402468336 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c031870 con 0x7f80b00d35f0 2024-04-16T16:19:19.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80ad400640 1 -- 172.21.15.22:0/1402468336 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c031c40 con 0x7f80b00d35f0 2024-04-16T16:19:19.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80b4a00640 1 -- 172.21.15.22:0/1402468336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 msgr2=0x7f80b00d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1402468336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b00d17a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f80b00d47b0 tx=0x7f809c02b910 comp rx=0 tx=0).stop 2024-04-16T16:19:19.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80b4a00640 1 -- 172.21.15.22:0/1402468336 shutdown_connections 2024-04-16T16:19:19.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1402468336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b00d17a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1402468336 >> v2:172.21.15.43:3300/0 conn(0x7f80b015eb60 0x7f80b00cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.372+0000 7f80b4a00640 1 -- 172.21.15.22:0/1402468336 >> 172.21.15.22:0/1402468336 conn(0x7f80b0072460 msgr2=0x7f80b0072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:19.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.373+0000 7f80b4a00640 1 -- 172.21.15.22:0/1402468336 shutdown_connections 2024-04-16T16:19:19.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.373+0000 7f80b4a00640 1 -- 172.21.15.22:0/1402468336 wait complete. 2024-04-16T16:19:19.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.374+0000 7f80b4a00640 1 Processor -- start 2024-04-16T16:19:19.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.375+0000 7f80b4a00640 1 -- start start 2024-04-16T16:19:19.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80b4a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b0159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80b4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b015eb60 0x7f80b01580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80b4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f80b00ce1a0 0x7f80b00b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80b4a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f80b00b9460 con 0x7f80b00d35f0 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80b4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f80b00b92e0 con 0x7f80b015eb60 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80b4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f80b00b95e0 con 0x7f80b00ce1a0 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b0159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46088/0 (socket says 172.21.15.22:46088) 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 -- 172.21.15.22:0/1572298386 learned_addr learned my addr 172.21.15.22:0/1572298386 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ade00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b015eb60 0x7f80b01580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 -- 172.21.15.22:0/1572298386 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f80b00ce1a0 msgr2=0x7f80b00b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f80b00ce1a0 0x7f80b00b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 -- 172.21.15.22:0/1572298386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b015eb60 msgr2=0x7f80b01580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b015eb60 0x7f80b01580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.376+0000 7f80ae800640 1 -- 172.21.15.22:0/1572298386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b00cd100 con 0x7f80b00d35f0 2024-04-16T16:19:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.377+0000 7f80ae800640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b0159710 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f80a000d800 tx=0x7f80a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.377+0000 7f80a6a00640 1 -- 172.21.15.22:0/1572298386 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a000b6c0 con 0x7f80b00d35f0 2024-04-16T16:19:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.377+0000 7f80a6a00640 1 -- 172.21.15.22:0/1572298386 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a0019070 con 0x7f80b00d35f0 2024-04-16T16:19:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.377+0000 7f80a6a00640 1 -- 172.21.15.22:0/1572298386 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a000ba80 con 0x7f80b00d35f0 2024-04-16T16:19:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.377+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b00cd3e0 con 0x7f80b00d35f0 2024-04-16T16:19:19.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.377+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b00cd9a0 con 0x7f80b00d35f0 2024-04-16T16:19:19.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.379+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b00cdde0 con 0x7f80b00d35f0 2024-04-16T16:19:19.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.380+0000 7f80a6a00640 1 -- 172.21.15.22:0/1572298386 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f80a000bc20 con 0x7f80b00d35f0 2024-04-16T16:19:19.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.381+0000 7f80a6a00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f809006cbc0 0x7f809006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.381+0000 7f80a6a00640 1 -- 172.21.15.22:0/1572298386 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f80a008c150 con 0x7f80b00d35f0 2024-04-16T16:19:19.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.381+0000 7f80ade00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f809006cbc0 0x7f809006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.382+0000 7f80ade00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f809006cbc0 0x7f809006f080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f809c036000 tx=0x7f809c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:19.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.386+0000 7f80a6a00640 1 -- 172.21.15.22:0/1572298386 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f80a005a580 con 0x7f80b00d35f0 2024-04-16T16:19:19.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.599+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f80b0075f30 con 0x7f80b00d35f0 2024-04-16T16:19:19.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.604+0000 7f80a6a00640 1 -- 172.21.15.22:0/1572298386 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f80a0059e80 con 0x7f80b00d35f0 2024-04-16T16:19:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f809006cbc0 msgr2=0x7f809006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f809006cbc0 0x7f809006f080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f809c036000 tx=0x7f809c008030 comp rx=0 tx=0).stop 2024-04-16T16:19:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 msgr2=0x7f80b0159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b0159710 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f80a000d800 tx=0x7f80a000dcc0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 shutdown_connections 2024-04-16T16:19:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f809006cbc0 0x7f809006f080 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f80b00ce1a0 0x7f80b00b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b015eb60 0x7f80b01580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 --2- 172.21.15.22:0/1572298386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80b00d35f0 0x7f80b0159710 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 >> 172.21.15.22:0/1572298386 conn(0x7f80b0072460 msgr2=0x7f80b0157880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 shutdown_connections 2024-04-16T16:19:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.607+0000 7f80b4a00640 1 -- 172.21.15.22:0/1572298386 wait complete. 2024-04-16T16:19:19.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2024-04-16T16:19:19.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.854+0000 7fa5df200640 1 Processor -- start 2024-04-16T16:19:19.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.855+0000 7fa5df200640 1 -- start start 2024-04-16T16:19:19.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.856+0000 7fa5df200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa5e0156e90 0x7fa5e015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.856+0000 7fa5df200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa5e00710c0 0x7fa5e00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5df200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e00b7520 con 0x7fa5e00cf040 2024-04-16T16:19:19.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5df200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e0071830 con 0x7fa5e00710c0 2024-04-16T16:19:19.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5df200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e00b7800 con 0x7fa5e0156e90 2024-04-16T16:19:19.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5dd400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa5e00cf040 0x7fa5e00709b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46202/0 (socket says 172.21.15.22:46202) 2024-04-16T16:19:19.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5dd400640 1 -- 172.21.15.22:0/1607798871 learned_addr learned my addr 172.21.15.22:0/1607798871 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:19.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5de800640 1 --2- 172.21.15.22:0/1607798871 >> v2:172.21.15.22:3300/0 conn(0x7fa5e00710c0 0x7fa5e00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5dde00640 1 --2- 172.21.15.22:0/1607798871 >> v2:172.21.15.43:3300/0 conn(0x7fa5e0156e90 0x7fa5e015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.858+0000 7fa5de800640 1 -- 172.21.15.22:0/1607798871 >> v2:172.21.15.43:3300/0 conn(0x7fa5e0156e90 msgr2=0x7fa5e015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:19.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.857+0000 7fa5dca00640 1 -- 172.21.15.22:0/1607798871 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380600977 0 0) 0x7fa5e00b7520 con 0x7fa5e00cf040 2024-04-16T16:19:19.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.858+0000 7fa5de800640 1 --2- 172.21.15.22:0/1607798871 >> v2:172.21.15.43:3300/0 conn(0x7fa5e0156e90 0x7fa5e015d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.858+0000 7fa5de800640 1 -- 172.21.15.22:0/1607798871 >> v1:172.21.15.22:6789/0 conn(0x7fa5e00cf040 legacy=0x7fa5e00709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.858+0000 7fa5de800640 1 -- 172.21.15.22:0/1607798871 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e00b5880 con 0x7fa5e00710c0 2024-04-16T16:19:19.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.859+0000 7fa5de800640 1 --2- 172.21.15.22:0/1607798871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00710c0 0x7fa5e00b5da0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0072d60 tx=0x7fa5d802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdd348227d1c0a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:19.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.859+0000 7fa5dca00640 1 -- 172.21.15.22:0/1607798871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8038070 con 0x7fa5e00710c0 2024-04-16T16:19:19.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.859+0000 7fa5dca00640 1 -- 172.21.15.22:0/1607798871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d8031710 con 0x7fa5e00710c0 2024-04-16T16:19:19.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.859+0000 7fa5dca00640 1 -- 172.21.15.22:0/1607798871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8031ae0 con 0x7fa5e00710c0 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 -- 172.21.15.22:0/1607798871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00710c0 msgr2=0x7fa5e00b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 --2- 172.21.15.22:0/1607798871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00710c0 0x7fa5e00b5da0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0072d60 tx=0x7fa5d802b7b0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 -- 172.21.15.22:0/1607798871 shutdown_connections 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 --2- 172.21.15.22:0/1607798871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00710c0 0x7fa5e00b5da0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 --2- 172.21.15.22:0/1607798871 >> v2:172.21.15.43:3300/0 conn(0x7fa5e0156e90 0x7fa5e015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 -- 172.21.15.22:0/1607798871 >> 172.21.15.22:0/1607798871 conn(0x7fa5e00b4400 msgr2=0x7fa5e00b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 -- 172.21.15.22:0/1607798871 shutdown_connections 2024-04-16T16:19:19.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.860+0000 7fa5df200640 1 -- 172.21.15.22:0/1607798871 wait complete. 2024-04-16T16:19:19.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.862+0000 7fa5df200640 1 Processor -- start 2024-04-16T16:19:19.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.862+0000 7fa5df200640 1 -- start start 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5df200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e00710c0 0x7fa5e00cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5df200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00cf040 0x7fa5e01e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5df200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5e0156e90 0x7fa5e015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5df200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01573f0 con 0x7fa5e00cf040 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5df200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0157270 con 0x7fa5e00710c0 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5df200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e00b62e0 con 0x7fa5e0156e90 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5dd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00cf040 0x7fa5e01e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5dd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00cf040 0x7fa5e01e7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48542/0 (socket says 172.21.15.22:48542) 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.863+0000 7fa5dd400640 1 -- 172.21.15.22:0/839048582 learned_addr learned my addr 172.21.15.22:0/839048582 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dde00640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e00710c0 0x7fa5e00cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dd400640 1 -- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5e0156e90 msgr2=0x7fa5e015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5de800640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5e0156e90 0x7fa5e015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dd400640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5e0156e90 0x7fa5e015e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dd400640 1 -- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e00710c0 msgr2=0x7fa5e00cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dd400640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e00710c0 0x7fa5e00cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dd400640 1 -- 172.21.15.22:0/839048582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e01e6370 con 0x7fa5e00cf040 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dde00640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e00710c0 0x7fa5e00cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5dd400640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00cf040 0x7fa5e01e7c70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c8c0 tx=0x7fa5d000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5d6000640 1 -- 172.21.15.22:0/839048582 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0018070 con 0x7fa5e00cf040 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5d6000640 1 -- 172.21.15.22:0/839048582 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d000a5e0 con 0x7fa5e00cf040 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5d6000640 1 -- 172.21.15.22:0/839048582 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000a9d0 con 0x7fa5e00cf040 2024-04-16T16:19:19.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e01f47f0 con 0x7fa5e00cf040 2024-04-16T16:19:19.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.864+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e01f4db0 con 0x7fa5e00cf040 2024-04-16T16:19:19.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.866+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e0075f30 con 0x7fa5e00cf040 2024-04-16T16:19:19.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.867+0000 7fa5d6000640 1 -- 172.21.15.22:0/839048582 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fa5d001b070 con 0x7fa5e00cf040 2024-04-16T16:19:19.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.868+0000 7fa5d6000640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa5bc06cbc0 0x7fa5bc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:19.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.868+0000 7fa5d6000640 1 -- 172.21.15.22:0/839048582 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fa5d008b430 con 0x7fa5e00cf040 2024-04-16T16:19:19.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.868+0000 7fa5dde00640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa5bc06cbc0 0x7fa5bc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:19.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.869+0000 7fa5dde00640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa5bc06cbc0 0x7fa5bc06f080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8006fd0 tx=0x7fa5c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:19.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:19.873+0000 7fa5d6000640 1 -- 172.21.15.22:0/839048582 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5d00596f0 con 0x7fa5e00cf040 2024-04-16T16:19:20.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.156+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) -- 0x7fa5e00b40c0 con 0x7fa5e00cf040 2024-04-16T16:19:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.638+0000 7fa5d6000640 1 -- 172.21.15.22:0/839048582 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v151) ==== 165+0+0 (secure 0 0 0) 0x7fa5d0058ff0 con 0x7fa5e00cf040 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa5bc06cbc0 msgr2=0x7fa5bc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa5bc06cbc0 0x7fa5bc06f080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8006fd0 tx=0x7fa5c8008040 comp rx=0 tx=0).stop 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00cf040 msgr2=0x7fa5e01e7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00cf040 0x7fa5e01e7c70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c8c0 tx=0x7fa5d000cd80 comp rx=0 tx=0).stop 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 shutdown_connections 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa5bc06cbc0 0x7fa5bc06f080 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5e0156e90 0x7fa5e015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5e00cf040 0x7fa5e01e7c70 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.642+0000 7fa5df200640 1 --2- 172.21.15.22:0/839048582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e00710c0 0x7fa5e00cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.643+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 >> 172.21.15.22:0/839048582 conn(0x7fa5e00b4400 msgr2=0x7fa5e00b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:20.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.643+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 shutdown_connections 2024-04-16T16:19:20.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.643+0000 7fa5df200640 1 -- 172.21.15.22:0/839048582 wait complete. 2024-04-16T16:19:20.665 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is in failed state and validate the reason ... ok 2024-04-16T16:19:20.666 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during in-progress state and validate the reason 2024-04-16T16:19:20.666 INFO:tasks.cephfs_test_runner:test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-16T16:19:20.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:20.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.894+0000 7fb17d600640 1 Processor -- start 2024-04-16T16:19:20.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.895+0000 7fb17d600640 1 -- start start 2024-04-16T16:19:20.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.896+0000 7fb17d600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb17815c870 0x7fb1780b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:20.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.896+0000 7fb17d600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb17815cc50 0x7fb1780cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:20.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.896+0000 7fb17d600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1780ce4f0 con 0x7fb1780d1080 2024-04-16T16:19:20.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.896+0000 7fb17d600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb1780d0350 con 0x7fb17815c870 2024-04-16T16:19:20.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.896+0000 7fb17d600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb1780d05a0 con 0x7fb17815cc50 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb17cc00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb1780d1080 0x7fb1781605f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46216/0 (socket says 172.21.15.22:46216) 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb17cc00640 1 -- 172.21.15.22:0/1091873420 learned_addr learned my addr 172.21.15.22:0/1091873420 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb177e00640 1 --2- 172.21.15.22:0/1091873420 >> v2:172.21.15.22:3300/0 conn(0x7fb17815c870 0x7fb1780b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb177400640 1 --2- 172.21.15.22:0/1091873420 >> v2:172.21.15.43:3300/0 conn(0x7fb17815cc50 0x7fb1780cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb176a00640 1 -- 172.21.15.22:0/1091873420 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038262850 0 0) 0x7fb1780ce4f0 con 0x7fb1780d1080 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb176a00640 1 -- 172.21.15.22:0/1091873420 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb15c003520 con 0x7fb1780d1080 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb177e00640 1 -- 172.21.15.22:0/1091873420 >> v2:172.21.15.43:3300/0 conn(0x7fb17815cc50 msgr2=0x7fb1780cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb177e00640 1 --2- 172.21.15.22:0/1091873420 >> v2:172.21.15.43:3300/0 conn(0x7fb17815cc50 0x7fb1780cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb177e00640 1 -- 172.21.15.22:0/1091873420 >> v1:172.21.15.22:6789/0 conn(0x7fb1780d1080 legacy=0x7fb1781605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:20.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.897+0000 7fb177e00640 1 -- 172.21.15.22:0/1091873420 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1780d0880 con 0x7fb17815c870 2024-04-16T16:19:20.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.899+0000 7fb177e00640 1 --2- 172.21.15.22:0/1091873420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb17815c870 0x7fb1780b4df0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb1780d04d0 tx=0x7fb16802bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84583d0e68c22357 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:20.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.899+0000 7fb176a00640 1 -- 172.21.15.22:0/1091873420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168039070 con 0x7fb17815c870 2024-04-16T16:19:20.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.899+0000 7fb176a00640 1 -- 172.21.15.22:0/1091873420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16802cb40 con 0x7fb17815c870 2024-04-16T16:19:20.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.899+0000 7fb176a00640 1 -- 172.21.15.22:0/1091873420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168034440 con 0x7fb17815c870 2024-04-16T16:19:20.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.899+0000 7fb17d600640 1 -- 172.21.15.22:0/1091873420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb17815c870 msgr2=0x7fb1780b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.899+0000 7fb17d600640 1 --2- 172.21.15.22:0/1091873420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb17815c870 0x7fb1780b4df0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb1780d04d0 tx=0x7fb16802bd90 comp rx=0 tx=0).stop 2024-04-16T16:19:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.900+0000 7fb17d600640 1 -- 172.21.15.22:0/1091873420 shutdown_connections 2024-04-16T16:19:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.900+0000 7fb17d600640 1 --2- 172.21.15.22:0/1091873420 >> v2:172.21.15.43:3300/0 conn(0x7fb17815cc50 0x7fb1780cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.900+0000 7fb17d600640 1 --2- 172.21.15.22:0/1091873420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb17815c870 0x7fb1780b4df0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.900+0000 7fb17d600640 1 -- 172.21.15.22:0/1091873420 >> 172.21.15.22:0/1091873420 conn(0x7fb1780b42d0 msgr2=0x7fb1780b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.900+0000 7fb17d600640 1 -- 172.21.15.22:0/1091873420 shutdown_connections 2024-04-16T16:19:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.900+0000 7fb17d600640 1 -- 172.21.15.22:0/1091873420 wait complete. 2024-04-16T16:19:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.902+0000 7fb17d600640 1 Processor -- start 2024-04-16T16:19:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.902+0000 7fb17d600640 1 -- start start 2024-04-16T16:19:20.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb17d600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1780d1080 0x7fb1780c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb17d600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb17815c870 0x7fb17806d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb17d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb17815cc50 0x7fb1780c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb17d600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb178160e80 con 0x7fb1780d1080 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb17d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb178160d00 con 0x7fb17815cc50 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb17d600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb1780d14b0 con 0x7fb17815c870 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb177e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1780d1080 0x7fb1780c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb177e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1780d1080 0x7fb1780c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48556/0 (socket says 172.21.15.22:48556) 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.903+0000 7fb177e00640 1 -- 172.21.15.22:0/1153770448 learned_addr learned my addr 172.21.15.22:0/1153770448 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb177e00640 1 -- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb17815c870 msgr2=0x7fb17806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:20.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb177400640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb17815c870 0x7fb17806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb17cc00640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb17815cc50 0x7fb1780c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb177e00640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb17815c870 0x7fb17806d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb177e00640 1 -- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb17815cc50 msgr2=0x7fb1780c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb177e00640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb17815cc50 0x7fb1780c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb177e00640 1 -- 172.21.15.22:0/1153770448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1781e8480 con 0x7fb1780d1080 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb177e00640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1780d1080 0x7fb1780c6270 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb168009e50 tx=0x7fb168004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb16fe00640 1 -- 172.21.15.22:0/1153770448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168039050 con 0x7fb1780d1080 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb16fe00640 1 -- 172.21.15.22:0/1153770448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb168045070 con 0x7fb1780d1080 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb16fe00640 1 -- 172.21.15.22:0/1153770448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16803e870 con 0x7fb1780d1080 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.904+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1781e8740 con 0x7fb1780d1080 2024-04-16T16:19:20.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.905+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1780c5800 con 0x7fb1780d1080 2024-04-16T16:19:20.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.906+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb178075f30 con 0x7fb1780d1080 2024-04-16T16:19:20.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.907+0000 7fb16fe00640 1 -- 172.21.15.22:0/1153770448 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fb16803ea10 con 0x7fb1780d1080 2024-04-16T16:19:20.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.908+0000 7fb16fe00640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb15806cc10 0x7fb15806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:20.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.908+0000 7fb16fe00640 1 -- 172.21.15.22:0/1153770448 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fb1680ae7c0 con 0x7fb1780d1080 2024-04-16T16:19:20.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.908+0000 7fb177400640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb15806cc10 0x7fb15806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:20.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.909+0000 7fb177400640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb15806cc10 0x7fb15806f0d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb164006fd0 tx=0x7fb164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:20.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:20.913+0000 7fb16fe00640 1 -- 172.21.15.22:0/1153770448 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb16804f020 con 0x7fb1780d1080 2024-04-16T16:19:21.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.122+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1780b39d0 con 0x7fb1780d1080 2024-04-16T16:19:21.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.123+0000 7fb16fe00640 1 -- 172.21.15.22:0/1153770448 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+12898 (secure 0 0 0) 0x7fb168032e20 con 0x7fb1780d1080 2024-04-16T16:19:21.122 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:21.122 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":39,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:19:18.616754+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6836/430366264":"2024-04-17T16:19:15.428764+0000","172.21.15.22:6834/430366264":"2024-04-17T16:19:15.428764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:21.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb15806cc10 msgr2=0x7fb15806f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb15806cc10 0x7fb15806f0d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb164006fd0 tx=0x7fb164008040 comp rx=0 tx=0).stop 2024-04-16T16:19:21.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1780d1080 msgr2=0x7fb1780c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1780d1080 0x7fb1780c6270 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb168009e50 tx=0x7fb168004a40 comp rx=0 tx=0).stop 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 shutdown_connections 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb15806cc10 0x7fb15806f0d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb17815cc50 0x7fb1780c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb17815c870 0x7fb17806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 --2- 172.21.15.22:0/1153770448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1780d1080 0x7fb1780c6270 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 >> 172.21.15.22:0/1153770448 conn(0x7fb1780b42d0 msgr2=0x7fb17815d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 shutdown_connections 2024-04-16T16:19:21.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.126+0000 7fb17d600640 1 -- 172.21.15.22:0/1153770448 wait complete. 2024-04-16T16:19:21.144 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:19:21.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:19:21.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.372+0000 7f375be00640 1 Processor -- start 2024-04-16T16:19:21.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.373+0000 7f375be00640 1 -- start start 2024-04-16T16:19:21.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.374+0000 7f375be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f375c15eb40 0x7f375c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.374+0000 7f375be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 0x7f375c0d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.374+0000 7f375be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375c0d3ed0 con 0x7f375c0d3a10 2024-04-16T16:19:21.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.374+0000 7f375be00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f375c0d41b0 con 0x7f375c15eb40 2024-04-16T16:19:21.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.374+0000 7f375be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f375c0d4490 con 0x7f375c0d35d0 2024-04-16T16:19:21.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.374+0000 7f375b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f375c0d3a10 0x7f375c0d47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46218/0 (socket says 172.21.15.22:46218) 2024-04-16T16:19:21.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.374+0000 7f375b400640 1 -- 172.21.15.22:0/4219642377 learned_addr learned my addr 172.21.15.22:0/4219642377 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:21.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f375a000640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 0x7f375c0d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f375aa00640 1 --2- 172.21.15.22:0/4219642377 >> v2:172.21.15.43:3300/0 conn(0x7f375c15eb40 0x7f375c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909333477 0 0) 0x7f375c0d3ed0 con 0x7f375c0d3a10 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3740003520 con 0x7f375c0d3a10 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1675553876 0 0) 0x7f3740003520 con 0x7f375c0d3a10 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 msgr2=0x7f375c0d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 0x7f375c0d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 >> v2:172.21.15.43:3300/0 conn(0x7f375c15eb40 msgr2=0x7f375c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 --2- 172.21.15.22:0/4219642377 >> v2:172.21.15.43:3300/0 conn(0x7f375c15eb40 0x7f375c0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c0b7d90 con 0x7f375c0d3a10 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f37540019f0 con 0x7f375c0d3a10 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 >> v1:172.21.15.22:6789/0 conn(0x7f375c0d3a10 legacy=0x7f375c0d47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37400039b0 0x7f3740003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.375+0000 7f3759600640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f3759600640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 0x7f37400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f375c0d41b0 con 0x7f37400039b0 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f375c0d4490 con 0x7f3740004800 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f374000b9c0 con 0x7f375c0d35d0 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375aa00640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37400039b0 0x7f3740003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375b400640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 0x7f37400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375a000640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375aa00640 1 -- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 msgr2=0x7f37400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375aa00640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 0x7f37400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375aa00640 1 -- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3740004800 msgr2=0x7f3740004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375aa00640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375aa00640 1 -- 172.21.15.22:0/4219642377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3740003520 con 0x7f37400039b0 2024-04-16T16:19:21.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.376+0000 7f375b400640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f375c0d35d0 0x7f37400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.378+0000 7f375aa00640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37400039b0 0x7f3740003dd0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f374c009ac0 tx=0x7f3740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00fd54f5ebdc735 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.378+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c039070 con 0x7f37400039b0 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.378+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f374c02c710 con 0x7f37400039b0 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.378+0000 7f3759600640 1 -- 172.21.15.22:0/4219642377 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c009690 con 0x7f37400039b0 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.379+0000 7f375be00640 1 -- 172.21.15.22:0/4219642377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37400039b0 msgr2=0x7f3740003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.379+0000 7f375be00640 1 --2- 172.21.15.22:0/4219642377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37400039b0 0x7f3740003dd0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f374c009ac0 tx=0x7f3740005830 comp rx=0 tx=0).stop 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.379+0000 7f375b400640 1 -- 172.21.15.22:0/4219642377 reap_dead start 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.379+0000 7f375be00640 1 -- 172.21.15.22:0/4219642377 shutdown_connections 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.379+0000 7f375be00640 1 -- 172.21.15.22:0/4219642377 >> 172.21.15.22:0/4219642377 conn(0x7f375c072460 msgr2=0x7f375c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.379+0000 7f375be00640 1 -- 172.21.15.22:0/4219642377 shutdown_connections 2024-04-16T16:19:21.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.379+0000 7f375be00640 1 -- 172.21.15.22:0/4219642377 wait complete. 2024-04-16T16:19:21.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.381+0000 7f375be00640 1 Processor -- start 2024-04-16T16:19:21.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.381+0000 7f375be00640 1 -- start start 2024-04-16T16:19:21.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37400039b0 0x7f375c153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f375c0ab210 0x7f375c161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375c161ba0 0x7f375c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f375c0b9440 con 0x7f375c161ba0 2024-04-16T16:19:21.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f375c0b92c0 con 0x7f375c0ab210 2024-04-16T16:19:21.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f375c0b95c0 con 0x7f37400039b0 2024-04-16T16:19:21.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375c161ba0 0x7f375c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375c161ba0 0x7f375c0cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48584/0 (socket says 172.21.15.22:48584) 2024-04-16T16:19:21.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.382+0000 7f375b400640 1 -- 172.21.15.22:0/1141738908 learned_addr learned my addr 172.21.15.22:0/1141738908 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375a000640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f375c0ab210 0x7f375c161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375b400640 1 -- 172.21.15.22:0/1141738908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37400039b0 msgr2=0x7f375c153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375b400640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37400039b0 0x7f375c153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375b400640 1 -- 172.21.15.22:0/1141738908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f375c0ab210 msgr2=0x7f375c161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375b400640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f375c0ab210 0x7f375c161660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375b400640 1 -- 172.21.15.22:0/1141738908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c1605c0 con 0x7f375c161ba0 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375b400640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375c161ba0 0x7f375c0cdad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f375c0b7330 tx=0x7f375400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f3752a00640 1 -- 172.21.15.22:0/1141738908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375400bb80 con 0x7f375c161ba0 2024-04-16T16:19:21.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f3752a00640 1 -- 172.21.15.22:0/1141738908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375400bd40 con 0x7f375c161ba0 2024-04-16T16:19:21.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375c1608a0 con 0x7f375c161ba0 2024-04-16T16:19:21.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.383+0000 7f3752a00640 1 -- 172.21.15.22:0/1141738908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37540072b0 con 0x7f375c161ba0 2024-04-16T16:19:21.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.384+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375c160e60 con 0x7f375c161ba0 2024-04-16T16:19:21.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.385+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f375c075f30 con 0x7f375c161ba0 2024-04-16T16:19:21.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.386+0000 7f3752a00640 1 -- 172.21.15.22:0/1141738908 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f375401b020 con 0x7f375c161ba0 2024-04-16T16:19:21.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.387+0000 7f3752a00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f373c06cbc0 0x7f373c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.387+0000 7f3752a00640 1 -- 172.21.15.22:0/1141738908 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f375408c060 con 0x7f375c161ba0 2024-04-16T16:19:21.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.388+0000 7f375aa00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f373c06cbc0 0x7f373c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.388+0000 7f375aa00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f373c06cbc0 0x7f373c06f080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f374c036000 tx=0x7f374c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:21.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.392+0000 7f3752a00640 1 -- 172.21.15.22:0/1141738908 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f375405a2f0 con 0x7f375c161ba0 2024-04-16T16:19:21.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.595+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f375c0ca9f0 con 0x7f375c161ba0 2024-04-16T16:19:21.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.596+0000 7f3752a00640 1 -- 172.21.15.22:0/1141738908 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f3754059bf0 con 0x7f375c161ba0 2024-04-16T16:19:21.594 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:19:21.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f373c06cbc0 msgr2=0x7f373c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f373c06cbc0 0x7f373c06f080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f374c036000 tx=0x7f374c02e000 comp rx=0 tx=0).stop 2024-04-16T16:19:21.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375c161ba0 msgr2=0x7f375c0cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375c161ba0 0x7f375c0cdad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f375c0b7330 tx=0x7f375400b4a0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 shutdown_connections 2024-04-16T16:19:21.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f373c06cbc0 0x7f373c06f080 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375c161ba0 0x7f375c0cdad0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f375c0ab210 0x7f375c161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 --2- 172.21.15.22:0/1141738908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37400039b0 0x7f375c153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 >> 172.21.15.22:0/1141738908 conn(0x7f375c072460 msgr2=0x7f375c0d4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:21.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 shutdown_connections 2024-04-16T16:19:21.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.598+0000 7f375be00640 1 -- 172.21.15.22:0/1141738908 wait complete. 2024-04-16T16:19:21.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2024-04-16T16:19:21.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.851+0000 7f138b400640 1 Processor -- start 2024-04-16T16:19:21.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.851+0000 7f138b400640 1 -- start start 2024-04-16T16:19:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.853+0000 7f138b400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f13840d1100 0x7f13840b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.853+0000 7f138b400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13840b6540 con 0x7f13840721f0 2024-04-16T16:19:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.853+0000 7f138b400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13840b6820 con 0x7f1384159550 2024-04-16T16:19:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.853+0000 7f138b400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1384070060 con 0x7f13840d1100 2024-04-16T16:19:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f1389400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f13840721f0 0x7f1384072600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46232/0 (socket says 172.21.15.22:46232) 2024-04-16T16:19:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f1389400640 1 -- 172.21.15.22:0/62570162 learned_addr learned my addr 172.21.15.22:0/62570162 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f137be00640 1 --2- 172.21.15.22:0/62570162 >> v2:172.21.15.22:3300/0 conn(0x7f13840d1100 0x7f13840b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f1383e00640 1 -- 172.21.15.22:0/62570162 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176782818 0 0) 0x7f13840b6540 con 0x7f13840721f0 2024-04-16T16:19:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f1383e00640 1 -- 172.21.15.22:0/62570162 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1368003520 con 0x7f13840721f0 2024-04-16T16:19:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f137be00640 1 -- 172.21.15.22:0/62570162 >> v1:172.21.15.43:6789/0 conn(0x7f1384159550 legacy=0x7f13840b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f137be00640 1 -- 172.21.15.22:0/62570162 >> v1:172.21.15.22:6789/0 conn(0x7f13840721f0 legacy=0x7f1384072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.854+0000 7f137be00640 1 -- 172.21.15.22:0/62570162 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13840b48b0 con 0x7f13840d1100 2024-04-16T16:19:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.856+0000 7f137be00640 1 --2- 172.21.15.22:0/62570162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840b5cf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa174f80986e784e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.856+0000 7f1383e00640 1 -- 172.21.15.22:0/62570162 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c035020 con 0x7f13840d1100 2024-04-16T16:19:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.856+0000 7f1383e00640 1 -- 172.21.15.22:0/62570162 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c031830 con 0x7f13840d1100 2024-04-16T16:19:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.856+0000 7f1383e00640 1 -- 172.21.15.22:0/62570162 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c031be0 con 0x7f13840d1100 2024-04-16T16:19:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.857+0000 7f138b400640 1 -- 172.21.15.22:0/62570162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 msgr2=0x7f13840b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.857+0000 7f138b400640 1 --2- 172.21.15.22:0/62570162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840b5cf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.857+0000 7f138b400640 1 -- 172.21.15.22:0/62570162 shutdown_connections 2024-04-16T16:19:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.857+0000 7f138b400640 1 --2- 172.21.15.22:0/62570162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840b5cf0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.857+0000 7f138b400640 1 -- 172.21.15.22:0/62570162 >> 172.21.15.22:0/62570162 conn(0x7f13840d1820 msgr2=0x7f13840d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.857+0000 7f138b400640 1 -- 172.21.15.22:0/62570162 shutdown_connections 2024-04-16T16:19:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.857+0000 7f138b400640 1 -- 172.21.15.22:0/62570162 wait complete. 2024-04-16T16:19:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.859+0000 7f138b400640 1 Processor -- start 2024-04-16T16:19:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.859+0000 7f138b400640 1 -- start start 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f138b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13840721f0 0x7f13840ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f138b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f138b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1384159550 0x7f138414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f138b400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f138415be50 con 0x7f13840d1100 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f138b400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1384159930 con 0x7f13840721f0 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f138b400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f138415bfd0 con 0x7f1384159550 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f137be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f137be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48612/0 (socket says 172.21.15.22:48612) 2024-04-16T16:19:21.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.860+0000 7f137be00640 1 -- 172.21.15.22:0/1373914554 learned_addr learned my addr 172.21.15.22:0/1373914554 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f1389400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1384159550 0x7f138414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f1388a00640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13840721f0 0x7f13840ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f137be00640 1 -- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1384159550 msgr2=0x7f138414e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f137be00640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1384159550 0x7f138414e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f137be00640 1 -- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13840721f0 msgr2=0x7f13840ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f137be00640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13840721f0 0x7f13840ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f137be00640 1 -- 172.21.15.22:0/1373914554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13840ceeb0 con 0x7f13840d1100 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f1389400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1384159550 0x7f138414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f137be00640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840c6730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f136c000c00 tx=0x7f136c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.861+0000 7f1381600640 1 -- 172.21.15.22:0/1373914554 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c035070 con 0x7f13840d1100 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.862+0000 7f1381600640 1 -- 172.21.15.22:0/1373914554 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c004230 con 0x7f13840d1100 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.862+0000 7f1381600640 1 -- 172.21.15.22:0/1373914554 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c03a630 con 0x7f13840d1100 2024-04-16T16:19:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.862+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13840cf190 con 0x7f13840d1100 2024-04-16T16:19:21.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.862+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13840cf750 con 0x7f13840d1100 2024-04-16T16:19:21.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.863+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138404fd90 con 0x7f13840d1100 2024-04-16T16:19:21.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.864+0000 7f1381600640 1 -- 172.21.15.22:0/1373914554 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f136c038020 con 0x7f13840d1100 2024-04-16T16:19:21.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.865+0000 7f1381600640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f136006cc40 0x7f136006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:21.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.865+0000 7f1381600640 1 -- 172.21.15.22:0/1373914554 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f136c0ad9b0 con 0x7f13840d1100 2024-04-16T16:19:21.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.865+0000 7f1388a00640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f136006cc40 0x7f136006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:21.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.866+0000 7f1388a00640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f136006cc40 0x7f136006f100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1374000f60 tx=0x7f1374009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:21.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:21.869+0000 7f1381600640 1 -- 172.21.15.22:0/1373914554 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f136c0afe20 con 0x7f13840d1100 2024-04-16T16:19:22.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.146+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) -- 0x7f138406f860 con 0x7f13840d1100 2024-04-16T16:19:22.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.651+0000 7f1381600640 1 -- 172.21.15.22:0/1373914554 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v153) ==== 183+0+0 (secure 0 0 0) 0x7f136c040070 con 0x7f13840d1100 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.655+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f136006cc40 msgr2=0x7f136006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.655+0000 7f138b400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f136006cc40 0x7f136006f100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1374000f60 tx=0x7f1374009040 comp rx=0 tx=0).stop 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.655+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 msgr2=0x7f13840c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.655+0000 7f138b400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840c6730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f136c000c00 tx=0x7f136c0046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 shutdown_connections 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f136006cc40 0x7f136006f100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1384159550 0x7f138414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13840d1100 0x7f13840c6730 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 --2- 172.21.15.22:0/1373914554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13840721f0 0x7f13840ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 >> 172.21.15.22:0/1373914554 conn(0x7f13840d1820 msgr2=0x7f13840b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:22.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 shutdown_connections 2024-04-16T16:19:22.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.656+0000 7f138b400640 1 -- 172.21.15.22:0/1373914554 wait complete. 2024-04-16T16:19:22.679 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T16:19:22.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.904+0000 7f53b3800640 1 Processor -- start 2024-04-16T16:19:22.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.905+0000 7f53b3800640 1 -- start start 2024-04-16T16:19:22.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.906+0000 7f53b3800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:22.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.906+0000 7f53b3800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f53ac162d00 0x7f53ac163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:22.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.906+0000 7f53b3800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ac0d04b0 con 0x7f53ac0b3d60 2024-04-16T16:19:22.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.906+0000 7f53b3800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f53ac163a30 con 0x7f53ac162d00 2024-04-16T16:19:22.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.906+0000 7f53b3800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac0d2f70 con 0x7f53ac0cfb10 2024-04-16T16:19:22.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.907+0000 7f53abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:22.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.907+0000 7f53b1800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f53ac162d00 0x7f53ac163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:22.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.907+0000 7f53abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:56360/0 (socket says 172.21.15.22:56360) 2024-04-16T16:19:22.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.907+0000 7f53abe00640 1 -- 172.21.15.22:0/1861989672 learned_addr learned my addr 172.21.15.22:0/1861989672 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:22.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.908+0000 7f53b1800640 1 -- 172.21.15.22:0/1861989672 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 msgr2=0x7f53ac0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:22.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.908+0000 7f53b1800640 1 --2- 172.21.15.22:0/1861989672 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.908+0000 7f53b1800640 1 -- 172.21.15.22:0/1861989672 >> v1:172.21.15.43:6789/0 conn(0x7f53ac0b3d60 legacy=0x7f53ac0d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:22.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.908+0000 7f53b1800640 1 -- 172.21.15.22:0/1861989672 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac0d3250 con 0x7f53ac162d00 2024-04-16T16:19:22.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.910+0000 7f53b1800640 1 --2- 172.21.15.22:0/1861989672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac163190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009d90 tx=0x7f53a402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4214f35bd3fdb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:22.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.910+0000 7f53ab400640 1 -- 172.21.15.22:0/1861989672 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4039070 con 0x7f53ac162d00 2024-04-16T16:19:22.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.910+0000 7f53ab400640 1 -- 172.21.15.22:0/1861989672 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a402cbc0 con 0x7f53ac162d00 2024-04-16T16:19:22.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.910+0000 7f53ab400640 1 -- 172.21.15.22:0/1861989672 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4034440 con 0x7f53ac162d00 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 -- 172.21.15.22:0/1861989672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 msgr2=0x7f53ac163190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 --2- 172.21.15.22:0/1861989672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac163190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009d90 tx=0x7f53a402be10 comp rx=0 tx=0).stop 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 -- 172.21.15.22:0/1861989672 shutdown_connections 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 --2- 172.21.15.22:0/1861989672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac163190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 --2- 172.21.15.22:0/1861989672 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 -- 172.21.15.22:0/1861989672 >> 172.21.15.22:0/1861989672 conn(0x7f53ac062860 msgr2=0x7f53ac062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 -- 172.21.15.22:0/1861989672 shutdown_connections 2024-04-16T16:19:22.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.911+0000 7f53b3800640 1 -- 172.21.15.22:0/1861989672 wait complete. 2024-04-16T16:19:22.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.913+0000 7f53b3800640 1 Processor -- start 2024-04-16T16:19:22.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.913+0000 7f53b3800640 1 -- start start 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b3800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ac0b3d60 0x7f53ac0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b3800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b3800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac14fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b3800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac0b4140 con 0x7f53ac0b3d60 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b3800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac0d3810 con 0x7f53ac162d00 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b3800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac1636d0 con 0x7f53ac0cfb10 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b0e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ac0b3d60 0x7f53ac0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b0e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ac0b3d60 0x7f53ac0ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48620/0 (socket says 172.21.15.22:48620) 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b0e00640 1 -- 172.21.15.22:0/1554189099 learned_addr learned my addr 172.21.15.22:0/1554189099 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53b1800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac14fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:22.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.915+0000 7f53abe00640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:22.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b0e00640 1 -- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 msgr2=0x7f53ac0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b0e00640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b0e00640 1 -- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 msgr2=0x7f53ac14fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b0e00640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac14fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b0e00640 1 -- 172.21.15.22:0/1554189099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac14ddd0 con 0x7f53ac0b3d60 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b1800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac14fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b0e00640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ac0b3d60 0x7f53ac0ce480 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c3f0 tx=0x7f53a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53a8c00640 1 -- 172.21.15.22:0/1554189099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a00052d0 con 0x7f53ac0b3d60 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53a8c00640 1 -- 172.21.15.22:0/1554189099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a0005490 con 0x7f53ac0b3d60 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53a8c00640 1 -- 172.21.15.22:0/1554189099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0007260 con 0x7f53ac0b3d60 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.916+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac14e0b0 con 0x7f53ac0b3d60 2024-04-16T16:19:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.917+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac0cbbe0 con 0x7f53ac0b3d60 2024-04-16T16:19:22.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.918+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac04fd90 con 0x7f53ac0b3d60 2024-04-16T16:19:22.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.919+0000 7f53a8c00640 1 -- 172.21.15.22:0/1554189099 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f53a0007400 con 0x7f53ac0b3d60 2024-04-16T16:19:22.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.920+0000 7f53a8c00640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f538c06cbf0 0x7f538c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:22.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.920+0000 7f53a8c00640 1 -- 172.21.15.22:0/1554189099 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f53a008b1e0 con 0x7f53ac0b3d60 2024-04-16T16:19:22.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.920+0000 7f53abe00640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f538c06cbf0 0x7f538c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:22.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.921+0000 7f53abe00640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f538c06cbf0 0x7f538c06f0b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0b3640 tx=0x7f5398008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:22.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:22.925+0000 7f53a8c00640 1 -- 172.21.15.22:0/1554189099 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53a00594f0 con 0x7f53ac0b3d60 2024-04-16T16:19:23.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.127+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f53ac0d58f0 con 0x7f53ac0b3d60 2024-04-16T16:19:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.135+0000 7f53a8c00640 1 -- 172.21.15.22:0/1554189099 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f53a0058df0 con 0x7f53ac0b3d60 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.137+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f538c06cbf0 msgr2=0x7f538c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.137+0000 7f53b3800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f538c06cbf0 0x7f538c06f0b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0b3640 tx=0x7f5398008040 comp rx=0 tx=0).stop 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.137+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ac0b3d60 msgr2=0x7f53ac0ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.137+0000 7f53b3800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ac0b3d60 0x7f53ac0ce480 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c3f0 tx=0x7f53a000c8b0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 shutdown_connections 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f538c06cbf0 0x7f538c06f0b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac162d00 0x7f53ac14fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac0cfb10 0x7f53ac0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 --2- 172.21.15.22:0/1554189099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53ac0b3d60 0x7f53ac0ce480 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 >> 172.21.15.22:0/1554189099 conn(0x7f53ac062860 msgr2=0x7f53ac0b9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 shutdown_connections 2024-04-16T16:19:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.138+0000 7f53b3800640 1 -- 172.21.15.22:0/1554189099 wait complete. 2024-04-16T16:19:23.157 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T16:19:23.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:19:23.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:19:23.409 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T16:19:23.410 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:23.410 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:23.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:19:23.468 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:19:23.468 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:23.530 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:19:23.530 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:23.530 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:23.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:19:23.589 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:19:23.589 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:23.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:19:23.650 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-16T16:19:23.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:19:23.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.883+0000 7f948ec00640 1 Processor -- start 2024-04-16T16:19:23.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.883+0000 7f948ec00640 1 -- start start 2024-04-16T16:19:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.885+0000 7f948ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 0x7f94880d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.885+0000 7f948ec00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f94880d0a80 0x7f948806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.885+0000 7f948ec00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94880af0b0 con 0x7f94881478c0 2024-04-16T16:19:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.885+0000 7f948ec00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f94880d0ef0 con 0x7f94880d0a80 2024-04-16T16:19:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.885+0000 7f948ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f94880af950 con 0x7f9488163340 2024-04-16T16:19:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.886+0000 7f9487e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f94881478c0 0x7f94880ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46242/0 (socket says 172.21.15.22:46242) 2024-04-16T16:19:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.886+0000 7f9487e00640 1 -- 172.21.15.22:0/332247467 learned_addr learned my addr 172.21.15.22:0/332247467 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.886+0000 7f948cc00640 1 --2- 172.21.15.22:0/332247467 >> v2:172.21.15.43:3300/0 conn(0x7f94880d0a80 0x7f948806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.886+0000 7f9487400640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 0x7f94880d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.886+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685335623 0 0) 0x7f94880af0b0 con 0x7f94881478c0 2024-04-16T16:19:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.886+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f946c003520 con 0x7f94881478c0 2024-04-16T16:19:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3035392834 0 0) 0x7f946c003520 con 0x7f94881478c0 2024-04-16T16:19:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 msgr2=0x7f94880d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 0x7f94880d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 >> v2:172.21.15.43:3300/0 conn(0x7f94880d0a80 msgr2=0x7f948806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 --2- 172.21.15.22:0/332247467 >> v2:172.21.15.43:3300/0 conn(0x7f94880d0a80 0x7f948806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94880af390 con 0x7f94881478c0 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f9478001670 con 0x7f94881478c0 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 >> v1:172.21.15.22:6789/0 conn(0x7f94881478c0 legacy=0x7f94880ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 0x7f946c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f946c003fb0 0x7f946c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f946c004d40 0x7f946c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f94880d0ef0 con 0x7f946c003fb0 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f946c00ba20 con 0x7f946c004d40 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f946c00bc20 con 0x7f9488163340 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.887+0000 7f9487400640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f946c003fb0 0x7f946c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f9487e00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 0x7f946c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f948cc00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f946c004d40 0x7f946c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f9487400640 1 -- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 msgr2=0x7f946c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f9487400640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 0x7f946c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f9487400640 1 -- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f946c004d40 msgr2=0x7f946c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f9487400640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f946c004d40 0x7f946c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f9487400640 1 -- 172.21.15.22:0/332247467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c003520 con 0x7f946c003fb0 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f9487e00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488163340 0x7f946c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.888+0000 7f948cc00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f946c004d40 0x7f946c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.889+0000 7f9487400640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f946c003fb0 0x7f946c004800 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9474009ac0 tx=0x7f946c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d24ac1f30b04c57 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.889+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474039070 con 0x7f946c003fb0 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.889+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947402c6b0 con 0x7f946c003fb0 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.889+0000 7f9486a00640 1 -- 172.21.15.22:0/332247467 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474009690 con 0x7f946c003fb0 2024-04-16T16:19:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.890+0000 7f948ec00640 1 -- 172.21.15.22:0/332247467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f946c003fb0 msgr2=0x7f946c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.890+0000 7f948ec00640 1 --2- 172.21.15.22:0/332247467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f946c003fb0 0x7f946c004800 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9474009ac0 tx=0x7f946c005830 comp rx=0 tx=0).stop 2024-04-16T16:19:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.890+0000 7f948cc00640 1 -- 172.21.15.22:0/332247467 reap_dead start 2024-04-16T16:19:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.890+0000 7f948ec00640 1 -- 172.21.15.22:0/332247467 shutdown_connections 2024-04-16T16:19:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.890+0000 7f948ec00640 1 -- 172.21.15.22:0/332247467 >> 172.21.15.22:0/332247467 conn(0x7f9488062440 msgr2=0x7f9488062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.890+0000 7f948ec00640 1 -- 172.21.15.22:0/332247467 shutdown_connections 2024-04-16T16:19:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.890+0000 7f948ec00640 1 -- 172.21.15.22:0/332247467 wait complete. 2024-04-16T16:19:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.892+0000 7f948ec00640 1 Processor -- start 2024-04-16T16:19:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.892+0000 7f948ec00640 1 -- start start 2024-04-16T16:19:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.893+0000 7f948ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946c003fb0 0x7f94881432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.893+0000 7f948ec00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9488130000 0x7f9488131840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.893+0000 7f948ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f948815e630 0x7f94880c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.893+0000 7f948ec00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f94880d0540 con 0x7f9488130000 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.893+0000 7f948ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9488147ca0 con 0x7f948815e630 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.893+0000 7f948ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f94880d06c0 con 0x7f946c003fb0 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9488130000 0x7f9488131840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9488130000 0x7f9488131840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48644/0 (socket says 172.21.15.22:48644) 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 -- 172.21.15.22:0/2328307590 learned_addr learned my addr 172.21.15.22:0/2328307590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487e00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946c003fb0 0x7f94881432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f948cc00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f948815e630 0x7f94880c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 -- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946c003fb0 msgr2=0x7f94881432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946c003fb0 0x7f94881432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 -- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f948815e630 msgr2=0x7f94880c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f948815e630 0x7f94880c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f9487400640 1 -- 172.21.15.22:0/2328307590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94881307a0 con 0x7f9488130000 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.894+0000 7f948cc00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f948815e630 0x7f94880c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.895+0000 7f9487400640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9488130000 0x7f9488131840 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9474009ac0 tx=0x7f9474004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.895+0000 7f947fe00640 1 -- 172.21.15.22:0/2328307590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474039050 con 0x7f9488130000 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.895+0000 7f947fe00640 1 -- 172.21.15.22:0/2328307590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474045070 con 0x7f9488130000 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.895+0000 7f947fe00640 1 -- 172.21.15.22:0/2328307590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94740044e0 con 0x7f9488130000 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.895+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9488130a80 con 0x7f9488130000 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.895+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9488131040 con 0x7f9488130000 2024-04-16T16:19:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.896+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94880694b0 con 0x7f9488130000 2024-04-16T16:19:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.897+0000 7f947fe00640 1 -- 172.21.15.22:0/2328307590 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f9474003850 con 0x7f9488130000 2024-04-16T16:19:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.898+0000 7f947fe00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f946806cbc0 0x7f946806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.898+0000 7f947fe00640 1 -- 172.21.15.22:0/2328307590 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f94740ad300 con 0x7f9488130000 2024-04-16T16:19:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.898+0000 7f9487e00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f946806cbc0 0x7f946806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.899+0000 7f9487e00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f946806cbc0 0x7f946806f080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9478001eb0 tx=0x7f9478009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:23.903+0000 7f947fe00640 1 -- 172.21.15.22:0/2328307590 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94880694b0 con 0x7f9488130000 2024-04-16T16:19:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.145+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f948804fd90 con 0x7f9488130000 2024-04-16T16:19:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.146+0000 7f947fe00640 1 -- 172.21.15.22:0/2328307590 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3869 (secure 0 0 0) 0x7f947407b610 con 0x7f9488130000 2024-04-16T16:19:24.146 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:24.147 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/2477236609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2477236609},{"type":"v1","addr":"172.21.15.43:6834","nonce":2477236609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2059330399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2059330399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2059330399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/4293003845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":4293003845},{"type":"v1","addr":"172.21.15.22:6837","nonce":4293003845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3269729974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3269729974},{"type":"v1","addr":"172.21.15.22:6836","nonce":3269729974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-04-16T16:19:24.147 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 19 2024-04-16T16:19:24.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f946806cbc0 msgr2=0x7f946806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f946806cbc0 0x7f946806f080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9478001eb0 tx=0x7f9478009040 comp rx=0 tx=0).stop 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9488130000 msgr2=0x7f9488131840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9488130000 0x7f9488131840 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9474009ac0 tx=0x7f9474004730 comp rx=0 tx=0).stop 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 shutdown_connections 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f946806cbc0 0x7f946806f080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f948815e630 0x7f94880c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9488130000 0x7f9488131840 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 --2- 172.21.15.22:0/2328307590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946c003fb0 0x7f94881432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 >> 172.21.15.22:0/2328307590 conn(0x7f9488062440 msgr2=0x7f9488071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:24.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 shutdown_connections 2024-04-16T16:19:24.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.149+0000 7f948ec00640 1 -- 172.21.15.22:0/2328307590 wait complete. 2024-04-16T16:19:24.168 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T16:19:24.168 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T16:19:24.168 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T16:19:24.168 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:19:24.169 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T16:19:24.169 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-16T16:19:24.169 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T16:19:24.169 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:19:24.169 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T16:19:24.170 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T16:19:24.170 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T16:19:24.170 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:19:24.170 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T16:19:24.170 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-16T16:19:24.171 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T16:19:24.171 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:19:24.187 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T16:19:24.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T16:19:24.190 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T16:19:24.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T16:19:24.192 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T16:19:24.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T16:19:24.196 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T16:19:24.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T16:19:24.238 INFO:tasks.ceph.mds.c:Started 2024-04-16T16:19:24.238 DEBUG:teuthology.parallel:result is None 2024-04-16T16:19:24.243 INFO:tasks.ceph.mds.b:Started 2024-04-16T16:19:24.244 DEBUG:teuthology.parallel:result is None 2024-04-16T16:19:24.245 INFO:tasks.ceph.mds.a:Started 2024-04-16T16:19:24.245 DEBUG:teuthology.parallel:result is None 2024-04-16T16:19:24.250 INFO:tasks.ceph.mds.d:Started 2024-04-16T16:19:24.251 DEBUG:teuthology.parallel:result is None 2024-04-16T16:19:24.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T16:19:24.398 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2024-04-16T16:19:24.398 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2024-04-16T16:19:24.410 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-04-16T16:19:24.411 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-04-16T16:19:24.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.444+0000 7f5ac6600640 1 Processor -- start 2024-04-16T16:19:24.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.444+0000 7f5ac6600640 1 -- start start 2024-04-16T16:19:24.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.445+0000 7f5ac6600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:24.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.445+0000 7f5ac6600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac00d4650 con 0x7f5ac00d1770 2024-04-16T16:19:24.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.445+0000 7f5ac6600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac015ef10 con 0x7f5ac00d2fb0 2024-04-16T16:19:24.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.445+0000 7f5ac6600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac00d1bb0 con 0x7f5ac015eb30 2024-04-16T16:19:24.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5abfe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5ac00d1770 0x7f5ac00d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46264/0 (socket says 172.21.15.22:46264) 2024-04-16T16:19:24.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5abfe00640 1 -- 172.21.15.22:0/559170818 learned_addr learned my addr 172.21.15.22:0/559170818 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:24.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5ac5200640 1 --2- 172.21.15.22:0/559170818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:24.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5abf400640 1 -- 172.21.15.22:0/559170818 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896582313 0 0) 0x7f5ac00d4650 con 0x7f5ac00d1770 2024-04-16T16:19:24.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5abf400640 1 -- 172.21.15.22:0/559170818 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa8003520 con 0x7f5ac00d1770 2024-04-16T16:19:24.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5abf400640 1 -- 172.21.15.22:0/559170818 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679013217 0 0) 0x7f5ac015ef10 con 0x7f5ac00d2fb0 2024-04-16T16:19:24.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5ac5200640 1 -- 172.21.15.22:0/559170818 >> v1:172.21.15.43:6789/0 conn(0x7f5ac00d2fb0 legacy=0x7f5ac00b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:24.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.446+0000 7f5ac5200640 1 -- 172.21.15.22:0/559170818 >> v1:172.21.15.22:6789/0 conn(0x7f5ac00d1770 legacy=0x7f5ac00d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:24.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.447+0000 7f5ac5200640 1 -- 172.21.15.22:0/559170818 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00d35b0 con 0x7f5ac015eb30 2024-04-16T16:19:24.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.448+0000 7f5ac5200640 1 --2- 172.21.15.22:0/559170818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00d1230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40097d0 tx=0x7f5ab402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3b49e4b3f38d7ca server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.448+0000 7f5abf400640 1 -- 172.21.15.22:0/559170818 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4034070 con 0x7f5ac015eb30 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.448+0000 7f5abf400640 1 -- 172.21.15.22:0/559170818 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab4030800 con 0x7f5ac015eb30 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.448+0000 7f5abf400640 1 -- 172.21.15.22:0/559170818 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4030bd0 con 0x7f5ac015eb30 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.449+0000 7f5ac6600640 1 -- 172.21.15.22:0/559170818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 msgr2=0x7f5ac00d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.449+0000 7f5ac6600640 1 --2- 172.21.15.22:0/559170818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00d1230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40097d0 tx=0x7f5ab402b940 comp rx=0 tx=0).stop 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.449+0000 7f5ac6600640 1 -- 172.21.15.22:0/559170818 shutdown_connections 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.449+0000 7f5ac6600640 1 --2- 172.21.15.22:0/559170818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00d1230 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.449+0000 7f5ac6600640 1 -- 172.21.15.22:0/559170818 >> 172.21.15.22:0/559170818 conn(0x7f5ac0072670 msgr2=0x7f5ac0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.449+0000 7f5ac6600640 1 -- 172.21.15.22:0/559170818 shutdown_connections 2024-04-16T16:19:24.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.449+0000 7f5ac6600640 1 -- 172.21.15.22:0/559170818 wait complete. 2024-04-16T16:19:24.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.451+0000 7f5ac6600640 1 Processor -- start 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.451+0000 7f5ac6600640 1 -- start start 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac6600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ac00d1770 0x7f5ac00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00d2fb0 0x7f5ac014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac6600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac6600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00d3e50 con 0x7f5ac00d1770 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac6600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00d3b70 con 0x7f5ac00d2fb0 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac6600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac00d4130 con 0x7f5ac015eb30 2024-04-16T16:19:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ac00d1770 0x7f5ac00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ac00d1770 0x7f5ac00cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48680/0 (socket says 172.21.15.22:48680) 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac5200640 1 -- 172.21.15.22:0/2378872278 learned_addr learned my addr 172.21.15.22:0/2378872278 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5ac5c00640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.452+0000 7f5abfe00640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00d2fb0 0x7f5ac014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac5200640 1 -- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 msgr2=0x7f5ac00c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac5200640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac5200640 1 -- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00d2fb0 msgr2=0x7f5ac014ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac5200640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00d2fb0 0x7f5ac014ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac5200640 1 -- 172.21.15.22:0/2378872278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00c9cf0 con 0x7f5ac00d1770 2024-04-16T16:19:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac5200640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ac00d1770 0x7f5ac00cad90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000c00 tx=0x7f5ab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5abcc00640 1 -- 172.21.15.22:0/2378872278 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4048070 con 0x7f5ac00d1770 2024-04-16T16:19:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5abcc00640 1 -- 172.21.15.22:0/2378872278 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab4030600 con 0x7f5ac00d1770 2024-04-16T16:19:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac00c9fd0 con 0x7f5ac00d1770 2024-04-16T16:19:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5abcc00640 1 -- 172.21.15.22:0/2378872278 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4034040 con 0x7f5ac00d1770 2024-04-16T16:19:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.453+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac00ca590 con 0x7f5ac00d1770 2024-04-16T16:19:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.455+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac0075f30 con 0x7f5ac00d1770 2024-04-16T16:19:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.455+0000 7f5abcc00640 1 -- 172.21.15.22:0/2378872278 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f5ab404b070 con 0x7f5ac00d1770 2024-04-16T16:19:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.456+0000 7f5abcc00640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5aa006cbf0 0x7f5aa006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.457+0000 7f5abcc00640 1 -- 172.21.15.22:0/2378872278 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f5ab40adb30 con 0x7f5ac00d1770 2024-04-16T16:19:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.457+0000 7f5abfe00640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5aa006cbf0 0x7f5aa006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.458+0000 7f5abfe00640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5aa006cbf0 0x7f5aa006f0b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5ac01f7e80 tx=0x7f5aac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.461+0000 7f5abcc00640 1 -- 172.21.15.22:0/2378872278 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ab407be50 con 0x7f5ac00d1770 2024-04-16T16:19:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:24.684+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5ac00b8e10 con 0x7f5ac00d1770 2024-04-16T16:19:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.694+0000 7f5abcc00640 1 -- 172.21.15.22:0/2378872278 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) ==== 97+0+0 (secure 0 0 0) 0x7f5ab407b750 con 0x7f5ac00d1770 2024-04-16T16:19:25.694 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5aa006cbf0 msgr2=0x7f5aa006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5aa006cbf0 0x7f5aa006f0b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5ac01f7e80 tx=0x7f5aac009040 comp rx=0 tx=0).stop 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ac00d1770 msgr2=0x7f5ac00cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ac00d1770 0x7f5ac00cad90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000c00 tx=0x7f5ab40046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 shutdown_connections 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5aa006cbf0 0x7f5aa006f0b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ac015eb30 0x7f5ac00c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00d2fb0 0x7f5ac014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 --2- 172.21.15.22:0/2378872278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ac00d1770 0x7f5ac00cad90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.699+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 >> 172.21.15.22:0/2378872278 conn(0x7f5ac0072670 msgr2=0x7f5ac00b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.700+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 shutdown_connections 2024-04-16T16:19:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.700+0000 7f5ac6600640 1 -- 172.21.15.22:0/2378872278 wait complete. 2024-04-16T16:19:25.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T16:19:25.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.932+0000 7fbf88600640 1 Processor -- start 2024-04-16T16:19:25.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.933+0000 7fbf88600640 1 -- start start 2024-04-16T16:19:25.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.934+0000 7fbf88600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf800cf3e0 0x7fbf800cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:25.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.934+0000 7fbf88600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf800d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:25.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.934+0000 7fbf88600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf800cfe40 con 0x7fbf800b3830 2024-04-16T16:19:25.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.934+0000 7fbf88600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbf800cdf50 con 0x7fbf800cf3e0 2024-04-16T16:19:25.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.934+0000 7fbf88600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbf800ce510 con 0x7fbf80160440 2024-04-16T16:19:25.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf85c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf800cf3e0 0x7fbf800cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:25.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf85c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf800cf3e0 0x7fbf800cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48684/0 (socket says 172.21.15.22:48684) 2024-04-16T16:19:25.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf85c00640 1 -- 172.21.15.22:0/895674052 learned_addr learned my addr 172.21.15.22:0/895674052 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:25.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf86600640 1 --2- 172.21.15.22:0/895674052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf800d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:25.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf85c00640 1 -- 172.21.15.22:0/895674052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 msgr2=0x7fbf800d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:25.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf85c00640 1 --2- 172.21.15.22:0/895674052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf800d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf85c00640 1 -- 172.21.15.22:0/895674052 >> v1:172.21.15.43:6789/0 conn(0x7fbf800b3830 legacy=0x7fbf8015fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:25.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.935+0000 7fbf85c00640 1 -- 172.21.15.22:0/895674052 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf800d00e0 con 0x7fbf800cf3e0 2024-04-16T16:19:25.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.937+0000 7fbf85c00640 1 --2- 172.21.15.22:0/895674052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf800cf7c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009870 tx=0x7fbf7002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b9dd9982215ef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.937+0000 7fbf7fe00640 1 -- 172.21.15.22:0/895674052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70034070 con 0x7fbf800cf3e0 2024-04-16T16:19:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.937+0000 7fbf7fe00640 1 -- 172.21.15.22:0/895674052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf70030840 con 0x7fbf800cf3e0 2024-04-16T16:19:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.937+0000 7fbf7fe00640 1 -- 172.21.15.22:0/895674052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70030c10 con 0x7fbf800cf3e0 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 -- 172.21.15.22:0/895674052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 msgr2=0x7fbf800cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 --2- 172.21.15.22:0/895674052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf800cf7c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009870 tx=0x7fbf7002b980 comp rx=0 tx=0).stop 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 -- 172.21.15.22:0/895674052 shutdown_connections 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 --2- 172.21.15.22:0/895674052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf800d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 --2- 172.21.15.22:0/895674052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf800cf7c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 -- 172.21.15.22:0/895674052 >> 172.21.15.22:0/895674052 conn(0x7fbf800d2930 msgr2=0x7fbf800d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 -- 172.21.15.22:0/895674052 shutdown_connections 2024-04-16T16:19:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.938+0000 7fbf88600640 1 -- 172.21.15.22:0/895674052 wait complete. 2024-04-16T16:19:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.940+0000 7fbf88600640 1 Processor -- start 2024-04-16T16:19:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.940+0000 7fbf88600640 1 -- start start 2024-04-16T16:19:25.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf88600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf800b3830 0x7fbf800c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:25.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf88600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf80156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:25.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf88600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf8014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:25.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf88600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800b5900 con 0x7fbf800cf3e0 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf88600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800b5780 con 0x7fbf800b3830 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf88600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbf800b5a80 con 0x7fbf80160440 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf85200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf80156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf85200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf80156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48692/0 (socket says 172.21.15.22:48692) 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.941+0000 7fbf85200640 1 -- 172.21.15.22:0/283425547 learned_addr learned my addr 172.21.15.22:0/283425547 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf85c00640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf800b3830 0x7fbf800c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf86600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf8014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf85200640 1 -- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 msgr2=0x7fbf8014beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf85200640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf8014beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf85200640 1 -- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf800b3830 msgr2=0x7fbf800c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf85200640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf800b3830 0x7fbf800c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf85200640 1 -- 172.21.15.22:0/283425547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf80149bd0 con 0x7fbf800cf3e0 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf85200640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf80156ac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00c7c0 tx=0x7fbf6c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.942+0000 7fbf7d600640 1 -- 172.21.15.22:0/283425547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c016020 con 0x7fbf800cf3e0 2024-04-16T16:19:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.943+0000 7fbf7d600640 1 -- 172.21.15.22:0/283425547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c006d50 con 0x7fbf800cf3e0 2024-04-16T16:19:25.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.943+0000 7fbf7d600640 1 -- 172.21.15.22:0/283425547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c003bb0 con 0x7fbf800cf3e0 2024-04-16T16:19:25.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.943+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf800c7ee0 con 0x7fbf800cf3e0 2024-04-16T16:19:25.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.943+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf800c84a0 con 0x7fbf800cf3e0 2024-04-16T16:19:25.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.944+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf8004fd90 con 0x7fbf800cf3e0 2024-04-16T16:19:25.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.945+0000 7fbf7d600640 1 -- 172.21.15.22:0/283425547 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fbf6c00a850 con 0x7fbf800cf3e0 2024-04-16T16:19:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.946+0000 7fbf7d600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbf6006cbc0 0x7fbf6006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.946+0000 7fbf7d600640 1 -- 172.21.15.22:0/283425547 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7fbf6c08b9e0 con 0x7fbf800cf3e0 2024-04-16T16:19:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.946+0000 7fbf85c00640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbf6006cbc0 0x7fbf6006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.947+0000 7fbf85c00640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbf6006cbc0 0x7fbf6006f080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbf70036000 tx=0x7fbf7003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:25.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:25.951+0000 7fbf7d600640 1 -- 172.21.15.22:0/283425547 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf6c020020 con 0x7fbf800cf3e0 2024-04-16T16:19:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.230+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbf800cebf0 con 0x7fbf800cf3e0 2024-04-16T16:19:26.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.232+0000 7fbf7d600640 1 -- 172.21.15.22:0/283425547 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fbf6c019310 con 0x7fbf800cf3e0 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5maPz2BxAAivyrcX8Q0RVwbHZKA4d4Qw==", 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:19:26.232 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5mWRiSKhAANQmBIwdBnXhI5EGtK2c86g==", 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.233 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5mqenxGBAAjtp8wD4KQJxzHvXwFiGhOw==", 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mjhgTARAAGaEgDRX6W3PVFW0MCREAlg==", 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.234 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAvpB5mOTo2JxAAv8ODGhoblmotI4MCQe6yFg==", 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.235 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAypB5m+sawMxAAnAne7tM6gWBZtKrFrv53WA==", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA2pB5mr/n9BRAA8Cg5a95OxPY//SZrLgt5iQ==", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA5pB5mzNRPFBAArNK/lgB2DkkAP/cZ8uD+Vg==", 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA+pB5mW52mERAAub8dzTaWbs/HB3ZLiwua+Q==", 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.237 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBBpB5mXWImHRAAWuZAlqR/+YQikJD4n34FUQ==", 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBEpB5mgBf6KhAAqcT5kTzdBSoQR6+MdHRIBA==", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBIpB5mhwmwCxAA33jQ9ARJ1dCc0D2CjzyaZA==", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:19:26.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw==", 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mnxe/JxAAbmM9S9qN7oeLgRvCGkAxMA==", 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.240 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mfNS0GxAAeD6JDkePBk6Zlda+ku47+g==", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mumHtMhAA4utGeU4f5JWOEHCvpo3Onw==", 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAqpB5moKzeMxAAQT7umjghe+/+tmNzbOi7ZQ==", 2024-04-16T16:19:26.242 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQArpB5mApKSNhAAAgDOhVl6JdS2WqfiNmMpQQ==", 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:19:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQArpB5mcdOSKRAAF92yoRpysHC1g6FsLdqIYw==", 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-16T16:19:26.244 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:19:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbf6006cbc0 msgr2=0x7fbf6006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbf6006cbc0 0x7fbf6006f080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbf70036000 tx=0x7fbf7003b040 comp rx=0 tx=0).stop 2024-04-16T16:19:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 msgr2=0x7fbf80156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf80156ac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00c7c0 tx=0x7fbf6c00cc80 comp rx=0 tx=0).stop 2024-04-16T16:19:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 shutdown_connections 2024-04-16T16:19:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbf6006cbc0 0x7fbf6006f080 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf80160440 0x7fbf8014beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf800cf3e0 0x7fbf80156ac0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 --2- 172.21.15.22:0/283425547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf800b3830 0x7fbf800c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 >> 172.21.15.22:0/283425547 conn(0x7fbf800d2930 msgr2=0x7fbf800b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 shutdown_connections 2024-04-16T16:19:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.235+0000 7fbf88600640 1 -- 172.21.15.22:0/283425547 wait complete. 2024-04-16T16:19:26.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.480+0000 7f73c6800640 1 Processor -- start 2024-04-16T16:19:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.480+0000 7f73c6800640 1 -- start start 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.481+0000 7f73c6800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f73c006eaa0 0x7f73c00b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c6800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 0x7f73c006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c6800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c006d160 con 0x7f73c006ee80 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c6800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f73c006cf10 con 0x7f73c006eaa0 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c6800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f73c006d440 con 0x7f73c00cc810 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c5e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f73c006ee80 0x7f73c015c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46268/0 (socket says 172.21.15.22:46268) 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c5e00640 1 -- 172.21.15.22:0/2605841099 learned_addr learned my addr 172.21.15.22:0/2605841099 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c5400640 1 --2- 172.21.15.22:0/2605841099 >> v2:172.21.15.43:3300/0 conn(0x7f73c006eaa0 0x7f73c00b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.482+0000 7f73c4a00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 0x7f73c006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909372257 0 0) 0x7f73c006d160 con 0x7f73c006ee80 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73a8003520 con 0x7f73c006ee80 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1446156846 0 0) 0x7f73a8003520 con 0x7f73c006ee80 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 msgr2=0x7f73c006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 0x7f73c006df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 >> v2:172.21.15.43:3300/0 conn(0x7f73c006eaa0 msgr2=0x7f73c00b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 --2- 172.21.15.22:0/2605841099 >> v2:172.21.15.43:3300/0 conn(0x7f73c006eaa0 0x7f73c00b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c006d720 con 0x7f73c006ee80 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f73b80019f0 con 0x7f73c006ee80 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 >> v1:172.21.15.22:6789/0 conn(0x7f73c006ee80 legacy=0x7f73c015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 0x7f73a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8003f80 0x7f73a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73a8004d40 0x7f73a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f73c006cf10 con 0x7f73a8004d40 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73c006d440 con 0x7f73a8003f80 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f73a800b9c0 con 0x7f73c00cc810 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.483+0000 7f73c5e00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73a8004d40 0x7f73a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c4a00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8003f80 0x7f73a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c5400640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 0x7f73a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c5e00640 1 -- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 msgr2=0x7f73a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c5e00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 0x7f73a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c5e00640 1 -- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8003f80 msgr2=0x7f73a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c5e00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8003f80 0x7f73a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c5e00640 1 -- 172.21.15.22:0/2605841099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a8003520 con 0x7f73a8004d40 2024-04-16T16:19:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.484+0000 7f73c5400640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00cc810 0x7f73a80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.485+0000 7f73c5e00640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73a8004d40 0x7f73a80051c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f73b800a7d0 tx=0x7f73a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff52e23f37bfbce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.485+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800a3f0 con 0x7f73a8004d40 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.485+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b8034630 con 0x7f73a8004d40 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.485+0000 7f73bfe00640 1 -- 172.21.15.22:0/2605841099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8034a80 con 0x7f73a8004d40 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.486+0000 7f73c6800640 1 -- 172.21.15.22:0/2605841099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73a8004d40 msgr2=0x7f73a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.486+0000 7f73c6800640 1 --2- 172.21.15.22:0/2605841099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73a8004d40 0x7f73a80051c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f73b800a7d0 tx=0x7f73a8005830 comp rx=0 tx=0).stop 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.486+0000 7f73c5e00640 1 -- 172.21.15.22:0/2605841099 reap_dead start 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.486+0000 7f73c6800640 1 -- 172.21.15.22:0/2605841099 shutdown_connections 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.486+0000 7f73c6800640 1 -- 172.21.15.22:0/2605841099 >> 172.21.15.22:0/2605841099 conn(0x7f73c0062440 msgr2=0x7f73c0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.486+0000 7f73c6800640 1 -- 172.21.15.22:0/2605841099 shutdown_connections 2024-04-16T16:19:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.486+0000 7f73c6800640 1 -- 172.21.15.22:0/2605841099 wait complete. 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.488+0000 7f73c6800640 1 Processor -- start 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.488+0000 7f73c6800640 1 -- start start 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8004d40 0x7f73c015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c6800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00aaef0 0x7f73c014bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73c00ad6f0 0x7f73c00ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c6800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f73c015c910 con 0x7f73c00ad6f0 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c6800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00b4360 con 0x7f73a8004d40 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c6800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f73c015ca90 con 0x7f73c00aaef0 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73c00ad6f0 0x7f73c00ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73c00ad6f0 0x7f73c00ab610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48698/0 (socket says 172.21.15.22:48698) 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.489+0000 7f73c5e00640 1 -- 172.21.15.22:0/4149235870 learned_addr learned my addr 172.21.15.22:0/4149235870 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c4a00640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00aaef0 0x7f73c014bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c5400640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8004d40 0x7f73c015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c5e00640 1 -- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00aaef0 msgr2=0x7f73c014bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c5e00640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00aaef0 0x7f73c014bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c5e00640 1 -- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8004d40 msgr2=0x7f73c015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c5e00640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8004d40 0x7f73c015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c5e00640 1 -- 172.21.15.22:0/4149235870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c0158740 con 0x7f73c00ad6f0 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c4a00640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00aaef0 0x7f73c014bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c5e00640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73c00ad6f0 0x7f73c00ab610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f73b802cbc0 tx=0x7f73c006d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73bd600640 1 -- 172.21.15.22:0/4149235870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8001f30 con 0x7f73c00ad6f0 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73bd600640 1 -- 172.21.15.22:0/4149235870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b803a040 con 0x7f73c00ad6f0 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73bd600640 1 -- 172.21.15.22:0/4149235870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800a3d0 con 0x7f73c00ad6f0 2024-04-16T16:19:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.490+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c0158a20 con 0x7f73c00ad6f0 2024-04-16T16:19:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.491+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c0158fe0 con 0x7f73c00ad6f0 2024-04-16T16:19:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.492+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c0075f30 con 0x7f73c00ad6f0 2024-04-16T16:19:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.493+0000 7f73bd600640 1 -- 172.21.15.22:0/4149235870 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f73b8034630 con 0x7f73c00ad6f0 2024-04-16T16:19:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.494+0000 7f73bd600640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f73a006cbc0 0x7f73a006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.494+0000 7f73bd600640 1 -- 172.21.15.22:0/4149235870 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7f73b80ad700 con 0x7f73c00ad6f0 2024-04-16T16:19:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.494+0000 7f73c5400640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f73a006cbc0 0x7f73a006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.495+0000 7f73c5400640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f73a006cbc0 0x7f73a006f080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009b20 tx=0x7f73b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:26.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.499+0000 7f73bd600640 1 -- 172.21.15.22:0/4149235870 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73b8048070 con 0x7f73c00ad6f0 2024-04-16T16:19:26.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.699+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73c00b4b70 con 0x7f73c00ad6f0 2024-04-16T16:19:26.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.701+0000 7f73bd600640 1 -- 172.21.15.22:0/4149235870 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+12771 (secure 0 0 0) 0x7f73b807ba70 con 0x7f73c00ad6f0 2024-04-16T16:19:26.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:26.702 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":44,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:19:25.691944+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f73a006cbc0 msgr2=0x7f73a006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f73a006cbc0 0x7f73a006f080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009b20 tx=0x7f73b4008040 comp rx=0 tx=0).stop 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73c00ad6f0 msgr2=0x7f73c00ab610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73c00ad6f0 0x7f73c00ab610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f73b802cbc0 tx=0x7f73c006d8f0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 shutdown_connections 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f73a006cbc0 0x7f73a006f080 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73c00ad6f0 0x7f73c00ab610 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73c00aaef0 0x7f73c014bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 --2- 172.21.15.22:0/4149235870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73a8004d40 0x7f73c015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 >> 172.21.15.22:0/4149235870 conn(0x7f73c0062440 msgr2=0x7f73c00afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 shutdown_connections 2024-04-16T16:19:26.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.705+0000 7f73c6800640 1 -- 172.21.15.22:0/4149235870 wait complete. 2024-04-16T16:19:26.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:19:26.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:19:26.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.947+0000 7f1cdbe00640 1 Processor -- start 2024-04-16T16:19:26.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.947+0000 7f1cdbe00640 1 -- start start 2024-04-16T16:19:26.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.948+0000 7f1cdbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1cdc0cf1a0 0x7f1cdc160860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.948+0000 7f1cdbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0d31b0 0x7f1cdc160da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.948+0000 7f1cdbe00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc0cec70 con 0x7f1cdc0cf580 2024-04-16T16:19:26.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.948+0000 7f1cdbe00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1cdc0ce990 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.948+0000 7f1cdbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc0b5510 con 0x7f1cdc0d31b0 2024-04-16T16:19:26.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cdaa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1cdc0cf1a0 0x7f1cdc160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cdb400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1cdc0cf580 0x7f1cdc0b5ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46282/0 (socket says 172.21.15.22:46282) 2024-04-16T16:19:26.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cdb400640 1 -- 172.21.15.22:0/3058260786 learned_addr learned my addr 172.21.15.22:0/3058260786 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:26.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cda000640 1 --2- 172.21.15.22:0/3058260786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0d31b0 0x7f1cdc160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cdaa00640 1 -- 172.21.15.22:0/3058260786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0d31b0 msgr2=0x7f1cdc160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:26.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cdaa00640 1 --2- 172.21.15.22:0/3058260786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0d31b0 0x7f1cdc160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cdaa00640 1 -- 172.21.15.22:0/3058260786 >> v1:172.21.15.22:6789/0 conn(0x7f1cdc0cf580 legacy=0x7f1cdc0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.949+0000 7f1cdaa00640 1 -- 172.21.15.22:0/3058260786 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc0b57f0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.950+0000 7f1cdaa00640 1 --2- 172.21.15.22:0/3058260786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc160860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009d90 tx=0x7f1ccc02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41e5d347a7c8ace server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:26.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.951+0000 7f1cd9600640 1 -- 172.21.15.22:0/3058260786 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc039070 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.951+0000 7f1cd9600640 1 -- 172.21.15.22:0/3058260786 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc02ccf0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.951+0000 7f1cd9600640 1 -- 172.21.15.22:0/3058260786 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc034660 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.951+0000 7f1cdbe00640 1 -- 172.21.15.22:0/3058260786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 msgr2=0x7f1cdc160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.952+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/3058260786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc160860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009d90 tx=0x7f1ccc02bf40 comp rx=0 tx=0).stop 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.952+0000 7f1cdbe00640 1 -- 172.21.15.22:0/3058260786 shutdown_connections 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.952+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/3058260786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0d31b0 0x7f1cdc160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.952+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/3058260786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc160860 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.952+0000 7f1cdbe00640 1 -- 172.21.15.22:0/3058260786 >> 172.21.15.22:0/3058260786 conn(0x7f1cdc0d2620 msgr2=0x7f1cdc0d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.952+0000 7f1cdbe00640 1 -- 172.21.15.22:0/3058260786 shutdown_connections 2024-04-16T16:19:26.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.952+0000 7f1cdbe00640 1 -- 172.21.15.22:0/3058260786 wait complete. 2024-04-16T16:19:26.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.953+0000 7f1cdbe00640 1 Processor -- start 2024-04-16T16:19:26.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.954+0000 7f1cdbe00640 1 -- start start 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.954+0000 7f1cdbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0cf580 0x7f1cdc1e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cdc0d31b0 0x7f1cdc15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdbe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc0ce730 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc0ce5b0 con 0x7f1cdc0d31b0 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc0cdfb0 con 0x7f1cdc0cf580 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc0cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48726/0 (socket says 172.21.15.22:48726) 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 -- 172.21.15.22:0/2687963818 learned_addr learned my addr 172.21.15.22:0/2687963818 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:26.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 -- 172.21.15.22:0/2687963818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0cf580 msgr2=0x7f1cdc1e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0cf580 0x7f1cdc1e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 -- 172.21.15.22:0/2687963818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cdc0d31b0 msgr2=0x7f1cdc15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:26.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cdc0d31b0 0x7f1cdc15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:26.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.955+0000 7f1cdaa00640 1 -- 172.21.15.22:0/2687963818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc15d620 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.956+0000 7f1cdaa00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc0cadb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc037040 tx=0x7f1ccc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:26.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.956+0000 7f1cd3400640 1 -- 172.21.15.22:0/2687963818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc039050 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.956+0000 7f1cd3400640 1 -- 172.21.15.22:0/2687963818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc045070 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.956+0000 7f1cd3400640 1 -- 172.21.15.22:0/2687963818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc03e850 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.956+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc15d900 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.956+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc15dec0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.957+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cdc075f30 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.958+0000 7f1cd3400640 1 -- 172.21.15.22:0/2687963818 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f1ccc03e9f0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.959+0000 7f1cd3400640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1cbc06cbc0 0x7f1cbc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:26.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.959+0000 7f1cd3400640 1 -- 172.21.15.22:0/2687963818 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7f1ccc0aebd0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:26.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.960+0000 7f1cda000640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1cbc06cbc0 0x7f1cbc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:26.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.960+0000 7f1cda000640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1cbc06cbc0 0x7f1cbc06f080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:26.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:26.964+0000 7f1cd3400640 1 -- 172.21.15.22:0/2687963818 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ccc07d0e0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:27.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.168+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1cdc0733a0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:27.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.168+0000 7f1cd3400640 1 -- 172.21.15.22:0/2687963818 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) ==== 93+0+10 (secure 0 0 0) 0x7f1ccc07c9e0 con 0x7f1cdc0cf1a0 2024-04-16T16:19:27.168 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1cbc06cbc0 msgr2=0x7f1cbc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1cbc06cbc0 0x7f1cbc06f080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 msgr2=0x7f1cdc0cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc0cadb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc037040 tx=0x7f1ccc004a40 comp rx=0 tx=0).stop 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 shutdown_connections 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1cbc06cbc0 0x7f1cbc06f080 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cdc0d31b0 0x7f1cdc15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cdc0cf580 0x7f1cdc1e6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 --2- 172.21.15.22:0/2687963818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cdc0cf1a0 0x7f1cdc0cadb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 >> 172.21.15.22:0/2687963818 conn(0x7f1cdc0d2620 msgr2=0x7f1cdc0b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 shutdown_connections 2024-04-16T16:19:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.171+0000 7f1cdbe00640 1 -- 172.21.15.22:0/2687963818 wait complete. 2024-04-16T16:19:27.189 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T16:19:27.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.410+0000 7fbcf3200640 1 Processor -- start 2024-04-16T16:19:27.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.410+0000 7fbcf3200640 1 -- start start 2024-04-16T16:19:27.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.411+0000 7fbcf3200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbcf415c860 0x7fbcf40ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.411+0000 7fbcf3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf40cfc30 0x7fbcf40b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.411+0000 7fbcf3200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf40b4460 con 0x7fbcf40d04a0 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf3200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf40d0090 con 0x7fbcf415c860 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf40ceb90 con 0x7fbcf40cfc30 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf1e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbcf415c860 0x7fbcf40ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf1e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbcf415c860 0x7fbcf40ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48728/0 (socket says 172.21.15.22:48728) 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf1e00640 1 -- 172.21.15.22:0/2482606882 learned_addr learned my addr 172.21.15.22:0/2482606882 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf2800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbcf40d04a0 0x7fbcf406cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46296/0 (socket says 172.21.15.22:46296) 2024-04-16T16:19:27.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf1400640 1 --2- 172.21.15.22:0/2482606882 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf40cfc30 0x7fbcf40b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf1e00640 1 -- 172.21.15.22:0/2482606882 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf40cfc30 msgr2=0x7fbcf40b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:27.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf1e00640 1 --2- 172.21.15.22:0/2482606882 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf40cfc30 0x7fbcf40b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.412+0000 7fbcf1e00640 1 -- 172.21.15.22:0/2482606882 >> v1:172.21.15.22:6789/0 conn(0x7fbcf40d04a0 legacy=0x7fbcf406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.413+0000 7fbcf1e00640 1 -- 172.21.15.22:0/2482606882 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf40cee70 con 0x7fbcf415c860 2024-04-16T16:19:27.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.413+0000 7fbcf0a00640 1 -- 172.21.15.22:0/2482606882 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 172062071 0 0) 0x7fbcf40b4460 con 0x7fbcf40d04a0 2024-04-16T16:19:27.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.414+0000 7fbcf1e00640 1 --2- 172.21.15.22:0/2482606882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf415c860 0x7fbcf40ce4d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009870 tx=0x7fbcdc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543f9ed768ad8dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:27.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.414+0000 7fbcf0a00640 1 -- 172.21.15.22:0/2482606882 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc034070 con 0x7fbcf415c860 2024-04-16T16:19:27.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.414+0000 7fbcf0a00640 1 -- 172.21.15.22:0/2482606882 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcdc030840 con 0x7fbcf415c860 2024-04-16T16:19:27.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.414+0000 7fbcf0a00640 1 -- 172.21.15.22:0/2482606882 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc030c10 con 0x7fbcf415c860 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 -- 172.21.15.22:0/2482606882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf415c860 msgr2=0x7fbcf40ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 --2- 172.21.15.22:0/2482606882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf415c860 0x7fbcf40ce4d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009870 tx=0x7fbcdc02b980 comp rx=0 tx=0).stop 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 -- 172.21.15.22:0/2482606882 shutdown_connections 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 --2- 172.21.15.22:0/2482606882 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf40cfc30 0x7fbcf40b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 --2- 172.21.15.22:0/2482606882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf415c860 0x7fbcf40ce4d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 -- 172.21.15.22:0/2482606882 >> 172.21.15.22:0/2482606882 conn(0x7fbcf4062440 msgr2=0x7fbcf4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 -- 172.21.15.22:0/2482606882 shutdown_connections 2024-04-16T16:19:27.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.415+0000 7fbcf3200640 1 -- 172.21.15.22:0/2482606882 wait complete. 2024-04-16T16:19:27.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.417+0000 7fbcf3200640 1 Processor -- start 2024-04-16T16:19:27.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.417+0000 7fbcf3200640 1 -- start start 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf40cfc30 0x7fbcf415a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf40d04a0 0x7fbcf414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf415c860 0x7fbcf414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf40cf710 con 0x7fbcf40cfc30 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf40cf430 con 0x7fbcf40d04a0 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf415cc40 con 0x7fbcf415c860 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf40cfc30 0x7fbcf415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf40cfc30 0x7fbcf415a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48734/0 (socket says 172.21.15.22:48734) 2024-04-16T16:19:27.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.418+0000 7fbcf1e00640 1 -- 172.21.15.22:0/3008975962 learned_addr learned my addr 172.21.15.22:0/3008975962 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1400640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf40d04a0 0x7fbcf414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1e00640 1 -- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf415c860 msgr2=0x7fbcf414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf2800640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf415c860 0x7fbcf414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1e00640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf415c860 0x7fbcf414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1e00640 1 -- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf40d04a0 msgr2=0x7fbcf414dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1e00640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf40d04a0 0x7fbcf414dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1e00640 1 -- 172.21.15.22:0/3008975962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf40ac100 con 0x7fbcf40cfc30 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf2800640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf415c860 0x7fbcf414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1400640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf40d04a0 0x7fbcf414dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcf1e00640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf40cfc30 0x7fbcf415a930 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc000c00 tx=0x7fbcdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcea000640 1 -- 172.21.15.22:0/3008975962 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc034040 con 0x7fbcf40cfc30 2024-04-16T16:19:27.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcea000640 1 -- 172.21.15.22:0/3008975962 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcdc039d90 con 0x7fbcf40cfc30 2024-04-16T16:19:27.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.419+0000 7fbcea000640 1 -- 172.21.15.22:0/3008975962 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc043610 con 0x7fbcf40cfc30 2024-04-16T16:19:27.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.420+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf40ac3e0 con 0x7fbcf40cfc30 2024-04-16T16:19:27.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.420+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf40ac9a0 con 0x7fbcf40cfc30 2024-04-16T16:19:27.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.421+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf4075f30 con 0x7fbcf40cfc30 2024-04-16T16:19:27.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.422+0000 7fbcea000640 1 -- 172.21.15.22:0/3008975962 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fbcdc04a060 con 0x7fbcf40cfc30 2024-04-16T16:19:27.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.422+0000 7fbcea000640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbcd006cbc0 0x7fbcd006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.423+0000 7fbcea000640 1 -- 172.21.15.22:0/3008975962 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7fbcdc0add60 con 0x7fbcf40cfc30 2024-04-16T16:19:27.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.423+0000 7fbcf1400640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbcd006cbc0 0x7fbcd006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.424+0000 7fbcf1400640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbcd006cbc0 0x7fbcd006f080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbcf41f80c0 tx=0x7fbce4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:27.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.427+0000 7fbcea000640 1 -- 172.21.15.22:0/3008975962 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbcdc03e070 con 0x7fbcf40cfc30 2024-04-16T16:19:27.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.633+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbcf40b4fa0 con 0x7fbcf40cfc30 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.634+0000 7fbcea000640 1 -- 172.21.15.22:0/3008975962 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) ==== 84+0+65 (secure 0 0 0) 0x7fbcdc07c110 con 0x7fbcf40cfc30 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:27.634 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-04-16T16:19:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.636+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbcd006cbc0 msgr2=0x7fbcd006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.636+0000 7fbcf3200640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbcd006cbc0 0x7fbcd006f080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbcf41f80c0 tx=0x7fbce4008040 comp rx=0 tx=0).stop 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.636+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf40cfc30 msgr2=0x7fbcf415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.636+0000 7fbcf3200640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf40cfc30 0x7fbcf415a930 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc000c00 tx=0x7fbcdc0046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 shutdown_connections 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbcd006cbc0 0x7fbcd006f080 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcf415c860 0x7fbcf414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf40d04a0 0x7fbcf414dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 --2- 172.21.15.22:0/3008975962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcf40cfc30 0x7fbcf415a930 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 >> 172.21.15.22:0/3008975962 conn(0x7fbcf4062440 msgr2=0x7fbcf415cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 shutdown_connections 2024-04-16T16:19:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.637+0000 7fbcf3200640 1 -- 172.21.15.22:0/3008975962 wait complete. 2024-04-16T16:19:27.654 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T16:19:27.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T16:19:27.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.877+0000 7fe773e00640 1 Processor -- start 2024-04-16T16:19:27.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.877+0000 7fe773e00640 1 -- start start 2024-04-16T16:19:27.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.879+0000 7fe773e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe774141a80 0x7fe7740cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.879+0000 7fe773e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740af550 con 0x7fe7740ce510 2024-04-16T16:19:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.879+0000 7fe773e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740af7e0 con 0x7fe7740af140 2024-04-16T16:19:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.879+0000 7fe773e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe774142190 con 0x7fe774141a80 2024-04-16T16:19:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.879+0000 7fe772000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe7740ce510 0x7fe7740aea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46298/0 (socket says 172.21.15.22:46298) 2024-04-16T16:19:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.879+0000 7fe772000640 1 -- 172.21.15.22:0/1560375039 learned_addr learned my addr 172.21.15.22:0/1560375039 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.879+0000 7fe772a00640 1 --2- 172.21.15.22:0/1560375039 >> v2:172.21.15.43:3300/0 conn(0x7fe774141a80 0x7fe7740cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810736363 0 0) 0x7fe7740af550 con 0x7fe7740ce510 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe758003520 con 0x7fe7740ce510 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2894731652 0 0) 0x7fe758003520 con 0x7fe7740ce510 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 >> v2:172.21.15.43:3300/0 conn(0x7fe774141a80 msgr2=0x7fe7740cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 --2- 172.21.15.22:0/1560375039 >> v2:172.21.15.43:3300/0 conn(0x7fe774141a80 0x7fe7740cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 >> v1:172.21.15.43:6789/0 conn(0x7fe7740af140 legacy=0x7fe774142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe774142470 con 0x7fe7740ce510 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fe760001670 con 0x7fe7740ce510 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 >> v1:172.21.15.22:6789/0 conn(0x7fe7740ce510 legacy=0x7fe7740aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7580039b0 0x7fe758003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe758004800 0x7fe758004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7580051c0 0x7fe75800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe774142190 con 0x7fe758004800 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe75800c160 con 0x7fe7580051c0 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.880+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe75800c360 con 0x7fe7580039b0 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe772000640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe758004800 0x7fe758004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe773400640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7580051c0 0x7fe75800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe772000640 1 -- 172.21.15.22:0/1560375039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7580039b0 msgr2=0x7fe758003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe772000640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7580039b0 0x7fe758003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe772000640 1 -- 172.21.15.22:0/1560375039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7580051c0 msgr2=0x7fe75800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe772000640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7580051c0 0x7fe75800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe772000640 1 -- 172.21.15.22:0/1560375039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe758003520 con 0x7fe758004800 2024-04-16T16:19:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.881+0000 7fe773400640 1 -- 172.21.15.22:0/1560375039 reap_dead start 2024-04-16T16:19:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.882+0000 7fe772000640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe758004800 0x7fe758004c80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c240 tx=0x7fe758005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542ecbb3c7c55afb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.882+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760007d10 con 0x7fe758004800 2024-04-16T16:19:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.882+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760030070 con 0x7fe758004800 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.882+0000 7fe771600640 1 -- 172.21.15.22:0/1560375039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76002cda0 con 0x7fe758004800 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.883+0000 7fe773e00640 1 -- 172.21.15.22:0/1560375039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe758004800 msgr2=0x7fe758004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.883+0000 7fe773e00640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe758004800 0x7fe758004c80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c240 tx=0x7fe758005830 comp rx=0 tx=0).stop 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.883+0000 7fe773e00640 1 -- 172.21.15.22:0/1560375039 shutdown_connections 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.883+0000 7fe773e00640 1 --2- 172.21.15.22:0/1560375039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe758004800 0x7fe758004c80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.883+0000 7fe773e00640 1 -- 172.21.15.22:0/1560375039 >> 172.21.15.22:0/1560375039 conn(0x7fe7740b2110 msgr2=0x7fe7740b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.883+0000 7fe773e00640 1 -- 172.21.15.22:0/1560375039 shutdown_connections 2024-04-16T16:19:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.883+0000 7fe773e00640 1 -- 172.21.15.22:0/1560375039 wait complete. 2024-04-16T16:19:27.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.885+0000 7fe773e00640 1 Processor -- start 2024-04-16T16:19:27.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.885+0000 7fe773e00640 1 -- start start 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.886+0000 7fe773e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe758004800 0x7fe774138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.886+0000 7fe773e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7741396f0 0x7fe77413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.886+0000 7fe773e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe77413fed0 0x7fe7741f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.886+0000 7fe773e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe77406ce90 con 0x7fe7741396f0 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.886+0000 7fe773e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe774142a30 con 0x7fe77413fed0 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.886+0000 7fe773e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe77406d010 con 0x7fe758004800 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.886+0000 7fe772000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7741396f0 0x7fe77413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7741396f0 0x7fe77413f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48752/0 (socket says 172.21.15.22:48752) 2024-04-16T16:19:27.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 -- 172.21.15.22:0/551117523 learned_addr learned my addr 172.21.15.22:0/551117523 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772a00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe758004800 0x7fe774138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 -- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe758004800 msgr2=0x7fe774138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe758004800 0x7fe774138640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 -- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe77413fed0 msgr2=0x7fe7741f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe773400640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe77413fed0 0x7fe7741f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe77413fed0 0x7fe7741f7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 -- 172.21.15.22:0/551117523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7741f8a40 con 0x7fe7741396f0 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.887+0000 7fe772000640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7741396f0 0x7fe77413f990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c360 tx=0x7fe76002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.888+0000 7fe76b400640 1 -- 172.21.15.22:0/551117523 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760007d10 con 0x7fe7741396f0 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.888+0000 7fe76b400640 1 -- 172.21.15.22:0/551117523 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760004bf0 con 0x7fe7741396f0 2024-04-16T16:19:27.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.888+0000 7fe76b400640 1 -- 172.21.15.22:0/551117523 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760007070 con 0x7fe7741396f0 2024-04-16T16:19:27.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.888+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe774137b60 con 0x7fe7741396f0 2024-04-16T16:19:27.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.888+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe774138120 con 0x7fe7741396f0 2024-04-16T16:19:27.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.889+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe774075f30 con 0x7fe7741396f0 2024-04-16T16:19:27.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.890+0000 7fe76b400640 1 -- 172.21.15.22:0/551117523 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fe760048020 con 0x7fe7741396f0 2024-04-16T16:19:27.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.891+0000 7fe76b400640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe75406cbc0 0x7fe75406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:27.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.891+0000 7fe76b400640 1 -- 172.21.15.22:0/551117523 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7fe7600ad250 con 0x7fe7741396f0 2024-04-16T16:19:27.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.891+0000 7fe772a00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe75406cbc0 0x7fe75406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:27.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.892+0000 7fe772a00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe75406cbc0 0x7fe75406f080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe7640099f0 tx=0x7fe764008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:27.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:27.896+0000 7fe76b400640 1 -- 172.21.15.22:0/551117523 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe76007b6d0 con 0x7fe7741396f0 2024-04-16T16:19:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.101+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe7741402b0 con 0x7fe7741396f0 2024-04-16T16:19:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.716+0000 7fe76b400640 1 -- 172.21.15.22:0/551117523 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) ==== 138+0+0 (secure 0 0 0) 0x7fe76007afd0 con 0x7fe7741396f0 2024-04-16T16:19:28.716 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.719+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe75406cbc0 msgr2=0x7fe75406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.719+0000 7fe773e00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe75406cbc0 0x7fe75406f080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe7640099f0 tx=0x7fe764008040 comp rx=0 tx=0).stop 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.719+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7741396f0 msgr2=0x7fe77413f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.719+0000 7fe773e00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7741396f0 0x7fe77413f990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c360 tx=0x7fe76002e070 comp rx=0 tx=0).stop 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 shutdown_connections 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe75406cbc0 0x7fe75406f080 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe77413fed0 0x7fe7741f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7741396f0 0x7fe77413f990 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 --2- 172.21.15.22:0/551117523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe758004800 0x7fe774138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 >> 172.21.15.22:0/551117523 conn(0x7fe7740b2110 msgr2=0x7fe7740b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:28.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 shutdown_connections 2024-04-16T16:19:28.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.720+0000 7fe773e00640 1 -- 172.21.15.22:0/551117523 wait complete. 2024-04-16T16:19:28.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T16:19:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.975+0000 7fb0d5000640 1 Processor -- start 2024-04-16T16:19:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.975+0000 7fb0d5000640 1 -- start start 2024-04-16T16:19:28.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.977+0000 7fb0d5000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb0d0072e30 0x7fb0d006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.977+0000 7fb0d5000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d006cf80 con 0x7fb0d015c6e0 2024-04-16T16:19:28.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.977+0000 7fb0d5000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d006d260 con 0x7fb0d00af930 2024-04-16T16:19:28.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.977+0000 7fb0d5000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d006d540 con 0x7fb0d0072e30 2024-04-16T16:19:28.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.977+0000 7fb0cf400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb0d015c6e0 0x7fb0d0072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46302/0 (socket says 172.21.15.22:46302) 2024-04-16T16:19:28.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.977+0000 7fb0cf400640 1 -- 172.21.15.22:0/2946416420 learned_addr learned my addr 172.21.15.22:0/2946416420 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:28.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0cea00640 1 --2- 172.21.15.22:0/2946416420 >> v2:172.21.15.43:3300/0 conn(0x7fb0d0072e30 0x7fb0d006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399563844 0 0) 0x7fb0d006cf80 con 0x7fb0d015c6e0 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0b4003520 con 0x7fb0d015c6e0 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 619306458 0 0) 0x7fb0b4003520 con 0x7fb0d015c6e0 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 >> v2:172.21.15.43:3300/0 conn(0x7fb0d0072e30 msgr2=0x7fb0d006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 --2- 172.21.15.22:0/2946416420 >> v2:172.21.15.43:3300/0 conn(0x7fb0d0072e30 0x7fb0d006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 >> v1:172.21.15.43:6789/0 conn(0x7fb0d00af930 legacy=0x7fb0d00ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d006d820 con 0x7fb0d015c6e0 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fb0c0001670 con 0x7fb0d015c6e0 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 >> v1:172.21.15.22:6789/0 conn(0x7fb0d015c6e0 legacy=0x7fb0d0072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0b40039b0 0x7fb0b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b4004800 0x7fb0b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0b40051c0 0x7fb0b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d006d540 con 0x7fb0b40051c0 2024-04-16T16:19:28.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b400c060 con 0x7fb0b40039b0 2024-04-16T16:19:28.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.978+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b400c260 con 0x7fb0b4004800 2024-04-16T16:19:28.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cfe00640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0b40051c0 0x7fb0b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cf400640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0b40039b0 0x7fb0b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cea00640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b4004800 0x7fb0b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b4004800 msgr2=0x7fb0b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cfe00640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b4004800 0x7fb0b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0b40039b0 msgr2=0x7fb0b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cfe00640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0b40039b0 0x7fb0b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.979+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2946416420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b4003520 con 0x7fb0b40051c0 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.980+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2946416420 reap_dead start 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.981+0000 7fb0cfe00640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0b40051c0 0x7fb0b400b9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8001e50 tx=0x7fb0b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f201d446e43eb79 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.981+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8001a70 con 0x7fb0b40051c0 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.981+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c8003bb0 con 0x7fb0b40051c0 2024-04-16T16:19:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.981+0000 7fb0ce000640 1 -- 172.21.15.22:0/2946416420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80050d0 con 0x7fb0b40051c0 2024-04-16T16:19:28.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.981+0000 7fb0d5000640 1 -- 172.21.15.22:0/2946416420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0b40051c0 msgr2=0x7fb0b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:28.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.981+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0b40051c0 0x7fb0b400b9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8001e50 tx=0x7fb0b4005830 comp rx=0 tx=0).stop 2024-04-16T16:19:28.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.981+0000 7fb0d5000640 1 -- 172.21.15.22:0/2946416420 shutdown_connections 2024-04-16T16:19:28.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.982+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2946416420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0b40051c0 0x7fb0b400b9c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.982+0000 7fb0d5000640 1 -- 172.21.15.22:0/2946416420 >> 172.21.15.22:0/2946416420 conn(0x7fb0d0062440 msgr2=0x7fb0d0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:28.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.982+0000 7fb0d5000640 1 -- 172.21.15.22:0/2946416420 shutdown_connections 2024-04-16T16:19:28.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.982+0000 7fb0d5000640 1 -- 172.21.15.22:0/2946416420 wait complete. 2024-04-16T16:19:28.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.984+0000 7fb0d5000640 1 Processor -- start 2024-04-16T16:19:28.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.984+0000 7fb0d5000640 1 -- start start 2024-04-16T16:19:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0d5000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b40051c0 0x7fb0d0146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0d5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d01e6250 0x7fb0d01e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0d5000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0d00b2830 0x7fb0d01446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0d5000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d015cc40 con 0x7fb0d00b2830 2024-04-16T16:19:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0d5000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d015cac0 con 0x7fb0d01e6250 2024-04-16T16:19:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0d5000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d006e940 con 0x7fb0b40051c0 2024-04-16T16:19:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0d00b2830 0x7fb0d01446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0d00b2830 0x7fb0d01446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48770/0 (socket says 172.21.15.22:48770) 2024-04-16T16:19:28.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.985+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2336505973 learned_addr learned my addr 172.21.15.22:0/2336505973 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:28.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cf400640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b40051c0 0x7fb0d0146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cea00640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d01e6250 0x7fb0d01e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b40051c0 msgr2=0x7fb0d0146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cfe00640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b40051c0 0x7fb0d0146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d01e6250 msgr2=0x7fb0d01e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cfe00640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d01e6250 0x7fb0d01e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cfe00640 1 -- 172.21.15.22:0/2336505973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d00b1790 con 0x7fb0d00b2830 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.986+0000 7fb0cfe00640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0d00b2830 0x7fb0d01446a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb0c802c060 tx=0x7fb0c80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.987+0000 7fb0c7400640 1 -- 172.21.15.22:0/2336505973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8006d60 con 0x7fb0d00b2830 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.987+0000 7fb0c7400640 1 -- 172.21.15.22:0/2336505973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c8007030 con 0x7fb0d00b2830 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.987+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d00b1a70 con 0x7fb0d00b2830 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.987+0000 7fb0c7400640 1 -- 172.21.15.22:0/2336505973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8007420 con 0x7fb0d00b2830 2024-04-16T16:19:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.987+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d00b2030 con 0x7fb0d00b2830 2024-04-16T16:19:28.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.988+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d0075f30 con 0x7fb0d00b2830 2024-04-16T16:19:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.989+0000 7fb0c7400640 1 -- 172.21.15.22:0/2336505973 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fb0c80075c0 con 0x7fb0d00b2830 2024-04-16T16:19:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.990+0000 7fb0c7400640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0b006cbc0 0x7fb0b006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.991+0000 7fb0c7400640 1 -- 172.21.15.22:0/2336505973 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5227+0+0 (secure 0 0 0) 0x7fb0c80ae100 con 0x7fb0d00b2830 2024-04-16T16:19:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.991+0000 7fb0cf400640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0b006cbc0 0x7fb0b006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.992+0000 7fb0cf400640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0b006cbc0 0x7fb0b006f080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0001050 tx=0x7fb0c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:28.996+0000 7fb0c7400640 1 -- 172.21.15.22:0/2336505973 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0c8033030 con 0x7fb0d00b2830 2024-04-16T16:19:29.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.200+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb0d0063230 con 0x7fb0d00b2830 2024-04-16T16:19:29.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.723+0000 7fb0c7400640 1 -- 172.21.15.22:0/2336505973 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) ==== 170+0+0 (secure 0 0 0) 0x7fb0c807c1e0 con 0x7fb0d00b2830 2024-04-16T16:19:29.724 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-04-16T16:19:29.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0b006cbc0 msgr2=0x7fb0b006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:29.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0b006cbc0 0x7fb0b006f080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0001050 tx=0x7fb0c0009040 comp rx=0 tx=0).stop 2024-04-16T16:19:29.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0d00b2830 msgr2=0x7fb0d01446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:29.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0d00b2830 0x7fb0d01446a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb0c802c060 tx=0x7fb0c80014a0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 shutdown_connections 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb0b006cbc0 0x7fb0b006f080 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0d00b2830 0x7fb0d01446a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d01e6250 0x7fb0d01e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 --2- 172.21.15.22:0/2336505973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0b40051c0 0x7fb0d0146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 >> 172.21.15.22:0/2336505973 conn(0x7fb0d0062440 msgr2=0x7fb0d00b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.727+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 shutdown_connections 2024-04-16T16:19:29.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.728+0000 7fb0d5000640 1 -- 172.21.15.22:0/2336505973 wait complete. 2024-04-16T16:19:29.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T16:19:29.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.952+0000 7f12bb400640 1 Processor -- start 2024-04-16T16:19:29.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.953+0000 7f12bb400640 1 -- start start 2024-04-16T16:19:29.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.954+0000 7f12bb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b406e0c0 0x7f12b406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:29.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.954+0000 7f12bb400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12b415fe20 0x7f12b40b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:29.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.954+0000 7f12bb400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b406e9e0 con 0x7f12b41626f0 2024-04-16T16:19:29.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.954+0000 7f12bb400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f12b40af2f0 con 0x7f12b415fe20 2024-04-16T16:19:29.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.954+0000 7f12bb400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f12b40b0cb0 con 0x7f12b406e0c0 2024-04-16T16:19:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.955+0000 7f12b3e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12b415fe20 0x7f12b40b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.955+0000 7f12b8a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b406e0c0 0x7f12b406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.955+0000 7f12b3e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12b415fe20 0x7f12b40b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:36952/0 (socket says 172.21.15.22:36952) 2024-04-16T16:19:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.955+0000 7f12b3e00640 1 -- 172.21.15.22:0/1224704753 learned_addr learned my addr 172.21.15.22:0/1224704753 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.956+0000 7f12b3e00640 1 -- 172.21.15.22:0/1224704753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b406e0c0 msgr2=0x7f12b406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:29.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.956+0000 7f12b3e00640 1 --2- 172.21.15.22:0/1224704753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b406e0c0 0x7f12b406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.956+0000 7f12b3e00640 1 -- 172.21.15.22:0/1224704753 >> v1:172.21.15.43:6789/0 conn(0x7f12b41626f0 legacy=0x7f12b4162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:29.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.956+0000 7f12b3e00640 1 -- 172.21.15.22:0/1224704753 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b40ae9e0 con 0x7f12b415fe20 2024-04-16T16:19:29.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.957+0000 7f12b3e00640 1 --2- 172.21.15.22:0/1224704753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b415fe20 0x7f12b40b03a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f129c0098a0 tx=0x7f129c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1f4e65262a9e124 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:29.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.958+0000 7f12b3400640 1 -- 172.21.15.22:0/1224704753 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c034070 con 0x7f12b415fe20 2024-04-16T16:19:29.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.958+0000 7f12b3400640 1 -- 172.21.15.22:0/1224704753 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c030840 con 0x7f12b415fe20 2024-04-16T16:19:29.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.958+0000 7f12b3400640 1 -- 172.21.15.22:0/1224704753 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c030c10 con 0x7f12b415fe20 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 -- 172.21.15.22:0/1224704753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b415fe20 msgr2=0x7f12b40b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 --2- 172.21.15.22:0/1224704753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b415fe20 0x7f12b40b03a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f129c0098a0 tx=0x7f129c02b980 comp rx=0 tx=0).stop 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 -- 172.21.15.22:0/1224704753 shutdown_connections 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 --2- 172.21.15.22:0/1224704753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b415fe20 0x7f12b40b03a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 --2- 172.21.15.22:0/1224704753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b406e0c0 0x7f12b406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 -- 172.21.15.22:0/1224704753 >> 172.21.15.22:0/1224704753 conn(0x7f12b4075200 msgr2=0x7f12b4062470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 -- 172.21.15.22:0/1224704753 shutdown_connections 2024-04-16T16:19:29.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.959+0000 7f12bb400640 1 -- 172.21.15.22:0/1224704753 wait complete. 2024-04-16T16:19:29.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.961+0000 7f12bb400640 1 Processor -- start 2024-04-16T16:19:29.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.961+0000 7f12bb400640 1 -- start start 2024-04-16T16:19:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12bb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b406e0c0 0x7f12b41eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12bb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b415fe20 0x7f12b415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12bb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b41626f0 0x7f12b415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12bb400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f12b40b3100 con 0x7f12b415fe20 2024-04-16T16:19:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12bb400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f12b40aef80 con 0x7f12b406e0c0 2024-04-16T16:19:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12bb400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f12b40b08e0 con 0x7f12b41626f0 2024-04-16T16:19:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12b3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b415fe20 0x7f12b415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:29.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12b3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b415fe20 0x7f12b415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56966/0 (socket says 172.21.15.22:56966) 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.962+0000 7f12b3e00640 1 -- 172.21.15.22:0/3712458635 learned_addr learned my addr 172.21.15.22:0/3712458635 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b8a00640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b406e0c0 0x7f12b41eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b9400640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b41626f0 0x7f12b415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b3e00640 1 -- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b41626f0 msgr2=0x7f12b415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b3e00640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b41626f0 0x7f12b415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b3e00640 1 -- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b406e0c0 msgr2=0x7f12b41eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b3e00640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b406e0c0 0x7f12b41eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b3e00640 1 -- 172.21.15.22:0/3712458635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b41e95b0 con 0x7f12b415fe20 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.963+0000 7f12b3e00640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b415fe20 0x7f12b415dd70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f129c000c00 tx=0x7f129c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.964+0000 7f12b0c00640 1 -- 172.21.15.22:0/3712458635 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c048070 con 0x7f12b415fe20 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.964+0000 7f12b0c00640 1 -- 172.21.15.22:0/3712458635 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c030640 con 0x7f12b415fe20 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.964+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b41e9890 con 0x7f12b415fe20 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.964+0000 7f12b0c00640 1 -- 172.21.15.22:0/3712458635 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c034040 con 0x7f12b415fe20 2024-04-16T16:19:29.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.964+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b41eb2f0 con 0x7f12b415fe20 2024-04-16T16:19:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.965+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b404fd90 con 0x7f12b415fe20 2024-04-16T16:19:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.966+0000 7f12b0c00640 1 -- 172.21.15.22:0/3712458635 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f129c04b070 con 0x7f12b415fe20 2024-04-16T16:19:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.967+0000 7f12b0c00640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f129006cbc0 0x7f129006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.967+0000 7f12b0c00640 1 -- 172.21.15.22:0/3712458635 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5609+0+0 (secure 0 0 0) 0x7f129c0adfb0 con 0x7f12b415fe20 2024-04-16T16:19:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.968+0000 7f12b8a00640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f129006cbc0 0x7f129006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.968+0000 7f12b8a00640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f129006cbc0 0x7f129006f080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ad0 tx=0x7f12a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:29.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:29.973+0000 7f12b0c00640 1 -- 172.21.15.22:0/3712458635 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f129c07bfa0 con 0x7f12b415fe20 2024-04-16T16:19:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.223+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f12b40b4ca0 con 0x7f12b415fe20 2024-04-16T16:19:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.767+0000 7f12b0c00640 1 -- 172.21.15.22:0/3712458635 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) ==== 172+0+0 (secure 0 0 0) 0x7f129c07b8a0 con 0x7f12b415fe20 2024-04-16T16:19:30.770 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 6 and data pool 7 2024-04-16T16:19:30.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.773+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f129006cbc0 msgr2=0x7f129006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:30.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.773+0000 7f12bb400640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f129006cbc0 0x7f129006f080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ad0 tx=0x7f12a4008040 comp rx=0 tx=0).stop 2024-04-16T16:19:30.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.773+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b415fe20 msgr2=0x7f12b415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:30.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.773+0000 7f12bb400640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b415fe20 0x7f12b415dd70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f129c000c00 tx=0x7f129c004730 comp rx=0 tx=0).stop 2024-04-16T16:19:30.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 shutdown_connections 2024-04-16T16:19:30.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f129006cbc0 0x7f129006f080 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:30.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12b41626f0 0x7f12b415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:30.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b415fe20 0x7f12b415dd70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:30.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 --2- 172.21.15.22:0/3712458635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12b406e0c0 0x7f12b41eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 >> 172.21.15.22:0/3712458635 conn(0x7f12b4075200 msgr2=0x7f12b415ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 shutdown_connections 2024-04-16T16:19:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.774+0000 7f12bb400640 1 -- 172.21.15.22:0/3712458635 wait complete. 2024-04-16T16:19:30.812 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:30.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.994+0000 7f6a78e00640 1 Processor -- start 2024-04-16T16:19:30.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.995+0000 7f6a78e00640 1 -- start start 2024-04-16T16:19:30.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.996+0000 7f6a78e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a740b2b30 0x7f6a7406eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:30.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.996+0000 7f6a78e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a74071240 con 0x7f6a74156de0 2024-04-16T16:19:30.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.996+0000 7f6a78e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a74071520 con 0x7f6a740ce8c0 2024-04-16T16:19:30.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.996+0000 7f6a78e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f6a74071800 con 0x7f6a740b2b30 2024-04-16T16:19:30.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a71e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6a74156de0 0x7f6a740b2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47618/0 (socket says 172.21.15.22:47618) 2024-04-16T16:19:30.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a71e00640 1 -- 172.21.15.22:0/4144561427 learned_addr learned my addr 172.21.15.22:0/4144561427 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:30.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a69400640 1 --2- 172.21.15.22:0/4144561427 >> v2:172.21.15.22:3300/0 conn(0x7f6a740b2b30 0x7f6a7406eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:30.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a71400640 1 -- 172.21.15.22:0/4144561427 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204841518 0 0) 0x7f6a74071240 con 0x7f6a74156de0 2024-04-16T16:19:30.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a71400640 1 -- 172.21.15.22:0/4144561427 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a58003520 con 0x7f6a74156de0 2024-04-16T16:19:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a69400640 1 -- 172.21.15.22:0/4144561427 >> v1:172.21.15.43:6789/0 conn(0x7f6a740ce8c0 legacy=0x7f6a7406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a69400640 1 -- 172.21.15.22:0/4144561427 >> v1:172.21.15.22:6789/0 conn(0x7f6a74156de0 legacy=0x7f6a740b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.997+0000 7f6a69400640 1 -- 172.21.15.22:0/4144561427 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a74071ae0 con 0x7f6a740b2b30 2024-04-16T16:19:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.999+0000 7f6a69400640 1 --2- 172.21.15.22:0/4144561427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a740b2b30 0x7f6a7406eae0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097a0 tx=0x7f6a5c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a915058ca1f841a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.999+0000 7f6a71400640 1 -- 172.21.15.22:0/4144561427 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0315a0 con 0x7f6a740b2b30 2024-04-16T16:19:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.999+0000 7f6a71400640 1 -- 172.21.15.22:0/4144561427 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c037070 con 0x7f6a740b2b30 2024-04-16T16:19:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.999+0000 7f6a71400640 1 -- 172.21.15.22:0/4144561427 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c031940 con 0x7f6a740b2b30 2024-04-16T16:19:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.999+0000 7f6a78e00640 1 -- 172.21.15.22:0/4144561427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a740b2b30 msgr2=0x7f6a7406eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:30.999+0000 7f6a78e00640 1 --2- 172.21.15.22:0/4144561427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a740b2b30 0x7f6a7406eae0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097a0 tx=0x7f6a5c02b840 comp rx=0 tx=0).stop 2024-04-16T16:19:31.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.000+0000 7f6a78e00640 1 -- 172.21.15.22:0/4144561427 shutdown_connections 2024-04-16T16:19:31.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.000+0000 7f6a78e00640 1 --2- 172.21.15.22:0/4144561427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a740b2b30 0x7f6a7406eae0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.000+0000 7f6a78e00640 1 -- 172.21.15.22:0/4144561427 >> 172.21.15.22:0/4144561427 conn(0x7f6a74062440 msgr2=0x7f6a74062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:31.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.000+0000 7f6a78e00640 1 -- 172.21.15.22:0/4144561427 shutdown_connections 2024-04-16T16:19:31.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.000+0000 7f6a78e00640 1 -- 172.21.15.22:0/4144561427 wait complete. 2024-04-16T16:19:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.002+0000 7f6a78e00640 1 Processor -- start 2024-04-16T16:19:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.002+0000 7f6a78e00640 1 -- start start 2024-04-16T16:19:31.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a78e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a740b2b30 0x7f6a741f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a78e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a740ce8c0 0x7f6a740b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a78e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a74156de0 0x7f6a740b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a78e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74157340 con 0x7f6a74156de0 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a78e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741571c0 con 0x7f6a740ce8c0 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a78e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7406f020 con 0x7f6a740b2b30 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a72800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a74156de0 0x7f6a740b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a72800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a74156de0 0x7f6a740b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56994/0 (socket says 172.21.15.22:56994) 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.003+0000 7f6a72800640 1 -- 172.21.15.22:0/201397774 learned_addr learned my addr 172.21.15.22:0/201397774 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a69400640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a740ce8c0 0x7f6a740b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a72800640 1 -- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a740b2b30 msgr2=0x7f6a741f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a71e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a740b2b30 0x7f6a741f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a72800640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a740b2b30 0x7f6a741f3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a72800640 1 -- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a740ce8c0 msgr2=0x7f6a740b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a72800640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a740ce8c0 0x7f6a740b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a72800640 1 -- 172.21.15.22:0/201397774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a74157af0 con 0x7f6a74156de0 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a69400640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a740ce8c0 0x7f6a740b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a71e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a740b2b30 0x7f6a741f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a72800640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a74156de0 0x7f6a740b4830 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c7a0 tx=0x7f6a6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.004+0000 7f6a6aa00640 1 -- 172.21.15.22:0/201397774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003b70 con 0x7f6a74156de0 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.005+0000 7f6a6aa00640 1 -- 172.21.15.22:0/201397774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c003d30 con 0x7f6a74156de0 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.005+0000 7f6a6aa00640 1 -- 172.21.15.22:0/201397774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00aa90 con 0x7f6a74156de0 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.005+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a74157dd0 con 0x7f6a74156de0 2024-04-16T16:19:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.005+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a74158390 con 0x7f6a74156de0 2024-04-16T16:19:31.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.006+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7404fd90 con 0x7f6a74156de0 2024-04-16T16:19:31.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.007+0000 7f6a6aa00640 1 -- 172.21.15.22:0/201397774 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f6a6c00ac30 con 0x7f6a74156de0 2024-04-16T16:19:31.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.008+0000 7f6a6aa00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a5006cbf0 0x7f6a5006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.008+0000 7f6a6aa00640 1 -- 172.21.15.22:0/201397774 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f6a6c08bed0 con 0x7f6a74156de0 2024-04-16T16:19:31.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.008+0000 7f6a71e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a5006cbf0 0x7f6a5006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.009+0000 7f6a71e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a5006cbf0 0x7f6a5006f0b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a640011e0 tx=0x7f6a64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.013+0000 7f6a6aa00640 1 -- 172.21.15.22:0/201397774 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a6c059fb0 con 0x7f6a74156de0 2024-04-16T16:19:31.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.215+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a7415b8c0 con 0x7f6a74156de0 2024-04-16T16:19:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.218+0000 7f6a6aa00640 1 -- 172.21.15.22:0/201397774 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16506 (secure 0 0 0) 0x7f6a6c0598b0 con 0x7f6a74156de0 2024-04-16T16:19:31.218 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:31.219 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":47,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:19:30.225337+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a5006cbf0 msgr2=0x7f6a5006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a5006cbf0 0x7f6a5006f0b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a640011e0 tx=0x7f6a64009040 comp rx=0 tx=0).stop 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a74156de0 msgr2=0x7f6a740b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a74156de0 0x7f6a740b4830 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c7a0 tx=0x7f6a6c00cc60 comp rx=0 tx=0).stop 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 shutdown_connections 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a5006cbf0 0x7f6a5006f0b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a74156de0 0x7f6a740b4830 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a740ce8c0 0x7f6a740b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 --2- 172.21.15.22:0/201397774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a740b2b30 0x7f6a741f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 >> 172.21.15.22:0/201397774 conn(0x7f6a74062440 msgr2=0x7f6a7406e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:31.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 shutdown_connections 2024-04-16T16:19:31.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.221+0000 7f6a78e00640 1 -- 172.21.15.22:0/201397774 wait complete. 2024-04-16T16:19:31.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:31.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.452+0000 7f5c7f200640 1 Processor -- start 2024-04-16T16:19:31.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.453+0000 7f5c7f200640 1 -- start start 2024-04-16T16:19:31.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.454+0000 7f5c7f200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c8015ea50 0x7f5c800ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.454+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800cf630 0x7f5c800cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.454+0000 7f5c7f200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c800b9080 con 0x7f5c800d2dc0 2024-04-16T16:19:31.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7f200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5c800b9c90 con 0x7f5c8015ea50 2024-04-16T16:19:31.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5c800cffb0 con 0x7f5c800cf630 2024-04-16T16:19:31.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7de00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c8015ea50 0x7f5c800ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7de00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5c8015ea50 0x7f5c800ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57006/0 (socket says 172.21.15.22:57006) 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7de00640 1 -- 172.21.15.22:0/1166603877 learned_addr learned my addr 172.21.15.22:0/1166603877 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7e800640 1 --1- 172.21.15.22:0/1166603877 >> v1:172.21.15.22:6789/0 conn(0x7f5c800d2dc0 0x7f5c800d3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47634/0 (socket says 172.21.15.22:47634) 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7d400640 1 --2- 172.21.15.22:0/1166603877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800cf630 0x7f5c800cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7de00640 1 -- 172.21.15.22:0/1166603877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800cf630 msgr2=0x7f5c800cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7de00640 1 --2- 172.21.15.22:0/1166603877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800cf630 0x7f5c800cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7de00640 1 -- 172.21.15.22:0/1166603877 >> v1:172.21.15.22:6789/0 conn(0x7f5c800d2dc0 legacy=0x7f5c800d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7de00640 1 -- 172.21.15.22:0/1166603877 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c800b9360 con 0x7f5c8015ea50 2024-04-16T16:19:31.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.455+0000 7f5c7d400640 1 --2- 172.21.15.22:0/1166603877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800cf630 0x7f5c800cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:31.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.456+0000 7f5c7de00640 1 --2- 172.21.15.22:0/1166603877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800ba280 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098a0 tx=0x7f5c7002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99594ddb06d6dba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7ca00640 1 -- 172.21.15.22:0/1166603877 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700317c0 con 0x7f5c8015ea50 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7ca00640 1 -- 172.21.15.22:0/1166603877 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c70037070 con 0x7f5c8015ea50 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7ca00640 1 -- 172.21.15.22:0/1166603877 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70031b80 con 0x7f5c8015ea50 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7f200640 1 -- 172.21.15.22:0/1166603877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 msgr2=0x7f5c800ba280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7f200640 1 --2- 172.21.15.22:0/1166603877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800ba280 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098a0 tx=0x7f5c7002b860 comp rx=0 tx=0).stop 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7f200640 1 -- 172.21.15.22:0/1166603877 shutdown_connections 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7f200640 1 --2- 172.21.15.22:0/1166603877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800cf630 0x7f5c800cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7f200640 1 --2- 172.21.15.22:0/1166603877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800ba280 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7f200640 1 -- 172.21.15.22:0/1166603877 >> 172.21.15.22:0/1166603877 conn(0x7f5c80072430 msgr2=0x7f5c80072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.457+0000 7f5c7f200640 1 -- 172.21.15.22:0/1166603877 shutdown_connections 2024-04-16T16:19:31.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.458+0000 7f5c7f200640 1 -- 172.21.15.22:0/1166603877 wait complete. 2024-04-16T16:19:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.459+0000 7f5c7f200640 1 Processor -- start 2024-04-16T16:19:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.459+0000 7f5c7f200640 1 -- start start 2024-04-16T16:19:31.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.460+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800cf630 0x7f5c801f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.460+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800d2dc0 0x7f5c801f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.460+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.460+0000 7f5c7f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8015ee30 con 0x7f5c8015ea50 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.460+0000 7f5c7f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5c800b9920 con 0x7f5c800cf630 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.460+0000 7f5c7f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5c800ba7c0 con 0x7f5c800d2dc0 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57008/0 (socket says 172.21.15.22:57008) 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 -- 172.21.15.22:0/3385579499 learned_addr learned my addr 172.21.15.22:0/3385579499 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7de00640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800cf630 0x7f5c801f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7d400640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800d2dc0 0x7f5c801f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 -- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800d2dc0 msgr2=0x7f5c801f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800d2dc0 0x7f5c801f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 -- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800cf630 msgr2=0x7f5c801f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800cf630 0x7f5c801f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 -- 172.21.15.22:0/3385579499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c801f5500 con 0x7f5c8015ea50 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.461+0000 7f5c7e800640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800cc360 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c400 tx=0x7f5c7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.462+0000 7f5c76000640 1 -- 172.21.15.22:0/3385579499 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c780074e0 con 0x7f5c8015ea50 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.462+0000 7f5c76000640 1 -- 172.21.15.22:0/3385579499 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c78007680 con 0x7f5c8015ea50 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.462+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c801f4f40 con 0x7f5c8015ea50 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.462+0000 7f5c76000640 1 -- 172.21.15.22:0/3385579499 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c780049e0 con 0x7f5c8015ea50 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.462+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c800cbb60 con 0x7f5c8015ea50 2024-04-16T16:19:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.463+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c80075f30 con 0x7f5c8015ea50 2024-04-16T16:19:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.464+0000 7f5c76000640 1 -- 172.21.15.22:0/3385579499 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f5c7801a020 con 0x7f5c8015ea50 2024-04-16T16:19:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.465+0000 7f5c76000640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c5c06cbc0 0x7f5c5c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.465+0000 7f5c76000640 1 -- 172.21.15.22:0/3385579499 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f5c7808b780 con 0x7f5c8015ea50 2024-04-16T16:19:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.466+0000 7f5c7de00640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c5c06cbc0 0x7f5c5c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.466+0000 7f5c7de00640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c5c06cbc0 0x7f5c5c06f080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5c70036000 tx=0x7f5c7003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.470+0000 7f5c76000640 1 -- 172.21.15.22:0/3385579499 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c780598b0 con 0x7f5c8015ea50 2024-04-16T16:19:31.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.672+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c8015bb90 con 0x7f5c8015ea50 2024-04-16T16:19:31.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.674+0000 7f5c76000640 1 -- 172.21.15.22:0/3385579499 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16506 (secure 0 0 0) 0x7f5c780591b0 con 0x7f5c8015ea50 2024-04-16T16:19:31.675 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:31.675 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":47,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:19:30.225337+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:31.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c5c06cbc0 msgr2=0x7f5c5c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c5c06cbc0 0x7f5c5c06f080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5c70036000 tx=0x7f5c7003d040 comp rx=0 tx=0).stop 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 msgr2=0x7f5c800cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800cc360 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c400 tx=0x7f5c7800c8c0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 shutdown_connections 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5c5c06cbc0 0x7f5c5c06f080 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c8015ea50 0x7f5c800cc360 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5c800d2dc0 0x7f5c801f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 --2- 172.21.15.22:0/3385579499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800cf630 0x7f5c801f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.677+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 >> 172.21.15.22:0/3385579499 conn(0x7f5c80072430 msgr2=0x7f5c800d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.678+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 shutdown_connections 2024-04-16T16:19:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.678+0000 7f5c7f200640 1 -- 172.21.15.22:0/3385579499 wait complete. 2024-04-16T16:19:31.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T16:19:31.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.911+0000 7f86b9a00640 1 Processor -- start 2024-04-16T16:19:31.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.912+0000 7f86b9a00640 1 -- start start 2024-04-16T16:19:31.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.913+0000 7f86b9a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86b415eb40 0x7f86b40cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.913+0000 7f86b9a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b40d3ed0 con 0x7f86b40d35d0 2024-04-16T16:19:31.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.913+0000 7f86b9a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b40d41b0 con 0x7f86b40d3a40 2024-04-16T16:19:31.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.913+0000 7f86b9a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f86b40d4490 con 0x7f86b415eb40 2024-04-16T16:19:31.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.913+0000 7f86b3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86b415eb40 0x7f86b40cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.913+0000 7f86ab400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f86b40d35d0 0x7f86b40d1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47646/0 (socket says 172.21.15.22:47646) 2024-04-16T16:19:31.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.913+0000 7f86ab400640 1 -- 172.21.15.22:0/2751749829 learned_addr learned my addr 172.21.15.22:0/2751749829 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.914+0000 7f86b3e00640 1 -- 172.21.15.22:0/2751749829 >> v1:172.21.15.43:6789/0 conn(0x7f86b40d3a40 legacy=0x7f86b40b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.914+0000 7f86b3e00640 1 -- 172.21.15.22:0/2751749829 >> v1:172.21.15.22:6789/0 conn(0x7f86b40d35d0 legacy=0x7f86b40d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.914+0000 7f86b3400640 1 -- 172.21.15.22:0/2751749829 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586784850 0 0) 0x7f86b40d3ed0 con 0x7f86b40d35d0 2024-04-16T16:19:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.914+0000 7f86b3e00640 1 -- 172.21.15.22:0/2751749829 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b40b7d90 con 0x7f86b415eb40 2024-04-16T16:19:31.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.915+0000 7f86b3e00640 1 --2- 172.21.15.22:0/2751749829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b40cfca0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f86a40097a0 tx=0x7f86a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cc5b749de26ba2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.915+0000 7f86b3400640 1 -- 172.21.15.22:0/2751749829 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4035020 con 0x7f86b415eb40 2024-04-16T16:19:31.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.915+0000 7f86b3400640 1 -- 172.21.15.22:0/2751749829 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a4031830 con 0x7f86b415eb40 2024-04-16T16:19:31.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.915+0000 7f86b3400640 1 -- 172.21.15.22:0/2751749829 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4031c00 con 0x7f86b415eb40 2024-04-16T16:19:31.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.916+0000 7f86b9a00640 1 -- 172.21.15.22:0/2751749829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 msgr2=0x7f86b40cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.916+0000 7f86b9a00640 1 --2- 172.21.15.22:0/2751749829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b40cfca0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f86a40097a0 tx=0x7f86a402b8d0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.916+0000 7f86b9a00640 1 -- 172.21.15.22:0/2751749829 shutdown_connections 2024-04-16T16:19:31.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.916+0000 7f86b9a00640 1 --2- 172.21.15.22:0/2751749829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b40cfca0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.916+0000 7f86b9a00640 1 -- 172.21.15.22:0/2751749829 >> 172.21.15.22:0/2751749829 conn(0x7f86b4072460 msgr2=0x7f86b4072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:31.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.916+0000 7f86b9a00640 1 -- 172.21.15.22:0/2751749829 shutdown_connections 2024-04-16T16:19:31.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.916+0000 7f86b9a00640 1 -- 172.21.15.22:0/2751749829 wait complete. 2024-04-16T16:19:31.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.918+0000 7f86b9a00640 1 Processor -- start 2024-04-16T16:19:31.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.918+0000 7f86b9a00640 1 -- start start 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86b9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86b40d35d0 0x7f86b415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86b9a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b41f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86b9a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86b4157b60 0x7f86b40b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86b9a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f86b40d2010 con 0x7f86b415eb40 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86b9a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f86b40d1e90 con 0x7f86b40d35d0 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86b9a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f86b40b89c0 con 0x7f86b4157b60 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86ab400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b41f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86ab400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b41f7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57018/0 (socket says 172.21.15.22:57018) 2024-04-16T16:19:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.919+0000 7f86ab400640 1 -- 172.21.15.22:0/3881775889 learned_addr learned my addr 172.21.15.22:0/3881775889 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:31.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86ab400640 1 -- 172.21.15.22:0/3881775889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86b4157b60 msgr2=0x7f86b40b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86ab400640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86b4157b60 0x7f86b40b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86ab400640 1 -- 172.21.15.22:0/3881775889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86b40d35d0 msgr2=0x7f86b415b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86ab400640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86b40d35d0 0x7f86b415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86ab400640 1 -- 172.21.15.22:0/3881775889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b41f86a0 con 0x7f86b415eb40 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86ab400640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b41f7f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f869c00c500 tx=0x7f869c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86b0c00640 1 -- 172.21.15.22:0/3881775889 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c018070 con 0x7f86b415eb40 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86b0c00640 1 -- 172.21.15.22:0/3881775889 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c007580 con 0x7f86b415eb40 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86b0c00640 1 -- 172.21.15.22:0/3881775889 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c004a20 con 0x7f86b415eb40 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b41f8980 con 0x7f86b415eb40 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.920+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b4157ff0 con 0x7f86b415eb40 2024-04-16T16:19:31.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.922+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b4075f30 con 0x7f86b415eb40 2024-04-16T16:19:31.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.923+0000 7f86b0c00640 1 -- 172.21.15.22:0/3881775889 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f869c004bc0 con 0x7f86b415eb40 2024-04-16T16:19:31.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.923+0000 7f86b0c00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f869006cbf0 0x7f869006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:31.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.924+0000 7f86b0c00640 1 -- 172.21.15.22:0/3881775889 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f869c08b2e0 con 0x7f86b415eb40 2024-04-16T16:19:31.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.924+0000 7f86b3e00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f869006cbf0 0x7f869006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:31.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.925+0000 7f86b3e00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f869006cbf0 0x7f869006f0b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86a4036000 tx=0x7f86a4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:31.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:31.928+0000 7f86b0c00640 1 -- 172.21.15.22:0/3881775889 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f869c059370 con 0x7f86b415eb40 2024-04-16T16:19:32.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.175+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f86b4068f70 con 0x7f86b415eb40 2024-04-16T16:19:32.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.780+0000 7f86b0c00640 1 -- 172.21.15.22:0/3881775889 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f869c05f020 con 0x7f86b415eb40 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.783+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f869006cbf0 msgr2=0x7f869006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.783+0000 7f86b9a00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f869006cbf0 0x7f869006f0b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86a4036000 tx=0x7f86a4030000 comp rx=0 tx=0).stop 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.783+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 msgr2=0x7f86b41f7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.783+0000 7f86b9a00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b41f7f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f869c00c500 tx=0x7f869c00c9c0 comp rx=0 tx=0).stop 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 shutdown_connections 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f869006cbf0 0x7f869006f0b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86b4157b60 0x7f86b40b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b415eb40 0x7f86b41f7f70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 --2- 172.21.15.22:0/3881775889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86b40d35d0 0x7f86b415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:32.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 >> 172.21.15.22:0/3881775889 conn(0x7f86b4072460 msgr2=0x7f86b415de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:32.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 shutdown_connections 2024-04-16T16:19:32.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:32.784+0000 7f86b9a00640 1 -- 172.21.15.22:0/3881775889 wait complete. 2024-04-16T16:19:32.807 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T16:19:32.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T16:19:33.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.035+0000 7ff0a3e00640 1 Processor -- start 2024-04-16T16:19:33.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.035+0000 7ff0a3e00640 1 -- start start 2024-04-16T16:19:33.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a4162fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:33.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff0a40b4790 0x7ff0a40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:33.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a4163520 con 0x7ff0a40d0110 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a40d0ab0 con 0x7ff0a40b4790 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a406ce50 con 0x7ff0a415e9c0 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff0a40b4790 0x7ff0a40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff0a40b4790 0x7ff0a40d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57026/0 (socket says 172.21.15.22:57026) 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.037+0000 7ff0a3400640 1 -- 172.21.15.22:0/3641935283 learned_addr learned my addr 172.21.15.22:0/3641935283 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.038+0000 7ff0a3400640 1 -- 172.21.15.22:0/3641935283 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 msgr2=0x7ff0a4162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.038+0000 7ff0a3400640 1 --2- 172.21.15.22:0/3641935283 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a4162fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.038+0000 7ff0a3400640 1 -- 172.21.15.22:0/3641935283 >> v1:172.21.15.43:6789/0 conn(0x7ff0a40d0110 legacy=0x7ff0a40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:33.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.038+0000 7ff0a3400640 1 -- 172.21.15.22:0/3641935283 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a406d0f0 con 0x7ff0a40b4790 2024-04-16T16:19:33.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.039+0000 7ff0a3400640 1 --2- 172.21.15.22:0/3641935283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40b4790 0x7ff0a40d0570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009870 tx=0x7ff09c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0d4c3929dd49cd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:33.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.039+0000 7ff0a1600640 1 -- 172.21.15.22:0/3641935283 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c035020 con 0x7ff0a40b4790 2024-04-16T16:19:33.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.039+0000 7ff0a1600640 1 -- 172.21.15.22:0/3641935283 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c031640 con 0x7ff0a40b4790 2024-04-16T16:19:33.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.039+0000 7ff0a1600640 1 -- 172.21.15.22:0/3641935283 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c02d040 con 0x7ff0a40b4790 2024-04-16T16:19:33.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3641935283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40b4790 msgr2=0x7ff0a40d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:33.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3641935283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40b4790 0x7ff0a40d0570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009870 tx=0x7ff09c02b8f0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3641935283 shutdown_connections 2024-04-16T16:19:33.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3641935283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40b4790 0x7ff0a40d0570 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3641935283 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a4162fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3641935283 >> 172.21.15.22:0/3641935283 conn(0x7ff0a4075070 msgr2=0x7ff0a4062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:33.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3641935283 shutdown_connections 2024-04-16T16:19:33.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.040+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3641935283 wait complete. 2024-04-16T16:19:33.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.042+0000 7ff0a3e00640 1 Processor -- start 2024-04-16T16:19:33.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.042+0000 7ff0a3e00640 1 -- start start 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0a40b4790 0x7ff0a4158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40d0110 0x7ff0a41e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a41ea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a3e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a406d990 con 0x7ff0a40d0110 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a406d6b0 con 0x7ff0a40b4790 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a406dc70 con 0x7ff0a415e9c0 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40d0110 0x7ff0a41e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40d0110 0x7ff0a41e9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57042/0 (socket says 172.21.15.22:57042) 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.043+0000 7ff0a2000640 1 -- 172.21.15.22:0/3645089546 learned_addr learned my addr 172.21.15.22:0/3645089546 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:33.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a2a00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0a40b4790 0x7ff0a4158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a3400640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a41ea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a2000640 1 -- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 msgr2=0x7ff0a41ea3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a2000640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a41ea3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a2000640 1 -- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0a40b4790 msgr2=0x7ff0a4158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a2000640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0a40b4790 0x7ff0a4158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a2000640 1 -- 172.21.15.22:0/3645089546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a4156570 con 0x7ff0a40d0110 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a3400640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a41ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:33.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff0a2000640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40d0110 0x7ff0a41e9e70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c7c0 tx=0x7ff08c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:33.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.044+0000 7ff09b400640 1 -- 172.21.15.22:0/3645089546 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c016020 con 0x7ff0a40d0110 2024-04-16T16:19:33.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.045+0000 7ff09b400640 1 -- 172.21.15.22:0/3645089546 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c00aa50 con 0x7ff0a40d0110 2024-04-16T16:19:33.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.045+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a41ea9e0 con 0x7ff0a40d0110 2024-04-16T16:19:33.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.045+0000 7ff09b400640 1 -- 172.21.15.22:0/3645089546 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00ae40 con 0x7ff0a40d0110 2024-04-16T16:19:33.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.045+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a415f650 con 0x7ff0a40d0110 2024-04-16T16:19:33.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.046+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a4075f30 con 0x7ff0a40d0110 2024-04-16T16:19:33.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.047+0000 7ff09b400640 1 -- 172.21.15.22:0/3645089546 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7ff08c019020 con 0x7ff0a40d0110 2024-04-16T16:19:33.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.048+0000 7ff09b400640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff08006cbc0 0x7ff08006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:33.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.048+0000 7ff09b400640 1 -- 172.21.15.22:0/3645089546 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7ff08c08c090 con 0x7ff0a40d0110 2024-04-16T16:19:33.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.048+0000 7ff0a2a00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff08006cbc0 0x7ff08006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:33.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.049+0000 7ff0a2a00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff08006cbc0 0x7ff08006f080 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff09400b810 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:33.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.053+0000 7ff09b400640 1 -- 172.21.15.22:0/3645089546 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff08c020030 con 0x7ff0a40d0110 2024-04-16T16:19:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.298+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff0a40721b0 con 0x7ff0a40d0110 2024-04-16T16:19:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.792+0000 7ff09b400640 1 -- 172.21.15.22:0/3645089546 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7ff08c05a130 con 0x7ff0a40d0110 2024-04-16T16:19:33.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.795+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff08006cbc0 msgr2=0x7ff08006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.795+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff08006cbc0 0x7ff08006f080 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff09400b810 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.795+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40d0110 msgr2=0x7ff0a41e9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.795+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40d0110 0x7ff0a41e9e70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c7c0 tx=0x7ff08c00cc80 comp rx=0 tx=0).stop 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 shutdown_connections 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff08006cbc0 0x7ff08006f080 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff0a415e9c0 0x7ff0a41ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0a40d0110 0x7ff0a41e9e70 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 --2- 172.21.15.22:0/3645089546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0a40b4790 0x7ff0a4158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:33.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 >> 172.21.15.22:0/3645089546 conn(0x7ff0a4075070 msgr2=0x7ff0a41573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:33.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 shutdown_connections 2024-04-16T16:19:33.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:33.796+0000 7ff0a3e00640 1 -- 172.21.15.22:0/3645089546 wait complete. 2024-04-16T16:19:33.818 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T16:19:33.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:19:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.042+0000 7f1b03e00640 1 Processor -- start 2024-04-16T16:19:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.042+0000 7f1b03e00640 1 -- start start 2024-04-16T16:19:34.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b03e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1b040d01a0 0x7f1b040d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b03e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b040d0ac0 con 0x7f1b040b3410 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b03e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b040af2b0 con 0x7f1b040b38a0 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b03e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0406d020 con 0x7f1b040d01a0 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b02a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1b040d01a0 0x7f1b040d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b02000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1b040b3410 0x7f1b040ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47658/0 (socket says 172.21.15.22:47658) 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b02000640 1 -- 172.21.15.22:0/3850144020 learned_addr learned my addr 172.21.15.22:0/3850144020 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.044+0000 7f1b02a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1b040d01a0 0x7f1b040d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57048/0 (socket says 172.21.15.22:57048) 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.045+0000 7f1b02a00640 1 -- 172.21.15.22:0/3850144020 >> v1:172.21.15.43:6789/0 conn(0x7f1b040b38a0 legacy=0x7f1b0406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.045+0000 7f1b02a00640 1 -- 172.21.15.22:0/3850144020 >> v1:172.21.15.22:6789/0 conn(0x7f1b040b3410 legacy=0x7f1b040ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.045+0000 7f1b02a00640 1 -- 172.21.15.22:0/3850144020 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b040af590 con 0x7f1b040d01a0 2024-04-16T16:19:34.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.045+0000 7f1b01600640 1 -- 172.21.15.22:0/3850144020 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352759197 0 0) 0x7f1b040d0ac0 con 0x7f1b040b3410 2024-04-16T16:19:34.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.046+0000 7f1b02a00640 1 --2- 172.21.15.22:0/3850144020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040d01a0 0x7f1b040d0580 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1af40097a0 tx=0x7f1af402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816bb59b871361bf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:34.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.046+0000 7f1b01600640 1 -- 172.21.15.22:0/3850144020 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4034070 con 0x7f1b040d01a0 2024-04-16T16:19:34.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.046+0000 7f1b01600640 1 -- 172.21.15.22:0/3850144020 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af4030610 con 0x7f1b040d01a0 2024-04-16T16:19:34.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.046+0000 7f1b01600640 1 -- 172.21.15.22:0/3850144020 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af40309e0 con 0x7f1b040d01a0 2024-04-16T16:19:34.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.047+0000 7f1b03e00640 1 -- 172.21.15.22:0/3850144020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040d01a0 msgr2=0x7f1b040d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.047+0000 7f1b03e00640 1 --2- 172.21.15.22:0/3850144020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040d01a0 0x7f1b040d0580 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1af40097a0 tx=0x7f1af402b960 comp rx=0 tx=0).stop 2024-04-16T16:19:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.047+0000 7f1b03e00640 1 -- 172.21.15.22:0/3850144020 shutdown_connections 2024-04-16T16:19:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.047+0000 7f1b03e00640 1 --2- 172.21.15.22:0/3850144020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040d01a0 0x7f1b040d0580 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.047+0000 7f1b03e00640 1 -- 172.21.15.22:0/3850144020 >> 172.21.15.22:0/3850144020 conn(0x7f1b04062440 msgr2=0x7f1b04062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.047+0000 7f1b03e00640 1 -- 172.21.15.22:0/3850144020 shutdown_connections 2024-04-16T16:19:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.047+0000 7f1b03e00640 1 -- 172.21.15.22:0/3850144020 wait complete. 2024-04-16T16:19:34.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.049+0000 7f1b03e00640 1 Processor -- start 2024-04-16T16:19:34.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.049+0000 7f1b03e00640 1 -- start start 2024-04-16T16:19:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b03e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040b3410 0x7f1b041f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b03e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b040b38a0 0x7f1b0406da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b03e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b040d01a0 0x7f1b0406df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b03e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1b040af870 con 0x7f1b040b3410 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b03e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0406d530 con 0x7f1b040b38a0 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b03e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1b040aef70 con 0x7f1b040d01a0 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b02a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040b3410 0x7f1b041f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b02a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040b3410 0x7f1b041f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57058/0 (socket says 172.21.15.22:57058) 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.050+0000 7f1b02a00640 1 -- 172.21.15.22:0/945200325 learned_addr learned my addr 172.21.15.22:0/945200325 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b03400640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b040d01a0 0x7f1b0406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02a00640 1 -- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b040d01a0 msgr2=0x7f1b0406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02000640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b040b38a0 0x7f1b0406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02a00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b040d01a0 0x7f1b0406df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02a00640 1 -- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b040b38a0 msgr2=0x7f1b0406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02a00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b040b38a0 0x7f1b0406da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02a00640 1 -- 172.21.15.22:0/945200325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b04159440 con 0x7f1b040b3410 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b03400640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b040d01a0 0x7f1b0406df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02000640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b040b38a0 0x7f1b0406da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1b02a00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040b3410 0x7f1b041f39d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1af40097a0 tx=0x7f1af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.051+0000 7f1afaa00640 1 -- 172.21.15.22:0/945200325 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4034040 con 0x7f1b040b3410 2024-04-16T16:19:34.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.052+0000 7f1afaa00640 1 -- 172.21.15.22:0/945200325 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af4004030 con 0x7f1b040b3410 2024-04-16T16:19:34.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.052+0000 7f1afaa00640 1 -- 172.21.15.22:0/945200325 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4004420 con 0x7f1b040b3410 2024-04-16T16:19:34.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.052+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b04159720 con 0x7f1b040b3410 2024-04-16T16:19:34.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.052+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b04159ce0 con 0x7f1b040b3410 2024-04-16T16:19:34.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.053+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b04075f30 con 0x7f1b040b3410 2024-04-16T16:19:34.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.054+0000 7f1afaa00640 1 -- 172.21.15.22:0/945200325 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f1af404c060 con 0x7f1b040b3410 2024-04-16T16:19:34.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.055+0000 7f1afaa00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ae406cbc0 0x7f1ae406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.055+0000 7f1afaa00640 1 -- 172.21.15.22:0/945200325 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f1af40adec0 con 0x7f1b040b3410 2024-04-16T16:19:34.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.055+0000 7f1b02000640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ae406cbc0 0x7f1ae406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.056+0000 7f1b02000640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ae406cbc0 0x7f1ae406f080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1b04161210 tx=0x7f1af0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.059+0000 7f1afaa00640 1 -- 172.21.15.22:0/945200325 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1af407be00 con 0x7f1b040b3410 2024-04-16T16:19:34.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.302+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b04159ee0 con 0x7f1b040b3410 2024-04-16T16:19:34.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.303+0000 7f1afaa00640 1 -- 172.21.15.22:0/945200325 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7f1af407b700 con 0x7f1b040b3410 2024-04-16T16:19:34.304 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:34.304 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3896039959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3896039959},{"type":"v1","addr":"172.21.15.22:6836","nonce":3896039959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/594862213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":594862213},{"type":"v1","addr":"172.21.15.43:6834","nonce":594862213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/754211698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":754211698},{"type":"v1","addr":"172.21.15.43:6835","nonce":754211698}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:19:30.225286+0000","modified":"2024-04-16T16:19:33.300977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5047},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5047":{"gid":5047,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/1166400952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1166400952},{"type":"v1","addr":"172.21.15.22:6837","nonce":1166400952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5047,"qdb_cluster":[5047]},"id":3}]} 2024-04-16T16:19:34.304 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2024-04-16T16:19:34.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ae406cbc0 msgr2=0x7f1ae406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ae406cbc0 0x7f1ae406f080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1b04161210 tx=0x7f1af0009040 comp rx=0 tx=0).stop 2024-04-16T16:19:34.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040b3410 msgr2=0x7f1b041f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040b3410 0x7f1b041f39d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1af40097a0 tx=0x7f1af40046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 shutdown_connections 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1ae406cbc0 0x7f1ae406f080 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b040d01a0 0x7f1b0406df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b040b38a0 0x7f1b0406da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 --2- 172.21.15.22:0/945200325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b040b3410 0x7f1b041f39d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 >> 172.21.15.22:0/945200325 conn(0x7f1b04062440 msgr2=0x7f1b040d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 shutdown_connections 2024-04-16T16:19:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.306+0000 7f1b03e00640 1 -- 172.21.15.22:0/945200325 wait complete. 2024-04-16T16:19:34.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:19:34.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.540+0000 7f3701400640 1 Processor -- start 2024-04-16T16:19:34.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.540+0000 7f3701400640 1 -- start start 2024-04-16T16:19:34.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f3701400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36fc06eaa0 0x7f36fc0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f3701400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f36fc06ee80 0x7f36fc15c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f3701400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36fc06d160 con 0x7f36fc0cc810 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f3701400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f36fc06cf10 con 0x7f36fc06eaa0 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f3701400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f36fc06d440 con 0x7f36fc06ee80 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f36fbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36fc06eaa0 0x7f36fc0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f36fbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36fc06eaa0 0x7f36fc0b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57062/0 (socket says 172.21.15.22:57062) 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f36fbe00640 1 -- 172.21.15.22:0/3421766933 learned_addr learned my addr 172.21.15.22:0/3421766933 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.542+0000 7f3700a00640 1 --2- 172.21.15.22:0/3421766933 >> v2:172.21.15.43:3300/0 conn(0x7f36fc06ee80 0x7f36fc15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.543+0000 7f36fbe00640 1 -- 172.21.15.22:0/3421766933 >> v2:172.21.15.43:3300/0 conn(0x7f36fc06ee80 msgr2=0x7f36fc15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:34.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.543+0000 7f36fbe00640 1 --2- 172.21.15.22:0/3421766933 >> v2:172.21.15.43:3300/0 conn(0x7f36fc06ee80 0x7f36fc15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.543+0000 7f36fbe00640 1 -- 172.21.15.22:0/3421766933 >> v1:172.21.15.43:6789/0 conn(0x7f36fc0cc810 legacy=0x7f36fc06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:34.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.543+0000 7f36fbe00640 1 -- 172.21.15.22:0/3421766933 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36fc06d720 con 0x7f36fc06eaa0 2024-04-16T16:19:34.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.543+0000 7f3700a00640 1 --2- 172.21.15.22:0/3421766933 >> v2:172.21.15.43:3300/0 conn(0x7f36fc06ee80 0x7f36fc15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:34.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.544+0000 7f36fbe00640 1 --2- 172.21.15.22:0/3421766933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0b3e20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23abda4cc062e780 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:34.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.544+0000 7f36faa00640 1 -- 172.21.15.22:0/3421766933 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec035020 con 0x7f36fc06eaa0 2024-04-16T16:19:34.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.544+0000 7f36faa00640 1 -- 172.21.15.22:0/3421766933 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec02d040 con 0x7f36fc06eaa0 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.544+0000 7f36faa00640 1 -- 172.21.15.22:0/3421766933 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec031a80 con 0x7f36fc06eaa0 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 -- 172.21.15.22:0/3421766933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 msgr2=0x7f36fc0b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 --2- 172.21.15.22:0/3421766933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0b3e20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec02b900 comp rx=0 tx=0).stop 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 -- 172.21.15.22:0/3421766933 shutdown_connections 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 --2- 172.21.15.22:0/3421766933 >> v2:172.21.15.43:3300/0 conn(0x7f36fc06ee80 0x7f36fc15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 --2- 172.21.15.22:0/3421766933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0b3e20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 -- 172.21.15.22:0/3421766933 >> 172.21.15.22:0/3421766933 conn(0x7f36fc062440 msgr2=0x7f36fc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 -- 172.21.15.22:0/3421766933 shutdown_connections 2024-04-16T16:19:34.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.545+0000 7f3701400640 1 -- 172.21.15.22:0/3421766933 wait complete. 2024-04-16T16:19:34.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.547+0000 7f3701400640 1 Processor -- start 2024-04-16T16:19:34.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.547+0000 7f3701400640 1 -- start start 2024-04-16T16:19:34.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f3701400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f3701400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36fc06ee80 0x7f36fc145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f3701400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36fc0cc810 0x7f36fc146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f3701400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc15c740 con 0x7f36fc06eaa0 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f3701400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc0b4360 con 0x7f36fc06ee80 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f3701400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36fc15c8c0 con 0x7f36fc0cc810 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57064/0 (socket says 172.21.15.22:57064) 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 -- 172.21.15.22:0/3857075024 learned_addr learned my addr 172.21.15.22:0/3857075024 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 -- 172.21.15.22:0/3857075024 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36fc0cc810 msgr2=0x7f36fc146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36fc0cc810 0x7f36fc146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 -- 172.21.15.22:0/3857075024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36fc06ee80 msgr2=0x7f36fc145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36fc06ee80 0x7f36fc145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.548+0000 7f36fbe00640 1 -- 172.21.15.22:0/3857075024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36fc153880 con 0x7f36fc06eaa0 2024-04-16T16:19:34.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.549+0000 7f36fbe00640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0aead0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:34.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.549+0000 7f36f3e00640 1 -- 172.21.15.22:0/3857075024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec040070 con 0x7f36fc06eaa0 2024-04-16T16:19:34.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.549+0000 7f36f3e00640 1 -- 172.21.15.22:0/3857075024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec039bf0 con 0x7f36fc06eaa0 2024-04-16T16:19:34.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.549+0000 7f36f3e00640 1 -- 172.21.15.22:0/3857075024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec035040 con 0x7f36fc06eaa0 2024-04-16T16:19:34.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.549+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36fc153b60 con 0x7f36fc06eaa0 2024-04-16T16:19:34.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.549+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36fc0af010 con 0x7f36fc06eaa0 2024-04-16T16:19:34.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.551+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36fc075f30 con 0x7f36fc06eaa0 2024-04-16T16:19:34.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.552+0000 7f36f3e00640 1 -- 172.21.15.22:0/3857075024 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f36ec04b060 con 0x7f36fc06eaa0 2024-04-16T16:19:34.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.553+0000 7f36f3e00640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f36dc06cbc0 0x7f36dc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:34.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.553+0000 7f36f3e00640 1 -- 172.21.15.22:0/3857075024 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f36ec0ade50 con 0x7f36fc06eaa0 2024-04-16T16:19:34.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.553+0000 7f36fb400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f36dc06cbc0 0x7f36dc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:34.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.554+0000 7f36fb400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f36dc06cbc0 0x7f36dc06f080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36e8006fd0 tx=0x7f36e8006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:34.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.557+0000 7f36f3e00640 1 -- 172.21.15.22:0/3857075024 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36ec07c000 con 0x7f36fc06eaa0 2024-04-16T16:19:34.678 INFO:tasks.ceph.mds.a.smithi022.stderr:2024-04-16T16:19:34.678+0000 7f9eada00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:19:34.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.763+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36fc0b4b70 con 0x7f36fc06eaa0 2024-04-16T16:19:34.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.765+0000 7f36f3e00640 1 -- 172.21.15.22:0/3857075024 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16493 (secure 0 0 0) 0x7f36ec07b900 con 0x7f36fc06eaa0 2024-04-16T16:19:34.766 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:34.766 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":48,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:19:31.767652+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.768+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f36dc06cbc0 msgr2=0x7f36dc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.768+0000 7f3701400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f36dc06cbc0 0x7f36dc06f080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36e8006fd0 tx=0x7f36e8006bc0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.768+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 msgr2=0x7f36fc0aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.768+0000 7f3701400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0aead0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec0046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 shutdown_connections 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f36dc06cbc0 0x7f36dc06f080 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36fc0cc810 0x7f36fc146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36fc06ee80 0x7f36fc145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 --2- 172.21.15.22:0/3857075024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc06eaa0 0x7f36fc0aead0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:34.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 >> 172.21.15.22:0/3857075024 conn(0x7f36fc062440 msgr2=0x7f36fc0d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:34.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 shutdown_connections 2024-04-16T16:19:34.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:34.769+0000 7f3701400640 1 -- 172.21.15.22:0/3857075024 wait complete. 2024-04-16T16:19:34.790 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T16:19:34.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:19:35.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.004+0000 7fe6d5c00640 1 Processor -- start 2024-04-16T16:19:35.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.004+0000 7fe6d5c00640 1 -- start start 2024-04-16T16:19:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.006+0000 7fe6d5c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe6d006eaa0 0x7fe6d00b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.006+0000 7fe6d5c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d006d160 con 0x7fe6d00cc810 2024-04-16T16:19:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.006+0000 7fe6d5c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d006d440 con 0x7fe6d006ee80 2024-04-16T16:19:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.006+0000 7fe6d5c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d006cf10 con 0x7fe6d006eaa0 2024-04-16T16:19:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.006+0000 7fe6c7400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe6d00cc810 0x7fe6d006df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47668/0 (socket says 172.21.15.22:47668) 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.006+0000 7fe6c7400640 1 -- 172.21.15.22:0/2176759878 learned_addr learned my addr 172.21.15.22:0/2176759878 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cfe00640 1 --2- 172.21.15.22:0/2176759878 >> v2:172.21.15.43:3300/0 conn(0x7fe6d006eaa0 0x7fe6d00b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552743023 0 0) 0x7fe6d006d160 con 0x7fe6d00cc810 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6b4003520 con 0x7fe6d00cc810 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 513108741 0 0) 0x7fe6b4003520 con 0x7fe6d00cc810 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 >> v2:172.21.15.43:3300/0 conn(0x7fe6d006eaa0 msgr2=0x7fe6d00b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 --2- 172.21.15.22:0/2176759878 >> v2:172.21.15.43:3300/0 conn(0x7fe6d006eaa0 0x7fe6d00b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 >> v1:172.21.15.43:6789/0 conn(0x7fe6d006ee80 legacy=0x7fe6d015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d006d720 con 0x7fe6d00cc810 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fe6b8001670 con 0x7fe6d00cc810 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 >> v1:172.21.15.22:6789/0 conn(0x7fe6d00cc810 legacy=0x7fe6d006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039b0 0x7fe6b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6b4004800 0x7fe6b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b40051c0 0x7fe6b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d006cf10 con 0x7fe6b4004800 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b400c060 con 0x7fe6b40039b0 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.007+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b400c260 con 0x7fe6b40051c0 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.008+0000 7fe6c7400640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6b4004800 0x7fe6b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.008+0000 7fe6c7400640 1 -- 172.21.15.22:0/2176759878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b40051c0 msgr2=0x7fe6b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:35.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.008+0000 7fe6c7400640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b40051c0 0x7fe6b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.008+0000 7fe6c7400640 1 -- 172.21.15.22:0/2176759878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039b0 msgr2=0x7fe6b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:35.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.008+0000 7fe6c7400640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039b0 0x7fe6b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.008+0000 7fe6c7400640 1 -- 172.21.15.22:0/2176759878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b4003520 con 0x7fe6b4004800 2024-04-16T16:19:35.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.008+0000 7fe6d5200640 1 -- 172.21.15.22:0/2176759878 reap_dead start 2024-04-16T16:19:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.009+0000 7fe6c7400640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6b4004800 0x7fe6b4004c80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800c240 tx=0x7fe6b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222aa2d231a52d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8007d10 con 0x7fe6b4004800 2024-04-16T16:19:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8030070 con 0x7fe6b4004800 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6cf400640 1 -- 172.21.15.22:0/2176759878 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b802cda0 con 0x7fe6b4004800 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6d5c00640 1 -- 172.21.15.22:0/2176759878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6b4004800 msgr2=0x7fe6b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6b4004800 0x7fe6b4004c80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800c240 tx=0x7fe6b4005830 comp rx=0 tx=0).stop 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6d5c00640 1 -- 172.21.15.22:0/2176759878 shutdown_connections 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/2176759878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6b4004800 0x7fe6b4004c80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6d5c00640 1 -- 172.21.15.22:0/2176759878 >> 172.21.15.22:0/2176759878 conn(0x7fe6d0062440 msgr2=0x7fe6d0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6d5c00640 1 -- 172.21.15.22:0/2176759878 shutdown_connections 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.010+0000 7fe6d5c00640 1 -- 172.21.15.22:0/2176759878 wait complete. 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.012+0000 7fe6d5c00640 1 Processor -- start 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.012+0000 7fe6d5c00640 1 -- start start 2024-04-16T16:19:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.013+0000 7fe6d5c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b4004800 0x7fe6d0143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.013+0000 7fe6d5c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6d01f80e0 0x7fe6d01f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d00cb240 0x7fe6d00cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00b3fa0 con 0x7fe6d00cb240 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00b3e20 con 0x7fe6d01f80e0 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d00b4120 con 0x7fe6b4004800 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d00cb240 0x7fe6d00cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d00cb240 0x7fe6d00cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57080/0 (socket says 172.21.15.22:57080) 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 -- 172.21.15.22:0/3105692089 learned_addr learned my addr 172.21.15.22:0/3105692089 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6cfe00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b4004800 0x7fe6d0143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6c7400640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6d01f80e0 0x7fe6d01f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 -- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b4004800 msgr2=0x7fe6d0143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b4004800 0x7fe6d0143aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 -- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6d01f80e0 msgr2=0x7fe6d01f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6d01f80e0 0x7fe6d01f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.014+0000 7fe6d5200640 1 -- 172.21.15.22:0/3105692089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d00b0190 con 0x7fe6d00cb240 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.015+0000 7fe6d5200640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d00cb240 0x7fe6d00cb6c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00cdac0 tx=0x7fe6c800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.015+0000 7fe6ccc00640 1 -- 172.21.15.22:0/3105692089 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8017070 con 0x7fe6d00cb240 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.015+0000 7fe6ccc00640 1 -- 172.21.15.22:0/3105692089 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c80070d0 con 0x7fe6d00cb240 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.015+0000 7fe6ccc00640 1 -- 172.21.15.22:0/3105692089 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80074c0 con 0x7fe6d00cb240 2024-04-16T16:19:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.015+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d00cbff0 con 0x7fe6d00cb240 2024-04-16T16:19:35.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.015+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d00b0730 con 0x7fe6d00cb240 2024-04-16T16:19:35.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.016+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d0075f30 con 0x7fe6d00cb240 2024-04-16T16:19:35.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.017+0000 7fe6ccc00640 1 -- 172.21.15.22:0/3105692089 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fe6c8007660 con 0x7fe6d00cb240 2024-04-16T16:19:35.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.018+0000 7fe6ccc00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe6ac06cbc0 0x7fe6ac06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.018+0000 7fe6ccc00640 1 -- 172.21.15.22:0/3105692089 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fe6c808afe0 con 0x7fe6d00cb240 2024-04-16T16:19:35.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.019+0000 7fe6cfe00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe6ac06cbc0 0x7fe6ac06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.019+0000 7fe6cfe00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe6ac06cbc0 0x7fe6ac06f080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0004770 tx=0x7fe6c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:35.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.023+0000 7fe6ccc00640 1 -- 172.21.15.22:0/3105692089 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6c8058fa0 con 0x7fe6d00cb240 2024-04-16T16:19:35.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.227+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6d00b4b70 con 0x7fe6ac06cbc0 2024-04-16T16:19:35.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.248+0000 7fe6ccc00640 1 -- 172.21.15.22:0/3105692089 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7fe6d00b4b70 con 0x7fe6ac06cbc0 2024-04-16T16:19:35.252 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:35.254 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe6ac06cbc0 msgr2=0x7fe6ac06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe6ac06cbc0 0x7fe6ac06f080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0004770 tx=0x7fe6c0008040 comp rx=0 tx=0).stop 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d00cb240 msgr2=0x7fe6d00cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d00cb240 0x7fe6d00cb6c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00cdac0 tx=0x7fe6c800c980 comp rx=0 tx=0).stop 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 shutdown_connections 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe6ac06cbc0 0x7fe6ac06f080 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6d00cb240 0x7fe6d00cb6c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6d01f80e0 0x7fe6d01f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 --2- 172.21.15.22:0/3105692089 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b4004800 0x7fe6d0143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 >> 172.21.15.22:0/3105692089 conn(0x7fe6d0062440 msgr2=0x7fe6d015b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 shutdown_connections 2024-04-16T16:19:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.255+0000 7fe6d5c00640 1 -- 172.21.15.22:0/3105692089 wait complete. 2024-04-16T16:19:35.275 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-04-16T16:19:33.762151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254760,"kb_used_data":5300,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719960,"statfs":{"total":773094113280,"available":772833239040,"internally_reserved":0,"allocated":5427200,"data_stored":2889347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.043578"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.753980+0000","last_change":"2024-04-16T16:19:29.753980+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.753980+0000","last_undegraded":"2024-04-16T16:19:29.753980+0000","last_fullsized":"2024-04-16T16:19:29.753980+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.735322+0000","last_change":"2024-04-16T16:19:29.735322+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.735322+0000","last_undegraded":"2024-04-16T16:19:29.735322+0000","last_fullsized":"2024-04-16T16:19:29.735322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.738631+0000","last_change":"2024-04-16T16:19:29.738631+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.738631+0000","last_undegraded":"2024-04-16T16:19:29.738631+0000","last_fullsized":"2024-04-16T16:19:29.738631+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.748136+0000","last_change":"2024-04-16T16:19:29.748136+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.748136+0000","last_undegraded":"2024-04-16T16:19:29.748136+0000","last_fullsized":"2024-04-16T16:19:29.748136+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.733608+0000","last_change":"2024-04-16T16:19:29.733608+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.733608+0000","last_undegraded":"2024-04-16T16:19:29.733608+0000","last_fullsized":"2024-04-16T16:19:29.733608+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.750266+0000","last_change":"2024-04-16T16:19:29.750266+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.750266+0000","last_undegraded":"2024-04-16T16:19:29.750266+0000","last_fullsized":"2024-04-16T16:19:29.750266+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.749192+0000","last_change":"2024-04-16T16:19:29.749192+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.749192+0000","last_undegraded":"2024-04-16T16:19:29.749192+0000","last_fullsized":"2024-04-16T16:19:29.749192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.748433+0000","last_change":"2024-04-16T16:19:29.748433+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.748433+0000","last_undegraded":"2024-04-16T16:19:29.748433+0000","last_fullsized":"2024-04-16T16:19:29.748433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.751134+0000","last_change":"2024-04-16T16:19:29.751134+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.751134+0000","last_undegraded":"2024-04-16T16:19:29.751134+0000","last_fullsized":"2024-04-16T16:19:29.751134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.749199+0000","last_change":"2024-04-16T16:19:29.749199+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.749199+0000","last_undegraded":"2024-04-16T16:19:29.749199+0000","last_fullsized":"2024-04-16T16:19:29.749199+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.742575+0000","last_change":"2024-04-16T16:19:29.742575+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.742575+0000","last_undegraded":"2024-04-16T16:19:29.742575+0000","last_fullsized":"2024-04-16T16:19:29.742575+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.738166+0000","last_change":"2024-04-16T16:19:29.738166+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.738166+0000","last_undegraded":"2024-04-16T16:19:29.738166+0000","last_fullsized":"2024-04-16T16:19:29.738166+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.747746+0000","last_change":"2024-04-16T16:19:29.747746+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.747746+0000","last_undegraded":"2024-04-16T16:19:29.747746+0000","last_fullsized":"2024-04-16T16:19:29.747746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.745725+0000","last_change":"2024-04-16T16:19:29.745725+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.745725+0000","last_undegraded":"2024-04-16T16:19:29.745725+0000","last_fullsized":"2024-04-16T16:19:29.745725+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.753219+0000","last_change":"2024-04-16T16:19:29.753219+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.753219+0000","last_undegraded":"2024-04-16T16:19:29.753219+0000","last_fullsized":"2024-04-16T16:19:29.753219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.756969+0000","last_change":"2024-04-16T16:19:29.756969+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.756969+0000","last_undegraded":"2024-04-16T16:19:29.756969+0000","last_fullsized":"2024-04-16T16:19:29.756969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.741574+0000","last_change":"2024-04-16T16:19:29.741574+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.741574+0000","last_undegraded":"2024-04-16T16:19:29.741574+0000","last_fullsized":"2024-04-16T16:19:29.741574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.740976+0000","last_change":"2024-04-16T16:19:29.740976+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.740976+0000","last_undegraded":"2024-04-16T16:19:29.740976+0000","last_fullsized":"2024-04-16T16:19:29.740976+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.750177+0000","last_change":"2024-04-16T16:19:29.750177+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.750177+0000","last_undegraded":"2024-04-16T16:19:29.750177+0000","last_fullsized":"2024-04-16T16:19:29.750177+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.751594+0000","last_change":"2024-04-16T16:19:29.751594+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.751594+0000","last_undegraded":"2024-04-16T16:19:29.751594+0000","last_fullsized":"2024-04-16T16:19:29.751594+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.751574+0000","last_change":"2024-04-16T16:19:29.751574+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.751574+0000","last_undegraded":"2024-04-16T16:19:29.751574+0000","last_fullsized":"2024-04-16T16:19:29.751574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.745063+0000","last_change":"2024-04-16T16:19:29.745063+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.745063+0000","last_undegraded":"2024-04-16T16:19:29.745063+0000","last_fullsized":"2024-04-16T16:19:29.745063+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.749102+0000","last_change":"2024-04-16T16:19:29.749102+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.749102+0000","last_undegraded":"2024-04-16T16:19:29.749102+0000","last_fullsized":"2024-04-16T16:19:29.749102+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.751641+0000","last_change":"2024-04-16T16:19:29.751641+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.751641+0000","last_undegraded":"2024-04-16T16:19:29.751641+0000","last_fullsized":"2024-04-16T16:19:29.751641+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.752611+0000","last_change":"2024-04-16T16:19:29.752611+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.752611+0000","last_undegraded":"2024-04-16T16:19:29.752611+0000","last_fullsized":"2024-04-16T16:19:29.752611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.752273+0000","last_change":"2024-04-16T16:19:29.752273+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.752273+0000","last_undegraded":"2024-04-16T16:19:29.752273+0000","last_fullsized":"2024-04-16T16:19:29.752273+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.737285+0000","last_change":"2024-04-16T16:19:29.737285+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.737285+0000","last_undegraded":"2024-04-16T16:19:29.737285+0000","last_fullsized":"2024-04-16T16:19:29.737285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.737047+0000","last_change":"2024-04-16T16:19:29.737047+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.737047+0000","last_undegraded":"2024-04-16T16:19:29.737047+0000","last_fullsized":"2024-04-16T16:19:29.737047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.752186+0000","last_change":"2024-04-16T16:19:29.752186+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.752186+0000","last_undegraded":"2024-04-16T16:19:29.752186+0000","last_fullsized":"2024-04-16T16:19:29.752186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.746181+0000","last_change":"2024-04-16T16:19:29.746181+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.746181+0000","last_undegraded":"2024-04-16T16:19:29.746181+0000","last_fullsized":"2024-04-16T16:19:29.746181+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.749116+0000","last_change":"2024-04-16T16:19:29.749116+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.749116+0000","last_undegraded":"2024-04-16T16:19:29.749116+0000","last_fullsized":"2024-04-16T16:19:29.749116+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.748325+0000","last_change":"2024-04-16T16:19:29.748325+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.748325+0000","last_undegraded":"2024-04-16T16:19:29.748325+0000","last_fullsized":"2024-04-16T16:19:29.748325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.739274+0000","last_change":"2024-04-16T16:19:29.739274+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.739274+0000","last_undegraded":"2024-04-16T16:19:29.739274+0000","last_fullsized":"2024-04-16T16:19:29.739274+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.766625+0000","last_change":"2024-04-16T16:19:29.762120+0000","last_active":"2024-04-16T16:19:29.766625+0000","last_peered":"2024-04-16T16:19:29.766625+0000","last_clean":"2024-04-16T16:19:29.766625+0000","last_became_active":"2024-04-16T16:19:29.761785+0000","last_became_peered":"2024-04-16T16:19:29.761785+0000","last_unstale":"2024-04-16T16:19:29.766625+0000","last_undegraded":"2024-04-16T16:19:29.766625+0000","last_fullsized":"2024-04-16T16:19:29.766625+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:33:27.566787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.750257+0000","last_change":"2024-04-16T16:19:29.750257+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.750257+0000","last_undegraded":"2024-04-16T16:19:29.750257+0000","last_fullsized":"2024-04-16T16:19:29.750257+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.764939+0000","last_change":"2024-04-16T16:19:29.763703+0000","last_active":"2024-04-16T16:19:29.764939+0000","last_peered":"2024-04-16T16:19:29.764939+0000","last_clean":"2024-04-16T16:19:29.764939+0000","last_became_active":"2024-04-16T16:19:29.762997+0000","last_became_peered":"2024-04-16T16:19:29.762997+0000","last_unstale":"2024-04-16T16:19:29.764939+0000","last_undegraded":"2024-04-16T16:19:29.764939+0000","last_fullsized":"2024-04-16T16:19:29.764939+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:10.194347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.735819+0000","last_change":"2024-04-16T16:19:29.735819+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.735819+0000","last_undegraded":"2024-04-16T16:19:29.735819+0000","last_fullsized":"2024-04-16T16:19:29.735819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.751707+0000","last_change":"2024-04-16T16:19:29.748810+0000","last_active":"2024-04-16T16:19:29.751707+0000","last_peered":"2024-04-16T16:19:29.751707+0000","last_clean":"2024-04-16T16:19:29.751707+0000","last_became_active":"2024-04-16T16:19:29.746905+0000","last_became_peered":"2024-04-16T16:19:29.746905+0000","last_unstale":"2024-04-16T16:19:29.751707+0000","last_undegraded":"2024-04-16T16:19:29.751707+0000","last_fullsized":"2024-04-16T16:19:29.751707+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:08.667927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.739291+0000","last_change":"2024-04-16T16:19:29.739291+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.739291+0000","last_undegraded":"2024-04-16T16:19:29.739291+0000","last_fullsized":"2024-04-16T16:19:29.739291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.768541+0000","last_change":"2024-04-16T16:19:29.766555+0000","last_active":"2024-04-16T16:19:29.768541+0000","last_peered":"2024-04-16T16:19:29.768541+0000","last_clean":"2024-04-16T16:19:29.768541+0000","last_became_active":"2024-04-16T16:19:29.766098+0000","last_became_peered":"2024-04-16T16:19:29.766098+0000","last_unstale":"2024-04-16T16:19:29.768541+0000","last_undegraded":"2024-04-16T16:19:29.768541+0000","last_fullsized":"2024-04-16T16:19:29.768541+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:09.957160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.744881+0000","last_change":"2024-04-16T16:19:29.744881+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.744881+0000","last_undegraded":"2024-04-16T16:19:29.744881+0000","last_fullsized":"2024-04-16T16:19:29.744881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.767991+0000","last_change":"2024-04-16T16:19:29.766919+0000","last_active":"2024-04-16T16:19:29.767991+0000","last_peered":"2024-04-16T16:19:29.767991+0000","last_clean":"2024-04-16T16:19:29.767991+0000","last_became_active":"2024-04-16T16:19:29.766548+0000","last_became_peered":"2024-04-16T16:19:29.766548+0000","last_unstale":"2024-04-16T16:19:29.767991+0000","last_undegraded":"2024-04-16T16:19:29.767991+0000","last_fullsized":"2024-04-16T16:19:29.767991+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:31.565467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.748154+0000","last_change":"2024-04-16T16:19:29.748154+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.748154+0000","last_undegraded":"2024-04-16T16:19:29.748154+0000","last_fullsized":"2024-04-16T16:19:29.748154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.761679+0000","last_change":"2024-04-16T16:19:29.756366+0000","last_active":"2024-04-16T16:19:29.761679+0000","last_peered":"2024-04-16T16:19:29.761679+0000","last_clean":"2024-04-16T16:19:29.761679+0000","last_became_active":"2024-04-16T16:19:29.756027+0000","last_became_peered":"2024-04-16T16:19:29.756027+0000","last_unstale":"2024-04-16T16:19:29.761679+0000","last_undegraded":"2024-04-16T16:19:29.761679+0000","last_fullsized":"2024-04-16T16:19:29.761679+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:51.080942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.740370+0000","last_change":"2024-04-16T16:19:29.740370+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.740370+0000","last_undegraded":"2024-04-16T16:19:29.740370+0000","last_fullsized":"2024-04-16T16:19:29.740370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.757824+0000","last_change":"2024-04-16T16:19:29.754988+0000","last_active":"2024-04-16T16:19:29.757824+0000","last_peered":"2024-04-16T16:19:29.757824+0000","last_clean":"2024-04-16T16:19:29.757824+0000","last_became_active":"2024-04-16T16:19:29.754674+0000","last_became_peered":"2024-04-16T16:19:29.754674+0000","last_unstale":"2024-04-16T16:19:29.757824+0000","last_undegraded":"2024-04-16T16:19:29.757824+0000","last_fullsized":"2024-04-16T16:19:29.757824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:43.180032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.753993+0000","last_change":"2024-04-16T16:19:29.753993+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.753993+0000","last_undegraded":"2024-04-16T16:19:29.753993+0000","last_fullsized":"2024-04-16T16:19:29.753993+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.758522+0000","last_change":"2024-04-16T16:19:29.752034+0000","last_active":"2024-04-16T16:19:29.758522+0000","last_peered":"2024-04-16T16:19:29.758522+0000","last_clean":"2024-04-16T16:19:29.758522+0000","last_became_active":"2024-04-16T16:19:29.751736+0000","last_became_peered":"2024-04-16T16:19:29.751736+0000","last_unstale":"2024-04-16T16:19:29.758522+0000","last_undegraded":"2024-04-16T16:19:29.758522+0000","last_fullsized":"2024-04-16T16:19:29.758522+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:35.029290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.739480+0000","last_change":"2024-04-16T16:19:29.739480+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.739480+0000","last_undegraded":"2024-04-16T16:19:29.739480+0000","last_fullsized":"2024-04-16T16:19:29.739480+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.762198+0000","last_change":"2024-04-16T16:19:29.758997+0000","last_active":"2024-04-16T16:19:29.762198+0000","last_peered":"2024-04-16T16:19:29.762198+0000","last_clean":"2024-04-16T16:19:29.762198+0000","last_became_active":"2024-04-16T16:19:29.758741+0000","last_became_peered":"2024-04-16T16:19:29.758741+0000","last_unstale":"2024-04-16T16:19:29.762198+0000","last_undegraded":"2024-04-16T16:19:29.762198+0000","last_fullsized":"2024-04-16T16:19:29.762198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:48:42.247776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.753505+0000","last_change":"2024-04-16T16:19:29.753505+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.753505+0000","last_undegraded":"2024-04-16T16:19:29.753505+0000","last_fullsized":"2024-04-16T16:19:29.753505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.767871+0000","last_change":"2024-04-16T16:19:29.766825+0000","last_active":"2024-04-16T16:19:29.767871+0000","last_peered":"2024-04-16T16:19:29.767871+0000","last_clean":"2024-04-16T16:19:29.767871+0000","last_became_active":"2024-04-16T16:19:29.766561+0000","last_became_peered":"2024-04-16T16:19:29.766561+0000","last_unstale":"2024-04-16T16:19:29.767871+0000","last_undegraded":"2024-04-16T16:19:29.767871+0000","last_fullsized":"2024-04-16T16:19:29.767871+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:58.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.745107+0000","last_change":"2024-04-16T16:19:29.745107+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.745107+0000","last_undegraded":"2024-04-16T16:19:29.745107+0000","last_fullsized":"2024-04-16T16:19:29.745107+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.771971+0000","last_change":"2024-04-16T16:19:29.770783+0000","last_active":"2024-04-16T16:19:29.771971+0000","last_peered":"2024-04-16T16:19:29.771971+0000","last_clean":"2024-04-16T16:19:29.771971+0000","last_became_active":"2024-04-16T16:19:29.770492+0000","last_became_peered":"2024-04-16T16:19:29.770492+0000","last_unstale":"2024-04-16T16:19:29.771971+0000","last_undegraded":"2024-04-16T16:19:29.771971+0000","last_fullsized":"2024-04-16T16:19:29.771971+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:04:15.371117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.752930+0000","last_change":"2024-04-16T16:19:29.752930+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.752930+0000","last_undegraded":"2024-04-16T16:19:29.752930+0000","last_fullsized":"2024-04-16T16:19:29.752930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.764579+0000","last_change":"2024-04-16T16:19:29.763091+0000","last_active":"2024-04-16T16:19:29.764579+0000","last_peered":"2024-04-16T16:19:29.764579+0000","last_clean":"2024-04-16T16:19:29.764579+0000","last_became_active":"2024-04-16T16:19:29.762790+0000","last_became_peered":"2024-04-16T16:19:29.762790+0000","last_unstale":"2024-04-16T16:19:29.764579+0000","last_undegraded":"2024-04-16T16:19:29.764579+0000","last_fullsized":"2024-04-16T16:19:29.764579+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:42:47.237568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.749435+0000","last_change":"2024-04-16T16:19:29.749435+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.749435+0000","last_undegraded":"2024-04-16T16:19:29.749435+0000","last_fullsized":"2024-04-16T16:19:29.749435+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.767055+0000","last_change":"2024-04-16T16:19:29.762012+0000","last_active":"2024-04-16T16:19:29.767055+0000","last_peered":"2024-04-16T16:19:29.767055+0000","last_clean":"2024-04-16T16:19:29.767055+0000","last_became_active":"2024-04-16T16:19:29.761695+0000","last_became_peered":"2024-04-16T16:19:29.761695+0000","last_unstale":"2024-04-16T16:19:29.767055+0000","last_undegraded":"2024-04-16T16:19:29.767055+0000","last_fullsized":"2024-04-16T16:19:29.767055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:08.389940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.744996+0000","last_change":"2024-04-16T16:19:29.744996+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.744996+0000","last_undegraded":"2024-04-16T16:19:29.744996+0000","last_fullsized":"2024-04-16T16:19:29.744996+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.770316+0000","last_change":"2024-04-16T16:19:29.768754+0000","last_active":"2024-04-16T16:19:29.770316+0000","last_peered":"2024-04-16T16:19:29.770316+0000","last_clean":"2024-04-16T16:19:29.770316+0000","last_became_active":"2024-04-16T16:19:29.768273+0000","last_became_peered":"2024-04-16T16:19:29.768273+0000","last_unstale":"2024-04-16T16:19:29.770316+0000","last_undegraded":"2024-04-16T16:19:29.770316+0000","last_fullsized":"2024-04-16T16:19:29.770316+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:55.845590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.743594+0000","last_change":"2024-04-16T16:19:29.743594+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.743594+0000","last_undegraded":"2024-04-16T16:19:29.743594+0000","last_fullsized":"2024-04-16T16:19:29.743594+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.767030+0000","last_change":"2024-04-16T16:19:29.762242+0000","last_active":"2024-04-16T16:19:29.767030+0000","last_peered":"2024-04-16T16:19:29.767030+0000","last_clean":"2024-04-16T16:19:29.767030+0000","last_became_active":"2024-04-16T16:19:29.761930+0000","last_became_peered":"2024-04-16T16:19:29.761930+0000","last_unstale":"2024-04-16T16:19:29.767030+0000","last_undegraded":"2024-04-16T16:19:29.767030+0000","last_fullsized":"2024-04-16T16:19:29.767030+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:49:53.642687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.748385+0000","last_change":"2024-04-16T16:19:29.748385+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.748385+0000","last_undegraded":"2024-04-16T16:19:29.748385+0000","last_fullsized":"2024-04-16T16:19:29.748385+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.764661+0000","last_change":"2024-04-16T16:19:29.760232+0000","last_active":"2024-04-16T16:19:29.764661+0000","last_peered":"2024-04-16T16:19:29.764661+0000","last_clean":"2024-04-16T16:19:29.764661+0000","last_became_active":"2024-04-16T16:19:29.759876+0000","last_became_peered":"2024-04-16T16:19:29.759876+0000","last_unstale":"2024-04-16T16:19:29.764661+0000","last_undegraded":"2024-04-16T16:19:29.764661+0000","last_fullsized":"2024-04-16T16:19:29.764661+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:27.698721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.751741+0000","last_change":"2024-04-16T16:19:29.751741+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.751741+0000","last_undegraded":"2024-04-16T16:19:29.751741+0000","last_fullsized":"2024-04-16T16:19:29.751741+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.767196+0000","last_change":"2024-04-16T16:19:29.763308+0000","last_active":"2024-04-16T16:19:29.767196+0000","last_peered":"2024-04-16T16:19:29.767196+0000","last_clean":"2024-04-16T16:19:29.767196+0000","last_became_active":"2024-04-16T16:19:29.762953+0000","last_became_peered":"2024-04-16T16:19:29.762953+0000","last_unstale":"2024-04-16T16:19:29.767196+0000","last_undegraded":"2024-04-16T16:19:29.767196+0000","last_fullsized":"2024-04-16T16:19:29.767196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:05.908151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.748689+0000","last_change":"2024-04-16T16:19:29.748689+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.748689+0000","last_undegraded":"2024-04-16T16:19:29.748689+0000","last_fullsized":"2024-04-16T16:19:29.748689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.762215+0000","last_change":"2024-04-16T16:19:29.758726+0000","last_active":"2024-04-16T16:19:29.762215+0000","last_peered":"2024-04-16T16:19:29.762215+0000","last_clean":"2024-04-16T16:19:29.762215+0000","last_became_active":"2024-04-16T16:19:29.758234+0000","last_became_peered":"2024-04-16T16:19:29.758234+0000","last_unstale":"2024-04-16T16:19:29.762215+0000","last_undegraded":"2024-04-16T16:19:29.762215+0000","last_fullsized":"2024-04-16T16:19:29.762215+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:30:06.395961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.751632+0000","last_change":"2024-04-16T16:19:29.751632+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.751632+0000","last_undegraded":"2024-04-16T16:19:29.751632+0000","last_fullsized":"2024-04-16T16:19:29.751632+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.745348+0000","last_change":"2024-04-16T16:19:29.742084+0000","last_active":"2024-04-16T16:19:29.745348+0000","last_peered":"2024-04-16T16:19:29.745348+0000","last_clean":"2024-04-16T16:19:29.745348+0000","last_became_active":"2024-04-16T16:19:29.741314+0000","last_became_peered":"2024-04-16T16:19:29.741314+0000","last_unstale":"2024-04-16T16:19:29.745348+0000","last_undegraded":"2024-04-16T16:19:29.745348+0000","last_fullsized":"2024-04-16T16:19:29.745348+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:27.737133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.750849+0000","last_change":"2024-04-16T16:19:29.750849+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.750849+0000","last_undegraded":"2024-04-16T16:19:29.750849+0000","last_fullsized":"2024-04-16T16:19:29.750849+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.766840+0000","last_change":"2024-04-16T16:19:29.762213+0000","last_active":"2024-04-16T16:19:29.766840+0000","last_peered":"2024-04-16T16:19:29.766840+0000","last_clean":"2024-04-16T16:19:29.766840+0000","last_became_active":"2024-04-16T16:19:29.761901+0000","last_became_peered":"2024-04-16T16:19:29.761901+0000","last_unstale":"2024-04-16T16:19:29.766840+0000","last_undegraded":"2024-04-16T16:19:29.766840+0000","last_fullsized":"2024-04-16T16:19:29.766840+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:39.138989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.749872+0000","last_change":"2024-04-16T16:19:29.749872+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.749872+0000","last_undegraded":"2024-04-16T16:19:29.749872+0000","last_fullsized":"2024-04-16T16:19:29.749872+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.764079+0000","last_change":"2024-04-16T16:19:29.760620+0000","last_active":"2024-04-16T16:19:29.764079+0000","last_peered":"2024-04-16T16:19:29.764079+0000","last_clean":"2024-04-16T16:19:29.764079+0000","last_became_active":"2024-04-16T16:19:29.758269+0000","last_became_peered":"2024-04-16T16:19:29.758269+0000","last_unstale":"2024-04-16T16:19:29.764079+0000","last_undegraded":"2024-04-16T16:19:29.764079+0000","last_fullsized":"2024-04-16T16:19:29.764079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:09.078113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.738897+0000","last_change":"2024-04-16T16:19:29.738897+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.738897+0000","last_undegraded":"2024-04-16T16:19:29.738897+0000","last_fullsized":"2024-04-16T16:19:29.738897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.763339+0000","last_change":"2024-04-16T16:19:29.760002+0000","last_active":"2024-04-16T16:19:29.763339+0000","last_peered":"2024-04-16T16:19:29.763339+0000","last_clean":"2024-04-16T16:19:29.763339+0000","last_became_active":"2024-04-16T16:19:29.759723+0000","last_became_peered":"2024-04-16T16:19:29.759723+0000","last_unstale":"2024-04-16T16:19:29.763339+0000","last_undegraded":"2024-04-16T16:19:29.763339+0000","last_fullsized":"2024-04-16T16:19:29.763339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:05.021917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.747876+0000","last_change":"2024-04-16T16:19:29.747876+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.747876+0000","last_undegraded":"2024-04-16T16:19:29.747876+0000","last_fullsized":"2024-04-16T16:19:29.747876+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.760278+0000","last_change":"2024-04-16T16:19:29.757779+0000","last_active":"2024-04-16T16:19:29.760278+0000","last_peered":"2024-04-16T16:19:29.760278+0000","last_clean":"2024-04-16T16:19:29.760278+0000","last_became_active":"2024-04-16T16:19:29.757490+0000","last_became_peered":"2024-04-16T16:19:29.757490+0000","last_unstale":"2024-04-16T16:19:29.760278+0000","last_undegraded":"2024-04-16T16:19:29.760278+0000","last_fullsized":"2024-04-16T16:19:29.760278+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:30:39.629858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.746951+0000","last_change":"2024-04-16T16:19:29.746951+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.746951+0000","last_undegraded":"2024-04-16T16:19:29.746951+0000","last_fullsized":"2024-04-16T16:19:29.746951+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.764994+0000","last_change":"2024-04-16T16:19:29.763082+0000","last_active":"2024-04-16T16:19:29.764994+0000","last_peered":"2024-04-16T16:19:29.764994+0000","last_clean":"2024-04-16T16:19:29.764994+0000","last_became_active":"2024-04-16T16:19:29.762303+0000","last_became_peered":"2024-04-16T16:19:29.762303+0000","last_unstale":"2024-04-16T16:19:29.764994+0000","last_undegraded":"2024-04-16T16:19:29.764994+0000","last_fullsized":"2024-04-16T16:19:29.764994+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:05.021917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.748387+0000","last_change":"2024-04-16T16:19:29.748387+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.748387+0000","last_undegraded":"2024-04-16T16:19:29.748387+0000","last_fullsized":"2024-04-16T16:19:29.748387+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.767585+0000","last_change":"2024-04-16T16:19:29.763976+0000","last_active":"2024-04-16T16:19:29.767585+0000","last_peered":"2024-04-16T16:19:29.767585+0000","last_clean":"2024-04-16T16:19:29.767585+0000","last_became_active":"2024-04-16T16:19:29.763659+0000","last_became_peered":"2024-04-16T16:19:29.763659+0000","last_unstale":"2024-04-16T16:19:29.767585+0000","last_undegraded":"2024-04-16T16:19:29.767585+0000","last_fullsized":"2024-04-16T16:19:29.767585+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:31:27.640486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.747531+0000","last_change":"2024-04-16T16:19:29.747531+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.747531+0000","last_undegraded":"2024-04-16T16:19:29.747531+0000","last_fullsized":"2024-04-16T16:19:29.747531+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.772524+0000","last_change":"2024-04-16T16:19:29.771379+0000","last_active":"2024-04-16T16:19:29.772524+0000","last_peered":"2024-04-16T16:19:29.772524+0000","last_clean":"2024-04-16T16:19:29.772524+0000","last_became_active":"2024-04-16T16:19:29.770810+0000","last_became_peered":"2024-04-16T16:19:29.770810+0000","last_unstale":"2024-04-16T16:19:29.772524+0000","last_undegraded":"2024-04-16T16:19:29.772524+0000","last_fullsized":"2024-04-16T16:19:29.772524+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:39:18.923354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.752468+0000","last_change":"2024-04-16T16:19:29.752468+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.752468+0000","last_undegraded":"2024-04-16T16:19:29.752468+0000","last_fullsized":"2024-04-16T16:19:29.752468+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.751603+0000","last_change":"2024-04-16T16:19:29.745757+0000","last_active":"2024-04-16T16:19:29.751603+0000","last_peered":"2024-04-16T16:19:29.751603+0000","last_clean":"2024-04-16T16:19:29.751603+0000","last_became_active":"2024-04-16T16:19:29.745414+0000","last_became_peered":"2024-04-16T16:19:29.745414+0000","last_unstale":"2024-04-16T16:19:29.751603+0000","last_undegraded":"2024-04-16T16:19:29.751603+0000","last_fullsized":"2024-04-16T16:19:29.751603+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:48:42.247776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.749465+0000","last_change":"2024-04-16T16:19:29.749465+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.749465+0000","last_undegraded":"2024-04-16T16:19:29.749465+0000","last_fullsized":"2024-04-16T16:19:29.749465+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.770808+0000","last_change":"2024-04-16T16:19:29.769655+0000","last_active":"2024-04-16T16:19:29.770808+0000","last_peered":"2024-04-16T16:19:29.770808+0000","last_clean":"2024-04-16T16:19:29.770808+0000","last_became_active":"2024-04-16T16:19:29.769186+0000","last_became_peered":"2024-04-16T16:19:29.769186+0000","last_unstale":"2024-04-16T16:19:29.770808+0000","last_undegraded":"2024-04-16T16:19:29.770808+0000","last_fullsized":"2024-04-16T16:19:29.770808+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:29.064020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.751177+0000","last_change":"2024-04-16T16:19:29.751177+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.751177+0000","last_undegraded":"2024-04-16T16:19:29.751177+0000","last_fullsized":"2024-04-16T16:19:29.751177+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.763382+0000","last_change":"2024-04-16T16:19:29.761542+0000","last_active":"2024-04-16T16:19:29.763382+0000","last_peered":"2024-04-16T16:19:29.763382+0000","last_clean":"2024-04-16T16:19:29.763382+0000","last_became_active":"2024-04-16T16:19:29.761254+0000","last_became_peered":"2024-04-16T16:19:29.761254+0000","last_unstale":"2024-04-16T16:19:29.763382+0000","last_undegraded":"2024-04-16T16:19:29.763382+0000","last_fullsized":"2024-04-16T16:19:29.763382+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:08.667927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.732849+0000","last_change":"2024-04-16T16:19:29.732849+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.732849+0000","last_undegraded":"2024-04-16T16:19:29.732849+0000","last_fullsized":"2024-04-16T16:19:29.732849+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.766835+0000","last_change":"2024-04-16T16:19:29.765295+0000","last_active":"2024-04-16T16:19:29.766835+0000","last_peered":"2024-04-16T16:19:29.766835+0000","last_clean":"2024-04-16T16:19:29.766835+0000","last_became_active":"2024-04-16T16:19:29.765007+0000","last_became_peered":"2024-04-16T16:19:29.765007+0000","last_unstale":"2024-04-16T16:19:29.766835+0000","last_undegraded":"2024-04-16T16:19:29.766835+0000","last_fullsized":"2024-04-16T16:19:29.766835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:10.194347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.737886+0000","last_change":"2024-04-16T16:19:29.737886+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.737886+0000","last_undegraded":"2024-04-16T16:19:29.737886+0000","last_fullsized":"2024-04-16T16:19:29.737886+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.758861+0000","last_change":"2024-04-16T16:19:29.755044+0000","last_active":"2024-04-16T16:19:29.758861+0000","last_peered":"2024-04-16T16:19:29.758861+0000","last_clean":"2024-04-16T16:19:29.758861+0000","last_became_active":"2024-04-16T16:19:29.754749+0000","last_became_peered":"2024-04-16T16:19:29.754749+0000","last_unstale":"2024-04-16T16:19:29.758861+0000","last_undegraded":"2024-04-16T16:19:29.758861+0000","last_fullsized":"2024-04-16T16:19:29.758861+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:04.982609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-16T16:19:29.747409+0000","last_change":"2024-04-16T16:19:29.747409+0000","last_active":"2024-04-16T16:19:29.716966+0000","last_peered":"2024-04-16T16:19:29.716966+0000","last_clean":"2024-04-16T16:19:29.716966+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:19:29.747409+0000","last_undegraded":"2024-04-16T16:19:29.747409+0000","last_fullsized":"2024-04-16T16:19:29.747409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.764101+0000","last_change":"2024-04-16T16:19:29.762543+0000","last_active":"2024-04-16T16:19:29.764101+0000","last_peered":"2024-04-16T16:19:29.764101+0000","last_clean":"2024-04-16T16:19:29.764101+0000","last_became_active":"2024-04-16T16:19:29.762159+0000","last_became_peered":"2024-04-16T16:19:29.762159+0000","last_unstale":"2024-04-16T16:19:29.764101+0000","last_undegraded":"2024-04-16T16:19:29.764101+0000","last_fullsized":"2024-04-16T16:19:29.764101+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:09.957160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-16T16:19:29.754058+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:19:29.754058+0000","last_peered":"2024-04-16T16:19:29.754058+0000","last_clean":"2024-04-16T16:19:29.754058+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:19:29.754058+0000","last_undegraded":"2024-04-16T16:19:29.754058+0000","last_fullsized":"2024-04-16T16:19:29.754058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1122304,"data_stored":803161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":528384,"data_stored":212793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":528384,"data_stored":212793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":528384,"data_stored":212793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":528384,"data_stored":212793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":528384,"data_stored":212793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":528384,"data_stored":212793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":809428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:19:35.280 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:19:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.542+0000 7f11f2c00640 1 Processor -- start 2024-04-16T16:19:35.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.542+0000 7f11f2c00640 1 -- start start 2024-04-16T16:19:35.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.543+0000 7f11f2c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec06eaa0 0x7f11ec0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f11ec0cc810 0x7f11ec06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11ec06ee80 0x7f11ec15c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f11ec06cf10 con 0x7f11ec06ee80 2024-04-16T16:19:35.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f11ec06d160 con 0x7f11ec0cc810 2024-04-16T16:19:35.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec06d440 con 0x7f11ec06eaa0 2024-04-16T16:19:35.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11ec06ee80 0x7f11ec15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11ec06ee80 0x7f11ec15c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57084/0 (socket says 172.21.15.22:57084) 2024-04-16T16:19:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2200640 1 -- 172.21.15.22:0/3114427470 learned_addr learned my addr 172.21.15.22:0/3114427470 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f1800640 1 --2- 172.21.15.22:0/3114427470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec06eaa0 0x7f11ec0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2200640 1 -- 172.21.15.22:0/3114427470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec06eaa0 msgr2=0x7f11ec0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2200640 1 --2- 172.21.15.22:0/3114427470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec06eaa0 0x7f11ec0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2200640 1 -- 172.21.15.22:0/3114427470 >> v2:172.21.15.43:3300/0 conn(0x7f11ec0cc810 msgr2=0x7f11ec06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.544+0000 7f11f2200640 1 --2- 172.21.15.22:0/3114427470 >> v2:172.21.15.43:3300/0 conn(0x7f11ec0cc810 0x7f11ec06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.545+0000 7f11f2200640 1 -- 172.21.15.22:0/3114427470 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec06d720 con 0x7f11ec06ee80 2024-04-16T16:19:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.545+0000 7f11f1800640 1 --2- 172.21.15.22:0/3114427470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec06eaa0 0x7f11ec0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.546+0000 7f11f2200640 1 --2- 172.21.15.22:0/3114427470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec15c200 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f11ec073160 tx=0x7f11e402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70ea33067c0cd13 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.546+0000 7f11ebe00640 1 -- 172.21.15.22:0/3114427470 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e402ca80 con 0x7f11ec06ee80 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.546+0000 7f11ebe00640 1 -- 172.21.15.22:0/3114427470 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e402cc20 con 0x7f11ec06ee80 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.546+0000 7f11ebe00640 1 -- 172.21.15.22:0/3114427470 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e40343f0 con 0x7f11ec06ee80 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 -- 172.21.15.22:0/3114427470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 msgr2=0x7f11ec15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 --2- 172.21.15.22:0/3114427470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec15c200 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f11ec073160 tx=0x7f11e402bee0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 -- 172.21.15.22:0/3114427470 shutdown_connections 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 --2- 172.21.15.22:0/3114427470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec15c200 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 --2- 172.21.15.22:0/3114427470 >> v2:172.21.15.43:3300/0 conn(0x7f11ec0cc810 0x7f11ec06df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 --2- 172.21.15.22:0/3114427470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec06eaa0 0x7f11ec0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 -- 172.21.15.22:0/3114427470 >> 172.21.15.22:0/3114427470 conn(0x7f11ec062440 msgr2=0x7f11ec062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 -- 172.21.15.22:0/3114427470 shutdown_connections 2024-04-16T16:19:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.547+0000 7f11f2c00640 1 -- 172.21.15.22:0/3114427470 wait complete. 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.548+0000 7f11f2c00640 1 Processor -- start 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.549+0000 7f11f2c00640 1 -- start start 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f2c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11ec06eaa0 0x7f11ec154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f2c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f2c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec0cc810 0x7f11ec0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f2c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec06e440 con 0x7f11ec06ee80 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f2c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec0b4360 con 0x7f11ec06eaa0 2024-04-16T16:19:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f2c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec15c740 con 0x7f11ec0cc810 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f0e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f0e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec0c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57096/0 (socket says 172.21.15.22:57096) 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f0e00640 1 -- 172.21.15.22:0/1359732798 learned_addr learned my addr 172.21.15.22:0/1359732798 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f1800640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11ec06eaa0 0x7f11ec154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f2200640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec0cc810 0x7f11ec0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f0e00640 1 -- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec0cc810 msgr2=0x7f11ec0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f0e00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec0cc810 0x7f11ec0cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f0e00640 1 -- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11ec06eaa0 msgr2=0x7f11ec154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.550+0000 7f11f0e00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11ec06eaa0 0x7f11ec154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11f0e00640 1 -- 172.21.15.22:0/1359732798 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec1f7bc0 con 0x7f11ec06ee80 2024-04-16T16:19:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11f2200640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec0cc810 0x7f11ec0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11f0e00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec0c9790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b440 tx=0x7f11d800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11e9600640 1 -- 172.21.15.22:0/1359732798 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8015020 con 0x7f11ec06ee80 2024-04-16T16:19:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11e9600640 1 -- 172.21.15.22:0/1359732798 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d8011890 con 0x7f11ec06ee80 2024-04-16T16:19:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11e9600640 1 -- 172.21.15.22:0/1359732798 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8011c80 con 0x7f11ec06ee80 2024-04-16T16:19:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ec1f7ea0 con 0x7f11ec06ee80 2024-04-16T16:19:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.551+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ec1f8460 con 0x7f11ec06ee80 2024-04-16T16:19:35.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.553+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ec075f30 con 0x7f11ec06ee80 2024-04-16T16:19:35.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.553+0000 7f11e9600640 1 -- 172.21.15.22:0/1359732798 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f11d8018020 con 0x7f11ec06ee80 2024-04-16T16:19:35.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.554+0000 7f11e9600640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f11cc06cbf0 0x7f11cc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:35.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.555+0000 7f11e9600640 1 -- 172.21.15.22:0/1359732798 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f11d808c0c0 con 0x7f11ec06ee80 2024-04-16T16:19:35.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.555+0000 7f11f1800640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f11cc06cbf0 0x7f11cc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:35.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.555+0000 7f11f1800640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f11cc06cbf0 0x7f11cc06f0b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f11e000a990 tx=0x7f11e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:35.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.559+0000 7f11e9600640 1 -- 172.21.15.22:0/1359732798 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11d801f020 con 0x7f11ec06ee80 2024-04-16T16:19:35.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.761+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11ec070ee0 con 0x7f11cc06cbf0 2024-04-16T16:19:35.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.774+0000 7f11e9600640 1 -- 172.21.15.22:0/1359732798 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251960 (secure 0 0 0) 0x7f11ec070ee0 con 0x7f11cc06cbf0 2024-04-16T16:19:35.776 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:35.778 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f11cc06cbf0 msgr2=0x7f11cc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f11cc06cbf0 0x7f11cc06f0b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f11e000a990 tx=0x7f11e0008040 comp rx=0 tx=0).stop 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 msgr2=0x7f11ec0c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec0c9790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b440 tx=0x7f11d800b900 comp rx=0 tx=0).stop 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 shutdown_connections 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f11cc06cbf0 0x7f11cc06f0b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11ec0cc810 0x7f11ec0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11ec06ee80 0x7f11ec0c9790 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 --2- 172.21.15.22:0/1359732798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11ec06eaa0 0x7f11ec154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 >> 172.21.15.22:0/1359732798 conn(0x7f11ec062440 msgr2=0x7f11ec0d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 shutdown_connections 2024-04-16T16:19:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:35.780+0000 7f11f2c00640 1 -- 172.21.15.22:0/1359732798 wait complete. 2024-04-16T16:19:35.801 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-04-16T16:19:35.762878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255120,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719600,"statfs":{"total":773094113280,"available":772832870400,"internally_reserved":0,"allocated":5775360,"data_stored":3042636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.035889"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049460+0000","last_change":"2024-04-16T16:19:30.769241+0000","last_active":"2024-04-16T16:19:32.049460+0000","last_peered":"2024-04-16T16:19:32.049460+0000","last_clean":"2024-04-16T16:19:32.049460+0000","last_became_active":"2024-04-16T16:19:30.768886+0000","last_became_peered":"2024-04-16T16:19:30.768886+0000","last_unstale":"2024-04-16T16:19:32.049460+0000","last_undegraded":"2024-04-16T16:19:32.049460+0000","last_fullsized":"2024-04-16T16:19:32.049460+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:51.034573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784806+0000","last_change":"2024-04-16T16:19:30.796977+0000","last_active":"2024-04-16T16:19:31.784806+0000","last_peered":"2024-04-16T16:19:31.784806+0000","last_clean":"2024-04-16T16:19:31.784806+0000","last_became_active":"2024-04-16T16:19:30.796636+0000","last_became_peered":"2024-04-16T16:19:30.796636+0000","last_unstale":"2024-04-16T16:19:31.784806+0000","last_undegraded":"2024-04-16T16:19:31.784806+0000","last_fullsized":"2024-04-16T16:19:31.784806+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:33:28.581842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784613+0000","last_change":"2024-04-16T16:19:30.788712+0000","last_active":"2024-04-16T16:19:31.784613+0000","last_peered":"2024-04-16T16:19:31.784613+0000","last_clean":"2024-04-16T16:19:31.784613+0000","last_became_active":"2024-04-16T16:19:30.787578+0000","last_became_peered":"2024-04-16T16:19:30.787578+0000","last_unstale":"2024-04-16T16:19:31.784613+0000","last_undegraded":"2024-04-16T16:19:31.784613+0000","last_fullsized":"2024-04-16T16:19:31.784613+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:26:33.812490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049928+0000","last_change":"2024-04-16T16:19:30.793271+0000","last_active":"2024-04-16T16:19:32.049928+0000","last_peered":"2024-04-16T16:19:32.049928+0000","last_clean":"2024-04-16T16:19:32.049928+0000","last_became_active":"2024-04-16T16:19:30.792940+0000","last_became_peered":"2024-04-16T16:19:30.792940+0000","last_unstale":"2024-04-16T16:19:32.049928+0000","last_undegraded":"2024-04-16T16:19:32.049928+0000","last_fullsized":"2024-04-16T16:19:32.049928+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:10.093168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784583+0000","last_change":"2024-04-16T16:19:30.794376+0000","last_active":"2024-04-16T16:19:31.784583+0000","last_peered":"2024-04-16T16:19:31.784583+0000","last_clean":"2024-04-16T16:19:31.784583+0000","last_became_active":"2024-04-16T16:19:30.794019+0000","last_became_peered":"2024-04-16T16:19:30.794019+0000","last_unstale":"2024-04-16T16:19:31.784583+0000","last_undegraded":"2024-04-16T16:19:31.784583+0000","last_fullsized":"2024-04-16T16:19:31.784583+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:49:54.657742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806635+0000","last_change":"2024-04-16T16:19:30.772638+0000","last_active":"2024-04-16T16:19:31.806635+0000","last_peered":"2024-04-16T16:19:31.806635+0000","last_clean":"2024-04-16T16:19:31.806635+0000","last_became_active":"2024-04-16T16:19:30.771939+0000","last_became_peered":"2024-04-16T16:19:30.771939+0000","last_unstale":"2024-04-16T16:19:31.806635+0000","last_undegraded":"2024-04-16T16:19:31.806635+0000","last_fullsized":"2024-04-16T16:19:31.806635+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:05.093532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048330+0000","last_change":"2024-04-16T16:19:30.779597+0000","last_active":"2024-04-16T16:19:32.048330+0000","last_peered":"2024-04-16T16:19:32.048330+0000","last_clean":"2024-04-16T16:19:32.048330+0000","last_became_active":"2024-04-16T16:19:30.779249+0000","last_became_peered":"2024-04-16T16:19:30.779249+0000","last_unstale":"2024-04-16T16:19:32.048330+0000","last_undegraded":"2024-04-16T16:19:32.048330+0000","last_fullsized":"2024-04-16T16:19:32.048330+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:31:28.655541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048896+0000","last_change":"2024-04-16T16:19:30.790044+0000","last_active":"2024-04-16T16:19:32.048896+0000","last_peered":"2024-04-16T16:19:32.048896+0000","last_clean":"2024-04-16T16:19:32.048896+0000","last_became_active":"2024-04-16T16:19:30.789666+0000","last_became_peered":"2024-04-16T16:19:30.789666+0000","last_unstale":"2024-04-16T16:19:32.048896+0000","last_undegraded":"2024-04-16T16:19:32.048896+0000","last_fullsized":"2024-04-16T16:19:32.048896+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:54:16.083852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050201+0000","last_change":"2024-04-16T16:19:30.790858+0000","last_active":"2024-04-16T16:19:32.050201+0000","last_peered":"2024-04-16T16:19:32.050201+0000","last_clean":"2024-04-16T16:19:32.050201+0000","last_became_active":"2024-04-16T16:19:30.790642+0000","last_became_peered":"2024-04-16T16:19:30.790642+0000","last_unstale":"2024-04-16T16:19:32.050201+0000","last_undegraded":"2024-04-16T16:19:32.050201+0000","last_fullsized":"2024-04-16T16:19:32.050201+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:33:28.581842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050855+0000","last_change":"2024-04-16T16:19:30.795064+0000","last_active":"2024-04-16T16:19:32.050855+0000","last_peered":"2024-04-16T16:19:32.050855+0000","last_clean":"2024-04-16T16:19:32.050855+0000","last_became_active":"2024-04-16T16:19:30.791686+0000","last_became_peered":"2024-04-16T16:19:30.791686+0000","last_unstale":"2024-04-16T16:19:32.050855+0000","last_undegraded":"2024-04-16T16:19:32.050855+0000","last_fullsized":"2024-04-16T16:19:32.050855+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:31:28.655541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049718+0000","last_change":"2024-04-16T16:19:30.783060+0000","last_active":"2024-04-16T16:19:32.049718+0000","last_peered":"2024-04-16T16:19:32.049718+0000","last_clean":"2024-04-16T16:19:32.049718+0000","last_became_active":"2024-04-16T16:19:30.782743+0000","last_became_peered":"2024-04-16T16:19:30.782743+0000","last_unstale":"2024-04-16T16:19:32.049718+0000","last_undegraded":"2024-04-16T16:19:32.049718+0000","last_fullsized":"2024-04-16T16:19:32.049718+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.585032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784323+0000","last_change":"2024-04-16T16:19:30.792067+0000","last_active":"2024-04-16T16:19:31.784323+0000","last_peered":"2024-04-16T16:19:31.784323+0000","last_clean":"2024-04-16T16:19:31.784323+0000","last_became_active":"2024-04-16T16:19:30.790780+0000","last_became_peered":"2024-04-16T16:19:30.790780+0000","last_unstale":"2024-04-16T16:19:31.784323+0000","last_undegraded":"2024-04-16T16:19:31.784323+0000","last_fullsized":"2024-04-16T16:19:31.784323+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:10.093168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050382+0000","last_change":"2024-04-16T16:19:30.785433+0000","last_active":"2024-04-16T16:19:32.050382+0000","last_peered":"2024-04-16T16:19:32.050382+0000","last_clean":"2024-04-16T16:19:32.050382+0000","last_became_active":"2024-04-16T16:19:30.784513+0000","last_became_peered":"2024-04-16T16:19:30.784513+0000","last_unstale":"2024-04-16T16:19:32.050382+0000","last_undegraded":"2024-04-16T16:19:32.050382+0000","last_fullsized":"2024-04-16T16:19:32.050382+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:11.209402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049637+0000","last_change":"2024-04-16T16:19:30.785612+0000","last_active":"2024-04-16T16:19:32.049637+0000","last_peered":"2024-04-16T16:19:32.049637+0000","last_clean":"2024-04-16T16:19:32.049637+0000","last_became_active":"2024-04-16T16:19:30.784861+0000","last_became_peered":"2024-04-16T16:19:30.784861+0000","last_unstale":"2024-04-16T16:19:32.049637+0000","last_undegraded":"2024-04-16T16:19:32.049637+0000","last_fullsized":"2024-04-16T16:19:32.049637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:26:33.812490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806755+0000","last_change":"2024-04-16T16:19:30.771578+0000","last_active":"2024-04-16T16:19:31.806755+0000","last_peered":"2024-04-16T16:19:31.806755+0000","last_clean":"2024-04-16T16:19:31.806755+0000","last_became_active":"2024-04-16T16:19:30.771235+0000","last_became_peered":"2024-04-16T16:19:30.771235+0000","last_unstale":"2024-04-16T16:19:31.806755+0000","last_undegraded":"2024-04-16T16:19:31.806755+0000","last_fullsized":"2024-04-16T16:19:31.806755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:36:37.009693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048239+0000","last_change":"2024-04-16T16:19:30.798941+0000","last_active":"2024-04-16T16:19:32.048239+0000","last_peered":"2024-04-16T16:19:32.048239+0000","last_clean":"2024-04-16T16:19:32.048239+0000","last_became_active":"2024-04-16T16:19:30.798214+0000","last_became_peered":"2024-04-16T16:19:30.798214+0000","last_unstale":"2024-04-16T16:19:32.048239+0000","last_undegraded":"2024-04-16T16:19:32.048239+0000","last_fullsized":"2024-04-16T16:19:32.048239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:30.192807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.785986+0000","last_change":"2024-04-16T16:19:30.786190+0000","last_active":"2024-04-16T16:19:31.785986+0000","last_peered":"2024-04-16T16:19:31.785986+0000","last_clean":"2024-04-16T16:19:31.785986+0000","last_became_active":"2024-04-16T16:19:30.785606+0000","last_became_peered":"2024-04-16T16:19:30.785606+0000","last_unstale":"2024-04-16T16:19:31.785986+0000","last_undegraded":"2024-04-16T16:19:31.785986+0000","last_fullsized":"2024-04-16T16:19:31.785986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:33:28.581842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.785707+0000","last_change":"2024-04-16T16:19:30.790178+0000","last_active":"2024-04-16T16:19:31.785707+0000","last_peered":"2024-04-16T16:19:31.785707+0000","last_clean":"2024-04-16T16:19:31.785707+0000","last_became_active":"2024-04-16T16:19:30.787840+0000","last_became_peered":"2024-04-16T16:19:30.787840+0000","last_unstale":"2024-04-16T16:19:31.785707+0000","last_undegraded":"2024-04-16T16:19:31.785707+0000","last_fullsized":"2024-04-16T16:19:31.785707+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:10.093168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050834+0000","last_change":"2024-04-16T16:19:30.793617+0000","last_active":"2024-04-16T16:19:32.050834+0000","last_peered":"2024-04-16T16:19:32.050834+0000","last_clean":"2024-04-16T16:19:32.050834+0000","last_became_active":"2024-04-16T16:19:30.793356+0000","last_became_peered":"2024-04-16T16:19:30.793356+0000","last_unstale":"2024-04-16T16:19:32.050834+0000","last_undegraded":"2024-04-16T16:19:32.050834+0000","last_fullsized":"2024-04-16T16:19:32.050834+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:30.079075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049078+0000","last_change":"2024-04-16T16:19:30.796005+0000","last_active":"2024-04-16T16:19:32.049078+0000","last_peered":"2024-04-16T16:19:32.049078+0000","last_clean":"2024-04-16T16:19:32.049078+0000","last_became_active":"2024-04-16T16:19:30.795705+0000","last_became_peered":"2024-04-16T16:19:30.795705+0000","last_unstale":"2024-04-16T16:19:32.049078+0000","last_undegraded":"2024-04-16T16:19:32.049078+0000","last_fullsized":"2024-04-16T16:19:32.049078+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:48:43.262831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806774+0000","last_change":"2024-04-16T16:19:30.786058+0000","last_active":"2024-04-16T16:19:31.806774+0000","last_peered":"2024-04-16T16:19:31.806774+0000","last_clean":"2024-04-16T16:19:31.806774+0000","last_became_active":"2024-04-16T16:19:30.785759+0000","last_became_peered":"2024-04-16T16:19:30.785759+0000","last_unstale":"2024-04-16T16:19:31.806774+0000","last_undegraded":"2024-04-16T16:19:31.806774+0000","last_fullsized":"2024-04-16T16:19:31.806774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:06.712905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049674+0000","last_change":"2024-04-16T16:19:30.793094+0000","last_active":"2024-04-16T16:19:32.049674+0000","last_peered":"2024-04-16T16:19:32.049674+0000","last_clean":"2024-04-16T16:19:32.049674+0000","last_became_active":"2024-04-16T16:19:30.791816+0000","last_became_peered":"2024-04-16T16:19:30.791816+0000","last_unstale":"2024-04-16T16:19:32.049674+0000","last_undegraded":"2024-04-16T16:19:32.049674+0000","last_fullsized":"2024-04-16T16:19:32.049674+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:58.477067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049466+0000","last_change":"2024-04-16T16:19:30.782627+0000","last_active":"2024-04-16T16:19:32.049466+0000","last_peered":"2024-04-16T16:19:32.049466+0000","last_clean":"2024-04-16T16:19:32.049466+0000","last_became_active":"2024-04-16T16:19:30.782051+0000","last_became_peered":"2024-04-16T16:19:30.782051+0000","last_unstale":"2024-04-16T16:19:32.049466+0000","last_undegraded":"2024-04-16T16:19:32.049466+0000","last_fullsized":"2024-04-16T16:19:32.049466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:28.752187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048644+0000","last_change":"2024-04-16T16:19:30.782257+0000","last_active":"2024-04-16T16:19:32.048644+0000","last_peered":"2024-04-16T16:19:32.048644+0000","last_clean":"2024-04-16T16:19:32.048644+0000","last_became_active":"2024-04-16T16:19:30.781546+0000","last_became_peered":"2024-04-16T16:19:30.781546+0000","last_unstale":"2024-04-16T16:19:32.048644+0000","last_undegraded":"2024-04-16T16:19:32.048644+0000","last_fullsized":"2024-04-16T16:19:32.048644+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:50.834345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.051056+0000","last_change":"2024-04-16T16:19:30.783479+0000","last_active":"2024-04-16T16:19:32.051056+0000","last_peered":"2024-04-16T16:19:32.051056+0000","last_clean":"2024-04-16T16:19:32.051056+0000","last_became_active":"2024-04-16T16:19:30.783148+0000","last_became_peered":"2024-04-16T16:19:30.783148+0000","last_unstale":"2024-04-16T16:19:32.051056+0000","last_undegraded":"2024-04-16T16:19:32.051056+0000","last_fullsized":"2024-04-16T16:19:32.051056+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:39:19.938409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048514+0000","last_change":"2024-04-16T16:19:30.787123+0000","last_active":"2024-04-16T16:19:32.048514+0000","last_peered":"2024-04-16T16:19:32.048514+0000","last_clean":"2024-04-16T16:19:32.048514+0000","last_became_active":"2024-04-16T16:19:30.786792+0000","last_became_peered":"2024-04-16T16:19:30.786792+0000","last_unstale":"2024-04-16T16:19:32.048514+0000","last_undegraded":"2024-04-16T16:19:32.048514+0000","last_fullsized":"2024-04-16T16:19:32.048514+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:56.172374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.785044+0000","last_change":"2024-04-16T16:19:30.784749+0000","last_active":"2024-04-16T16:19:31.785044+0000","last_peered":"2024-04-16T16:19:31.785044+0000","last_clean":"2024-04-16T16:19:31.785044+0000","last_became_active":"2024-04-16T16:19:30.784336+0000","last_became_peered":"2024-04-16T16:19:30.784336+0000","last_unstale":"2024-04-16T16:19:31.785044+0000","last_undegraded":"2024-04-16T16:19:31.785044+0000","last_fullsized":"2024-04-16T16:19:31.785044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:58.477067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784789+0000","last_change":"2024-04-16T16:19:30.790757+0000","last_active":"2024-04-16T16:19:31.784789+0000","last_peered":"2024-04-16T16:19:31.784789+0000","last_clean":"2024-04-16T16:19:31.784789+0000","last_became_active":"2024-04-16T16:19:30.790471+0000","last_became_peered":"2024-04-16T16:19:30.790471+0000","last_unstale":"2024-04-16T16:19:31.784789+0000","last_undegraded":"2024-04-16T16:19:31.784789+0000","last_fullsized":"2024-04-16T16:19:31.784789+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:09.404995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050287+0000","last_change":"2024-04-16T16:19:30.785137+0000","last_active":"2024-04-16T16:19:32.050287+0000","last_peered":"2024-04-16T16:19:32.050287+0000","last_clean":"2024-04-16T16:19:32.050287+0000","last_became_active":"2024-04-16T16:19:30.781445+0000","last_became_peered":"2024-04-16T16:19:30.781445+0000","last_unstale":"2024-04-16T16:19:32.050287+0000","last_undegraded":"2024-04-16T16:19:32.050287+0000","last_fullsized":"2024-04-16T16:19:32.050287+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:10.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.783696+0000","last_change":"2024-04-16T16:19:30.768539+0000","last_active":"2024-04-16T16:19:31.783696+0000","last_peered":"2024-04-16T16:19:31.783696+0000","last_clean":"2024-04-16T16:19:31.783696+0000","last_became_active":"2024-04-16T16:19:30.767518+0000","last_became_peered":"2024-04-16T16:19:30.767518+0000","last_unstale":"2024-04-16T16:19:31.783696+0000","last_undegraded":"2024-04-16T16:19:31.783696+0000","last_fullsized":"2024-04-16T16:19:31.783696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.585032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807172+0000","last_change":"2024-04-16T16:19:30.787204+0000","last_active":"2024-04-16T16:19:31.807172+0000","last_peered":"2024-04-16T16:19:31.807172+0000","last_clean":"2024-04-16T16:19:31.807172+0000","last_became_active":"2024-04-16T16:19:30.786921+0000","last_became_peered":"2024-04-16T16:19:30.786921+0000","last_unstale":"2024-04-16T16:19:31.807172+0000","last_undegraded":"2024-04-16T16:19:31.807172+0000","last_fullsized":"2024-04-16T16:19:31.807172+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:58.502286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049060+0000","last_change":"2024-04-16T16:19:30.785186+0000","last_active":"2024-04-16T16:19:32.049060+0000","last_peered":"2024-04-16T16:19:32.049060+0000","last_clean":"2024-04-16T16:19:32.049060+0000","last_became_active":"2024-04-16T16:19:30.784818+0000","last_became_peered":"2024-04-16T16:19:30.784818+0000","last_unstale":"2024-04-16T16:19:32.049060+0000","last_undegraded":"2024-04-16T16:19:32.049060+0000","last_fullsized":"2024-04-16T16:19:32.049060+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:30:07.411016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.780586+0000","last_change":"2024-04-16T16:19:30.777233+0000","last_active":"2024-04-16T16:19:31.780586+0000","last_peered":"2024-04-16T16:19:31.780586+0000","last_clean":"2024-04-16T16:19:31.780586+0000","last_became_active":"2024-04-16T16:19:30.776878+0000","last_became_peered":"2024-04-16T16:19:30.776878+0000","last_unstale":"2024-04-16T16:19:31.780586+0000","last_undegraded":"2024-04-16T16:19:31.780586+0000","last_fullsized":"2024-04-16T16:19:31.780586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:30.079075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807092+0000","last_change":"2024-04-16T16:19:29.762120+0000","last_active":"2024-04-16T16:19:31.807092+0000","last_peered":"2024-04-16T16:19:31.807092+0000","last_clean":"2024-04-16T16:19:31.807092+0000","last_became_active":"2024-04-16T16:19:29.761785+0000","last_became_peered":"2024-04-16T16:19:29.761785+0000","last_unstale":"2024-04-16T16:19:31.807092+0000","last_undegraded":"2024-04-16T16:19:31.807092+0000","last_fullsized":"2024-04-16T16:19:31.807092+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:44:50.751934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.051083+0000","last_change":"2024-04-16T16:19:30.787571+0000","last_active":"2024-04-16T16:19:32.051083+0000","last_peered":"2024-04-16T16:19:32.051083+0000","last_clean":"2024-04-16T16:19:32.051083+0000","last_became_active":"2024-04-16T16:19:30.784262+0000","last_became_peered":"2024-04-16T16:19:30.784262+0000","last_unstale":"2024-04-16T16:19:32.051083+0000","last_undegraded":"2024-04-16T16:19:32.051083+0000","last_fullsized":"2024-04-16T16:19:32.051083+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:16.075966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.785909+0000","last_change":"2024-04-16T16:19:29.763703+0000","last_active":"2024-04-16T16:19:31.785909+0000","last_peered":"2024-04-16T16:19:31.785909+0000","last_clean":"2024-04-16T16:19:31.785909+0000","last_became_active":"2024-04-16T16:19:29.762997+0000","last_became_peered":"2024-04-16T16:19:29.762997+0000","last_unstale":"2024-04-16T16:19:31.785909+0000","last_undegraded":"2024-04-16T16:19:31.785909+0000","last_fullsized":"2024-04-16T16:19:31.785909+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:43.180032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.785244+0000","last_change":"2024-04-16T16:19:30.787740+0000","last_active":"2024-04-16T16:19:31.785244+0000","last_peered":"2024-04-16T16:19:31.785244+0000","last_clean":"2024-04-16T16:19:31.785244+0000","last_became_active":"2024-04-16T16:19:30.787458+0000","last_became_peered":"2024-04-16T16:19:30.787458+0000","last_unstale":"2024-04-16T16:19:31.785244+0000","last_undegraded":"2024-04-16T16:19:31.785244+0000","last_fullsized":"2024-04-16T16:19:31.785244+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:40.154044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.781107+0000","last_change":"2024-04-16T16:19:29.748810+0000","last_active":"2024-04-16T16:19:31.781107+0000","last_peered":"2024-04-16T16:19:31.781107+0000","last_clean":"2024-04-16T16:19:31.781107+0000","last_became_active":"2024-04-16T16:19:29.746905+0000","last_became_peered":"2024-04-16T16:19:29.746905+0000","last_unstale":"2024-04-16T16:19:31.781107+0000","last_undegraded":"2024-04-16T16:19:31.781107+0000","last_fullsized":"2024-04-16T16:19:31.781107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:49.819290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.780956+0000","last_change":"2024-04-16T16:19:30.790509+0000","last_active":"2024-04-16T16:19:31.780956+0000","last_peered":"2024-04-16T16:19:31.780956+0000","last_clean":"2024-04-16T16:19:31.780956+0000","last_became_active":"2024-04-16T16:19:30.787162+0000","last_became_peered":"2024-04-16T16:19:30.787162+0000","last_unstale":"2024-04-16T16:19:31.780956+0000","last_undegraded":"2024-04-16T16:19:31.780956+0000","last_fullsized":"2024-04-16T16:19:31.780956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:04:16.386172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049048+0000","last_change":"2024-04-16T16:19:29.766555+0000","last_active":"2024-04-16T16:19:32.049048+0000","last_peered":"2024-04-16T16:19:32.049048+0000","last_clean":"2024-04-16T16:19:32.049048+0000","last_became_active":"2024-04-16T16:19:29.766098+0000","last_became_peered":"2024-04-16T16:19:29.766098+0000","last_unstale":"2024-04-16T16:19:32.049048+0000","last_undegraded":"2024-04-16T16:19:32.049048+0000","last_fullsized":"2024-04-16T16:19:32.049048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:22.242618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784476+0000","last_change":"2024-04-16T16:19:30.785606+0000","last_active":"2024-04-16T16:19:31.784476+0000","last_peered":"2024-04-16T16:19:31.784476+0000","last_clean":"2024-04-16T16:19:31.784476+0000","last_became_active":"2024-04-16T16:19:30.785307+0000","last_became_peered":"2024-04-16T16:19:30.785307+0000","last_unstale":"2024-04-16T16:19:31.784476+0000","last_undegraded":"2024-04-16T16:19:31.784476+0000","last_fullsized":"2024-04-16T16:19:31.784476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:23.257673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807027+0000","last_change":"2024-04-16T16:19:29.766919+0000","last_active":"2024-04-16T16:19:31.807027+0000","last_peered":"2024-04-16T16:19:31.807027+0000","last_clean":"2024-04-16T16:19:31.807027+0000","last_became_active":"2024-04-16T16:19:29.766548+0000","last_became_peered":"2024-04-16T16:19:29.766548+0000","last_unstale":"2024-04-16T16:19:31.807027+0000","last_undegraded":"2024-04-16T16:19:31.807027+0000","last_fullsized":"2024-04-16T16:19:31.807027+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:00:34.119802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049523+0000","last_change":"2024-04-16T16:19:30.794057+0000","last_active":"2024-04-16T16:19:32.049523+0000","last_peered":"2024-04-16T16:19:32.049523+0000","last_clean":"2024-04-16T16:19:32.049523+0000","last_became_active":"2024-04-16T16:19:30.793840+0000","last_became_peered":"2024-04-16T16:19:30.793840+0000","last_unstale":"2024-04-16T16:19:32.049523+0000","last_undegraded":"2024-04-16T16:19:32.049523+0000","last_fullsized":"2024-04-16T16:19:32.049523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:23.257673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784790+0000","last_change":"2024-04-16T16:19:29.756366+0000","last_active":"2024-04-16T16:19:31.784790+0000","last_peered":"2024-04-16T16:19:31.784790+0000","last_clean":"2024-04-16T16:19:31.784790+0000","last_became_active":"2024-04-16T16:19:29.756027+0000","last_became_peered":"2024-04-16T16:19:29.756027+0000","last_unstale":"2024-04-16T16:19:31.784790+0000","last_undegraded":"2024-04-16T16:19:31.784790+0000","last_fullsized":"2024-04-16T16:19:31.784790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:49.819290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049065+0000","last_change":"2024-04-16T16:19:30.788922+0000","last_active":"2024-04-16T16:19:32.049065+0000","last_peered":"2024-04-16T16:19:32.049065+0000","last_clean":"2024-04-16T16:19:32.049065+0000","last_became_active":"2024-04-16T16:19:30.785324+0000","last_became_peered":"2024-04-16T16:19:30.785324+0000","last_unstale":"2024-04-16T16:19:32.049065+0000","last_undegraded":"2024-04-16T16:19:32.049065+0000","last_fullsized":"2024-04-16T16:19:32.049065+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:15.276832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.783815+0000","last_change":"2024-04-16T16:19:29.754988+0000","last_active":"2024-04-16T16:19:31.783815+0000","last_peered":"2024-04-16T16:19:31.783815+0000","last_clean":"2024-04-16T16:19:31.783815+0000","last_became_active":"2024-04-16T16:19:29.754674+0000","last_became_peered":"2024-04-16T16:19:29.754674+0000","last_unstale":"2024-04-16T16:19:31.783815+0000","last_undegraded":"2024-04-16T16:19:31.783815+0000","last_fullsized":"2024-04-16T16:19:31.783815+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:04:15.371117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049375+0000","last_change":"2024-04-16T16:19:30.783593+0000","last_active":"2024-04-16T16:19:32.049375+0000","last_peered":"2024-04-16T16:19:32.049375+0000","last_clean":"2024-04-16T16:19:32.049375+0000","last_became_active":"2024-04-16T16:19:30.783241+0000","last_became_peered":"2024-04-16T16:19:30.783241+0000","last_unstale":"2024-04-16T16:19:32.049375+0000","last_undegraded":"2024-04-16T16:19:32.049375+0000","last_fullsized":"2024-04-16T16:19:32.049375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:44.195086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049171+0000","last_change":"2024-04-16T16:19:29.752034+0000","last_active":"2024-04-16T16:19:32.049171+0000","last_peered":"2024-04-16T16:19:32.049171+0000","last_clean":"2024-04-16T16:19:32.049171+0000","last_became_active":"2024-04-16T16:19:29.751736+0000","last_became_peered":"2024-04-16T16:19:29.751736+0000","last_unstale":"2024-04-16T16:19:32.049171+0000","last_undegraded":"2024-04-16T16:19:32.049171+0000","last_fullsized":"2024-04-16T16:19:32.049171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:17:28.775630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.785795+0000","last_change":"2024-04-16T16:19:30.789496+0000","last_active":"2024-04-16T16:19:31.785795+0000","last_peered":"2024-04-16T16:19:31.785795+0000","last_clean":"2024-04-16T16:19:31.785795+0000","last_became_active":"2024-04-16T16:19:30.787583+0000","last_became_peered":"2024-04-16T16:19:30.787583+0000","last_unstale":"2024-04-16T16:19:31.785795+0000","last_undegraded":"2024-04-16T16:19:31.785795+0000","last_fullsized":"2024-04-16T16:19:31.785795+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:09.404995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.786180+0000","last_change":"2024-04-16T16:19:29.758997+0000","last_active":"2024-04-16T16:19:31.786180+0000","last_peered":"2024-04-16T16:19:31.786180+0000","last_clean":"2024-04-16T16:19:31.786180+0000","last_became_active":"2024-04-16T16:19:29.758741+0000","last_became_peered":"2024-04-16T16:19:29.758741+0000","last_unstale":"2024-04-16T16:19:31.786180+0000","last_undegraded":"2024-04-16T16:19:31.786180+0000","last_fullsized":"2024-04-16T16:19:31.786180+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:29.177752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049755+0000","last_change":"2024-04-16T16:19:30.784804+0000","last_active":"2024-04-16T16:19:32.049755+0000","last_peered":"2024-04-16T16:19:32.049755+0000","last_clean":"2024-04-16T16:19:32.049755+0000","last_became_active":"2024-04-16T16:19:30.784482+0000","last_became_peered":"2024-04-16T16:19:30.784482+0000","last_unstale":"2024-04-16T16:19:32.049755+0000","last_undegraded":"2024-04-16T16:19:32.049755+0000","last_fullsized":"2024-04-16T16:19:32.049755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:34.659016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.051496+0000","last_change":"2024-04-16T16:19:29.766825+0000","last_active":"2024-04-16T16:19:32.051496+0000","last_peered":"2024-04-16T16:19:32.051496+0000","last_clean":"2024-04-16T16:19:32.051496+0000","last_became_active":"2024-04-16T16:19:29.766561+0000","last_became_peered":"2024-04-16T16:19:29.766561+0000","last_unstale":"2024-04-16T16:19:32.051496+0000","last_undegraded":"2024-04-16T16:19:32.051496+0000","last_fullsized":"2024-04-16T16:19:32.051496+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:30:06.395961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806868+0000","last_change":"2024-04-16T16:19:30.791439+0000","last_active":"2024-04-16T16:19:31.806868+0000","last_peered":"2024-04-16T16:19:31.806868+0000","last_clean":"2024-04-16T16:19:31.806868+0000","last_became_active":"2024-04-16T16:19:30.790967+0000","last_became_peered":"2024-04-16T16:19:30.790967+0000","last_unstale":"2024-04-16T16:19:31.806868+0000","last_undegraded":"2024-04-16T16:19:31.806868+0000","last_fullsized":"2024-04-16T16:19:31.806868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:05:58.634239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049518+0000","last_change":"2024-04-16T16:19:29.770783+0000","last_active":"2024-04-16T16:19:32.049518+0000","last_peered":"2024-04-16T16:19:32.049518+0000","last_clean":"2024-04-16T16:19:32.049518+0000","last_became_active":"2024-04-16T16:19:29.770492+0000","last_became_peered":"2024-04-16T16:19:29.770492+0000","last_unstale":"2024-04-16T16:19:32.049518+0000","last_undegraded":"2024-04-16T16:19:32.049518+0000","last_fullsized":"2024-04-16T16:19:32.049518+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:52:20.255752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048999+0000","last_change":"2024-04-16T16:19:30.777078+0000","last_active":"2024-04-16T16:19:32.048999+0000","last_peered":"2024-04-16T16:19:32.048999+0000","last_clean":"2024-04-16T16:19:32.048999+0000","last_became_active":"2024-04-16T16:19:30.776859+0000","last_became_peered":"2024-04-16T16:19:30.776859+0000","last_unstale":"2024-04-16T16:19:32.048999+0000","last_undegraded":"2024-04-16T16:19:32.048999+0000","last_fullsized":"2024-04-16T16:19:32.048999+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:34:21.113171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049334+0000","last_change":"2024-04-16T16:19:29.763091+0000","last_active":"2024-04-16T16:19:32.049334+0000","last_peered":"2024-04-16T16:19:32.049334+0000","last_clean":"2024-04-16T16:19:32.049334+0000","last_became_active":"2024-04-16T16:19:29.762790+0000","last_became_peered":"2024-04-16T16:19:29.762790+0000","last_unstale":"2024-04-16T16:19:32.049334+0000","last_undegraded":"2024-04-16T16:19:32.049334+0000","last_fullsized":"2024-04-16T16:19:32.049334+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:04.982609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050256+0000","last_change":"2024-04-16T16:19:30.794685+0000","last_active":"2024-04-16T16:19:32.050256+0000","last_peered":"2024-04-16T16:19:32.050256+0000","last_clean":"2024-04-16T16:19:32.050256+0000","last_became_active":"2024-04-16T16:19:30.793943+0000","last_became_peered":"2024-04-16T16:19:30.793943+0000","last_unstale":"2024-04-16T16:19:32.050256+0000","last_undegraded":"2024-04-16T16:19:32.050256+0000","last_fullsized":"2024-04-16T16:19:32.050256+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:06.036972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807231+0000","last_change":"2024-04-16T16:19:29.762012+0000","last_active":"2024-04-16T16:19:31.807231+0000","last_peered":"2024-04-16T16:19:31.807231+0000","last_clean":"2024-04-16T16:19:31.807231+0000","last_became_active":"2024-04-16T16:19:29.761695+0000","last_became_peered":"2024-04-16T16:19:29.761695+0000","last_unstale":"2024-04-16T16:19:31.807231+0000","last_undegraded":"2024-04-16T16:19:31.807231+0000","last_fullsized":"2024-04-16T16:19:31.807231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:50.019518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049950+0000","last_change":"2024-04-16T16:19:30.783885+0000","last_active":"2024-04-16T16:19:32.049950+0000","last_peered":"2024-04-16T16:19:32.049950+0000","last_clean":"2024-04-16T16:19:32.049950+0000","last_became_active":"2024-04-16T16:19:30.783579+0000","last_became_peered":"2024-04-16T16:19:30.783579+0000","last_unstale":"2024-04-16T16:19:32.049950+0000","last_undegraded":"2024-04-16T16:19:32.049950+0000","last_fullsized":"2024-04-16T16:19:32.049950+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:09.404995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048344+0000","last_change":"2024-04-16T16:19:29.768754+0000","last_active":"2024-04-16T16:19:32.048344+0000","last_peered":"2024-04-16T16:19:32.048344+0000","last_clean":"2024-04-16T16:19:32.048344+0000","last_became_active":"2024-04-16T16:19:29.768273+0000","last_became_peered":"2024-04-16T16:19:29.768273+0000","last_unstale":"2024-04-16T16:19:32.048344+0000","last_undegraded":"2024-04-16T16:19:32.048344+0000","last_fullsized":"2024-04-16T16:19:32.048344+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:54:15.068797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806536+0000","last_change":"2024-04-16T16:19:30.792158+0000","last_active":"2024-04-16T16:19:31.806536+0000","last_peered":"2024-04-16T16:19:31.806536+0000","last_clean":"2024-04-16T16:19:31.806536+0000","last_became_active":"2024-04-16T16:19:30.791899+0000","last_became_peered":"2024-04-16T16:19:30.791899+0000","last_unstale":"2024-04-16T16:19:31.806536+0000","last_undegraded":"2024-04-16T16:19:31.806536+0000","last_fullsized":"2024-04-16T16:19:31.806536+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:15.159044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807251+0000","last_change":"2024-04-16T16:19:29.762242+0000","last_active":"2024-04-16T16:19:31.807251+0000","last_peered":"2024-04-16T16:19:31.807251+0000","last_clean":"2024-04-16T16:19:31.807251+0000","last_became_active":"2024-04-16T16:19:29.761930+0000","last_became_peered":"2024-04-16T16:19:29.761930+0000","last_unstale":"2024-04-16T16:19:31.807251+0000","last_undegraded":"2024-04-16T16:19:31.807251+0000","last_fullsized":"2024-04-16T16:19:31.807251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:34:20.098116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048480+0000","last_change":"2024-04-16T16:19:30.785959+0000","last_active":"2024-04-16T16:19:32.048480+0000","last_peered":"2024-04-16T16:19:32.048480+0000","last_clean":"2024-04-16T16:19:32.048480+0000","last_became_active":"2024-04-16T16:19:30.785664+0000","last_became_peered":"2024-04-16T16:19:30.785664+0000","last_unstale":"2024-04-16T16:19:32.048480+0000","last_undegraded":"2024-04-16T16:19:32.048480+0000","last_fullsized":"2024-04-16T16:19:32.048480+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:32.580522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049285+0000","last_change":"2024-04-16T16:19:29.760232+0000","last_active":"2024-04-16T16:19:32.049285+0000","last_peered":"2024-04-16T16:19:32.049285+0000","last_clean":"2024-04-16T16:19:32.049285+0000","last_became_active":"2024-04-16T16:19:29.759876+0000","last_became_peered":"2024-04-16T16:19:29.759876+0000","last_unstale":"2024-04-16T16:19:32.049285+0000","last_undegraded":"2024-04-16T16:19:32.049285+0000","last_fullsized":"2024-04-16T16:19:32.049285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:41:21.128389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048692+0000","last_change":"2024-04-16T16:19:30.788818+0000","last_active":"2024-04-16T16:19:32.048692+0000","last_peered":"2024-04-16T16:19:32.048692+0000","last_clean":"2024-04-16T16:19:32.048692+0000","last_became_active":"2024-04-16T16:19:30.788298+0000","last_became_peered":"2024-04-16T16:19:30.788298+0000","last_unstale":"2024-04-16T16:19:32.048692+0000","last_undegraded":"2024-04-16T16:19:32.048692+0000","last_fullsized":"2024-04-16T16:19:32.048692+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:52.095997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.051828+0000","last_change":"2024-04-16T16:19:29.763308+0000","last_active":"2024-04-16T16:19:32.051828+0000","last_peered":"2024-04-16T16:19:32.051828+0000","last_clean":"2024-04-16T16:19:32.051828+0000","last_became_active":"2024-04-16T16:19:29.762953+0000","last_became_peered":"2024-04-16T16:19:29.762953+0000","last_unstale":"2024-04-16T16:19:32.051828+0000","last_undegraded":"2024-04-16T16:19:32.051828+0000","last_fullsized":"2024-04-16T16:19:32.051828+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:35.029290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050497+0000","last_change":"2024-04-16T16:19:30.791067+0000","last_active":"2024-04-16T16:19:32.050497+0000","last_peered":"2024-04-16T16:19:32.050497+0000","last_clean":"2024-04-16T16:19:32.050497+0000","last_became_active":"2024-04-16T16:19:30.784409+0000","last_became_peered":"2024-04-16T16:19:30.784409+0000","last_unstale":"2024-04-16T16:19:32.050497+0000","last_undegraded":"2024-04-16T16:19:32.050497+0000","last_fullsized":"2024-04-16T16:19:32.050497+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:49:54.657742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.786080+0000","last_change":"2024-04-16T16:19:29.758726+0000","last_active":"2024-04-16T16:19:31.786080+0000","last_peered":"2024-04-16T16:19:31.786080+0000","last_clean":"2024-04-16T16:19:31.786080+0000","last_became_active":"2024-04-16T16:19:29.758234+0000","last_became_peered":"2024-04-16T16:19:29.758234+0000","last_unstale":"2024-04-16T16:19:31.786080+0000","last_undegraded":"2024-04-16T16:19:31.786080+0000","last_fullsized":"2024-04-16T16:19:31.786080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:05.021917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050983+0000","last_change":"2024-04-16T16:19:30.788852+0000","last_active":"2024-04-16T16:19:32.050983+0000","last_peered":"2024-04-16T16:19:32.050983+0000","last_clean":"2024-04-16T16:19:32.050983+0000","last_became_active":"2024-04-16T16:19:30.786652+0000","last_became_peered":"2024-04-16T16:19:30.786652+0000","last_unstale":"2024-04-16T16:19:32.050983+0000","last_undegraded":"2024-04-16T16:19:32.050983+0000","last_fullsized":"2024-04-16T16:19:32.050983+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:04:16.386172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784991+0000","last_change":"2024-04-16T16:19:29.742084+0000","last_active":"2024-04-16T16:19:31.784991+0000","last_peered":"2024-04-16T16:19:31.784991+0000","last_clean":"2024-04-16T16:19:31.784991+0000","last_became_active":"2024-04-16T16:19:29.741314+0000","last_became_peered":"2024-04-16T16:19:29.741314+0000","last_unstale":"2024-04-16T16:19:31.784991+0000","last_undegraded":"2024-04-16T16:19:31.784991+0000","last_fullsized":"2024-04-16T16:19:31.784991+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:39:18.923354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050676+0000","last_change":"2024-04-16T16:19:30.785196+0000","last_active":"2024-04-16T16:19:32.050676+0000","last_peered":"2024-04-16T16:19:32.050676+0000","last_clean":"2024-04-16T16:19:32.050676+0000","last_became_active":"2024-04-16T16:19:30.784855+0000","last_became_peered":"2024-04-16T16:19:30.784855+0000","last_unstale":"2024-04-16T16:19:32.050676+0000","last_undegraded":"2024-04-16T16:19:32.050676+0000","last_fullsized":"2024-04-16T16:19:32.050676+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:56.860645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806972+0000","last_change":"2024-04-16T16:19:29.762213+0000","last_active":"2024-04-16T16:19:31.806972+0000","last_peered":"2024-04-16T16:19:31.806972+0000","last_clean":"2024-04-16T16:19:31.806972+0000","last_became_active":"2024-04-16T16:19:29.761901+0000","last_became_peered":"2024-04-16T16:19:29.761901+0000","last_unstale":"2024-04-16T16:19:31.806972+0000","last_undegraded":"2024-04-16T16:19:31.806972+0000","last_fullsized":"2024-04-16T16:19:31.806972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:33.643961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806641+0000","last_change":"2024-04-16T16:19:30.787772+0000","last_active":"2024-04-16T16:19:31.806641+0000","last_peered":"2024-04-16T16:19:31.806641+0000","last_clean":"2024-04-16T16:19:31.806641+0000","last_became_active":"2024-04-16T16:19:30.787509+0000","last_became_peered":"2024-04-16T16:19:30.787509+0000","last_unstale":"2024-04-16T16:19:31.806641+0000","last_undegraded":"2024-04-16T16:19:31.806641+0000","last_fullsized":"2024-04-16T16:19:31.806641+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:08:52.537987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807455+0000","last_change":"2024-04-16T16:19:29.760620+0000","last_active":"2024-04-16T16:19:31.807455+0000","last_peered":"2024-04-16T16:19:31.807455+0000","last_clean":"2024-04-16T16:19:31.807455+0000","last_became_active":"2024-04-16T16:19:29.758269+0000","last_became_peered":"2024-04-16T16:19:29.758269+0000","last_unstale":"2024-04-16T16:19:31.807455+0000","last_undegraded":"2024-04-16T16:19:31.807455+0000","last_fullsized":"2024-04-16T16:19:31.807455+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:29.985514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.780588+0000","last_change":"2024-04-16T16:19:30.786402+0000","last_active":"2024-04-16T16:19:31.780588+0000","last_peered":"2024-04-16T16:19:31.780588+0000","last_clean":"2024-04-16T16:19:31.780588+0000","last_became_active":"2024-04-16T16:19:30.784673+0000","last_became_peered":"2024-04-16T16:19:30.784673+0000","last_unstale":"2024-04-16T16:19:31.780588+0000","last_undegraded":"2024-04-16T16:19:31.780588+0000","last_fullsized":"2024-04-16T16:19:31.780588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:56.860645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784088+0000","last_change":"2024-04-16T16:19:29.760002+0000","last_active":"2024-04-16T16:19:31.784088+0000","last_peered":"2024-04-16T16:19:31.784088+0000","last_clean":"2024-04-16T16:19:31.784088+0000","last_became_active":"2024-04-16T16:19:29.759723+0000","last_became_peered":"2024-04-16T16:19:29.759723+0000","last_unstale":"2024-04-16T16:19:31.784088+0000","last_undegraded":"2024-04-16T16:19:31.784088+0000","last_fullsized":"2024-04-16T16:19:31.784088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:55.845590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049481+0000","last_change":"2024-04-16T16:19:30.791397+0000","last_active":"2024-04-16T16:19:32.049481+0000","last_peered":"2024-04-16T16:19:32.049481+0000","last_clean":"2024-04-16T16:19:32.049481+0000","last_became_active":"2024-04-16T16:19:30.791045+0000","last_became_peered":"2024-04-16T16:19:30.791045+0000","last_unstale":"2024-04-16T16:19:32.049481+0000","last_undegraded":"2024-04-16T16:19:32.049481+0000","last_fullsized":"2024-04-16T16:19:32.049481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:09.682982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048904+0000","last_change":"2024-04-16T16:19:29.757779+0000","last_active":"2024-04-16T16:19:32.048904+0000","last_peered":"2024-04-16T16:19:32.048904+0000","last_clean":"2024-04-16T16:19:32.048904+0000","last_became_active":"2024-04-16T16:19:29.757490+0000","last_became_peered":"2024-04-16T16:19:29.757490+0000","last_unstale":"2024-04-16T16:19:32.048904+0000","last_undegraded":"2024-04-16T16:19:32.048904+0000","last_fullsized":"2024-04-16T16:19:32.048904+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:51.080942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049012+0000","last_change":"2024-04-16T16:19:30.785218+0000","last_active":"2024-04-16T16:19:32.049012+0000","last_peered":"2024-04-16T16:19:32.049012+0000","last_clean":"2024-04-16T16:19:32.049012+0000","last_became_active":"2024-04-16T16:19:30.783354+0000","last_became_peered":"2024-04-16T16:19:30.783354+0000","last_unstale":"2024-04-16T16:19:32.049012+0000","last_undegraded":"2024-04-16T16:19:32.049012+0000","last_fullsized":"2024-04-16T16:19:32.049012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:52:21.270807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.047997+0000","last_change":"2024-04-16T16:19:29.763082+0000","last_active":"2024-04-16T16:19:32.047997+0000","last_peered":"2024-04-16T16:19:32.047997+0000","last_clean":"2024-04-16T16:19:32.047997+0000","last_became_active":"2024-04-16T16:19:29.762303+0000","last_became_peered":"2024-04-16T16:19:29.762303+0000","last_unstale":"2024-04-16T16:19:32.047997+0000","last_undegraded":"2024-04-16T16:19:32.047997+0000","last_fullsized":"2024-04-16T16:19:32.047997+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:26:32.797435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.051334+0000","last_change":"2024-04-16T16:19:30.798819+0000","last_active":"2024-04-16T16:19:32.051334+0000","last_peered":"2024-04-16T16:19:32.051334+0000","last_clean":"2024-04-16T16:19:32.051334+0000","last_became_active":"2024-04-16T16:19:30.798513+0000","last_became_peered":"2024-04-16T16:19:30.798513+0000","last_unstale":"2024-04-16T16:19:32.051334+0000","last_undegraded":"2024-04-16T16:19:32.051334+0000","last_fullsized":"2024-04-16T16:19:32.051334+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:54:16.083852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807168+0000","last_change":"2024-04-16T16:19:29.763976+0000","last_active":"2024-04-16T16:19:31.807168+0000","last_peered":"2024-04-16T16:19:31.807168+0000","last_clean":"2024-04-16T16:19:31.807168+0000","last_became_active":"2024-04-16T16:19:29.763659+0000","last_became_peered":"2024-04-16T16:19:29.763659+0000","last_unstale":"2024-04-16T16:19:31.807168+0000","last_undegraded":"2024-04-16T16:19:31.807168+0000","last_fullsized":"2024-04-16T16:19:31.807168+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:38:09.259518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050188+0000","last_change":"2024-04-16T16:19:30.783222+0000","last_active":"2024-04-16T16:19:32.050188+0000","last_peered":"2024-04-16T16:19:32.050188+0000","last_clean":"2024-04-16T16:19:32.050188+0000","last_became_active":"2024-04-16T16:19:30.782816+0000","last_became_peered":"2024-04-16T16:19:30.782816+0000","last_unstale":"2024-04-16T16:19:32.050188+0000","last_undegraded":"2024-04-16T16:19:32.050188+0000","last_fullsized":"2024-04-16T16:19:32.050188+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:40.154044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049735+0000","last_change":"2024-04-16T16:19:29.771379+0000","last_active":"2024-04-16T16:19:32.049735+0000","last_peered":"2024-04-16T16:19:32.049735+0000","last_clean":"2024-04-16T16:19:32.049735+0000","last_became_active":"2024-04-16T16:19:29.770810+0000","last_became_peered":"2024-04-16T16:19:29.770810+0000","last_unstale":"2024-04-16T16:19:32.049735+0000","last_undegraded":"2024-04-16T16:19:32.049735+0000","last_fullsized":"2024-04-16T16:19:32.049735+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:57.462012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.049468+0000","last_change":"2024-04-16T16:19:30.790913+0000","last_active":"2024-04-16T16:19:32.049468+0000","last_peered":"2024-04-16T16:19:32.049468+0000","last_clean":"2024-04-16T16:19:32.049468+0000","last_became_active":"2024-04-16T16:19:30.790560+0000","last_became_peered":"2024-04-16T16:19:30.790560+0000","last_unstale":"2024-04-16T16:19:32.049468+0000","last_undegraded":"2024-04-16T16:19:32.049468+0000","last_fullsized":"2024-04-16T16:19:32.049468+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:38:10.274573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.780265+0000","last_change":"2024-04-16T16:19:29.745757+0000","last_active":"2024-04-16T16:19:31.780265+0000","last_peered":"2024-04-16T16:19:31.780265+0000","last_clean":"2024-04-16T16:19:31.780265+0000","last_became_active":"2024-04-16T16:19:29.745414+0000","last_became_peered":"2024-04-16T16:19:29.745414+0000","last_unstale":"2024-04-16T16:19:31.780265+0000","last_undegraded":"2024-04-16T16:19:31.780265+0000","last_fullsized":"2024-04-16T16:19:31.780265+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:29.177752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.806924+0000","last_change":"2024-04-16T16:19:30.772878+0000","last_active":"2024-04-16T16:19:31.806924+0000","last_peered":"2024-04-16T16:19:31.806924+0000","last_clean":"2024-04-16T16:19:31.806924+0000","last_became_active":"2024-04-16T16:19:30.772306+0000","last_became_peered":"2024-04-16T16:19:30.772306+0000","last_unstale":"2024-04-16T16:19:31.806924+0000","last_undegraded":"2024-04-16T16:19:31.806924+0000","last_fullsized":"2024-04-16T16:19:31.806924+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:15:56.633511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048958+0000","last_change":"2024-04-16T16:19:29.769655+0000","last_active":"2024-04-16T16:19:32.048958+0000","last_peered":"2024-04-16T16:19:32.048958+0000","last_clean":"2024-04-16T16:19:32.048958+0000","last_became_active":"2024-04-16T16:19:29.769186+0000","last_became_peered":"2024-04-16T16:19:29.769186+0000","last_unstale":"2024-04-16T16:19:32.048958+0000","last_undegraded":"2024-04-16T16:19:32.048958+0000","last_fullsized":"2024-04-16T16:19:32.048958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:14.261777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.807115+0000","last_change":"2024-04-16T16:19:30.789924+0000","last_active":"2024-04-16T16:19:31.807115+0000","last_peered":"2024-04-16T16:19:31.807115+0000","last_clean":"2024-04-16T16:19:31.807115+0000","last_became_active":"2024-04-16T16:19:30.789554+0000","last_became_peered":"2024-04-16T16:19:30.789554+0000","last_unstale":"2024-04-16T16:19:31.807115+0000","last_undegraded":"2024-04-16T16:19:31.807115+0000","last_fullsized":"2024-04-16T16:19:31.807115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:35.473007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.785092+0000","last_change":"2024-04-16T16:19:29.761542+0000","last_active":"2024-04-16T16:19:31.785092+0000","last_peered":"2024-04-16T16:19:31.785092+0000","last_clean":"2024-04-16T16:19:31.785092+0000","last_became_active":"2024-04-16T16:19:29.761254+0000","last_became_peered":"2024-04-16T16:19:29.761254+0000","last_unstale":"2024-04-16T16:19:31.785092+0000","last_undegraded":"2024-04-16T16:19:31.785092+0000","last_fullsized":"2024-04-16T16:19:31.785092+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:27.737133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.783701+0000","last_change":"2024-04-16T16:19:30.786941+0000","last_active":"2024-04-16T16:19:31.783701+0000","last_peered":"2024-04-16T16:19:31.783701+0000","last_clean":"2024-04-16T16:19:31.783701+0000","last_became_active":"2024-04-16T16:19:30.786599+0000","last_became_peered":"2024-04-16T16:19:30.786599+0000","last_unstale":"2024-04-16T16:19:31.783701+0000","last_undegraded":"2024-04-16T16:19:31.783701+0000","last_fullsized":"2024-04-16T16:19:31.783701+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.585032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.780314+0000","last_change":"2024-04-16T16:19:29.765295+0000","last_active":"2024-04-16T16:19:31.780314+0000","last_peered":"2024-04-16T16:19:31.780314+0000","last_clean":"2024-04-16T16:19:31.780314+0000","last_became_active":"2024-04-16T16:19:29.765007+0000","last_became_peered":"2024-04-16T16:19:29.765007+0000","last_unstale":"2024-04-16T16:19:31.780314+0000","last_undegraded":"2024-04-16T16:19:31.780314+0000","last_fullsized":"2024-04-16T16:19:31.780314+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:27.737133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784344+0000","last_change":"2024-04-16T16:19:30.765392+0000","last_active":"2024-04-16T16:19:31.784344+0000","last_peered":"2024-04-16T16:19:31.784344+0000","last_clean":"2024-04-16T16:19:31.784344+0000","last_became_active":"2024-04-16T16:19:30.764576+0000","last_became_peered":"2024-04-16T16:19:30.764576+0000","last_unstale":"2024-04-16T16:19:31.784344+0000","last_undegraded":"2024-04-16T16:19:31.784344+0000","last_fullsized":"2024-04-16T16:19:31.784344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:52:21.270807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.050204+0000","last_change":"2024-04-16T16:19:29.755044+0000","last_active":"2024-04-16T16:19:32.050204+0000","last_peered":"2024-04-16T16:19:32.050204+0000","last_clean":"2024-04-16T16:19:32.050204+0000","last_became_active":"2024-04-16T16:19:29.754749+0000","last_became_peered":"2024-04-16T16:19:29.754749+0000","last_unstale":"2024-04-16T16:19:32.050204+0000","last_undegraded":"2024-04-16T16:19:32.050204+0000","last_fullsized":"2024-04-16T16:19:32.050204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:55.157319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.051246+0000","last_change":"2024-04-16T16:19:30.785837+0000","last_active":"2024-04-16T16:19:32.051246+0000","last_peered":"2024-04-16T16:19:32.051246+0000","last_clean":"2024-04-16T16:19:32.051246+0000","last_became_active":"2024-04-16T16:19:30.785559+0000","last_became_peered":"2024-04-16T16:19:30.785559+0000","last_unstale":"2024-04-16T16:19:32.051246+0000","last_undegraded":"2024-04-16T16:19:32.051246+0000","last_fullsized":"2024-04-16T16:19:32.051246+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:29.716966+0000","last_clean_scrub_stamp":"2024-04-16T16:19:29.716966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:32.580522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:31.784880+0000","last_change":"2024-04-16T16:19:29.762543+0000","last_active":"2024-04-16T16:19:31.784880+0000","last_peered":"2024-04-16T16:19:31.784880+0000","last_clean":"2024-04-16T16:19:31.784880+0000","last_became_active":"2024-04-16T16:19:29.762159+0000","last_became_peered":"2024-04-16T16:19:29.762159+0000","last_unstale":"2024-04-16T16:19:31.784880+0000","last_undegraded":"2024-04-16T16:19:31.784880+0000","last_fullsized":"2024-04-16T16:19:31.784880+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:19:28.701911+0000","last_clean_scrub_stamp":"2024-04-16T16:19:28.701911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:29.064020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":222,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-16T16:19:32.048338+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:19:32.048338+0000","last_peered":"2024-04-16T16:19:32.048338+0000","last_clean":"2024-04-16T16:19:32.048338+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:19:32.048338+0000","last_undegraded":"2024-04-16T16:19:32.048338+0000","last_fullsized":"2024-04-16T16:19:32.048338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1163264,"data_stored":822593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":232807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":569344,"data_stored":232205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":233747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":577536,"data_stored":232773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":581632,"data_stored":233769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":569344,"data_stored":232205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":822537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:19:35.804 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T16:19:35.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T16:19:36.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.070+0000 7f211b200640 1 Processor -- start 2024-04-16T16:19:36.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.071+0000 7f211b200640 1 -- start start 2024-04-16T16:19:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.072+0000 7f211b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b3b80 0x7f21140cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.072+0000 7f211b200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21140cfee0 con 0x7f21140b6640 2024-04-16T16:19:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.072+0000 7f211b200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21140d4610 con 0x7f21140d41b0 2024-04-16T16:19:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.072+0000 7f211b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f21140d3d20 con 0x7f21140b3b80 2024-04-16T16:19:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.073+0000 7f2119e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f21140b6640 0x7f21140b6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47680/0 (socket says 172.21.15.22:47680) 2024-04-16T16:19:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.073+0000 7f2119e00640 1 -- 172.21.15.22:0/2655313933 learned_addr learned my addr 172.21.15.22:0/2655313933 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.073+0000 7f2119400640 1 --2- 172.21.15.22:0/2655313933 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b3b80 0x7f21140cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.073+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255752922 0 0) 0x7f21140cfee0 con 0x7f21140b6640 2024-04-16T16:19:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.074+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20fc003520 con 0x7f21140b6640 2024-04-16T16:19:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.074+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901282274 0 0) 0x7f21140d4610 con 0x7f21140d41b0 2024-04-16T16:19:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.074+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21140cfee0 con 0x7f21140d41b0 2024-04-16T16:19:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.074+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3952148235 0 0) 0x7f20fc003520 con 0x7f21140b6640 2024-04-16T16:19:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.074+0000 7f2119400640 1 -- 172.21.15.22:0/2655313933 >> v1:172.21.15.43:6789/0 conn(0x7f21140d41b0 legacy=0x7f21140b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.074+0000 7f2119400640 1 -- 172.21.15.22:0/2655313933 >> v1:172.21.15.22:6789/0 conn(0x7f21140b6640 legacy=0x7f21140b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.074+0000 7f2119400640 1 -- 172.21.15.22:0/2655313933 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21140cfc00 con 0x7f21140b3b80 2024-04-16T16:19:36.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.076+0000 7f2119400640 1 --2- 172.21.15.22:0/2655313933 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b3b80 0x7f21140cf090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f21040097d0 tx=0x7f210402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e12c1bf6a92b902 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:36.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.076+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104037070 con 0x7f21140b3b80 2024-04-16T16:19:36.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.076+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2104030510 con 0x7f21140b3b80 2024-04-16T16:19:36.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.076+0000 7f2118a00640 1 -- 172.21.15.22:0/2655313933 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108001670 con 0x7f21140b3b80 2024-04-16T16:19:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.077+0000 7f211b200640 1 -- 172.21.15.22:0/2655313933 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b3b80 msgr2=0x7f21140cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.077+0000 7f211b200640 1 --2- 172.21.15.22:0/2655313933 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b3b80 0x7f21140cf090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f21040097d0 tx=0x7f210402b800 comp rx=0 tx=0).stop 2024-04-16T16:19:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.077+0000 7f211b200640 1 -- 172.21.15.22:0/2655313933 shutdown_connections 2024-04-16T16:19:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.077+0000 7f211b200640 1 --2- 172.21.15.22:0/2655313933 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b3b80 0x7f21140cf090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.077+0000 7f211b200640 1 -- 172.21.15.22:0/2655313933 >> 172.21.15.22:0/2655313933 conn(0x7f2114062620 msgr2=0x7f2114062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.077+0000 7f211b200640 1 -- 172.21.15.22:0/2655313933 shutdown_connections 2024-04-16T16:19:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.077+0000 7f211b200640 1 -- 172.21.15.22:0/2655313933 wait complete. 2024-04-16T16:19:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.080+0000 7f211b200640 1 Processor -- start 2024-04-16T16:19:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.080+0000 7f211b200640 1 -- start start 2024-04-16T16:19:36.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.081+0000 7f211b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21140b3b80 0x7f2114161b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.081+0000 7f211b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b6640 0x7f21140cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.081+0000 7f211b200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140d41b0 0x7f21140cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.081+0000 7f211b200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21140cf890 con 0x7f21140d41b0 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.081+0000 7f211b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21140d39b0 con 0x7f21140b3b80 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.081+0000 7f211b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f21140b8100 con 0x7f21140b6640 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140d41b0 0x7f21140cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140d41b0 0x7f21140cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57102/0 (socket says 172.21.15.22:57102) 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 -- 172.21.15.22:0/47622592 learned_addr learned my addr 172.21.15.22:0/47622592 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f2119e00640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21140b3b80 0x7f2114161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f2119400640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b6640 0x7f21140cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 -- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b6640 msgr2=0x7f21140cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b6640 0x7f21140cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 -- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21140b3b80 msgr2=0x7f2114161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21140b3b80 0x7f2114161b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f211a800640 1 -- 172.21.15.22:0/47622592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21140cca60 con 0x7f21140d41b0 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.082+0000 7f2119400640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b6640 0x7f21140cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.083+0000 7f211a800640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140d41b0 0x7f21140cd980 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f211000c790 tx=0x7f211000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.083+0000 7f210e000640 1 -- 172.21.15.22:0/47622592 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110003b70 con 0x7f21140d41b0 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.083+0000 7f210e000640 1 -- 172.21.15.22:0/47622592 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2110003d10 con 0x7f21140d41b0 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.083+0000 7f210e000640 1 -- 172.21.15.22:0/47622592 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211000aa50 con 0x7f21140d41b0 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.083+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21140ccd40 con 0x7f21140d41b0 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.083+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211415f480 con 0x7f21140d41b0 2024-04-16T16:19:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.084+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21140b4e70 con 0x7f21140d41b0 2024-04-16T16:19:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.085+0000 7f210e000640 1 -- 172.21.15.22:0/47622592 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f211000abf0 con 0x7f21140d41b0 2024-04-16T16:19:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.086+0000 7f210e000640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f20f806cbc0 0x7f20f806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.086+0000 7f210e000640 1 -- 172.21.15.22:0/47622592 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f211008bf70 con 0x7f21140d41b0 2024-04-16T16:19:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.087+0000 7f2119e00640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f20f806cbc0 0x7f20f806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.087+0000 7f2119e00640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f20f806cbc0 0x7f20f806f080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21080011e0 tx=0x7f2108009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.091+0000 7f210e000640 1 -- 172.21.15.22:0/47622592 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21140b4e70 con 0x7f21140d41b0 2024-04-16T16:19:36.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.376+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2114075f30 con 0x7f21140d41b0 2024-04-16T16:19:36.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.382+0000 7f210e000640 1 -- 172.21.15.22:0/47622592 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f211005a0a0 con 0x7f21140d41b0 2024-04-16T16:19:36.382 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-04-16T16:19:36.382 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw== 2024-04-16T16:19:36.382 INFO:teuthology.orchestra.run.smithi022.stdout: caps mds = "allow" 2024-04-16T16:19:36.383 INFO:teuthology.orchestra.run.smithi022.stdout: caps mon = "allow r" 2024-04-16T16:19:36.383 INFO:teuthology.orchestra.run.smithi022.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T16:19:36.383 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2024-04-16T16:19:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f20f806cbc0 msgr2=0x7f20f806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f20f806cbc0 0x7f20f806f080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21080011e0 tx=0x7f2108009040 comp rx=0 tx=0).stop 2024-04-16T16:19:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140d41b0 msgr2=0x7f21140cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140d41b0 0x7f21140cd980 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f211000c790 tx=0x7f211000cc50 comp rx=0 tx=0).stop 2024-04-16T16:19:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 shutdown_connections 2024-04-16T16:19:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f20f806cbc0 0x7f20f806f080 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140d41b0 0x7f21140cd980 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21140b6640 0x7f21140cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 --2- 172.21.15.22:0/47622592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21140b3b80 0x7f2114161b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 >> 172.21.15.22:0/47622592 conn(0x7f2114062620 msgr2=0x7f21140b5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 shutdown_connections 2024-04-16T16:19:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.385+0000 7f211b200640 1 -- 172.21.15.22:0/47622592 wait complete. 2024-04-16T16:19:36.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:19:36.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.627+0000 7f7c2a600640 1 Processor -- start 2024-04-16T16:19:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.628+0000 7f7c2a600640 1 -- start start 2024-04-16T16:19:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.629+0000 7f7c2a600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 0x7f7c240d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.629+0000 7f7c2a600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7c24070a20 0x7f7c240d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.629+0000 7f7c2a600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c240d0fd0 con 0x7f7c2415c870 2024-04-16T16:19:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.629+0000 7f7c2a600640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7c24071bd0 con 0x7f7c24070a20 2024-04-16T16:19:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.629+0000 7f7c2a600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7c240d12b0 con 0x7f7c240d2070 2024-04-16T16:19:36.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.630+0000 7f7c29200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7c2415c870 0x7f7c240d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47682/0 (socket says 172.21.15.22:47682) 2024-04-16T16:19:36.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.630+0000 7f7c29200640 1 -- 172.21.15.22:0/113548279 learned_addr learned my addr 172.21.15.22:0/113548279 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.630+0000 7f7c23e00640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 0x7f7c240d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.630+0000 7f7c29c00640 1 --2- 172.21.15.22:0/113548279 >> v2:172.21.15.43:3300/0 conn(0x7f7c24070a20 0x7f7c240d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.630+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796010921 0 0) 0x7f7c240d0fd0 con 0x7f7c2415c870 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.630+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c08003520 con 0x7f7c2415c870 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1386318788 0 0) 0x7f7c08003520 con 0x7f7c2415c870 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 msgr2=0x7f7c240d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 0x7f7c240d26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 >> v2:172.21.15.43:3300/0 conn(0x7f7c24070a20 msgr2=0x7f7c240d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 --2- 172.21.15.22:0/113548279 >> v2:172.21.15.43:3300/0 conn(0x7f7c24070a20 0x7f7c240d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c240d1590 con 0x7f7c2415c870 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f7c14001670 con 0x7f7c2415c870 2024-04-16T16:19:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 >> v1:172.21.15.22:6789/0 conn(0x7f7c2415c870 legacy=0x7f7c240d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 0x7f7c080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c08003f80 0x7f7c08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c08004d40 0x7f7c080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24071bd0 con 0x7f7c08003f80 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c240d12b0 con 0x7f7c08004d40 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0800ba70 con 0x7f7c240d2070 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23e00640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c08003f80 0x7f7c08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c29200640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 0x7f7c080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23e00640 1 -- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 msgr2=0x7f7c080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23e00640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c240d2070 0x7f7c080039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23e00640 1 -- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c08004d40 msgr2=0x7f7c080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23e00640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c08004d40 0x7f7c080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.631+0000 7f7c23e00640 1 -- 172.21.15.22:0/113548279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c08003520 con 0x7f7c08003f80 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.633+0000 7f7c23e00640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c08003f80 0x7f7c08004800 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009a90 tx=0x7f7c08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b75a0cb214a01bd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.633+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10039070 con 0x7f7c08003f80 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.633+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1002c680 con 0x7f7c08003f80 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.633+0000 7f7c23400640 1 -- 172.21.15.22:0/113548279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10009690 con 0x7f7c08003f80 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.633+0000 7f7c2a600640 1 -- 172.21.15.22:0/113548279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c08003f80 msgr2=0x7f7c08004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.633+0000 7f7c2a600640 1 --2- 172.21.15.22:0/113548279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c08003f80 0x7f7c08004800 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009a90 tx=0x7f7c08005830 comp rx=0 tx=0).stop 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.634+0000 7f7c29c00640 1 -- 172.21.15.22:0/113548279 reap_dead start 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.634+0000 7f7c2a600640 1 -- 172.21.15.22:0/113548279 shutdown_connections 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.634+0000 7f7c2a600640 1 -- 172.21.15.22:0/113548279 >> 172.21.15.22:0/113548279 conn(0x7f7c240731a0 msgr2=0x7f7c240735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.634+0000 7f7c2a600640 1 -- 172.21.15.22:0/113548279 shutdown_connections 2024-04-16T16:19:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.634+0000 7f7c2a600640 1 -- 172.21.15.22:0/113548279 wait complete. 2024-04-16T16:19:36.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.636+0000 7f7c2a600640 1 Processor -- start 2024-04-16T16:19:36.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.636+0000 7f7c2a600640 1 -- start start 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c2a600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c08003f80 0x7f7c2415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c2a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c24158520 0x7f7c2414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c2a600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c240cd0e0 0x7f7c240cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c2a600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2415cc50 con 0x7f7c240cd0e0 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c2a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c240d1b50 con 0x7f7c24158520 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c2a600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7c240d26f0 con 0x7f7c08003f80 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c29c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c240cd0e0 0x7f7c240cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c29c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c240cd0e0 0x7f7c240cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57116/0 (socket says 172.21.15.22:57116) 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.637+0000 7f7c29c00640 1 -- 172.21.15.22:0/2395769989 learned_addr learned my addr 172.21.15.22:0/2395769989 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c23e00640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c24158520 0x7f7c2414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29200640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c08003f80 0x7f7c2415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29c00640 1 -- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c08003f80 msgr2=0x7f7c2415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29c00640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c08003f80 0x7f7c2415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29c00640 1 -- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c24158520 msgr2=0x7f7c2414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29c00640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c24158520 0x7f7c2414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29c00640 1 -- 172.21.15.22:0/2395769989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c241589a0 con 0x7f7c240cd0e0 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c23e00640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c24158520 0x7f7c2414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29200640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c08003f80 0x7f7c2415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c29c00640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c240cd0e0 0x7f7c240cd560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c240b7c40 tx=0x7f7c1c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c20c00640 1 -- 172.21.15.22:0/2395769989 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00bce0 con 0x7f7c240cd0e0 2024-04-16T16:19:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c20c00640 1 -- 172.21.15.22:0/2395769989 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c01a070 con 0x7f7c240cd0e0 2024-04-16T16:19:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.638+0000 7f7c20c00640 1 -- 172.21.15.22:0/2395769989 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c014640 con 0x7f7c240cd0e0 2024-04-16T16:19:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.639+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2415ba10 con 0x7f7c240cd0e0 2024-04-16T16:19:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.639+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241f84c0 con 0x7f7c240cd0e0 2024-04-16T16:19:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.640+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c241f7fd0 con 0x7f7c240cd0e0 2024-04-16T16:19:36.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.641+0000 7f7c20c00640 1 -- 172.21.15.22:0/2395769989 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f7c1c005d10 con 0x7f7c240cd0e0 2024-04-16T16:19:36.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.642+0000 7f7c20c00640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c0406cbf0 0x7f7c0406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:36.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.642+0000 7f7c20c00640 1 -- 172.21.15.22:0/2395769989 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f7c1c08c280 con 0x7f7c240cd0e0 2024-04-16T16:19:36.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.642+0000 7f7c29200640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c0406cbf0 0x7f7c0406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:36.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.643+0000 7f7c29200640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c0406cbf0 0x7f7c0406f0b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001200 tx=0x7f7c14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:36.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.646+0000 7f7c20c00640 1 -- 172.21.15.22:0/2395769989 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c1c05a210 con 0x7f7c240cd0e0 2024-04-16T16:19:36.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.894+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c24075f30 con 0x7f7c240cd0e0 2024-04-16T16:19:36.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.895+0000 7f7c20c00640 1 -- 172.21.15.22:0/2395769989 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7f7c1c059b10 con 0x7f7c240cd0e0 2024-04-16T16:19:36.895 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:19:36.895 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3896039959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3896039959},{"type":"v1","addr":"172.21.15.22:6836","nonce":3896039959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/594862213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":594862213},{"type":"v1","addr":"172.21.15.43:6834","nonce":594862213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/754211698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":754211698},{"type":"v1","addr":"172.21.15.43:6835","nonce":754211698}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:19:30.225286+0000","modified":"2024-04-16T16:19:33.300977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5047},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5047":{"gid":5047,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/1166400952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1166400952},{"type":"v1","addr":"172.21.15.22:6837","nonce":1166400952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5047,"qdb_cluster":[5047]},"id":3}]} 2024-04-16T16:19:36.896 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2024-04-16T16:19:36.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c0406cbf0 msgr2=0x7f7c0406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c0406cbf0 0x7f7c0406f0b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001200 tx=0x7f7c14009040 comp rx=0 tx=0).stop 2024-04-16T16:19:36.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c240cd0e0 msgr2=0x7f7c240cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:36.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c240cd0e0 0x7f7c240cd560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c240b7c40 tx=0x7f7c1c00b480 comp rx=0 tx=0).stop 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 shutdown_connections 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7c0406cbf0 0x7f7c0406f0b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c240cd0e0 0x7f7c240cd560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c24158520 0x7f7c2414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 --2- 172.21.15.22:0/2395769989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c08003f80 0x7f7c2415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.898+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 >> 172.21.15.22:0/2395769989 conn(0x7f7c240731a0 msgr2=0x7f7c240735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.899+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 shutdown_connections 2024-04-16T16:19:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:36.899+0000 7f7c2a600640 1 -- 172.21.15.22:0/2395769989 wait complete. 2024-04-16T16:19:36.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:19:36.985 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:19:37.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T16:19:30.225286+0000', 'modified': '2024-04-16T16:19:33.300977+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5047}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5047': {'gid': 5047, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6837/1166400952', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6835', 'nonce': 1166400952}, {'type': 'v1', 'addr': '172.21.15.22:6837', 'nonce': 1166400952}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5047, 'qdb_cluster': [5047]} 2024-04-16T16:19:37.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T16:19:37.322 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-16T16:19:37.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.559+0000 7f62f7200640 1 Processor -- start 2024-04-16T16:19:37.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.559+0000 7f62f7200640 1 -- start start 2024-04-16T16:19:37.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.560+0000 7f62f7200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f62f815cd90 0x7f62f80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.560+0000 7f62f7200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f815d300 con 0x7f62f815a240 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.560+0000 7f62f7200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f815d5e0 con 0x7f62f80d09a0 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.560+0000 7f62f7200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f62f815d8c0 con 0x7f62f815cd90 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.561+0000 7f62f5e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f62f815a240 0x7f62f80d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47698/0 (socket says 172.21.15.22:47698) 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.561+0000 7f62f5e00640 1 -- 172.21.15.22:0/1077026442 learned_addr learned my addr 172.21.15.22:0/1077026442 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.561+0000 7f62f6800640 1 --2- 172.21.15.22:0/1077026442 >> v2:172.21.15.43:3300/0 conn(0x7f62f815cd90 0x7f62f80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.561+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1771891399 0 0) 0x7f62f815d300 con 0x7f62f815a240 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.561+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62dc003520 con 0x7f62f815a240 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2539800238 0 0) 0x7f62dc003520 con 0x7f62f815a240 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 >> v2:172.21.15.43:3300/0 conn(0x7f62f815cd90 msgr2=0x7f62f80cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 --2- 172.21.15.22:0/1077026442 >> v2:172.21.15.43:3300/0 conn(0x7f62f815cd90 0x7f62f80cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 >> v1:172.21.15.43:6789/0 conn(0x7f62f80d09a0 legacy=0x7f62f80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f815dba0 con 0x7f62f815a240 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f62f00019f0 con 0x7f62f815a240 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 >> v1:172.21.15.22:6789/0 conn(0x7f62f815a240 legacy=0x7f62f80d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62dc003a20 0x7f62dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc004800 0x7f62dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62dc005210 0x7f62dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62f815d8c0 con 0x7f62dc003a20 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc00c160 con 0x7f62dc004800 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f62dc00c360 con 0x7f62dc005210 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f5e00640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62dc003a20 0x7f62dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f5400640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc004800 0x7f62dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.562+0000 7f62f6800640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62dc005210 0x7f62dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.563+0000 7f62f5e00640 1 -- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62dc005210 msgr2=0x7f62dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.563+0000 7f62f5e00640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62dc005210 0x7f62dc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.563+0000 7f62f5e00640 1 -- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc004800 msgr2=0x7f62dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.563+0000 7f62f5e00640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc004800 0x7f62dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.563+0000 7f62f5e00640 1 -- 172.21.15.22:0/1077026442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc003520 con 0x7f62dc003a20 2024-04-16T16:19:37.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.563+0000 7f62f6800640 1 -- 172.21.15.22:0/1077026442 reap_dead start 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.564+0000 7f62f5e00640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62dc003a20 0x7f62dc003e20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f62f000a830 tx=0x7f62dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4daa2c6907ebe79d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.564+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f000a480 con 0x7f62dc003a20 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.564+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f0034630 con 0x7f62dc003a20 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.564+0000 7f62f4a00640 1 -- 172.21.15.22:0/1077026442 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f002ce60 con 0x7f62dc003a20 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.564+0000 7f62f7200640 1 -- 172.21.15.22:0/1077026442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62dc003a20 msgr2=0x7f62dc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.564+0000 7f62f7200640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62dc003a20 0x7f62dc003e20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f62f000a830 tx=0x7f62dc005830 comp rx=0 tx=0).stop 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.565+0000 7f62f7200640 1 -- 172.21.15.22:0/1077026442 shutdown_connections 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.565+0000 7f62f7200640 1 --2- 172.21.15.22:0/1077026442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62dc003a20 0x7f62dc003e20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.565+0000 7f62f7200640 1 -- 172.21.15.22:0/1077026442 >> 172.21.15.22:0/1077026442 conn(0x7f62f8075070 msgr2=0x7f62f8062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:37.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.565+0000 7f62f7200640 1 -- 172.21.15.22:0/1077026442 shutdown_connections 2024-04-16T16:19:37.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.565+0000 7f62f7200640 1 -- 172.21.15.22:0/1077026442 wait complete. 2024-04-16T16:19:37.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.566+0000 7f62f7200640 1 Processor -- start 2024-04-16T16:19:37.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.567+0000 7f62f7200640 1 -- start start 2024-04-16T16:19:37.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.567+0000 7f62f7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc003a20 0x7f62f8151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f814f390 0x7f62f80ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f814f810 0x7f62f80aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f7200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8073120 con 0x7f62f814f810 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8072fa0 con 0x7f62dc003a20 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f62f815a620 con 0x7f62f814f390 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f814f810 0x7f62f80aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f814f810 0x7f62f80aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57146/0 (socket says 172.21.15.22:57146) 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f6800640 1 -- 172.21.15.22:0/2595813013 learned_addr learned my addr 172.21.15.22:0/2595813013 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f5400640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f814f390 0x7f62f80ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.568+0000 7f62f5e00640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc003a20 0x7f62f8151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f6800640 1 -- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f814f390 msgr2=0x7f62f80ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f6800640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f814f390 0x7f62f80ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f6800640 1 -- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc003a20 msgr2=0x7f62f8151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f6800640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc003a20 0x7f62f8151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f6800640 1 -- 172.21.15.22:0/2595813013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f81f5b00 con 0x7f62f814f810 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f6800640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f814f810 0x7f62f80aeda0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f62f80d1140 tx=0x7f62e8010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62ee000640 1 -- 172.21.15.22:0/2595813013 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e800f040 con 0x7f62f814f810 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62ee000640 1 -- 172.21.15.22:0/2595813013 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e800e890 con 0x7f62f814f810 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62ee000640 1 -- 172.21.15.22:0/2595813013 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e800ec80 con 0x7f62f814f810 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f8151030 con 0x7f62f814f810 2024-04-16T16:19:37.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.569+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81515f0 con 0x7f62f814f810 2024-04-16T16:19:37.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.572+0000 7f62ee000640 1 -- 172.21.15.22:0/2595813013 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f62e80143f0 con 0x7f62f814f810 2024-04-16T16:19:37.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.573+0000 7f62ee000640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f62d406cbc0 0x7f62d406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.573+0000 7f62ee000640 1 -- 172.21.15.22:0/2595813013 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f62e808bf10 con 0x7f62f814f810 2024-04-16T16:19:37.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.573+0000 7f62f5e00640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f62d406cbc0 0x7f62d406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.574+0000 7f62ff7a9740 1 Processor -- start 2024-04-16T16:19:37.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.574+0000 7f62f5e00640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f62d406cbc0 0x7f62d406f080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f62f0034000 tx=0x7f62f0036040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.574+0000 7f62ff7a9740 1 -- start start 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.575+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258890 0x55aaf32779d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.575+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3231570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.575+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3231ab0 0x55aaf322f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.575+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aaf31969c0 con 0x55aaf3258890 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.575+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aaf313d560 con 0x55aaf3258c70 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.575+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aaf3192980 con 0x55aaf3231ab0 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258890 0x55aaf32779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258890 0x55aaf32779d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57154/0 (socket says 172.21.15.22:57154) 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 -- 172.21.15.22:0/3795950795 learned_addr learned my addr 172.21.15.22:0/3795950795 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f6800640 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3231ab0 0x55aaf322f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5400640 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3231570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 -- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3231ab0 msgr2=0x55aaf322f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3231ab0 0x55aaf322f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 -- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 msgr2=0x55aaf3231570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3231570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.576+0000 7f62f5e00640 1 -- 172.21.15.22:0/3795950795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaf2ea92d0 con 0x55aaf3258890 2024-04-16T16:19:37.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.577+0000 7f62f5e00640 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258890 0x55aaf32779d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f62f002cbf0 tx=0x7f62f0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e649340186c98b49 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.577+0000 7f62e6600640 1 -- 172.21.15.22:0/3795950795 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0043030 con 0x55aaf3258890 2024-04-16T16:19:37.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.577+0000 7f62e6600640 1 -- 172.21.15.22:0/3795950795 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f004f070 con 0x55aaf3258890 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.577+0000 7f62e6600640 1 -- 172.21.15.22:0/3795950795 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0034d00 con 0x55aaf3258890 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.577+0000 7f62ff7a9740 1 -- 172.21.15.22:0/3795950795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258890 msgr2=0x55aaf32779d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.577+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258890 0x55aaf32779d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f62f002cbf0 tx=0x7f62f0007000 comp rx=0 tx=0).stop 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 -- 172.21.15.22:0/3795950795 shutdown_connections 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3231ab0 0x55aaf322f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3231570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/3795950795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258890 0x55aaf32779d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 -- 172.21.15.22:0/3795950795 >> 172.21.15.22:0/3795950795 conn(0x55aaf322db50 msgr2=0x55aaf32766d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 -- 172.21.15.22:0/3795950795 shutdown_connections 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 -- 172.21.15.22:0/3795950795 wait complete. 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.578+0000 7f62ff7a9740 1 -- start start 2024-04-16T16:19:37.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.579+0000 7f62ff7a9740 1 Processor -- start 2024-04-16T16:19:37.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258890 0x55aaf3248c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258c70 0x55aaf325a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf325af00 0x55aaf325e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aaf322b980 con 0x55aaf3258c70 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aaf3150920 con 0x55aaf3258890 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aaf3231f30 con 0x55aaf325af00 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62ff7a9740 10 client.0 _ll_register_callbacks cb 0x55aaf3150310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62f5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258c70 0x55aaf325a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62f5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258c70 0x55aaf325a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57166/0 (socket says 172.21.15.22:57166) 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62f5400640 1 -- 172.21.15.22:0/436433683 learned_addr learned my addr 172.21.15.22:0/436433683 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.580+0000 7f62f5e00640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258890 0x55aaf3248c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f6800640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf325af00 0x55aaf325e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f5400640 1 -- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf325af00 msgr2=0x55aaf325e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f5400640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf325af00 0x55aaf325e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f5400640 1 -- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258890 msgr2=0x55aaf3248c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f5400640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258890 0x55aaf3248c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f5400640 1 -- 172.21.15.22:0/436433683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaf2f736b0 con 0x55aaf3258c70 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f5e00640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258890 0x55aaf3248c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f6800640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf325af00 0x55aaf325e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62f5400640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258c70 0x55aaf325a9c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f62e0005340 tx=0x7f62e0012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f91a3ec671e895 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62daa00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62daa00640 1 -- 172.21.15.22:0/436433683 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e001a020 con 0x55aaf3258c70 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62f004f070 con 0x55aaf3258c70 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.581+0000 7f62daa00640 1 -- 172.21.15.22:0/436433683 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f62e0007050 con 0x55aaf3258c70 2024-04-16T16:19:37.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62daa00640 1 -- 172.21.15.22:0/436433683 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62e0024050 con 0x55aaf3258c70 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 10 client.5871 fetch_fsmap learned FSMap version 26 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55aaf325cec0 con 0x55aaf3258c70 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62daa00640 1 -- 172.21.15.22:0/436433683 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f004f070 con 0x55aaf3258c70 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62daa00640 1 -- 172.21.15.22:0/436433683 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f62e0027020 con 0x55aaf3258c70 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 10 client.5871 fetch_fsmap finished waiting for FSMap version 26 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 10 client.5871 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 20 client.5871 populate_metadata read hostname 'smithi022' 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3286b80 0x55aaf325a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 4 client.5871 mds_command: new command op to 5047 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 --> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaf313cb70 con 0x55aaf3286b80 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.582+0000 7f62f5e00640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3286b80 0x55aaf325a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.583+0000 7f62daa00640 10 client.5871 ms_handle_connect on v2:172.21.15.22:6835/1166400952 2024-04-16T16:19:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.583+0000 7f62f5e00640 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3286b80 0x55aaf325a010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e204288ff5f8e1f3 server_cookie=639a7168d2aef01e in_seq=0 out_seq=0 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62daa00640 1 -- 172.21.15.22:0/436433683 <== mds.0 v2:172.21.15.22:6835/1166400952 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aaf313cb70 con 0x55aaf3286b80 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62daa00640 10 client.5871 handle_command_reply: tid=0 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 client.5871 shutdown 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258c70 msgr2=0x55aaf325a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258c70 0x55aaf325a9c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f62e0005340 tx=0x7f62e0012630 comp rx=0 tx=0).stop 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 shutdown_connections 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3286b80 0x55aaf325a010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf325af00 0x55aaf325e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf3258c70 0x55aaf325a9c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/436433683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258890 0x55aaf3248c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62daa00640 0 client.5871 ms_handle_reset on v2:172.21.15.22:6835/1166400952 2024-04-16T16:19:37.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.584+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 >> 172.21.15.22:0/436433683 conn(0x55aaf3231ab0 msgr2=0x55aaf322a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:37.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.585+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 shutdown_connections 2024-04-16T16:19:37.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.585+0000 7f62ff7a9740 1 -- 172.21.15.22:0/436433683 wait complete. 2024-04-16T16:19:37.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.585+0000 7f62ff7a9740 20 client.5871 trim_cache size 0 max 16384 2024-04-16T16:19:37.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.605+0000 7f62ff7a9740 1 Processor -- start 2024-04-16T16:19:37.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.605+0000 7f62ff7a9740 1 -- start start 2024-04-16T16:19:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf322c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3259050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8200680 con 0x55aaf325af00 2024-04-16T16:19:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62f814e870 con 0x55aaf3258c70 2024-04-16T16:19:37.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f62f806d940 con 0x55aaf3258890 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57176/0 (socket says 172.21.15.22:57176) 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62f6800640 1 -- 172.21.15.22:0/4041464122 learned_addr learned my addr 172.21.15.22:0/4041464122 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.606+0000 7f62f5e00640 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf322c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f5400640 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3259050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f6800640 1 -- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 msgr2=0x55aaf322c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f6800640 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf322c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f6800640 1 -- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 msgr2=0x55aaf3259050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f6800640 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3259050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f6800640 1 -- 172.21.15.22:0/4041464122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaf322d2b0 con 0x55aaf325af00 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f5400640 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3259050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62f6800640 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f62e8059640 tx=0x7f62e8060040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1594baa158b33f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62e5c00640 1 -- 172.21.15.22:0/4041464122 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8000e60 con 0x55aaf325af00 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62e5c00640 1 -- 172.21.15.22:0/4041464122 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e8057c40 con 0x55aaf325af00 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.607+0000 7f62e5c00640 1 -- 172.21.15.22:0/4041464122 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80600b0 con 0x55aaf325af00 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 -- 172.21.15.22:0/4041464122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 msgr2=0x55aaf32307e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f62e8059640 tx=0x7f62e8060040 comp rx=0 tx=0).stop 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 -- 172.21.15.22:0/4041464122 shutdown_connections 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf3259050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/4041464122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf322c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 -- 172.21.15.22:0/4041464122 >> 172.21.15.22:0/4041464122 conn(0x55aaf3231ab0 msgr2=0x55aaf325b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 -- 172.21.15.22:0/4041464122 shutdown_connections 2024-04-16T16:19:37.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.608+0000 7f62ff7a9740 1 -- 172.21.15.22:0/4041464122 wait complete. 2024-04-16T16:19:37.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.609+0000 7f62ff7a9740 1 -- start start 2024-04-16T16:19:37.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.609+0000 7f62ff7a9740 1 Processor -- start 2024-04-16T16:19:37.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf32f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf32f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62ff7a9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aaf3286a00 con 0x55aaf325af00 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aaf32873e0 con 0x55aaf3258c70 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62ff7a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aaf3287020 con 0x55aaf3258890 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62ff7a9740 10 client.0 _ll_register_callbacks cb 0x7f62e0004ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62f6800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57178/0 (socket says 172.21.15.22:57178) 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.610+0000 7f62f6800640 1 -- 172.21.15.22:0/2192700613 learned_addr learned my addr 172.21.15.22:0/2192700613 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f5400640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf32f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f6800640 1 -- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 msgr2=0x55aaf32f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f5e00640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf32f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f6800640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf32f1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f6800640 1 -- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 msgr2=0x55aaf32f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f6800640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf32f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f6800640 1 -- 172.21.15.22:0/2192700613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaf322cba0 con 0x55aaf325af00 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f5400640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf32f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62f6800640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f62e808a1c0 tx=0x7f62e805d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca609eadf14dd37 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62daa00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62daa00640 1 -- 172.21.15.22:0/2192700613 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8000e60 con 0x55aaf325af00 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62daa00640 1 -- 172.21.15.22:0/2192700613 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f62e808a240 con 0x55aaf325af00 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e8057c40 con 0x55aaf325af00 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62daa00640 1 -- 172.21.15.22:0/2192700613 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62e808a460 con 0x55aaf325af00 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62ff7a9740 10 client.5877 fetch_fsmap learned FSMap version 26 2024-04-16T16:19:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.611+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55aaf32f4700 con 0x55aaf325af00 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62daa00640 1 -- 172.21.15.22:0/2192700613 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e8057c40 con 0x55aaf325af00 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62daa00640 1 -- 172.21.15.22:0/2192700613 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f62e8055690 con 0x55aaf325af00 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62ff7a9740 10 client.5877 fetch_fsmap finished waiting for FSMap version 26 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62ff7a9740 10 client.5877 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62ff7a9740 20 client.5877 populate_metadata read hostname 'smithi022' 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3230e60 0x55aaf3259ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62ff7a9740 4 client.5877 mds_command: new command op to 5047 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 --> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] -- command(tid 0: {"prefix": "status"}) -- 0x55aaf31a43e0 con 0x55aaf3230e60 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.612+0000 7f62f5e00640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3230e60 0x55aaf3259ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62f5e00640 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3230e60 0x55aaf3259ed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e14f3e18adc9cd8 server_cookie=70ddca0f1e83d15a in_seq=0 out_seq=0 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62daa00640 10 client.5877 ms_handle_connect on v2:172.21.15.22:6835/1166400952 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62daa00640 1 -- 172.21.15.22:0/2192700613 <== mds.0 v2:172.21.15.22:6835/1166400952 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55aaf31a43e0 con 0x55aaf3230e60 2024-04-16T16:19:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62daa00640 10 client.5877 handle_command_reply: tid=0 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 client.5877 shutdown 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 msgr2=0x55aaf32307e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f62e808a1c0 tx=0x7f62e805d040 comp rx=0 tx=0).stop 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 shutdown_connections 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:6835/1166400952,v1:172.21.15.22:6837/1166400952] conn(0x55aaf3230e60 0x55aaf3259ed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aaf325af00 0x55aaf32307e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aaf3258c70 0x55aaf32f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62daa00640 0 client.5877 ms_handle_reset on v2:172.21.15.22:6835/1166400952 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 --2- 172.21.15.22:0/2192700613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aaf3258890 0x55aaf32f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 >> 172.21.15.22:0/2192700613 conn(0x55aaf3231ab0 msgr2=0x55aaf3232700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 shutdown_connections 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.613+0000 7f62ff7a9740 1 -- 172.21.15.22:0/2192700613 wait complete. 2024-04-16T16:19:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62ff7a9740 20 client.5877 trim_cache size 0 max 16384 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf", 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5047, 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 6.8348902159999998, 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 26, 2024-04-16T16:19:37.618 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 48, 2024-04-16T16:19:37.619 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 48, 2024-04-16T16:19:37.619 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 13.210166835000001 2024-04-16T16:19:37.619 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:19:37.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f62d406cbc0 msgr2=0x7f62d406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f62d406cbc0 0x7f62d406f080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f62f0034000 tx=0x7f62f0036040 comp rx=0 tx=0).stop 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f814f810 msgr2=0x7f62f80aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f814f810 0x7f62f80aeda0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f62f80d1140 tx=0x7f62e8010c20 comp rx=0 tx=0).stop 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 shutdown_connections 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f62d406cbc0 0x7f62d406f080 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f814f810 0x7f62f80aeda0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f814f390 0x7f62f80ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 --2- 172.21.15.22:0/2595813013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62dc003a20 0x7f62f8151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 >> 172.21.15.22:0/2595813013 conn(0x7f62f8075070 msgr2=0x7f62f8072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 shutdown_connections 2024-04-16T16:19:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.614+0000 7f62f7200640 1 -- 172.21.15.22:0/2595813013 wait complete. 2024-04-16T16:19:37.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:19:37.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.849+0000 7fe33f200640 1 Processor -- start 2024-04-16T16:19:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.849+0000 7fe33f200640 1 -- start start 2024-04-16T16:19:37.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3400cc810 0x7fe34006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33f200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe34006ee80 0x7fe34015c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33f200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34006d160 con 0x7fe34006eaa0 2024-04-16T16:19:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33f200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe34006cf10 con 0x7fe34006ee80 2024-04-16T16:19:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe34006d440 con 0x7fe3400cc810 2024-04-16T16:19:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe34006ee80 0x7fe34015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe34006ee80 0x7fe34015c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57192/0 (socket says 172.21.15.22:57192) 2024-04-16T16:19:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33e800640 1 -- 172.21.15.22:0/4204448743 learned_addr learned my addr 172.21.15.22:0/4204448743 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33e800640 1 -- 172.21.15.22:0/4204448743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3400cc810 msgr2=0x7fe34006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33e800640 1 --2- 172.21.15.22:0/4204448743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3400cc810 0x7fe34006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33e800640 1 -- 172.21.15.22:0/4204448743 >> v1:172.21.15.43:6789/0 conn(0x7fe34006eaa0 legacy=0x7fe3400b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.851+0000 7fe33e800640 1 -- 172.21.15.22:0/4204448743 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34006d720 con 0x7fe34006ee80 2024-04-16T16:19:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.853+0000 7fe33e800640 1 --2- 172.21.15.22:0/4204448743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe34006ee80 0x7fe34015c200 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe338009e50 tx=0x7fe33802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5865b66399ea685 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.853+0000 7fe33d400640 1 -- 172.21.15.22:0/4204448743 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33802ca70 con 0x7fe34006ee80 2024-04-16T16:19:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.853+0000 7fe33d400640 1 -- 172.21.15.22:0/4204448743 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33802cc10 con 0x7fe34006ee80 2024-04-16T16:19:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.853+0000 7fe33d400640 1 -- 172.21.15.22:0/4204448743 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380343f0 con 0x7fe34006ee80 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.853+0000 7fe33f200640 1 -- 172.21.15.22:0/4204448743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe34006ee80 msgr2=0x7fe34015c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.853+0000 7fe33f200640 1 --2- 172.21.15.22:0/4204448743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe34006ee80 0x7fe34015c200 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe338009e50 tx=0x7fe33802bed0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.854+0000 7fe33f200640 1 -- 172.21.15.22:0/4204448743 shutdown_connections 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.854+0000 7fe33f200640 1 --2- 172.21.15.22:0/4204448743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe34006ee80 0x7fe34015c200 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.854+0000 7fe33f200640 1 --2- 172.21.15.22:0/4204448743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3400cc810 0x7fe34006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.854+0000 7fe33f200640 1 -- 172.21.15.22:0/4204448743 >> 172.21.15.22:0/4204448743 conn(0x7fe340062440 msgr2=0x7fe340062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.854+0000 7fe33f200640 1 -- 172.21.15.22:0/4204448743 shutdown_connections 2024-04-16T16:19:37.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.854+0000 7fe33f200640 1 -- 172.21.15.22:0/4204448743 wait complete. 2024-04-16T16:19:37.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.855+0000 7fe33f200640 1 Processor -- start 2024-04-16T16:19:37.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.856+0000 7fe33f200640 1 -- start start 2024-04-16T16:19:37.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34006eaa0 0x7fe3400b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe34006ee80 0x7fe340156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3400cc810 0x7fe340156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe34015c740 con 0x7fe3400cc810 2024-04-16T16:19:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe34006e440 con 0x7fe34006eaa0 2024-04-16T16:19:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe34015c8c0 con 0x7fe34006ee80 2024-04-16T16:19:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3400cc810 0x7fe340156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3400cc810 0x7fe340156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57208/0 (socket says 172.21.15.22:57208) 2024-04-16T16:19:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 -- 172.21.15.22:0/2232853831 learned_addr learned my addr 172.21.15.22:0/2232853831 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33de00640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34006eaa0 0x7fe3400b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe337e00640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe34006ee80 0x7fe340156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 -- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe34006ee80 msgr2=0x7fe340156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe34006ee80 0x7fe340156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 -- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34006eaa0 msgr2=0x7fe3400b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34006eaa0 0x7fe3400b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.857+0000 7fe33e800640 1 -- 172.21.15.22:0/2232853831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3401f8f50 con 0x7fe3400cc810 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.858+0000 7fe33e800640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3400cc810 0x7fe340156ca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe338036040 tx=0x7fe338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.858+0000 7fe336000640 1 -- 172.21.15.22:0/2232853831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338043020 con 0x7fe3400cc810 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.858+0000 7fe336000640 1 -- 172.21.15.22:0/2232853831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33803e450 con 0x7fe3400cc810 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.858+0000 7fe336000640 1 -- 172.21.15.22:0/2232853831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33803e820 con 0x7fe3400cc810 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.858+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34015cd80 con 0x7fe3400cc810 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.858+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34015d340 con 0x7fe3400cc810 2024-04-16T16:19:37.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.859+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe340075f30 con 0x7fe3400cc810 2024-04-16T16:19:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.861+0000 7fe336000640 1 -- 172.21.15.22:0/2232853831 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fe338046020 con 0x7fe3400cc810 2024-04-16T16:19:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.862+0000 7fe336000640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe31c06cbc0 0x7fe31c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.862+0000 7fe336000640 1 -- 172.21.15.22:0/2232853831 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fe3380aea10 con 0x7fe3400cc810 2024-04-16T16:19:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.862+0000 7fe33de00640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe31c06cbc0 0x7fe31c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.863+0000 7fe33de00640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe31c06cbc0 0x7fe31c06f080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe3300015d0 tx=0x7fe330009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:37.867+0000 7fe336000640 1 -- 172.21.15.22:0/2232853831 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe33804d030 con 0x7fe3400cc810 2024-04-16T16:19:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.112+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe3400b4b70 con 0x7fe3400cc810 2024-04-16T16:19:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.113+0000 7fe336000640 1 -- 172.21.15.22:0/2232853831 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7fe33807ca10 con 0x7fe3400cc810 2024-04-16T16:19:38.113 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:19:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe31c06cbc0 msgr2=0x7fe31c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe31c06cbc0 0x7fe31c06f080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe3300015d0 tx=0x7fe330009040 comp rx=0 tx=0).stop 2024-04-16T16:19:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3400cc810 msgr2=0x7fe340156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:38.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3400cc810 0x7fe340156ca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe338036040 tx=0x7fe338004a40 comp rx=0 tx=0).stop 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 shutdown_connections 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe31c06cbc0 0x7fe31c06f080 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3400cc810 0x7fe340156ca0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe34006ee80 0x7fe340156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 --2- 172.21.15.22:0/2232853831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34006eaa0 0x7fe3400b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 >> 172.21.15.22:0/2232853831 conn(0x7fe340062440 msgr2=0x7fe3400ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.115+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 shutdown_connections 2024-04-16T16:19:38.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38.116+0000 7fe33f200640 1 -- 172.21.15.22:0/2232853831 wait complete. 2024-04-16T16:19:38.135 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-16T16:19:38.135 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:19:38.136 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-04-16T16:19:38.136 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T16:19:38.136 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T16:19:38.136 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-16T16:19:38.136 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-16T16:19:38.136 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:19:38.136 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:19:38.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:38.136 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-04-16T16:19:38.192 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:19:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42430sec preferred_lft 42430sec 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ae:a4:6d:e3:ed:65 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::d864:8ff:fe17:e583/64 scope link 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ba:9d:95:17:f0:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::b89d:95ff:fe17:f073/64 scope link 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:38.195 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:19:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ae:a4:6d:e3:ed:65 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T16:19:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::aca4:6dff:fee3:ed65/64 scope link 2024-04-16T16:19:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:38.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:38.197 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:19:38.292 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-04-16T16:19:38.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:38.297 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-04-16T16:19:38.352 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-04-16T16:19:38.352 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:19:38.352 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:19:38.352 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:19:38.353 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:19:38.353 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:19:38.353 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-04-16T16:19:38.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:19:38.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:19:38.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:19:38.353 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-04-16T16:19:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:19:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:19:38.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:38.615 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:19:38.664 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T16:19:38.664 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-16T16:19:38.665 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:19:38.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:38.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-04-16T16:19:38.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:19:38.762 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T16:19:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T16:19:38.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:19:38.821 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T16:19:38.874 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:19:38.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:38.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:19:39.002 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:19:39.002 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:19:39.002 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:19:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:19:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:19:39.025 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:19:39.025 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:19:39.025 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:19:39.051 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T16:19:39.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T16:19:39.052 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2024-04-16T16:19:39.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:19:39.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:19:39.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:19:39.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:19:39.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:19:39.054 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-16T16:19:39.054 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:19:39.054 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:19:39.055 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:19:39.055 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:19:39.059 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:19:39.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:39.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T16:19:39.144 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:19:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:19:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:19:39.280 INFO:teuthology.orchestra.run.smithi022.stdout:client5886 2024-04-16T16:19:39.280 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:39.280 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:39.335 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T16:19:39.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.554+0000 7fd7ad400640 1 Processor -- start 2024-04-16T16:19:39.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.554+0000 7fd7ad400640 1 -- start start 2024-04-16T16:19:39.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.556+0000 7fd7ad400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 0x7fd7a8169b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.556+0000 7fd7ad400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a80af0b0 con 0x7fd7a81478c0 2024-04-16T16:19:39.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.556+0000 7fd7ad400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a80af390 con 0x7fd7a8163340 2024-04-16T16:19:39.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.556+0000 7fd7ad400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a80af950 con 0x7fd7a80d0c50 2024-04-16T16:19:39.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.556+0000 7fd7a6800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd7a81478c0 0x7fd7a80ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47710/0 (socket says 172.21.15.22:47710) 2024-04-16T16:19:39.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.556+0000 7fd7a6800640 1 -- 172.21.15.22:0/2083027696 learned_addr learned my addr 172.21.15.22:0/2083027696 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a7200640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 0x7fd7a8169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3157362016 0 0) 0x7fd7a80af0b0 con 0x7fd7a81478c0 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd788003520 con 0x7fd7a81478c0 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3606359755 0 0) 0x7fd788003520 con 0x7fd7a81478c0 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 msgr2=0x7fd7a8169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 0x7fd7a8169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 >> v1:172.21.15.43:6789/0 conn(0x7fd7a8163340 legacy=0x7fd7a80d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a80af670 con 0x7fd7a81478c0 2024-04-16T16:19:39.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.557+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fd798001690 con 0x7fd7a81478c0 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 >> v1:172.21.15.22:6789/0 conn(0x7fd7a81478c0 legacy=0x7fd7a80ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5400640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 0x7fd7880039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5400640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd788003f60 0x7fd788004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5400640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd788004d40 0x7fd7880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd78800bb50 con 0x7fd788003f60 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd78800bcd0 con 0x7fd788004d40 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd78800bed0 con 0x7fd7a80d0c50 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd788003f60 0x7fd788004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a6800640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 0x7fd7880039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a7200640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd788004d40 0x7fd7880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5e00640 1 -- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 msgr2=0x7fd7880039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7a80d0c50 0x7fd7880039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5e00640 1 -- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd788004d40 msgr2=0x7fd7880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd788004d40 0x7fd7880051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.558+0000 7fd7a5e00640 1 -- 172.21.15.22:0/2083027696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd788003520 con 0x7fd788003f60 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.560+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd788003f60 0x7fd788004800 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd790001e50 tx=0x7fd788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3597dd443420bd93 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.560+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790001a70 con 0x7fd788003f60 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.560+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd790003b70 con 0x7fd788003f60 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.560+0000 7fd7a5400640 1 -- 172.21.15.22:0/2083027696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7900050d0 con 0x7fd788003f60 2024-04-16T16:19:39.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.560+0000 7fd7ad400640 1 -- 172.21.15.22:0/2083027696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd788003f60 msgr2=0x7fd788004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:39.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.560+0000 7fd7ad400640 1 --2- 172.21.15.22:0/2083027696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd788003f60 0x7fd788004800 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd790001e50 tx=0x7fd788005830 comp rx=0 tx=0).stop 2024-04-16T16:19:39.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.560+0000 7fd7a7200640 1 -- 172.21.15.22:0/2083027696 reap_dead start 2024-04-16T16:19:39.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.561+0000 7fd7ad400640 1 -- 172.21.15.22:0/2083027696 shutdown_connections 2024-04-16T16:19:39.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.561+0000 7fd7ad400640 1 -- 172.21.15.22:0/2083027696 >> 172.21.15.22:0/2083027696 conn(0x7fd7a8062440 msgr2=0x7fd7a8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:39.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.561+0000 7fd7ad400640 1 -- 172.21.15.22:0/2083027696 shutdown_connections 2024-04-16T16:19:39.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.561+0000 7fd7ad400640 1 -- 172.21.15.22:0/2083027696 wait complete. 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.562+0000 7fd7ad400640 1 Processor -- start 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.563+0000 7fd7ad400640 1 -- start start 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7ad400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd788003f60 0x7fd7a815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7ad400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8146d60 0x7fd7a813eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7ad400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a813f3e0 0x7fd7a8144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7ad400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8147ca0 con 0x7fd7a813f3e0 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7ad400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a806e920 con 0x7fd7a8146d60 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7ad400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a8167b20 con 0x7fd788003f60 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a813f3e0 0x7fd7a8144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a813f3e0 0x7fd7a8144f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57228/0 (socket says 172.21.15.22:57228) 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 -- 172.21.15.22:0/2240207480 learned_addr learned my addr 172.21.15.22:0/2240207480 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a5e00640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8146d60 0x7fd7a813eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a6800640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd788003f60 0x7fd7a815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 -- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd788003f60 msgr2=0x7fd7a815dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd788003f60 0x7fd7a815dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 -- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8146d60 msgr2=0x7fd7a813eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8146d60 0x7fd7a813eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.564+0000 7fd7a7200640 1 -- 172.21.15.22:0/2240207480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a8145cc0 con 0x7fd7a813f3e0 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.565+0000 7fd7a7200640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a813f3e0 0x7fd7a8144f90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0010790 tx=0x7fd7a0010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:39.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.565+0000 7fd79ea00640 1 -- 172.21.15.22:0/2240207480 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000f040 con 0x7fd7a813f3e0 2024-04-16T16:19:39.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.565+0000 7fd79ea00640 1 -- 172.21.15.22:0/2240207480 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a001c070 con 0x7fd7a813f3e0 2024-04-16T16:19:39.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.565+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a8145fa0 con 0x7fd7a813f3e0 2024-04-16T16:19:39.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.565+0000 7fd79ea00640 1 -- 172.21.15.22:0/2240207480 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000ead0 con 0x7fd7a813f3e0 2024-04-16T16:19:39.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.565+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a8146560 con 0x7fd7a813f3e0 2024-04-16T16:19:39.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.566+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a804fd90 con 0x7fd7a813f3e0 2024-04-16T16:19:39.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.567+0000 7fd79ea00640 1 -- 172.21.15.22:0/2240207480 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7fd7a000ec70 con 0x7fd7a813f3e0 2024-04-16T16:19:39.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.568+0000 7fd79ea00640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406cbc0 0x7fd78406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:39.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.568+0000 7fd79ea00640 1 -- 172.21.15.22:0/2240207480 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fd7a008b7a0 con 0x7fd7a813f3e0 2024-04-16T16:19:39.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.569+0000 7fd7a6800640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406cbc0 0x7fd78406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:39.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.569+0000 7fd7a6800640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406cbc0 0x7fd78406f080 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd798000f60 tx=0x7fd798000ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:39.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.573+0000 7fd79ea00640 1 -- 172.21.15.22:0/2240207480 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7a0025020 con 0x7fd7a813f3e0 2024-04-16T16:19:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.818+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd7a80afef0 con 0x7fd7a813f3e0 2024-04-16T16:19:39.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.819+0000 7fd79ea00640 1 -- 172.21.15.22:0/2240207480 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7fd7a0059840 con 0x7fd7a813f3e0 2024-04-16T16:19:39.819 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T16:19:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.821+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406cbc0 msgr2=0x7fd78406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.821+0000 7fd7ad400640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406cbc0 0x7fd78406f080 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd798000f60 tx=0x7fd798000ef0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.821+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a813f3e0 msgr2=0x7fd7a8144f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.821+0000 7fd7ad400640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a813f3e0 0x7fd7a8144f90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0010790 tx=0x7fd7a0010c50 comp rx=0 tx=0).stop 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 shutdown_connections 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd78406cbc0 0x7fd78406f080 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7a813f3e0 0x7fd7a8144f90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a8146d60 0x7fd7a813eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 --2- 172.21.15.22:0/2240207480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd788003f60 0x7fd7a815dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 >> 172.21.15.22:0/2240207480 conn(0x7fd7a8062440 msgr2=0x7fd7a80b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 shutdown_connections 2024-04-16T16:19:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:39.822+0000 7fd7ad400640 1 -- 172.21.15.22:0/2240207480 wait complete. 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T16:19:39.843 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:19:39.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:39.844 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-16T16:19:39.905 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T16:19:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T16:19:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T16:19:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-16T16:19:39.905 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:39.905 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-16T16:19:39.906 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 36:10:94:e1:22:8d brd ff:ff:ff:ff:ff:ff 2024-04-16T16:19:39.907 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::b4ad:c9ff:fedb:4436/64 scope link 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether ce:17:27:11:48:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::cc17:27ff:fe11:48db/64 scope link 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 36:10:94:e1:22:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T16:19:39.908 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::3410:94ff:fee1:228d/64 scope link 2024-04-16T16:19:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-16T16:19:39.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:39.910 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T16:19:40.008 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-16T16:19:40.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:40.014 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-16T16:19:40.071 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-16T16:19:40.072 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T16:19:40.072 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T16:19:40.072 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T16:19:40.072 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T16:19:40.072 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T16:19:40.072 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-16T16:19:40.072 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T16:19:40.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T16:19:40.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T16:19:40.073 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-16T16:19:40.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:19:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T16:19:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:19:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:19:40.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:40.333 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:19:40.384 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T16:19:40.384 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-16T16:19:40.385 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:19:40.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:40.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-16T16:19:40.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:19:40.483 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T16:19:40.539 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T16:19:40.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T16:19:40.540 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T16:19:40.596 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T16:19:40.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:40.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:19:40.744 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:19:40.744 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:19:40.744 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:19:40.766 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:19:40.766 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:19:40.766 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:19:40.766 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:19:40.766 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:19:40.794 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T16:19:40.795 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T16:19:40.795 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-04-16T16:19:40.795 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-04-16T16:19:40.795 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T16:19:40.795 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-04-16T16:19:40.795 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-04-16T16:19:40.795 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf" will pass to kernel 2024-04-16T16:19:40.797 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-16T16:19:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-04-16T16:19:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T16:19:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T16:19:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T16:19:40.801 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T16:19:40.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:40.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T16:19:40.891 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T16:19:41.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:19:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:19:41.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-16T16:19:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:19:41.021 INFO:teuthology.orchestra.run.smithi043.stdout:client4856 2024-04-16T16:19:41.021 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:19:41.021 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:41.075 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-16T16:19:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.307+0000 7f1847e00640 1 Processor -- start 2024-04-16T16:19:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.307+0000 7f1847e00640 1 -- start start 2024-04-16T16:19:41.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1847e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1848162cd0 0x7f1848167340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:41.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1847e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1848072650 0x7f1848163d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:41.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1847e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1848164240 con 0x7f18480b4da0 2024-04-16T16:19:41.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1847e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1848072b00 con 0x7f1848072650 2024-04-16T16:19:41.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1847e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1848166eb0 con 0x7f1848162cd0 2024-04-16T16:19:41.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1846000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1848072650 0x7f1848163d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:41.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1846000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1848072650 0x7f1848163d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46812/0 (socket says 172.21.15.22:46812) 2024-04-16T16:19:41.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.309+0000 7f1846000640 1 -- 172.21.15.22:0/15911684 learned_addr learned my addr 172.21.15.22:0/15911684 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:41.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.310+0000 7f1846000640 1 -- 172.21.15.22:0/15911684 >> v2:172.21.15.43:3300/0 conn(0x7f1848162cd0 msgr2=0x7f1848167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:41.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.310+0000 7f1846000640 1 --2- 172.21.15.22:0/15911684 >> v2:172.21.15.43:3300/0 conn(0x7f1848162cd0 0x7f1848167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.310+0000 7f1846000640 1 -- 172.21.15.22:0/15911684 >> v1:172.21.15.43:6789/0 conn(0x7f18480b4da0 legacy=0x7f18480b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:41.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.310+0000 7f1846000640 1 -- 172.21.15.22:0/15911684 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1848072d30 con 0x7f1848072650 2024-04-16T16:19:41.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.311+0000 7f1846000640 1 --2- 172.21.15.22:0/15911684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1848072650 0x7f1848163d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f184806f070 tx=0x7f183402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227be56f5e38c5d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:41.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.312+0000 7f1845600640 1 -- 172.21.15.22:0/15911684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183402e070 con 0x7f1848072650 2024-04-16T16:19:41.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.312+0000 7f1845600640 1 -- 172.21.15.22:0/15911684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1834037070 con 0x7f1848072650 2024-04-16T16:19:41.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.312+0000 7f1845600640 1 -- 172.21.15.22:0/15911684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834031a00 con 0x7f1848072650 2024-04-16T16:19:41.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 -- 172.21.15.22:0/15911684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1848072650 msgr2=0x7f1848163d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:41.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 --2- 172.21.15.22:0/15911684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1848072650 0x7f1848163d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f184806f070 tx=0x7f183402b880 comp rx=0 tx=0).stop 2024-04-16T16:19:41.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 -- 172.21.15.22:0/15911684 shutdown_connections 2024-04-16T16:19:41.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 --2- 172.21.15.22:0/15911684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1848072650 0x7f1848163d00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 --2- 172.21.15.22:0/15911684 >> v2:172.21.15.43:3300/0 conn(0x7f1848162cd0 0x7f1848167340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 -- 172.21.15.22:0/15911684 >> 172.21.15.22:0/15911684 conn(0x7f1848062440 msgr2=0x7f1848062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:41.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 -- 172.21.15.22:0/15911684 shutdown_connections 2024-04-16T16:19:41.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.313+0000 7f1847e00640 1 -- 172.21.15.22:0/15911684 wait complete. 2024-04-16T16:19:41.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.315+0000 7f1847e00640 1 Processor -- start 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.315+0000 7f1847e00640 1 -- start start 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1847e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1848072650 0x7f18481581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1847e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18480b4da0 0x7f18481ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1847e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848162cd0 0x7f18481fc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1847e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1848166b40 con 0x7f18480b4da0 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1847e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1848166860 con 0x7f1848162cd0 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1847e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f18481630b0 con 0x7f1848072650 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1846000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18480b4da0 0x7f18481ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:41.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1846000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18480b4da0 0x7f18481ec590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46820/0 (socket says 172.21.15.22:46820) 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1846000640 1 -- 172.21.15.22:0/3933939005 learned_addr learned my addr 172.21.15.22:0/3933939005 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.316+0000 7f1846a00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1848072650 0x7f18481581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1847400640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848162cd0 0x7f18481fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1846000640 1 -- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1848072650 msgr2=0x7f18481581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1846000640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1848072650 0x7f18481581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1846000640 1 -- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848162cd0 msgr2=0x7f18481fc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1846000640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848162cd0 0x7f18481fc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1846000640 1 -- 172.21.15.22:0/3933939005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18481ecde0 con 0x7f18480b4da0 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1847400640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848162cd0 0x7f18481fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1846000640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18480b4da0 0x7f18481ec590 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f183402b8c0 tx=0x7f18340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:41.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f183ea00640 1 -- 172.21.15.22:0/3933939005 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834032880 con 0x7f18480b4da0 2024-04-16T16:19:41.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f183ea00640 1 -- 172.21.15.22:0/3933939005 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1834032a20 con 0x7f18480b4da0 2024-04-16T16:19:41.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f183ea00640 1 -- 172.21.15.22:0/3933939005 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834032e10 con 0x7f18480b4da0 2024-04-16T16:19:41.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.317+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18481ed0c0 con 0x7f18480b4da0 2024-04-16T16:19:41.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.318+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18481ed680 con 0x7f18480b4da0 2024-04-16T16:19:41.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.319+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1848075f30 con 0x7f18480b4da0 2024-04-16T16:19:41.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.320+0000 7f183ea00640 1 -- 172.21.15.22:0/3933939005 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f18340453f0 con 0x7f18480b4da0 2024-04-16T16:19:41.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.321+0000 7f183ea00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182806cbc0 0x7f182806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:41.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.321+0000 7f183ea00640 1 -- 172.21.15.22:0/3933939005 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f18340ae170 con 0x7f18480b4da0 2024-04-16T16:19:41.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.321+0000 7f1846a00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182806cbc0 0x7f182806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:41.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.322+0000 7f1846a00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182806cbc0 0x7f182806f080 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1840009f20 tx=0x7f18400094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:41.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.326+0000 7f183ea00640 1 -- 172.21.15.22:0/3933939005 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1834040070 con 0x7f18480b4da0 2024-04-16T16:19:41.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.571+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f18480b17b0 con 0x7f18480b4da0 2024-04-16T16:19:41.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.846+0000 7f183ea00640 1 -- 172.21.15.22:0/3933939005 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v27) ==== 136+0+0 (secure 0 0 0) 0x7f183407c2f0 con 0x7f18480b4da0 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.849+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182806cbc0 msgr2=0x7f182806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.849+0000 7f1847e00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182806cbc0 0x7f182806f080 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1840009f20 tx=0x7f18400094f0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18480b4da0 msgr2=0x7f18481ec590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18480b4da0 0x7f18481ec590 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f183402b8c0 tx=0x7f18340046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 shutdown_connections 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182806cbc0 0x7f182806f080 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848162cd0 0x7f18481fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18480b4da0 0x7f18481ec590 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 --2- 172.21.15.22:0/3933939005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1848072650 0x7f18481581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 >> 172.21.15.22:0/3933939005 conn(0x7f1848062440 msgr2=0x7f184815d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 shutdown_connections 2024-04-16T16:19:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:41.850+0000 7f1847e00640 1 -- 172.21.15.22:0/3933939005 wait complete. 2024-04-16T16:19:41.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-16T16:19:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.104+0000 7f0887e00640 1 Processor -- start 2024-04-16T16:19:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.104+0000 7f0887e00640 1 -- start start 2024-04-16T16:19:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.106+0000 7f0887e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f08880b56b0 0x7f08880d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.106+0000 7f0887e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088806d060 con 0x7f088815e8b0 2024-04-16T16:19:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.106+0000 7f0887e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088806d340 con 0x7f08880d05f0 2024-04-16T16:19:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.106+0000 7f0887e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f088806dc70 con 0x7f08880b56b0 2024-04-16T16:19:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.106+0000 7f0886a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f088815e8b0 0x7f0888162ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56816/0 (socket says 172.21.15.22:56816) 2024-04-16T16:19:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.106+0000 7f0886a00640 1 -- 172.21.15.22:0/1223541395 learned_addr learned my addr 172.21.15.22:0/1223541395 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:19:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0886000640 1 --2- 172.21.15.22:0/1223541395 >> v2:172.21.15.43:3300/0 conn(0x7f08880b56b0 0x7f08880d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043928277 0 0) 0x7f088806d060 con 0x7f088815e8b0 2024-04-16T16:19:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c003520 con 0x7f088815e8b0 2024-04-16T16:19:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3080932204 0 0) 0x7f086c003520 con 0x7f088815e8b0 2024-04-16T16:19:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 >> v2:172.21.15.43:3300/0 conn(0x7f08880b56b0 msgr2=0x7f08880d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 --2- 172.21.15.22:0/1223541395 >> v2:172.21.15.43:3300/0 conn(0x7f08880b56b0 0x7f08880d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 >> v1:172.21.15.43:6789/0 conn(0x7f08880d05f0 legacy=0x7f08880b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088806d620 con 0x7f088815e8b0 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f0878001670 con 0x7f088815e8b0 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 >> v1:172.21.15.22:6789/0 conn(0x7f088815e8b0 legacy=0x7f0888162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c003a20 0x7f086c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c004800 0x7f086c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c0051c0 0x7f086c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f088806dc70 con 0x7f086c0051c0 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f086c00c0f0 con 0x7f086c004800 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.107+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f086c00c2f0 con 0x7f086c003a20 2024-04-16T16:19:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0887400640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c0051c0 0x7f086c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0886a00640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c003a20 0x7f086c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0886000640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c004800 0x7f086c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0887400640 1 -- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c003a20 msgr2=0x7f086c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0887400640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c003a20 0x7f086c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0887400640 1 -- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c004800 msgr2=0x7f086c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0887400640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c004800 0x7f086c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0887400640 1 -- 172.21.15.22:0/1223541395 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c003520 con 0x7f086c0051c0 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0886000640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c004800 0x7f086c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.108+0000 7f0886a00640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c003a20 0x7f086c003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.109+0000 7f0887400640 1 -- 172.21.15.22:0/1223541395 reap_dead start 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.109+0000 7f0887400640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c0051c0 0x7f086c00b9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0880001e20 tx=0x7f086c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446753eda5d217ea server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880001a70 con 0x7f086c0051c0 2024-04-16T16:19:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0880003b70 con 0x7f086c0051c0 2024-04-16T16:19:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0885600640 1 -- 172.21.15.22:0/1223541395 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08800050d0 con 0x7f086c0051c0 2024-04-16T16:19:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0887e00640 1 -- 172.21.15.22:0/1223541395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c0051c0 msgr2=0x7f086c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0887e00640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c0051c0 0x7f086c00b9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0880001e20 tx=0x7f086c005830 comp rx=0 tx=0).stop 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0887e00640 1 -- 172.21.15.22:0/1223541395 shutdown_connections 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0887e00640 1 --2- 172.21.15.22:0/1223541395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c0051c0 0x7f086c00b9c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0887e00640 1 -- 172.21.15.22:0/1223541395 >> 172.21.15.22:0/1223541395 conn(0x7f0888075070 msgr2=0x7f0888062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0887e00640 1 -- 172.21.15.22:0/1223541395 shutdown_connections 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.110+0000 7f0887e00640 1 -- 172.21.15.22:0/1223541395 wait complete. 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.112+0000 7f0887e00640 1 Processor -- start 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.112+0000 7f0887e00640 1 -- start start 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0887e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c0051c0 0x7f0888153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0887e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f088815bcb0 0x7f0888154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0887e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0888157380 0x7f08881551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0887e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f08880d0a20 con 0x7f088815bcb0 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0887e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f088806e100 con 0x7f0888157380 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0887e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f088815ec90 con 0x7f086c0051c0 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0886000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f088815bcb0 0x7f0888154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0886000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f088815bcb0 0x7f0888154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46842/0 (socket says 172.21.15.22:46842) 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.113+0000 7f0886000640 1 -- 172.21.15.22:0/2646408733 learned_addr learned my addr 172.21.15.22:0/2646408733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0886a00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c0051c0 0x7f0888153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0887400640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0888157380 0x7f08881551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0886000640 1 -- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c0051c0 msgr2=0x7f0888153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0886000640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c0051c0 0x7f0888153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0886000640 1 -- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0888157380 msgr2=0x7f08881551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0886000640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0888157380 0x7f08881551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0886000640 1 -- 172.21.15.22:0/2646408733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0888154e90 con 0x7f088815bcb0 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0887400640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0888157380 0x7f08881551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f0886000640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f088815bcb0 0x7f0888154950 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0874010890 tx=0x7f0874010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f087ea00640 1 -- 172.21.15.22:0/2646408733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087400f040 con 0x7f088815bcb0 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f087ea00640 1 -- 172.21.15.22:0/2646408733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087400eb60 con 0x7f088815bcb0 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.114+0000 7f087ea00640 1 -- 172.21.15.22:0/2646408733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087401c400 con 0x7f088815bcb0 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.115+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08881578f0 con 0x7f088815bcb0 2024-04-16T16:19:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.115+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08880cccd0 con 0x7f088815bcb0 2024-04-16T16:19:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.116+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0888075f30 con 0x7f088815bcb0 2024-04-16T16:19:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.117+0000 7f087ea00640 1 -- 172.21.15.22:0/2646408733 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f087401c5a0 con 0x7f088815bcb0 2024-04-16T16:19:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.118+0000 7f087ea00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f086806cbc0 0x7f086806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.118+0000 7f087ea00640 1 -- 172.21.15.22:0/2646408733 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f087408c6d0 con 0x7f088815bcb0 2024-04-16T16:19:42.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.118+0000 7f0886a00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f086806cbc0 0x7f086806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.119+0000 7f0886a00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f086806cbc0 0x7f086806f080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0878001eb0 tx=0x7f0878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:42.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.123+0000 7f087ea00640 1 -- 172.21.15.22:0/2646408733 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0874018030 con 0x7f088815bcb0 2024-04-16T16:19:42.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.343+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f0888071160 con 0x7f086806cbc0 2024-04-16T16:19:42.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.345+0000 7f087ea00640 1 -- 172.21.15.22:0/2646408733 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f0888071160 con 0x7f086806cbc0 2024-04-16T16:19:42.345 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-04-16T16:19:42.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:19:42.345 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2024-04-16T16:19:42.345 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:19:42.345 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f086806cbc0 msgr2=0x7f086806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f086806cbc0 0x7f086806f080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0878001eb0 tx=0x7f0878009040 comp rx=0 tx=0).stop 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f088815bcb0 msgr2=0x7f0888154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f088815bcb0 0x7f0888154950 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0874010890 tx=0x7f0874010d50 comp rx=0 tx=0).stop 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 shutdown_connections 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f086806cbc0 0x7f086806f080 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0888157380 0x7f08881551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f088815bcb0 0x7f0888154950 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.347+0000 7f0887e00640 1 --2- 172.21.15.22:0/2646408733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f086c0051c0 0x7f0888153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.348+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 >> 172.21.15.22:0/2646408733 conn(0x7f0888075070 msgr2=0x7f08880b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:42.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.348+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 shutdown_connections 2024-04-16T16:19:42.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.348+0000 7f0887e00640 1 -- 172.21.15.22:0/2646408733 wait complete. 2024-04-16T16:19:42.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T16:19:42.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.579+0000 7f9df8a00640 1 Processor -- start 2024-04-16T16:19:42.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.580+0000 7f9df8a00640 1 -- start start 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.581+0000 7f9df8a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df406c130 0x7f9df4072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.581+0000 7f9df8a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9df4160160 0x7f9df4072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.581+0000 7f9df8a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df4072da0 con 0x7f9df4156160 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.581+0000 7f9df8a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9df4073080 con 0x7f9df4160160 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.581+0000 7f9df8a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9df415fcd0 con 0x7f9df406c130 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9df2800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9df4160160 0x7f9df4072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9df2800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9df4160160 0x7f9df4072690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46846/0 (socket says 172.21.15.22:46846) 2024-04-16T16:19:42.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9df2800640 1 -- 172.21.15.22:0/4050891380 learned_addr learned my addr 172.21.15.22:0/4050891380 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:42.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9debe00640 1 --2- 172.21.15.22:0/4050891380 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df406c130 0x7f9df4072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9df2800640 1 -- 172.21.15.22:0/4050891380 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df406c130 msgr2=0x7f9df4072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:42.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9df2800640 1 --2- 172.21.15.22:0/4050891380 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df406c130 0x7f9df4072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9df2800640 1 -- 172.21.15.22:0/4050891380 >> v1:172.21.15.43:6789/0 conn(0x7f9df4156160 legacy=0x7f9df406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:42.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.582+0000 7f9df2800640 1 -- 172.21.15.22:0/4050891380 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df415f680 con 0x7f9df4160160 2024-04-16T16:19:42.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.583+0000 7f9df2800640 1 --2- 172.21.15.22:0/4050891380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df4160160 0x7f9df4072690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009e50 tx=0x7f9dec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e465b4d390f23c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:42.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df1400640 1 -- 172.21.15.22:0/4050891380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec02ca70 con 0x7f9df4160160 2024-04-16T16:19:42.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df1400640 1 -- 172.21.15.22:0/4050891380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec02cc10 con 0x7f9df4160160 2024-04-16T16:19:42.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df1400640 1 -- 172.21.15.22:0/4050891380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0343f0 con 0x7f9df4160160 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df8a00640 1 -- 172.21.15.22:0/4050891380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df4160160 msgr2=0x7f9df4072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df8a00640 1 --2- 172.21.15.22:0/4050891380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df4160160 0x7f9df4072690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009e50 tx=0x7f9dec02bed0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df8a00640 1 -- 172.21.15.22:0/4050891380 shutdown_connections 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df8a00640 1 --2- 172.21.15.22:0/4050891380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df4160160 0x7f9df4072690 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df8a00640 1 --2- 172.21.15.22:0/4050891380 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df406c130 0x7f9df4072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.584+0000 7f9df8a00640 1 -- 172.21.15.22:0/4050891380 >> 172.21.15.22:0/4050891380 conn(0x7f9df40b3510 msgr2=0x7f9df40b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.585+0000 7f9df8a00640 1 -- 172.21.15.22:0/4050891380 shutdown_connections 2024-04-16T16:19:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.585+0000 7f9df8a00640 1 -- 172.21.15.22:0/4050891380 wait complete. 2024-04-16T16:19:42.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.586+0000 7f9df8a00640 1 Processor -- start 2024-04-16T16:19:42.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.587+0000 7f9df8a00640 1 -- start start 2024-04-16T16:19:42.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.587+0000 7f9df8a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df406c130 0x7f9df41496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.587+0000 7f9df8a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df4156160 0x7f9df415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.587+0000 7f9df8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4160160 0x7f9df40b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.587+0000 7f9df8a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9df40b0630 con 0x7f9df406c130 2024-04-16T16:19:42.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.587+0000 7f9df8a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9df40b04b0 con 0x7f9df4160160 2024-04-16T16:19:42.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.587+0000 7f9df8a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9df40b07b0 con 0x7f9df4156160 2024-04-16T16:19:42.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df406c130 0x7f9df41496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df406c130 0x7f9df41496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46860/0 (socket says 172.21.15.22:46860) 2024-04-16T16:19:42.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 -- 172.21.15.22:0/681053410 learned_addr learned my addr 172.21.15.22:0/681053410 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:42.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df2800640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4160160 0x7f9df40b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9debe00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df4156160 0x7f9df415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 -- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df4156160 msgr2=0x7f9df415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df4156160 0x7f9df415d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 -- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4160160 msgr2=0x7f9df40b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4160160 0x7f9df40b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.588+0000 7f9df1e00640 1 -- 172.21.15.22:0/681053410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df415e110 con 0x7f9df406c130 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.589+0000 7f9df1e00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df406c130 0x7f9df41496e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c430 tx=0x7f9de400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.589+0000 7f9dea000640 1 -- 172.21.15.22:0/681053410 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de40052d0 con 0x7f9df406c130 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.589+0000 7f9dea000640 1 -- 172.21.15.22:0/681053410 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4005490 con 0x7f9df406c130 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.589+0000 7f9dea000640 1 -- 172.21.15.22:0/681053410 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4007260 con 0x7f9df406c130 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.589+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df40ceab0 con 0x7f9df406c130 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.589+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df40cf070 con 0x7f9df406c130 2024-04-16T16:19:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.590+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df404fd90 con 0x7f9df406c130 2024-04-16T16:19:42.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.591+0000 7f9dea000640 1 -- 172.21.15.22:0/681053410 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f9de4007400 con 0x7f9df406c130 2024-04-16T16:19:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.593+0000 7f9dea000640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd006cbc0 0x7f9dd006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.593+0000 7f9dea000640 1 -- 172.21.15.22:0/681053410 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f9de408b550 con 0x7f9df406c130 2024-04-16T16:19:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.593+0000 7f9debe00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd006cbc0 0x7f9dd006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.594+0000 7f9debe00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd006cbc0 0x7f9dd006f080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc006fd0 tx=0x7f9ddc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:42.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.598+0000 7f9dea000640 1 -- 172.21.15.22:0/681053410 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9de40595e0 con 0x7f9df406c130 2024-04-16T16:19:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.801+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9df415f0e0 con 0x7f9df406c130 2024-04-16T16:19:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.802+0000 7f9dea000640 1 -- 172.21.15.22:0/681053410 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f9de4058ee0 con 0x7f9df406c130 2024-04-16T16:19:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.804+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd006cbc0 msgr2=0x7f9dd006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.804+0000 7f9df8a00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd006cbc0 0x7f9dd006f080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc006fd0 tx=0x7f9ddc008040 comp rx=0 tx=0).stop 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.804+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df406c130 msgr2=0x7f9df41496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.804+0000 7f9df8a00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df406c130 0x7f9df41496e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c430 tx=0x7f9de400c8f0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 shutdown_connections 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9dd006cbc0 0x7f9dd006f080 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4160160 0x7f9df40b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9df4156160 0x7f9df415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 --2- 172.21.15.22:0/681053410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df406c130 0x7f9df41496e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 >> 172.21.15.22:0/681053410 conn(0x7f9df40b3510 msgr2=0x7f9df406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 shutdown_connections 2024-04-16T16:19:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:42.805+0000 7f9df8a00640 1 -- 172.21.15.22:0/681053410 wait complete. 2024-04-16T16:19:42.826 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol64180 --mode=777 2024-04-16T16:19:43.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.047+0000 7f4aeaa00640 1 Processor -- start 2024-04-16T16:19:43.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.048+0000 7f4aeaa00640 1 -- start start 2024-04-16T16:19:43.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4aeaa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4ae40b6640 0x7f4ae40cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4aeaa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4ae40d41b0 0x7f4ae40b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4aeaa00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae40d4640 con 0x7f4ae40b3b80 2024-04-16T16:19:43.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4aeaa00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae40d3d20 con 0x7f4ae40b6640 2024-04-16T16:19:43.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4aeaa00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae40cfee0 con 0x7f4ae40d41b0 2024-04-16T16:19:43.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4ae9600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4ae40b6640 0x7f4ae40cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4ae9600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4ae40b6640 0x7f4ae40cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46870/0 (socket says 172.21.15.22:46870) 2024-04-16T16:19:43.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.049+0000 7f4ae9600640 1 -- 172.21.15.22:0/4102482313 learned_addr learned my addr 172.21.15.22:0/4102482313 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:43.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.050+0000 7f4aea000640 1 --2- 172.21.15.22:0/4102482313 >> v2:172.21.15.43:3300/0 conn(0x7f4ae40d41b0 0x7f4ae40b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.050+0000 7f4ae9600640 1 -- 172.21.15.22:0/4102482313 >> v2:172.21.15.43:3300/0 conn(0x7f4ae40d41b0 msgr2=0x7f4ae40b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:43.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.050+0000 7f4ae9600640 1 --2- 172.21.15.22:0/4102482313 >> v2:172.21.15.43:3300/0 conn(0x7f4ae40d41b0 0x7f4ae40b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.050+0000 7f4ae9600640 1 -- 172.21.15.22:0/4102482313 >> v1:172.21.15.43:6789/0 conn(0x7f4ae40b3b80 legacy=0x7f4ae40b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:43.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.050+0000 7f4ae9600640 1 -- 172.21.15.22:0/4102482313 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae40cfc00 con 0x7f4ae40b6640 2024-04-16T16:19:43.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.051+0000 7f4ae9600640 1 --2- 172.21.15.22:0/4102482313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b6640 0x7f4ae40cf090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4ae408db00 tx=0x7f4ad802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4419764eb71dc68 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:43.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.051+0000 7f4ae3e00640 1 -- 172.21.15.22:0/4102482313 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8035020 con 0x7f4ae40b6640 2024-04-16T16:19:43.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4ae3e00640 1 -- 172.21.15.22:0/4102482313 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad8031870 con 0x7f4ae40b6640 2024-04-16T16:19:43.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4ae3e00640 1 -- 172.21.15.22:0/4102482313 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8031c40 con 0x7f4ae40b6640 2024-04-16T16:19:43.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4aeaa00640 1 -- 172.21.15.22:0/4102482313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b6640 msgr2=0x7f4ae40cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/4102482313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b6640 0x7f4ae40cf090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4ae408db00 tx=0x7f4ad802b910 comp rx=0 tx=0).stop 2024-04-16T16:19:43.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4aeaa00640 1 -- 172.21.15.22:0/4102482313 shutdown_connections 2024-04-16T16:19:43.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/4102482313 >> v2:172.21.15.43:3300/0 conn(0x7f4ae40d41b0 0x7f4ae40b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/4102482313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b6640 0x7f4ae40cf090 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.052+0000 7f4aeaa00640 1 -- 172.21.15.22:0/4102482313 >> 172.21.15.22:0/4102482313 conn(0x7f4ae4062620 msgr2=0x7f4ae4062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:43.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.053+0000 7f4aeaa00640 1 -- 172.21.15.22:0/4102482313 shutdown_connections 2024-04-16T16:19:43.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.053+0000 7f4aeaa00640 1 -- 172.21.15.22:0/4102482313 wait complete. 2024-04-16T16:19:43.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.054+0000 7f4aeaa00640 1 Processor -- start 2024-04-16T16:19:43.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.054+0000 7f4aeaa00640 1 -- start start 2024-04-16T16:19:43.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.055+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b3b80 0x7f4ae415f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.055+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ae40b6640 0x7f4ae415f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.055+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae40d41b0 0x7f4ae4159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.055+0000 7f4aeaa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae40cf890 con 0x7f4ae40b3b80 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.055+0000 7f4aeaa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae40d39b0 con 0x7f4ae40d41b0 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.055+0000 7f4aeaa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae40b7f30 con 0x7f4ae40b6640 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b3b80 0x7f4ae415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b3b80 0x7f4ae415f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46882/0 (socket says 172.21.15.22:46882) 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 -- 172.21.15.22:0/1341217132 learned_addr learned my addr 172.21.15.22:0/1341217132 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4aea000640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae40d41b0 0x7f4ae4159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 -- 172.21.15.22:0/1341217132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ae40b6640 msgr2=0x7f4ae415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ae40b6640 0x7f4ae415f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 -- 172.21.15.22:0/1341217132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae40d41b0 msgr2=0x7f4ae4159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae40d41b0 0x7f4ae4159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 -- 172.21.15.22:0/1341217132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae40cd580 con 0x7f4ae40b3b80 2024-04-16T16:19:43.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.056+0000 7f4ae9600640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b3b80 0x7f4ae415f000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000c00 tx=0x7f4ad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:43.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.057+0000 7f4ae1600640 1 -- 172.21.15.22:0/1341217132 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad803ad60 con 0x7f4ae40b3b80 2024-04-16T16:19:43.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.057+0000 7f4ae1600640 1 -- 172.21.15.22:0/1341217132 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad80443f0 con 0x7f4ae40b3b80 2024-04-16T16:19:43.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.057+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae40cd860 con 0x7f4ae40b3b80 2024-04-16T16:19:43.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.057+0000 7f4ae1600640 1 -- 172.21.15.22:0/1341217132 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80447e0 con 0x7f4ae40b3b80 2024-04-16T16:19:43.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.057+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae40cde20 con 0x7f4ae40b3b80 2024-04-16T16:19:43.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.058+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae4075f30 con 0x7f4ae40b3b80 2024-04-16T16:19:43.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.059+0000 7f4ae1600640 1 -- 172.21.15.22:0/1341217132 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f4ad804b060 con 0x7f4ae40b3b80 2024-04-16T16:19:43.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.060+0000 7f4ae1600640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4ac406cbf0 0x7f4ac406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.060+0000 7f4ae1600640 1 -- 172.21.15.22:0/1341217132 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f4ad80ae250 con 0x7f4ae40b3b80 2024-04-16T16:19:43.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.060+0000 7f4ae8c00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4ac406cbf0 0x7f4ac406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.061+0000 7f4ae8c00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4ac406cbf0 0x7f4ac406f0b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0006fd0 tx=0x7f4ad0006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:43.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.064+0000 7f4ae1600640 1 -- 172.21.15.22:0/1341217132 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ad803f070 con 0x7f4ae40b3b80 2024-04-16T16:19:43.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.301+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol64180", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f4ae40cf670 con 0x7f4ac406cbf0 2024-04-16T16:19:43.312 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:19:43.312+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:19:43.312 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:19:43.312+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:19:43.312 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:19:43.312+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:19:43.312 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:19:43.312+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:19:43.312 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:19:43.312+0000 7f04dec00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:19:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.366+0000 7f4ae1600640 1 -- 172.21.15.22:0/1341217132 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ae40cf670 con 0x7f4ac406cbf0 2024-04-16T16:19:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4ac406cbf0 msgr2=0x7f4ac406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4ac406cbf0 0x7f4ac406f0b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0006fd0 tx=0x7f4ad0006bc0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b3b80 msgr2=0x7f4ae415f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b3b80 0x7f4ae415f000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000c00 tx=0x7f4ad80046c0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 shutdown_connections 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4ac406cbf0 0x7f4ac406f0b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae40d41b0 0x7f4ae4159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ae40b6640 0x7f4ae415f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 --2- 172.21.15.22:0/1341217132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae40b3b80 0x7f4ae415f000 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 >> 172.21.15.22:0/1341217132 conn(0x7f4ae4062620 msgr2=0x7f4ae40b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 shutdown_connections 2024-04-16T16:19:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.369+0000 7f4aeaa00640 1 -- 172.21.15.22:0/1341217132 wait complete. 2024-04-16T16:19:43.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol64180 2024-04-16T16:19:43.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.593+0000 7f76c5600640 1 Processor -- start 2024-04-16T16:19:43.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.593+0000 7f76c5600640 1 -- start start 2024-04-16T16:19:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.595+0000 7f76c5600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b5630 0x7f76c00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.595+0000 7f76c5600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f76c0071110 0x7f76c00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.595+0000 7f76c5600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c00b3350 con 0x7f76c00b3d60 2024-04-16T16:19:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.595+0000 7f76c5600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f76c006d040 con 0x7f76c0071110 2024-04-16T16:19:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.595+0000 7f76c5600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f76c006ea40 con 0x7f76c00b5630 2024-04-16T16:19:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bf400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f76c0071110 0x7f76c00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bf400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f76c0071110 0x7f76c00715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46902/0 (socket says 172.21.15.22:46902) 2024-04-16T16:19:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bf400640 1 -- 172.21.15.22:0/163337944 learned_addr learned my addr 172.21.15.22:0/163337944 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:43.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bf400640 1 -- 172.21.15.22:0/163337944 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b5630 msgr2=0x7f76c00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:43.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bea00640 1 --2- 172.21.15.22:0/163337944 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b5630 0x7f76c00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bf400640 1 --2- 172.21.15.22:0/163337944 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b5630 0x7f76c00b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bf400640 1 -- 172.21.15.22:0/163337944 >> v1:172.21.15.43:6789/0 conn(0x7f76c00b3d60 legacy=0x7f76c006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:19:43.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.596+0000 7f76bf400640 1 -- 172.21.15.22:0/163337944 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c006d290 con 0x7f76c0071110 2024-04-16T16:19:43.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.598+0000 7f76bf400640 1 --2- 172.21.15.22:0/163337944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0071110 0x7f76c00715a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e50 tx=0x7f76b802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf259cc020310f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.598+0000 7f76be000640 1 -- 172.21.15.22:0/163337944 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b802c9e0 con 0x7f76c0071110 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.598+0000 7f76be000640 1 -- 172.21.15.22:0/163337944 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b802cb80 con 0x7f76c0071110 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.598+0000 7f76be000640 1 -- 172.21.15.22:0/163337944 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b80343f0 con 0x7f76c0071110 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.598+0000 7f76c5600640 1 -- 172.21.15.22:0/163337944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0071110 msgr2=0x7f76c00715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.598+0000 7f76c5600640 1 --2- 172.21.15.22:0/163337944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0071110 0x7f76c00715a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e50 tx=0x7f76b802be40 comp rx=0 tx=0).stop 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.599+0000 7f76c5600640 1 -- 172.21.15.22:0/163337944 shutdown_connections 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.599+0000 7f76c5600640 1 --2- 172.21.15.22:0/163337944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0071110 0x7f76c00715a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.599+0000 7f76c5600640 1 --2- 172.21.15.22:0/163337944 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b5630 0x7f76c00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.599+0000 7f76c5600640 1 -- 172.21.15.22:0/163337944 >> 172.21.15.22:0/163337944 conn(0x7f76c0062440 msgr2=0x7f76c0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.599+0000 7f76c5600640 1 -- 172.21.15.22:0/163337944 shutdown_connections 2024-04-16T16:19:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.599+0000 7f76c5600640 1 -- 172.21.15.22:0/163337944 wait complete. 2024-04-16T16:19:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.600+0000 7f76c5600640 1 Processor -- start 2024-04-16T16:19:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.601+0000 7f76c5600640 1 -- start start 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.601+0000 7f76c5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76c0071110 0x7f76c0139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.601+0000 7f76c5600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b3d60 0x7f76c0146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.601+0000 7f76c5600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c00b5630 0x7f76c0146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.601+0000 7f76c5600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76c006db30 con 0x7f76c00b5630 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.601+0000 7f76c5600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f76c006d850 con 0x7f76c0071110 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.601+0000 7f76c5600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f76c006de10 con 0x7f76c00b3d60 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c00b5630 0x7f76c0146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c00b5630 0x7f76c0146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46914/0 (socket says 172.21.15.22:46914) 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 -- 172.21.15.22:0/53188197 learned_addr learned my addr 172.21.15.22:0/53188197 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bea00640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76c0071110 0x7f76c0139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 -- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b3d60 msgr2=0x7f76c0146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b3d60 0x7f76c0146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 -- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76c0071110 msgr2=0x7f76c0139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76c0071110 0x7f76c0139ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bf400640 1 -- 172.21.15.22:0/53188197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c0145de0 con 0x7f76c00b5630 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.602+0000 7f76bea00640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76c0071110 0x7f76c0139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.603+0000 7f76bf400640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c00b5630 0x7f76c0146c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e50 tx=0x7f76b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.603+0000 7f76b6a00640 1 -- 172.21.15.22:0/53188197 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8043020 con 0x7f76c00b5630 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.603+0000 7f76b6a00640 1 -- 172.21.15.22:0/53188197 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b803e450 con 0x7f76c00b5630 2024-04-16T16:19:43.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.603+0000 7f76b6a00640 1 -- 172.21.15.22:0/53188197 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b803e840 con 0x7f76c00b5630 2024-04-16T16:19:43.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.603+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c0143b50 con 0x7f76c00b5630 2024-04-16T16:19:43.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.603+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c014ce20 con 0x7f76c00b5630 2024-04-16T16:19:43.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.604+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c004fd90 con 0x7f76c00b5630 2024-04-16T16:19:43.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.605+0000 7f76b6a00640 1 -- 172.21.15.22:0/53188197 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7f76b8046020 con 0x7f76c00b5630 2024-04-16T16:19:43.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.606+0000 7f76b6a00640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f769c06cbc0 0x7f769c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:19:43.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.606+0000 7f76b6a00640 1 -- 172.21.15.22:0/53188197 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f76b80ae970 con 0x7f76c00b5630 2024-04-16T16:19:43.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.606+0000 7f76bea00640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f769c06cbc0 0x7f769c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:19:43.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.607+0000 7f76bea00640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f769c06cbc0 0x7f769c06f080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f76c0144df0 tx=0x7f76b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:19:43.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.611+0000 7f76b6a00640 1 -- 172.21.15.22:0/53188197 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76b804d030 con 0x7f76c00b5630 2024-04-16T16:19:43.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.853+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol64180", "target": ["mon-mgr", ""]}) -- 0x7f76c00cffa0 con 0x7f769c06cbc0 2024-04-16T16:19:43.864 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea 2024-04-16T16:19:43.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.864+0000 7f76b6a00640 1 -- 172.21.15.22:0/53188197 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f76c00cffa0 con 0x7f769c06cbc0 2024-04-16T16:19:43.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f769c06cbc0 msgr2=0x7f769c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f769c06cbc0 0x7f769c06f080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f76c0144df0 tx=0x7f76b0008040 comp rx=0 tx=0).stop 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c00b5630 msgr2=0x7f76c0146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c00b5630 0x7f76c0146c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e50 tx=0x7f76b8004a40 comp rx=0 tx=0).stop 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 shutdown_connections 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f769c06cbc0 0x7f769c06f080 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c00b5630 0x7f76c0146c90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76c00b3d60 0x7f76c0146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 --2- 172.21.15.22:0/53188197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76c0071110 0x7f76c0139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.867+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 >> 172.21.15.22:0/53188197 conn(0x7f76c0062440 msgr2=0x7f76c015c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:19:43.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.868+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 shutdown_connections 2024-04-16T16:19:43.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:19:43.868+0000 7f76c5600640 1 -- 172.21.15.22:0/53188197 wait complete. 2024-04-16T16:19:43.891 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol64180 with 200 files each 1MB size under directory volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea 2024-04-16T16:19:43.891 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:43.891 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:43.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:43.940 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:44.087 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:44.087 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:44.088 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340611 s, 30.8 MB/s 2024-04-16T16:19:44.090 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:44.090 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:44.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:44.150 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284179 s, 36.9 MB/s 2024-04-16T16:19:44.235 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:44.235 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:44.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:44.293 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337276 s, 31.1 MB/s 2024-04-16T16:19:44.384 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:44.384 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:44.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:44.443 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221234 s, 47.4 MB/s 2024-04-16T16:19:44.525 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:44.525 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:44.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:44.579 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:44.665 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:44.665 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:44.665 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286881 s, 36.6 MB/s 2024-04-16T16:19:44.667 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:44.667 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:44.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:44.725 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:44.808 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:44.808 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:44.808 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239419 s, 43.8 MB/s 2024-04-16T16:19:44.810 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:44.810 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:44.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:44.866 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:44.947 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:44.947 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:44.947 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246474 s, 42.5 MB/s 2024-04-16T16:19:44.948 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:44.948 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:45.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:45.006 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:45.103 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:45.103 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:45.103 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386903 s, 27.1 MB/s 2024-04-16T16:19:45.105 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:45.105 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:45.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:45.163 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:45.452 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:45.452 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:45.452 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233152 s, 4.5 MB/s 2024-04-16T16:19:45.454 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:45.454 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:45.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:45.514 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407673 s, 25.7 MB/s 2024-04-16T16:19:45.613 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:45.613 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:45.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:45.668 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205411 s, 51.0 MB/s 2024-04-16T16:19:45.744 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:45.744 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:45.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:45.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:45.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:45.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:45.878 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224304 s, 46.7 MB/s 2024-04-16T16:19:45.880 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:45.880 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:45.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:45.938 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:46.017 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:46.017 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:46.017 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260013 s, 40.3 MB/s 2024-04-16T16:19:46.019 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:46.019 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:46.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:46.075 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226101 s, 46.4 MB/s 2024-04-16T16:19:46.150 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:46.150 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:46.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:46.209 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:46.294 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:46.294 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:46.294 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278162 s, 37.7 MB/s 2024-04-16T16:19:46.295 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:46.296 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:46.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:46.355 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:46.455 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:46.455 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:46.455 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0429008 s, 24.4 MB/s 2024-04-16T16:19:46.457 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:46.457 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:46.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:46.516 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:46.602 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:46.602 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:46.602 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236584 s, 44.3 MB/s 2024-04-16T16:19:46.604 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:46.604 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:46.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:46.664 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301911 s, 34.7 MB/s 2024-04-16T16:19:46.752 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:46.752 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:46.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:46.813 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:46.883 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:46.883 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:46.883 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216623 s, 48.4 MB/s 2024-04-16T16:19:46.885 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:46.885 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:46.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:46.934 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247539 s, 42.4 MB/s 2024-04-16T16:19:47.015 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:47.015 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:47.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:47.073 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0433835 s, 24.2 MB/s 2024-04-16T16:19:47.176 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:47.176 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:47.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:47.233 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:47.317 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:47.317 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:47.317 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280878 s, 37.3 MB/s 2024-04-16T16:19:47.319 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:47.319 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:47.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:47.375 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326614 s, 32.1 MB/s 2024-04-16T16:19:47.459 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:47.459 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:47.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:47.513 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:47.586 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:47.586 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:47.586 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218521 s, 48.0 MB/s 2024-04-16T16:19:47.588 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:47.588 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:47.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:47.644 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233471 s, 44.9 MB/s 2024-04-16T16:19:47.728 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:47.728 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:47.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:47.787 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:47.864 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:47.864 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:47.864 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023598 s, 44.4 MB/s 2024-04-16T16:19:47.866 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:47.866 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:47.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:47.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.022 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.022 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.023 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0419132 s, 25.0 MB/s 2024-04-16T16:19:48.024 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.024 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:48.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:48.081 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02476 s, 42.3 MB/s 2024-04-16T16:19:48.163 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.163 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:48.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:48.219 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.300 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.300 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.300 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024136 s, 43.4 MB/s 2024-04-16T16:19:48.301 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.302 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:48.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:48.358 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.435 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.435 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.435 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226906 s, 46.2 MB/s 2024-04-16T16:19:48.437 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.437 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:48.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:48.492 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.565 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.565 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.566 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221912 s, 47.3 MB/s 2024-04-16T16:19:48.567 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.568 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:48.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:48.627 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.709 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.709 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.709 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254554 s, 41.2 MB/s 2024-04-16T16:19:48.711 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.711 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:48.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:48.769 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.844 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.844 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231349 s, 45.3 MB/s 2024-04-16T16:19:48.846 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.846 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:48.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:48.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:48.971 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:48.971 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:48.972 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193141 s, 54.3 MB/s 2024-04-16T16:19:48.973 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:48.973 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.028 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:49.107 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:49.107 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:49.107 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235206 s, 44.6 MB/s 2024-04-16T16:19:49.109 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:49.109 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.167 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:49.253 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:49.253 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:49.253 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305731 s, 34.3 MB/s 2024-04-16T16:19:49.254 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:49.254 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.314 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:49.395 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:49.395 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:49.395 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259728 s, 40.4 MB/s 2024-04-16T16:19:49.396 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:49.396 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.451 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:49.520 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:49.520 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:49.520 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021447 s, 48.9 MB/s 2024-04-16T16:19:49.521 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:49.521 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.579 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:49.662 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:49.662 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:49.662 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286768 s, 36.6 MB/s 2024-04-16T16:19:49.664 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:49.664 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.720 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:49.805 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:49.805 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:49.805 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268023 s, 39.1 MB/s 2024-04-16T16:19:49.807 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:49.807 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.862 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215462 s, 48.7 MB/s 2024-04-16T16:19:49.937 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:49.937 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:49.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:49.987 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:50.068 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:50.068 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:50.069 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246764 s, 42.5 MB/s 2024-04-16T16:19:50.070 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:50.071 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:50.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:50.130 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280741 s, 37.4 MB/s 2024-04-16T16:19:50.215 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:50.215 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:50.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:50.274 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:50.358 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:50.358 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:50.358 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024696 s, 42.5 MB/s 2024-04-16T16:19:50.359 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:50.360 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:50.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:50.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:50.509 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:50.509 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:50.509 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347941 s, 30.1 MB/s 2024-04-16T16:19:50.511 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:50.511 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:50.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:50.571 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229025 s, 45.8 MB/s 2024-04-16T16:19:50.650 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:50.650 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:50.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:50.705 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215834 s, 48.6 MB/s 2024-04-16T16:19:50.781 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:50.781 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:50.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:50.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:50.909 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:50.909 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:50.909 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202254 s, 51.8 MB/s 2024-04-16T16:19:50.911 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:50.911 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:50.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:50.965 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:51.057 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:51.057 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:51.057 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406369 s, 25.8 MB/s 2024-04-16T16:19:51.059 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:51.059 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:51.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:51.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:51.183 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:51.183 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:51.183 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026088 s, 40.2 MB/s 2024-04-16T16:19:51.185 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:51.185 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:51.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:51.243 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:51.320 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:51.320 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:51.320 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215124 s, 48.7 MB/s 2024-04-16T16:19:51.322 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:51.322 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:51.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:51.377 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:51.460 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:51.460 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:51.460 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234681 s, 44.7 MB/s 2024-04-16T16:19:51.462 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:51.462 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:51.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:51.521 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:51.604 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:51.604 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:51.604 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300502 s, 34.9 MB/s 2024-04-16T16:19:51.605 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:51.606 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:51.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:51.662 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:51.752 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:51.753 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:51.753 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034804 s, 30.1 MB/s 2024-04-16T16:19:51.755 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:51.755 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:51.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:51.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:51.890 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:51.890 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:51.890 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276316 s, 37.9 MB/s 2024-04-16T16:19:51.892 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:51.892 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:51.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:51.945 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:52.021 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:52.021 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:52.021 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243299 s, 43.1 MB/s 2024-04-16T16:19:52.023 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:52.023 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:52.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:52.080 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196437 s, 53.4 MB/s 2024-04-16T16:19:52.153 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:52.154 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:52.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:52.211 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:52.294 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:52.294 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:52.294 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263184 s, 39.8 MB/s 2024-04-16T16:19:52.296 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:52.296 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:52.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:52.355 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304655 s, 34.4 MB/s 2024-04-16T16:19:52.445 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:52.445 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:52.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:52.503 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:52.589 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:52.589 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:52.590 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265892 s, 39.4 MB/s 2024-04-16T16:19:52.591 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:52.591 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:52.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:52.646 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:52.725 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:52.725 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:52.725 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262479 s, 39.9 MB/s 2024-04-16T16:19:52.727 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:52.727 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:52.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:52.785 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:52.871 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:52.871 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:52.871 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288381 s, 36.4 MB/s 2024-04-16T16:19:52.873 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:52.873 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:52.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:52.932 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:53.019 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:53.019 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:53.019 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288641 s, 36.3 MB/s 2024-04-16T16:19:53.021 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:53.021 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:53.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:53.081 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:53.176 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:53.176 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:53.176 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340993 s, 30.8 MB/s 2024-04-16T16:19:53.177 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:53.177 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:53.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:53.236 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:53.322 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:53.323 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:53.323 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250498 s, 41.9 MB/s 2024-04-16T16:19:53.324 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:53.324 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:53.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:53.384 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:53.462 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:53.462 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:53.462 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237803 s, 44.1 MB/s 2024-04-16T16:19:53.463 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:53.463 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:53.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:53.522 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266898 s, 39.3 MB/s 2024-04-16T16:19:53.613 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:53.613 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:53.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:53.668 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:53.750 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:53.750 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:53.750 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268029 s, 39.1 MB/s 2024-04-16T16:19:53.752 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:53.752 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:53.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:53.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:53.891 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:53.891 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:53.891 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252081 s, 41.6 MB/s 2024-04-16T16:19:53.893 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:53.893 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:53.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:53.946 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.029 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.029 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.029 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264003 s, 39.7 MB/s 2024-04-16T16:19:54.030 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.031 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:54.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:54.090 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.171 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.171 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.171 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026664 s, 39.3 MB/s 2024-04-16T16:19:54.173 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.173 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:54.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:54.228 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.301 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.301 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.301 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217223 s, 48.3 MB/s 2024-04-16T16:19:54.302 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.302 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:54.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:54.359 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.441 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.441 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.442 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253027 s, 41.4 MB/s 2024-04-16T16:19:54.443 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.443 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:54.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:54.500 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261078 s, 40.2 MB/s 2024-04-16T16:19:54.583 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.583 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:54.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:54.638 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.708 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.708 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.708 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183777 s, 57.1 MB/s 2024-04-16T16:19:54.709 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.709 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:54.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:54.766 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036629 s, 28.6 MB/s 2024-04-16T16:19:54.859 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.859 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:54.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:54.911 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:54.996 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:54.996 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:54.996 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312886 s, 33.5 MB/s 2024-04-16T16:19:54.998 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:54.998 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:55.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:55.055 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313483 s, 33.4 MB/s 2024-04-16T16:19:55.141 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:55.142 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:55.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:55.199 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275603 s, 38.0 MB/s 2024-04-16T16:19:55.286 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:55.286 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:55.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:55.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:55.433 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:55.433 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348449 s, 30.1 MB/s 2024-04-16T16:19:55.436 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:55.436 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:55.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:55.495 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027556 s, 38.1 MB/s 2024-04-16T16:19:55.581 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:55.581 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:55.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:55.641 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:55.724 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:55.724 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:55.724 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243423 s, 43.1 MB/s 2024-04-16T16:19:55.727 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:55.727 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:55.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:55.788 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:55.874 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:55.874 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:55.874 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251566 s, 41.7 MB/s 2024-04-16T16:19:55.876 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:55.876 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:55.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:55.935 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.019 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.019 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.019 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277948 s, 37.7 MB/s 2024-04-16T16:19:56.021 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.021 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:56.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:56.078 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227908 s, 46.0 MB/s 2024-04-16T16:19:56.157 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.157 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:56.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:56.215 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.302 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.302 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.302 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02835 s, 37.0 MB/s 2024-04-16T16:19:56.304 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.304 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:56.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:56.364 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.443 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.443 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.443 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213506 s, 49.1 MB/s 2024-04-16T16:19:56.444 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.445 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:56.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:56.501 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286992 s, 36.5 MB/s 2024-04-16T16:19:56.587 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.588 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:56.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:56.644 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.718 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.718 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.718 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217232 s, 48.3 MB/s 2024-04-16T16:19:56.720 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.720 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:56.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:56.775 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.855 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.855 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.855 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264854 s, 39.6 MB/s 2024-04-16T16:19:56.857 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.857 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:56.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:56.915 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:56.993 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:56.993 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:56.994 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274232 s, 38.2 MB/s 2024-04-16T16:19:56.995 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:56.995 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:57.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:57.051 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:57.131 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:57.131 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:57.131 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239003 s, 43.9 MB/s 2024-04-16T16:19:57.133 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:57.133 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:57.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:57.192 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:57.275 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:57.275 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:57.275 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263137 s, 39.8 MB/s 2024-04-16T16:19:57.277 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:57.277 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:57.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:57.336 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:57.422 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:57.422 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:57.422 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277699 s, 37.8 MB/s 2024-04-16T16:19:57.424 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:57.424 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:57.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:57.485 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:57.573 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:57.573 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:57.573 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324722 s, 32.3 MB/s 2024-04-16T16:19:57.575 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:57.575 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:57.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:57.630 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:57.704 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:57.704 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:57.704 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228833 s, 45.8 MB/s 2024-04-16T16:19:57.706 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:57.707 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:57.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:57.764 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:57.850 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:57.850 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:57.850 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307557 s, 34.1 MB/s 2024-04-16T16:19:57.851 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:57.852 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:57.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:57.910 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:57.995 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:57.995 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:57.995 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296112 s, 35.4 MB/s 2024-04-16T16:19:57.996 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:57.997 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.055 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241082 s, 43.5 MB/s 2024-04-16T16:19:58.137 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:58.137 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.194 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:58.271 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:58.271 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:58.271 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021719 s, 48.3 MB/s 2024-04-16T16:19:58.272 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:58.272 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.327 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218091 s, 48.1 MB/s 2024-04-16T16:19:58.406 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:58.406 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.463 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:58.538 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:58.539 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:58.539 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213352 s, 49.1 MB/s 2024-04-16T16:19:58.540 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:58.540 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.597 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219923 s, 47.7 MB/s 2024-04-16T16:19:58.679 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:58.679 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.736 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:58.804 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:58.804 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:58.804 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171897 s, 61.0 MB/s 2024-04-16T16:19:58.806 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:58.806 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.860 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:58.939 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:58.939 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:58.939 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206976 s, 50.7 MB/s 2024-04-16T16:19:58.941 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:58.941 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:58.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:58.997 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:59.082 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:59.082 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:59.082 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289405 s, 36.2 MB/s 2024-04-16T16:19:59.084 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:59.084 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:59.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:59.138 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237163 s, 44.2 MB/s 2024-04-16T16:19:59.221 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:59.221 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:59.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:59.281 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:59.360 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:59.360 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:59.360 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234147 s, 44.8 MB/s 2024-04-16T16:19:59.361 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:59.361 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:59.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:59.422 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:59.502 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:59.502 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:59.503 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247387 s, 42.4 MB/s 2024-04-16T16:19:59.504 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:59.504 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:59.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:59.560 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:59.637 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:59.637 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:59.637 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248629 s, 42.2 MB/s 2024-04-16T16:19:59.639 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:59.639 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:59.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:59.693 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:59.764 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212296 s, 49.4 MB/s 2024-04-16T16:19:59.765 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:59.765 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:59.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:59.826 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:19:59.905 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:19:59.906 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:19:59.906 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239807 s, 43.7 MB/s 2024-04-16T16:19:59.908 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:19:59.908 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:19:59.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:19:59.963 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265491 s, 39.5 MB/s 2024-04-16T16:20:00.047 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:00.047 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:00.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:00.105 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247293 s, 42.4 MB/s 2024-04-16T16:20:00.190 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:00.190 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:00.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:00.248 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:00.331 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:00.331 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:00.331 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247495 s, 42.4 MB/s 2024-04-16T16:20:00.332 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:00.332 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:00.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:00.391 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:00.470 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:00.470 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:00.470 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225854 s, 46.4 MB/s 2024-04-16T16:20:00.472 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:00.472 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:00.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:00.528 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273873 s, 38.3 MB/s 2024-04-16T16:20:00.609 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:00.609 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:00.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:00.668 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:00.746 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:00.746 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:00.747 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252286 s, 41.6 MB/s 2024-04-16T16:20:00.748 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:00.749 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:00.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:00.806 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:00.888 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258239 s, 40.6 MB/s 2024-04-16T16:20:00.890 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:00.891 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:00.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:00.949 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:01.036 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:01.036 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:01.036 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297675 s, 35.2 MB/s 2024-04-16T16:20:01.038 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:01.038 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:01.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:01.093 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235604 s, 44.5 MB/s 2024-04-16T16:20:01.172 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:01.172 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:01.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:01.230 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:01.309 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:01.309 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:01.310 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239522 s, 43.8 MB/s 2024-04-16T16:20:01.311 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:01.311 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:01.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:01.368 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:01.449 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:01.449 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:01.449 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276674 s, 37.9 MB/s 2024-04-16T16:20:01.451 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:01.451 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:01.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:01.510 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:01.594 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:01.594 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:01.594 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260066 s, 40.3 MB/s 2024-04-16T16:20:01.596 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:01.596 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:01.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:01.651 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:01.729 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:01.729 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:01.729 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022736 s, 46.1 MB/s 2024-04-16T16:20:01.731 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:01.731 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:01.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:01.791 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:01.865 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021366 s, 49.1 MB/s 2024-04-16T16:20:01.867 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:01.867 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:01.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:01.923 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.007 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.007 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.007 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284777 s, 36.8 MB/s 2024-04-16T16:20:02.008 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.008 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:02.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:02.067 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.156 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.156 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.157 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340907 s, 30.8 MB/s 2024-04-16T16:20:02.158 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.159 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:02.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:02.212 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291283 s, 36.0 MB/s 2024-04-16T16:20:02.294 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.294 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:02.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:02.354 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.440 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.440 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.440 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026814 s, 39.1 MB/s 2024-04-16T16:20:02.442 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.442 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:02.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:02.501 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247717 s, 42.3 MB/s 2024-04-16T16:20:02.585 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.585 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:02.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:02.643 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.724 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.724 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.724 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264396 s, 39.7 MB/s 2024-04-16T16:20:02.726 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.727 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:02.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:02.787 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.862 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.862 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.862 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204128 s, 51.4 MB/s 2024-04-16T16:20:02.864 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.864 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:02.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:02.919 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:02.995 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:02.995 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:02.995 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236269 s, 44.4 MB/s 2024-04-16T16:20:02.997 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:02.997 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:03.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:03.055 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:03.134 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:03.134 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:03.134 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248782 s, 42.1 MB/s 2024-04-16T16:20:03.136 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:03.136 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:03.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:03.193 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:03.261 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:03.261 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:03.261 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160849 s, 65.2 MB/s 2024-04-16T16:20:03.262 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:03.262 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:03.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:03.319 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238844 s, 43.9 MB/s 2024-04-16T16:20:03.398 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:03.398 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:03.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:03.452 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:03.527 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:03.528 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:03.528 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250657 s, 41.8 MB/s 2024-04-16T16:20:03.529 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:03.529 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:03.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:03.590 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:03.669 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:03.669 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:03.669 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241425 s, 43.4 MB/s 2024-04-16T16:20:03.671 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:03.671 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:03.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:03.729 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:03.812 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:03.812 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:03.813 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256884 s, 40.8 MB/s 2024-04-16T16:20:03.814 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:03.814 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:03.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:03.872 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:03.955 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:03.955 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:03.955 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258352 s, 40.6 MB/s 2024-04-16T16:20:03.957 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:03.957 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.015 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:04.096 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:04.097 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:04.097 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227266 s, 46.1 MB/s 2024-04-16T16:20:04.098 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:04.098 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.154 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:04.232 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:04.232 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:04.232 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254958 s, 41.1 MB/s 2024-04-16T16:20:04.233 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:04.234 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:04.369 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:04.369 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:04.369 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260544 s, 40.2 MB/s 2024-04-16T16:20:04.371 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:04.371 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.433 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229271 s, 45.7 MB/s 2024-04-16T16:20:04.507 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:04.507 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.560 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228493 s, 45.9 MB/s 2024-04-16T16:20:04.635 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:04.635 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.693 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:04.771 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:04.771 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:04.771 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220904 s, 47.5 MB/s 2024-04-16T16:20:04.773 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:04.773 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.829 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194681 s, 53.9 MB/s 2024-04-16T16:20:04.904 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:04.904 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:04.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:04.954 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:05.021 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:05.022 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:05.022 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217356 s, 48.2 MB/s 2024-04-16T16:20:05.024 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:05.024 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:05.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:05.081 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:05.164 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:05.164 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:05.165 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266357 s, 39.4 MB/s 2024-04-16T16:20:05.167 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:05.167 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:05.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:05.225 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:05.304 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:05.304 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:05.304 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237025 s, 44.2 MB/s 2024-04-16T16:20:05.306 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:05.306 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:05.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:05.364 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:05.452 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:05.452 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:05.452 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302721 s, 34.6 MB/s 2024-04-16T16:20:05.454 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:05.454 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:05.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:05.513 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:05.588 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:05.588 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:05.588 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193766 s, 54.1 MB/s 2024-04-16T16:20:05.590 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:05.590 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:05.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:05.644 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264633 s, 39.6 MB/s 2024-04-16T16:20:05.725 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:05.726 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:05.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:05.785 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249055 s, 42.1 MB/s 2024-04-16T16:20:05.870 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:05.870 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:05.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:05.926 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.007 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.007 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.007 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254139 s, 41.3 MB/s 2024-04-16T16:20:06.009 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.009 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:06.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:06.066 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.148 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.148 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.148 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252206 s, 41.6 MB/s 2024-04-16T16:20:06.149 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.150 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:06.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:06.206 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.286 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.286 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.286 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025199 s, 41.6 MB/s 2024-04-16T16:20:06.287 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.287 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:06.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:06.340 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252644 s, 41.5 MB/s 2024-04-16T16:20:06.424 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.425 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:06.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:06.484 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.557 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.557 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.558 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201694 s, 52.0 MB/s 2024-04-16T16:20:06.559 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.559 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:06.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:06.616 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.700 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.700 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.700 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254855 s, 41.1 MB/s 2024-04-16T16:20:06.701 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.701 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:06.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:06.760 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.845 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.845 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.845 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252871 s, 41.5 MB/s 2024-04-16T16:20:06.846 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.846 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:06.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:06.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:06.981 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:06.981 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:06.981 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241612 s, 43.4 MB/s 2024-04-16T16:20:06.983 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:06.983 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:07.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:07.041 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232897 s, 45.0 MB/s 2024-04-16T16:20:07.123 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:07.123 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:07.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:20:07.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:20:07.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:07.180 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:07.292 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:07.292 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:07.292 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202338 s, 51.8 MB/s 2024-04-16T16:20:07.293 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:07.293 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:07.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:07.341 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:07.442 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:07.442 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175478 s, 59.8 MB/s 2024-04-16T16:20:07.444 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:07.444 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:07.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:07.483 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:07.584 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:07.584 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:07.584 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219007 s, 47.9 MB/s 2024-04-16T16:20:07.585 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:07.585 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:07.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:07.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:07.743 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:07.743 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:07.743 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226432 s, 46.3 MB/s 2024-04-16T16:20:07.745 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:07.745 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:07.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:07.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:07.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:07.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:07.878 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220259 s, 47.6 MB/s 2024-04-16T16:20:07.880 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:07.880 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:07.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:07.939 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026586 s, 39.4 MB/s 2024-04-16T16:20:08.025 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.025 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:08.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:08.080 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.155 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.155 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.156 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233435 s, 44.9 MB/s 2024-04-16T16:20:08.157 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.157 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:08.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:08.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.296 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.296 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.296 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250752 s, 41.8 MB/s 2024-04-16T16:20:08.298 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.298 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:08.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:08.355 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.435 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.435 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.435 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242196 s, 43.3 MB/s 2024-04-16T16:20:08.437 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.437 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:08.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:08.495 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311362 s, 33.7 MB/s 2024-04-16T16:20:08.585 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.585 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:08.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:08.644 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245795 s, 42.7 MB/s 2024-04-16T16:20:08.727 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.728 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:08.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:08.786 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.863 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.863 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.863 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225351 s, 46.5 MB/s 2024-04-16T16:20:08.865 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.865 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:08.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:08.919 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:08.996 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:08.996 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:08.996 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210567 s, 49.8 MB/s 2024-04-16T16:20:08.998 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:08.998 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.049 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:09.132 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:09.132 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:09.133 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028836 s, 36.4 MB/s 2024-04-16T16:20:09.134 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:09.134 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.193 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:09.265 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:09.265 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:09.265 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182989 s, 57.3 MB/s 2024-04-16T16:20:09.267 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:09.267 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.322 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:09.396 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:09.396 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:09.396 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025233 s, 41.6 MB/s 2024-04-16T16:20:09.398 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:09.398 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.453 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:09.520 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:09.520 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:09.520 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221759 s, 47.3 MB/s 2024-04-16T16:20:09.522 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:09.522 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.573 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:09.643 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:09.643 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:09.643 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223426 s, 46.9 MB/s 2024-04-16T16:20:09.645 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:09.645 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.703 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:09.785 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:09.785 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:09.785 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237035 s, 44.2 MB/s 2024-04-16T16:20:09.787 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:09.787 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.843 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:09.924 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:09.924 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:09.924 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236865 s, 44.3 MB/s 2024-04-16T16:20:09.926 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:09.926 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:09.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:09.983 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:10.063 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:10.063 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:10.063 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212128 s, 49.4 MB/s 2024-04-16T16:20:10.064 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:10.064 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:10.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:10.121 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:10.198 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:10.198 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:10.198 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222714 s, 47.1 MB/s 2024-04-16T16:20:10.200 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:10.200 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:10.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:10.251 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:10.333 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:10.333 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:10.333 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250353 s, 41.9 MB/s 2024-04-16T16:20:10.334 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:10.334 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:10.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:10.391 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:10.463 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:10.463 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:10.463 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227211 s, 46.1 MB/s 2024-04-16T16:20:10.465 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:10.465 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:10.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:10.519 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:10.600 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:10.600 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:10.600 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242313 s, 43.3 MB/s 2024-04-16T16:20:10.601 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:10.602 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:10.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:10.655 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:10.738 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:10.738 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:10.738 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024098 s, 43.5 MB/s 2024-04-16T16:20:10.739 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:10.739 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:10.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:10.802 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:10.876 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:10.876 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:10.876 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208577 s, 50.3 MB/s 2024-04-16T16:20:10.878 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:10.879 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:10.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:10.935 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182273 s, 57.5 MB/s 2024-04-16T16:20:11.007 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.007 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:11.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:11.057 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230093 s, 45.6 MB/s 2024-04-16T16:20:11.135 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.135 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:11.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:11.191 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.271 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.271 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.271 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244111 s, 43.0 MB/s 2024-04-16T16:20:11.273 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.273 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:11.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:11.332 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.412 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.412 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.412 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240643 s, 43.6 MB/s 2024-04-16T16:20:11.414 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.414 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:11.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:11.471 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.540 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.540 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169674 s, 61.8 MB/s 2024-04-16T16:20:11.541 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.541 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:11.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:11.599 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.682 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.682 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.682 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026752 s, 39.2 MB/s 2024-04-16T16:20:11.684 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.684 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:11.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:11.741 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.823 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.823 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273399 s, 38.4 MB/s 2024-04-16T16:20:11.824 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.824 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:11.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:11.880 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:11.959 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:11.959 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:11.959 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206218 s, 50.8 MB/s 2024-04-16T16:20:11.961 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:11.961 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:12.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:12.018 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol64180/2744d9b5-f88a-480e-8fb9-ad4114d7c5ea/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2024-04-16T16:20:12.091 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-16T16:20:12.091 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-16T16:20:12.091 INFO:teuthology.orchestra.run.smithi022.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212148 s, 49.4 MB/s 2024-04-16T16:20:12.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol64180 subvol_snap76020 2024-04-16T16:20:12.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.322+0000 7efd48a00640 1 Processor -- start 2024-04-16T16:20:12.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.323+0000 7efd48a00640 1 -- start start 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.324+0000 7efd48a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd440cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.324+0000 7efd48a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd440cc830 0x7efd440cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.324+0000 7efd48a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd4415cc20 con 0x7efd4415c840 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.324+0000 7efd48a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7efd440ce390 con 0x7efd440cc830 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.324+0000 7efd48a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efd4406dda0 con 0x7efd440d0a10 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd43e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd440cc830 0x7efd440cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd43e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd440cc830 0x7efd440cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49432/0 (socket says 172.21.15.22:49432) 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd43e00640 1 -- 172.21.15.22:0/1748422544 learned_addr learned my addr 172.21.15.22:0/1748422544 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd42a00640 1 --2- 172.21.15.22:0/1748422544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd440cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd43e00640 1 -- 172.21.15.22:0/1748422544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 msgr2=0x7efd440cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd43e00640 1 --2- 172.21.15.22:0/1748422544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd440cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd43e00640 1 -- 172.21.15.22:0/1748422544 >> v1:172.21.15.43:6789/0 conn(0x7efd4415c840 legacy=0x7efd440d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.325+0000 7efd43e00640 1 -- 172.21.15.22:0/1748422544 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4406d800 con 0x7efd440cc830 2024-04-16T16:20:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.326+0000 7efd43e00640 1 --2- 172.21.15.22:0/1748422544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd440cc830 0x7efd440cf5e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009870 tx=0x7efd3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdc28c57e818dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.327+0000 7efd42000640 1 -- 172.21.15.22:0/1748422544 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c035020 con 0x7efd440cc830 2024-04-16T16:20:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.327+0000 7efd42000640 1 -- 172.21.15.22:0/1748422544 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3c031640 con 0x7efd440cc830 2024-04-16T16:20:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.327+0000 7efd42000640 1 -- 172.21.15.22:0/1748422544 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c02d040 con 0x7efd440cc830 2024-04-16T16:20:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 -- 172.21.15.22:0/1748422544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd440cc830 msgr2=0x7efd440cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 --2- 172.21.15.22:0/1748422544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd440cc830 0x7efd440cf5e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009870 tx=0x7efd3c02b8f0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 -- 172.21.15.22:0/1748422544 shutdown_connections 2024-04-16T16:20:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 --2- 172.21.15.22:0/1748422544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd440cc830 0x7efd440cf5e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 --2- 172.21.15.22:0/1748422544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd440cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 -- 172.21.15.22:0/1748422544 >> 172.21.15.22:0/1748422544 conn(0x7efd44062440 msgr2=0x7efd44062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 -- 172.21.15.22:0/1748422544 shutdown_connections 2024-04-16T16:20:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.328+0000 7efd48a00640 1 -- 172.21.15.22:0/1748422544 wait complete. 2024-04-16T16:20:12.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.330+0000 7efd48a00640 1 Processor -- start 2024-04-16T16:20:12.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.330+0000 7efd48a00640 1 -- start start 2024-04-16T16:20:12.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd48a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd440cc830 0x7efd44149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd48a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd4414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd48a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd4415c840 0x7efd4414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd48a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efd440ce8a0 con 0x7efd4415c840 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd48a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efd440ce5c0 con 0x7efd440cc830 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd48a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efd440ceb80 con 0x7efd440d0a10 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd43e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd4415c840 0x7efd4414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd43e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd4415c840 0x7efd4414fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49448/0 (socket says 172.21.15.22:49448) 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.331+0000 7efd43e00640 1 -- 172.21.15.22:0/340478659 learned_addr learned my addr 172.21.15.22:0/340478659 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43400640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd440cc830 0x7efd44149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd42a00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd4414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43e00640 1 -- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 msgr2=0x7efd4414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43e00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd4414d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43e00640 1 -- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd440cc830 msgr2=0x7efd44149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43e00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd440cc830 0x7efd44149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43e00640 1 -- 172.21.15.22:0/340478659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd440b36f0 con 0x7efd4415c840 2024-04-16T16:20:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43400640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd440cc830 0x7efd44149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd43e00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd4415c840 0x7efd4414fdb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009870 tx=0x7efd3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd3b400640 1 -- 172.21.15.22:0/340478659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c040070 con 0x7efd4415c840 2024-04-16T16:20:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd3b400640 1 -- 172.21.15.22:0/340478659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3c039c10 con 0x7efd4415c840 2024-04-16T16:20:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd3b400640 1 -- 172.21.15.22:0/340478659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c035040 con 0x7efd4415c840 2024-04-16T16:20:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.332+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd440b39d0 con 0x7efd4415c840 2024-04-16T16:20:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.333+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd44149590 con 0x7efd4415c840 2024-04-16T16:20:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.334+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd44075f30 con 0x7efd4415c840 2024-04-16T16:20:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.335+0000 7efd3b400640 1 -- 172.21.15.22:0/340478659 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 91346+0+0 (secure 0 0 0) 0x7efd3c04b060 con 0x7efd4415c840 2024-04-16T16:20:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.336+0000 7efd3b400640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efd2006cc50 0x7efd2006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.336+0000 7efd3b400640 1 -- 172.21.15.22:0/340478659 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7efd3c0adbd0 con 0x7efd4415c840 2024-04-16T16:20:12.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.336+0000 7efd43400640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efd2006cc50 0x7efd2006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.337+0000 7efd43400640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efd2006cc50 0x7efd2006f110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd34007eb0 tx=0x7efd340073c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:12.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.341+0000 7efd3b400640 1 -- 172.21.15.22:0/340478659 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd4415cc20 con 0x7efd4415c840 2024-04-16T16:20:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.585+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol64180", "snap_name": "subvol_snap76020", "target": ["mon-mgr", ""]}) -- 0x7efd440b34a0 con 0x7efd2006cc50 2024-04-16T16:20:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.632+0000 7efd3b400640 1 -- 172.21.15.22:0/340478659 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efd440b34a0 con 0x7efd2006cc50 2024-04-16T16:20:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efd2006cc50 msgr2=0x7efd2006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efd2006cc50 0x7efd2006f110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd34007eb0 tx=0x7efd340073c0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd4415c840 msgr2=0x7efd4414fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd4415c840 0x7efd4414fdb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009870 tx=0x7efd3c0046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 shutdown_connections 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efd2006cc50 0x7efd2006f110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd4415c840 0x7efd4414fdb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd440d0a10 0x7efd4414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 --2- 172.21.15.22:0/340478659 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd440cc830 0x7efd44149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 >> 172.21.15.22:0/340478659 conn(0x7efd44062440 msgr2=0x7efd440cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 shutdown_connections 2024-04-16T16:20:12.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.636+0000 7efd48a00640 1 -- 172.21.15.22:0/340478659 wait complete. 2024-04-16T16:20:12.664 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2024-04-16T16:20:12.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.875+0000 7f6095000640 1 Processor -- start 2024-04-16T16:20:12.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.875+0000 7f6095000640 1 -- start start 2024-04-16T16:20:12.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6095000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f609015db60 0x7f60900b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6095000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f60900b2960 0x7f6090071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6095000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6090073420 con 0x7f609015c8d0 2024-04-16T16:20:12.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6095000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f60900b2d90 con 0x7f609015db60 2024-04-16T16:20:12.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6095000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6090072eb0 con 0x7f60900b2960 2024-04-16T16:20:12.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6087e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f609015db60 0x7f60900b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6087e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f609015db60 0x7f60900b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49462/0 (socket says 172.21.15.22:49462) 2024-04-16T16:20:12.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6087e00640 1 -- 172.21.15.22:0/1316521723 learned_addr learned my addr 172.21.15.22:0/1316521723 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:12.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f608e800640 1 --2- 172.21.15.22:0/1316521723 >> v2:172.21.15.43:3300/0 conn(0x7f60900b2960 0x7f6090071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6087e00640 1 -- 172.21.15.22:0/1316521723 >> v2:172.21.15.43:3300/0 conn(0x7f60900b2960 msgr2=0x7f6090071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:12.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6087e00640 1 --2- 172.21.15.22:0/1316521723 >> v2:172.21.15.43:3300/0 conn(0x7f60900b2960 0x7f6090071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.877+0000 7f6087e00640 1 -- 172.21.15.22:0/1316521723 >> v1:172.21.15.43:6789/0 conn(0x7f609015c8d0 legacy=0x7f60900727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:12.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.878+0000 7f6087e00640 1 -- 172.21.15.22:0/1316521723 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6090073140 con 0x7f609015db60 2024-04-16T16:20:12.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.879+0000 7f6087e00640 1 --2- 172.21.15.22:0/1316521723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015db60 0x7f60900b2420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6090074210 tx=0x7f607802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502719932d66804 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:12.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.879+0000 7f608d400640 1 -- 172.21.15.22:0/1316521723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078035020 con 0x7f609015db60 2024-04-16T16:20:12.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.879+0000 7f608d400640 1 -- 172.21.15.22:0/1316521723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6078031870 con 0x7f609015db60 2024-04-16T16:20:12.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.879+0000 7f608d400640 1 -- 172.21.15.22:0/1316521723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078031c40 con 0x7f609015db60 2024-04-16T16:20:12.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 -- 172.21.15.22:0/1316521723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015db60 msgr2=0x7f60900b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 --2- 172.21.15.22:0/1316521723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015db60 0x7f60900b2420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6090074210 tx=0x7f607802b910 comp rx=0 tx=0).stop 2024-04-16T16:20:12.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 -- 172.21.15.22:0/1316521723 shutdown_connections 2024-04-16T16:20:12.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 --2- 172.21.15.22:0/1316521723 >> v2:172.21.15.43:3300/0 conn(0x7f60900b2960 0x7f6090071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 --2- 172.21.15.22:0/1316521723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015db60 0x7f60900b2420 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 -- 172.21.15.22:0/1316521723 >> 172.21.15.22:0/1316521723 conn(0x7f6090062440 msgr2=0x7f6090062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:12.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 -- 172.21.15.22:0/1316521723 shutdown_connections 2024-04-16T16:20:12.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.880+0000 7f6095000640 1 -- 172.21.15.22:0/1316521723 wait complete. 2024-04-16T16:20:12.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.882+0000 7f6095000640 1 Processor -- start 2024-04-16T16:20:12.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.882+0000 7f6095000640 1 -- start start 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6095000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60900b2960 0x7f60900b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6095000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015c8d0 0x7f6090155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6095000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609015db60 0x7f6090156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6095000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f609015d640 con 0x7f609015c8d0 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6095000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f609015d360 con 0x7f60900b2960 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6095000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f609015ccb0 con 0x7f609015db60 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6087e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015c8d0 0x7f6090155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6087e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015c8d0 0x7f6090155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49470/0 (socket says 172.21.15.22:49470) 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.883+0000 7f6087e00640 1 -- 172.21.15.22:0/751824264 learned_addr learned my addr 172.21.15.22:0/751824264 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f608de00640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60900b2960 0x7f60900b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f608e800640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609015db60 0x7f6090156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6087e00640 1 -- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609015db60 msgr2=0x7f6090156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6087e00640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609015db60 0x7f6090156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6087e00640 1 -- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60900b2960 msgr2=0x7f60900b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6087e00640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60900b2960 0x7f60900b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6087e00640 1 -- 172.21.15.22:0/751824264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60901566d0 con 0x7f609015c8d0 2024-04-16T16:20:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f608de00640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60900b2960 0x7f60900b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6087e00640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015c8d0 0x7f6090155c50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f60780090b0 tx=0x7f60780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6086000640 1 -- 172.21.15.22:0/751824264 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078040070 con 0x7f609015c8d0 2024-04-16T16:20:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6086000640 1 -- 172.21.15.22:0/751824264 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6078030d00 con 0x7f609015c8d0 2024-04-16T16:20:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.884+0000 7f6086000640 1 -- 172.21.15.22:0/751824264 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078035040 con 0x7f609015c8d0 2024-04-16T16:20:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.885+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60901569c0 con 0x7f609015c8d0 2024-04-16T16:20:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.885+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6090157200 con 0x7f609015c8d0 2024-04-16T16:20:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.886+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6090157540 con 0x7f609015c8d0 2024-04-16T16:20:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.887+0000 7f6086000640 1 -- 172.21.15.22:0/751824264 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 91346+0+0 (secure 0 0 0) 0x7f607804b060 con 0x7f609015c8d0 2024-04-16T16:20:12.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.888+0000 7f6086000640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f606c06cc50 0x7f606c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:12.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.888+0000 7f6086000640 1 -- 172.21.15.22:0/751824264 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f60780ade30 con 0x7f609015c8d0 2024-04-16T16:20:12.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.888+0000 7f608de00640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f606c06cc50 0x7f606c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:12.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.889+0000 7f608de00640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f606c06cc50 0x7f606c06f110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6080003eb0 tx=0x7f6080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:12.893+0000 7f6086000640 1 -- 172.21.15.22:0/751824264 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6090157540 con 0x7f609015c8d0 2024-04-16T16:20:13.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.100+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) -- 0x7f609004fd90 con 0x7f609015c8d0 2024-04-16T16:20:13.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.107+0000 7f6086000640 1 -- 172.21.15.22:0/751824264 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v15)=0 v15) ==== 130+0+0 (secure 0 0 0) 0x7f60901569c0 con 0x7f609015c8d0 2024-04-16T16:20:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f606c06cc50 msgr2=0x7f606c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f606c06cc50 0x7f606c06f110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6080003eb0 tx=0x7f6080009040 comp rx=0 tx=0).stop 2024-04-16T16:20:13.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015c8d0 msgr2=0x7f6090155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015c8d0 0x7f6090155c50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f60780090b0 tx=0x7f60780046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 shutdown_connections 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f606c06cc50 0x7f606c06f110 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f609015db60 0x7f6090156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f609015c8d0 0x7f6090155c50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 --2- 172.21.15.22:0/751824264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60900b2960 0x7f60900b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 >> 172.21.15.22:0/751824264 conn(0x7f6090062440 msgr2=0x7f609015aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 shutdown_connections 2024-04-16T16:20:13.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.110+0000 7f6095000640 1 -- 172.21.15.22:0/751824264 wait complete. 2024-04-16T16:20:13.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol64180 subvol_snap76020 subvol_clone11320 2024-04-16T16:20:13.130 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.130+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.130 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.130+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.130 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.130+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.130 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.130+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.130 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.130+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.332+0000 7f39d3000640 1 Processor -- start 2024-04-16T16:20:13.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.332+0000 7f39d3000640 1 -- start start 2024-04-16T16:20:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.334+0000 7f39d3000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39cc15ed00 0x7f39cc0ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.334+0000 7f39d3000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc0d32e0 con 0x7f39cc0d1240 2024-04-16T16:20:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.334+0000 7f39d3000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc0d35c0 con 0x7f39cc0d4380 2024-04-16T16:20:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.334+0000 7f39d3000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f39cc0d38a0 con 0x7f39cc15ed00 2024-04-16T16:20:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.334+0000 7f39d1200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39cc15ed00 0x7f39cc0ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.334+0000 7f39d1c00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f39cc0d1240 0x7f39cc0d1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53306/0 (socket says 172.21.15.22:53306) 2024-04-16T16:20:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.334+0000 7f39d1c00640 1 -- 172.21.15.22:0/2542521532 learned_addr learned my addr 172.21.15.22:0/2542521532 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.335+0000 7f39d1200640 1 -- 172.21.15.22:0/2542521532 >> v1:172.21.15.43:6789/0 conn(0x7f39cc0d4380 legacy=0x7f39cc0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.335+0000 7f39d1200640 1 -- 172.21.15.22:0/2542521532 >> v1:172.21.15.22:6789/0 conn(0x7f39cc0d1240 legacy=0x7f39cc0d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.335+0000 7f39d1200640 1 -- 172.21.15.22:0/2542521532 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc0d3b80 con 0x7f39cc15ed00 2024-04-16T16:20:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.336+0000 7f39d1200640 1 --2- 172.21.15.22:0/2542521532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0ba380 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f39b80097a0 tx=0x7f39b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315be6b3cb9f81f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.336+0000 7f39cbe00640 1 -- 172.21.15.22:0/2542521532 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80315a0 con 0x7f39cc15ed00 2024-04-16T16:20:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.336+0000 7f39cbe00640 1 -- 172.21.15.22:0/2542521532 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8037070 con 0x7f39cc15ed00 2024-04-16T16:20:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.336+0000 7f39cbe00640 1 -- 172.21.15.22:0/2542521532 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8031960 con 0x7f39cc15ed00 2024-04-16T16:20:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.337+0000 7f39d3000640 1 -- 172.21.15.22:0/2542521532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 msgr2=0x7f39cc0ba380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.337+0000 7f39d3000640 1 --2- 172.21.15.22:0/2542521532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0ba380 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f39b80097a0 tx=0x7f39b802b840 comp rx=0 tx=0).stop 2024-04-16T16:20:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.337+0000 7f39d3000640 1 -- 172.21.15.22:0/2542521532 shutdown_connections 2024-04-16T16:20:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.337+0000 7f39d3000640 1 --2- 172.21.15.22:0/2542521532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0ba380 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.337+0000 7f39d3000640 1 -- 172.21.15.22:0/2542521532 >> 172.21.15.22:0/2542521532 conn(0x7f39cc072670 msgr2=0x7f39cc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.337+0000 7f39d3000640 1 -- 172.21.15.22:0/2542521532 shutdown_connections 2024-04-16T16:20:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.337+0000 7f39d3000640 1 -- 172.21.15.22:0/2542521532 wait complete. 2024-04-16T16:20:13.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.339+0000 7f39d3000640 1 Processor -- start 2024-04-16T16:20:13.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.339+0000 7f39d3000640 1 -- start start 2024-04-16T16:20:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d3000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39cc0d1240 0x7f39cc0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d3000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39cc0d4380 0x7f39cc0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d3000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d3000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc0d2f20 con 0x7f39cc15ed00 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d3000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc0d2da0 con 0x7f39cc0d1240 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d3000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc0d30a0 con 0x7f39cc0d4380 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d2600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d2600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49502/0 (socket says 172.21.15.22:49502) 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.340+0000 7f39d2600640 1 -- 172.21.15.22:0/660148550 learned_addr learned my addr 172.21.15.22:0/660148550 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d2600640 1 -- 172.21.15.22:0/660148550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39cc0d4380 msgr2=0x7f39cc0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d2600640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39cc0d4380 0x7f39cc0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d1c00640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39cc0d1240 0x7f39cc0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d2600640 1 -- 172.21.15.22:0/660148550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39cc0d1240 msgr2=0x7f39cc0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d2600640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39cc0d1240 0x7f39cc0b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d2600640 1 -- 172.21.15.22:0/660148550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc0cae30 con 0x7f39cc15ed00 2024-04-16T16:20:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d2600640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0b8c10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c410 tx=0x7f39c400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39c9600640 1 -- 172.21.15.22:0/660148550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4011790 con 0x7f39cc15ed00 2024-04-16T16:20:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39c9600640 1 -- 172.21.15.22:0/660148550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c4017070 con 0x7f39cc15ed00 2024-04-16T16:20:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39c9600640 1 -- 172.21.15.22:0/660148550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4011bb0 con 0x7f39cc15ed00 2024-04-16T16:20:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.341+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc155080 con 0x7f39cc15ed00 2024-04-16T16:20:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.342+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc0b6a60 con 0x7f39cc15ed00 2024-04-16T16:20:13.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.343+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc075f30 con 0x7f39cc15ed00 2024-04-16T16:20:13.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.344+0000 7f39c9600640 1 -- 172.21.15.22:0/660148550 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 91346+0+0 (secure 0 0 0) 0x7f39c401c460 con 0x7f39cc15ed00 2024-04-16T16:20:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.345+0000 7f39c9600640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39ac06cc50 0x7f39ac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.345+0000 7f39c9600640 1 -- 172.21.15.22:0/660148550 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f39c408bd00 con 0x7f39cc15ed00 2024-04-16T16:20:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.345+0000 7f39d1c00640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39ac06cc50 0x7f39ac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.346+0000 7f39d1c00640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39ac06cc50 0x7f39ac06f110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f39c00012e0 tx=0x7f39c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:13.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.350+0000 7f39c9600640 1 -- 172.21.15.22:0/660148550 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39c4021020 con 0x7f39cc15ed00 2024-04-16T16:20:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.591+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol64180", "snap_name": "subvol_snap76020", "target_sub_name": "subvol_clone11320", "target": ["mon-mgr", ""]}) -- 0x7f39cc0b9bd0 con 0x7f39ac06cc50 2024-04-16T16:20:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.739+0000 7f39c9600640 1 -- 172.21.15.22:0/660148550 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39cc0b9bd0 con 0x7f39ac06cc50 2024-04-16T16:20:13.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39ac06cc50 msgr2=0x7f39ac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39ac06cc50 0x7f39ac06f110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f39c00012e0 tx=0x7f39c0009040 comp rx=0 tx=0).stop 2024-04-16T16:20:13.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 msgr2=0x7f39cc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0b8c10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c410 tx=0x7f39c400c8d0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 shutdown_connections 2024-04-16T16:20:13.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f39ac06cc50 0x7f39ac06f110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39cc15ed00 0x7f39cc0b8c10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39cc0d4380 0x7f39cc0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 --2- 172.21.15.22:0/660148550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39cc0d1240 0x7f39cc0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 >> 172.21.15.22:0/660148550 conn(0x7f39cc072670 msgr2=0x7f39cc0cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:13.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.742+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 shutdown_connections 2024-04-16T16:20:13.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.743+0000 7f39d3000640 1 -- 172.21.15.22:0/660148550 wait complete. 2024-04-16T16:20:13.745 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.746+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.745 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.746+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.745 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.746+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.745 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.746+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.745 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.746+0000 7f04e4600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11320 2024-04-16T16:20:13.767 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.769+0000 7f04e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.767 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.769+0000 7f04e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.767 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.769+0000 7f04e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.767 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.769+0000 7f04e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.768 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:13.769+0000 7f04e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.956+0000 7f2b3a400640 1 Processor -- start 2024-04-16T16:20:13.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.957+0000 7f2b3a400640 1 -- start start 2024-04-16T16:20:13.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.958+0000 7f2b3a400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b340b3dc0 0x7f2b3406df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.958+0000 7f2b3a400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b34163170 con 0x7f2b3415e850 2024-04-16T16:20:13.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.958+0000 7f2b3a400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3406d4a0 con 0x7f2b34072680 2024-04-16T16:20:13.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.958+0000 7f2b3a400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2b3406e4c0 con 0x7f2b340b3dc0 2024-04-16T16:20:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.959+0000 7f2b39000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2b3415e850 0x7f2b340b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53322/0 (socket says 172.21.15.22:53322) 2024-04-16T16:20:13.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.959+0000 7f2b39000640 1 -- 172.21.15.22:0/2723592568 learned_addr learned my addr 172.21.15.22:0/2723592568 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.959+0000 7f2b33e00640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b340b3dc0 0x7f2b3406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.959+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673527106 0 0) 0x7f2b34163170 con 0x7f2b3415e850 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.959+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b1c003520 con 0x7f2b3415e850 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3023873059 0 0) 0x7f2b1c003520 con 0x7f2b3415e850 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b340b3dc0 msgr2=0x7f2b3406df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b340b3dc0 0x7f2b3406df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 >> v1:172.21.15.43:6789/0 conn(0x7f2b34072680 legacy=0x7f2b34070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3406d780 con 0x7f2b3415e850 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f2b28001670 con 0x7f2b3415e850 2024-04-16T16:20:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 >> v1:172.21.15.22:6789/0 conn(0x7f2b3415e850 legacy=0x7f2b340b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1c0039e0 0x7f2b1c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b1c004800 0x7f2b1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b340b3dc0 0x7f2b1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3406e4c0 con 0x7f2b1c004800 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c00baa0 con 0x7f2b1c0039e0 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1c00bca0 con 0x7f2b340b3dc0 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.960+0000 7f2b33e00640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b1c004800 0x7f2b1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.961+0000 7f2b39000640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1c0039e0 0x7f2b1c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.961+0000 7f2b33e00640 1 -- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b340b3dc0 msgr2=0x7f2b1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.961+0000 7f2b33e00640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b340b3dc0 0x7f2b1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.961+0000 7f2b33e00640 1 -- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1c0039e0 msgr2=0x7f2b1c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:13.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.961+0000 7f2b33e00640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1c0039e0 0x7f2b1c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.961+0000 7f2b33e00640 1 -- 172.21.15.22:0/2723592568 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1c003520 con 0x7f2b1c004800 2024-04-16T16:20:13.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.961+0000 7f2b39000640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1c0039e0 0x7f2b1c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.962+0000 7f2b33e00640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b1c004800 0x7f2b1c004c80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009a90 tx=0x7f2b1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfabd3df951a54ac server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.962+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20039070 con 0x7f2b1c004800 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.962+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2002c6b0 con 0x7f2b1c004800 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.962+0000 7f2b33400640 1 -- 172.21.15.22:0/2723592568 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20009690 con 0x7f2b1c004800 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.963+0000 7f2b3a400640 1 -- 172.21.15.22:0/2723592568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b1c004800 msgr2=0x7f2b1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.963+0000 7f2b3a400640 1 --2- 172.21.15.22:0/2723592568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b1c004800 0x7f2b1c004c80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009a90 tx=0x7f2b1c005830 comp rx=0 tx=0).stop 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.963+0000 7f2b39a00640 1 -- 172.21.15.22:0/2723592568 reap_dead start 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.963+0000 7f2b3a400640 1 -- 172.21.15.22:0/2723592568 shutdown_connections 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.963+0000 7f2b3a400640 1 -- 172.21.15.22:0/2723592568 >> 172.21.15.22:0/2723592568 conn(0x7f2b34062440 msgr2=0x7f2b34062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.963+0000 7f2b3a400640 1 -- 172.21.15.22:0/2723592568 shutdown_connections 2024-04-16T16:20:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.963+0000 7f2b3a400640 1 -- 172.21.15.22:0/2723592568 wait complete. 2024-04-16T16:20:13.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.965+0000 7f2b3a400640 1 Processor -- start 2024-04-16T16:20:13.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.965+0000 7f2b3a400640 1 -- start start 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.966+0000 7f2b3a400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b1c004800 0x7f2b34143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.966+0000 7f2b3a400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b34161b50 0x7f2b3415f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.966+0000 7f2b3a400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b341ea470 0x7f2b341ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.966+0000 7f2b3a400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2b34162e10 con 0x7f2b34161b50 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.966+0000 7f2b3a400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3415ec30 con 0x7f2b341ea470 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.966+0000 7f2b3a400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2b34072d60 con 0x7f2b1c004800 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.966+0000 7f2b33e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b34161b50 0x7f2b3415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b34161b50 0x7f2b3415f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49548/0 (socket says 172.21.15.22:49548) 2024-04-16T16:20:13.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 -- 172.21.15.22:0/3301880903 learned_addr learned my addr 172.21.15.22:0/3301880903 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b39000640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b1c004800 0x7f2b34143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b39a00640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b341ea470 0x7f2b341ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 -- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b1c004800 msgr2=0x7f2b34143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b1c004800 0x7f2b34143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 -- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b341ea470 msgr2=0x7f2b341ea900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b341ea470 0x7f2b341ea900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 -- 172.21.15.22:0/3301880903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b341600f0 con 0x7f2b34161b50 2024-04-16T16:20:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.967+0000 7f2b33e00640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b34161b50 0x7f2b3415f790 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009bb0 tx=0x7f2b20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:13.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.968+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20042020 con 0x7f2b34161b50 2024-04-16T16:20:13.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.968+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2003a040 con 0x7f2b34161b50 2024-04-16T16:20:13.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.968+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20039070 con 0x7f2b34161b50 2024-04-16T16:20:13.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.968+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b341603d0 con 0x7f2b34161b50 2024-04-16T16:20:13.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.968+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b341e8310 con 0x7f2b34161b50 2024-04-16T16:20:13.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.969+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b34075f30 con 0x7f2b34161b50 2024-04-16T16:20:13.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.970+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 91346+0+0 (secure 0 0 0) 0x7f2b20045020 con 0x7f2b34161b50 2024-04-16T16:20:13.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.971+0000 7f2b30c00640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2b1406cc80 0x7f2b1406f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:13.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.971+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f2b200ad550 con 0x7f2b34161b50 2024-04-16T16:20:13.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.971+0000 7f2b39000640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2b1406cc80 0x7f2b1406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:13.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.972+0000 7f2b39000640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2b1406cc80 0x7f2b1406f140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2b28001eb0 tx=0x7f2b28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:13.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:13.976+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b2004c070 con 0x7f2b34161b50 2024-04-16T16:20:14.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.125+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7f2b200774a0 con 0x7f2b34161b50 2024-04-16T16:20:14.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.220+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11320", "target": ["mon-mgr", ""]}) -- 0x7f2b34072250 con 0x7f2b1406cc80 2024-04-16T16:20:14.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.236+0000 7f2b30c00640 1 -- 172.21.15.22:0/3301880903 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7f2b34072250 con 0x7f2b1406cc80 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "pending", 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol64180", 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap76020" 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:20:14.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.238+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2b1406cc80 msgr2=0x7f2b1406f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.238+0000 7f2b3a400640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2b1406cc80 0x7f2b1406f140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2b28001eb0 tx=0x7f2b28009040 comp rx=0 tx=0).stop 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.238+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b34161b50 msgr2=0x7f2b3415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.238+0000 7f2b3a400640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b34161b50 0x7f2b3415f790 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009bb0 tx=0x7f2b20004730 comp rx=0 tx=0).stop 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 shutdown_connections 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2b1406cc80 0x7f2b1406f140 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b341ea470 0x7f2b341ea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b34161b50 0x7f2b3415f790 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 --2- 172.21.15.22:0/3301880903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2b1c004800 0x7f2b34143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 >> 172.21.15.22:0/3301880903 conn(0x7f2b34062440 msgr2=0x7f2b3415d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 shutdown_connections 2024-04-16T16:20:14.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:14.239+0000 7f2b3a400640 1 -- 172.21.15.22:0/3301880903 wait complete. 2024-04-16T16:20:15.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11320 2024-04-16T16:20:15.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.493+0000 7f1178400640 1 Processor -- start 2024-04-16T16:20:15.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.494+0000 7f1178400640 1 -- start start 2024-04-16T16:20:15.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.495+0000 7f1178400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f117015ecb0 0x7f11700cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.495+0000 7f1178400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11700d2240 0x7f11700b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.495+0000 7f1178400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f117015f090 con 0x7f11700d0140 2024-04-16T16:20:15.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.495+0000 7f1178400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f11700d4430 con 0x7f117015ecb0 2024-04-16T16:20:15.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.495+0000 7f1178400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f11700d48c0 con 0x7f11700d2240 2024-04-16T16:20:15.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.495+0000 7f1175000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f11700d0140 0x7f11700d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53336/0 (socket says 172.21.15.22:53336) 2024-04-16T16:20:15.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.495+0000 7f1175000640 1 -- 172.21.15.22:0/845118037 learned_addr learned my addr 172.21.15.22:0/845118037 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:15.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f1175a00640 1 --2- 172.21.15.22:0/845118037 >> v2:172.21.15.43:3300/0 conn(0x7f117015ecb0 0x7f11700cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:15.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f1176400640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11700d2240 0x7f11700b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:15.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921170281 0 0) 0x7f117015f090 con 0x7f11700d0140 2024-04-16T16:20:15.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1158003520 con 0x7f11700d0140 2024-04-16T16:20:15.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1203484263 0 0) 0x7f1158003520 con 0x7f11700d0140 2024-04-16T16:20:15.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11700d2240 msgr2=0x7f11700b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:15.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11700d2240 0x7f11700b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 >> v2:172.21.15.43:3300/0 conn(0x7f117015ecb0 msgr2=0x7f11700cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:15.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 --2- 172.21.15.22:0/845118037 >> v2:172.21.15.43:3300/0 conn(0x7f117015ecb0 0x7f11700cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11700d3840 con 0x7f11700d0140 2024-04-16T16:20:15.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f1160001a10 con 0x7f11700d0140 2024-04-16T16:20:15.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 >> v1:172.21.15.22:6789/0 conn(0x7f11700d0140 legacy=0x7f11700d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:15.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11700d2240 0x7f11580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1158003f80 0x7f1158004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11700d4430 con 0x7f1158004d40 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f11700d48c0 con 0x7f1158003f80 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.496+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f115800baf0 con 0x7f11700d2240 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.497+0000 7f1176400640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.497+0000 7f1175000640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1158003f80 0x7f1158004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.497+0000 7f1176400640 1 -- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11700d2240 msgr2=0x7f11580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.497+0000 7f1176400640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11700d2240 0x7f11580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.497+0000 7f1176400640 1 -- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1158003f80 msgr2=0x7f1158004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.497+0000 7f1176400640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1158003f80 0x7f1158004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.497+0000 7f1176400640 1 -- 172.21.15.22:0/845118037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1158003520 con 0x7f1158004d40 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.498+0000 7f1176400640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11580051c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1168009a90 tx=0x7f1158005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cd9feb64471e43 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.498+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1168039070 con 0x7f1158004d40 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116802c6b0 con 0x7f1158004d40 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f116fe00640 1 -- 172.21.15.22:0/845118037 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1168009690 con 0x7f1158004d40 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f1178400640 1 -- 172.21.15.22:0/845118037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 msgr2=0x7f11580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f1178400640 1 --2- 172.21.15.22:0/845118037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11580051c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1168009a90 tx=0x7f1158005830 comp rx=0 tx=0).stop 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f1176400640 1 -- 172.21.15.22:0/845118037 reap_dead start 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f1178400640 1 -- 172.21.15.22:0/845118037 shutdown_connections 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f1178400640 1 -- 172.21.15.22:0/845118037 >> 172.21.15.22:0/845118037 conn(0x7f1170072460 msgr2=0x7f1170072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f1178400640 1 -- 172.21.15.22:0/845118037 shutdown_connections 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.499+0000 7f1178400640 1 -- 172.21.15.22:0/845118037 wait complete. 2024-04-16T16:20:15.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.501+0000 7f1178400640 1 Processor -- start 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.501+0000 7f1178400640 1 -- start start 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1178400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11700cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1178400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11701e90f0 0x7f117014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1178400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11701e9570 0x7f1170150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1178400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11700d40c0 con 0x7f1158004d40 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1178400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f11700d3de0 con 0x7f11701e90f0 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1178400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f11700b3e70 con 0x7f11701e9570 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1175a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11700cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1175a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11700cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49570/0 (socket says 172.21.15.22:49570) 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.502+0000 7f1175a00640 1 -- 172.21.15.22:0/2949360588 learned_addr learned my addr 172.21.15.22:0/2949360588 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f1175000640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11701e90f0 0x7f117014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f1175a00640 1 -- 172.21.15.22:0/2949360588 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11701e9570 msgr2=0x7f1170150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f1175a00640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11701e9570 0x7f1170150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f1175a00640 1 -- 172.21.15.22:0/2949360588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11701e90f0 msgr2=0x7f117014fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f1175a00640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11701e90f0 0x7f117014fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f1175a00640 1 -- 172.21.15.22:0/2949360588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11701f45e0 con 0x7f1158004d40 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f1175a00640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11700cc6a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f116400e7f0 tx=0x7f116400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.503+0000 7f116d600640 1 -- 172.21.15.22:0/2949360588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164017070 con 0x7f1158004d40 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.504+0000 7f116d600640 1 -- 172.21.15.22:0/2949360588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116400c8c0 con 0x7f1158004d40 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.504+0000 7f116d600640 1 -- 172.21.15.22:0/2949360588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116400ccb0 con 0x7f1158004d40 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.504+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11700ccda0 con 0x7f1158004d40 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.504+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11700cd360 con 0x7f1158004d40 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.505+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117004fd90 con 0x7f1158004d40 2024-04-16T16:20:15.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.506+0000 7f116d600640 1 -- 172.21.15.22:0/2949360588 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7f116401a070 con 0x7f1158004d40 2024-04-16T16:20:15.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.508+0000 7f116d600640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f115406ce00 0x7f115406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:15.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.508+0000 7f116d600640 1 -- 172.21.15.22:0/2949360588 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f116408c530 con 0x7f1158004d40 2024-04-16T16:20:15.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.508+0000 7f1175000640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f115406ce00 0x7f115406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:15.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.509+0000 7f1175000640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f115406ce00 0x7f115406f2c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1170161e50 tx=0x7f1160009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:15.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.513+0000 7f116d600640 1 -- 172.21.15.22:0/2949360588 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f116405a360 con 0x7f1158004d40 2024-04-16T16:20:15.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.760+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11320", "target": ["mon-mgr", ""]}) -- 0x7f1170069df0 con 0x7f115406ce00 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.774+0000 7f116d600640 1 -- 172.21.15.22:0/2949360588 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7f1170069df0 con 0x7f115406ce00 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "pending", 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol64180", 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap76020" 2024-04-16T16:20:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:15.774 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:15.774 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.776+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f115406ce00 msgr2=0x7f115406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.776+0000 7f1178400640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f115406ce00 0x7f115406f2c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1170161e50 tx=0x7f1160009040 comp rx=0 tx=0).stop 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 msgr2=0x7f11700cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11700cc6a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f116400e7f0 tx=0x7f116400ecb0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 shutdown_connections 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f115406ce00 0x7f115406f2c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11701e9570 0x7f1170150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11701e90f0 0x7f117014fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 --2- 172.21.15.22:0/2949360588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1158004d40 0x7f11700cc6a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 >> 172.21.15.22:0/2949360588 conn(0x7f1170072460 msgr2=0x7f11700b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 shutdown_connections 2024-04-16T16:20:15.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:15.777+0000 7f1178400640 1 -- 172.21.15.22:0/2949360588 wait complete. 2024-04-16T16:20:16.795 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11320 2024-04-16T16:20:17.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.032+0000 7fd0cda00640 1 Processor -- start 2024-04-16T16:20:17.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.032+0000 7fd0cda00640 1 -- start start 2024-04-16T16:20:17.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.034+0000 7fd0cda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c815ebb0 0x7fd0c80d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.034+0000 7fd0cda00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd0c80d3080 0x7fd0c80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.034+0000 7fd0cda00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c815ef90 con 0x7fd0c80d1840 2024-04-16T16:20:17.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.034+0000 7fd0cda00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c80ba4c0 con 0x7fd0c80d3080 2024-04-16T16:20:17.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.034+0000 7fd0cda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c80d1ca0 con 0x7fd0c815ebb0 2024-04-16T16:20:17.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.034+0000 7fd0c7400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd0c80d1840 0x7fd0c80d2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53342/0 (socket says 172.21.15.22:53342) 2024-04-16T16:20:17.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.034+0000 7fd0c7400640 1 -- 172.21.15.22:0/987577483 learned_addr learned my addr 172.21.15.22:0/987577483 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0cd000640 1 --2- 172.21.15.22:0/987577483 >> v2:172.21.15.43:3300/0 conn(0x7fd0c80d3080 0x7fd0c80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c7e00640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c815ebb0 0x7fd0c80d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481297462 0 0) 0x7fd0c815ef90 con 0x7fd0c80d1840 2024-04-16T16:20:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0ac003520 con 0x7fd0c80d1840 2024-04-16T16:20:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 614151559 0 0) 0x7fd0ac003520 con 0x7fd0c80d1840 2024-04-16T16:20:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c815ebb0 msgr2=0x7fd0c80d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c815ebb0 0x7fd0c80d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 >> v2:172.21.15.43:3300/0 conn(0x7fd0c80d3080 msgr2=0x7fd0c80b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 --2- 172.21.15.22:0/987577483 >> v2:172.21.15.43:3300/0 conn(0x7fd0c80d3080 0x7fd0c80b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c80d3550 con 0x7fd0c80d1840 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fd0b4001670 con 0x7fd0c80d1840 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0cd000640 1 --2- 172.21.15.22:0/987577483 >> v2:172.21.15.43:3300/0 conn(0x7fd0c80d3080 0x7fd0c80b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 >> v1:172.21.15.22:6789/0 conn(0x7fd0c80d1840 legacy=0x7fd0c80d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0ac0039b0 0x7fd0ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c815ebb0 0x7fd0ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0ac004d40 0x7fd0ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac00ba50 con 0x7fd0ac004d40 2024-04-16T16:20:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac00bbd0 con 0x7fd0ac0039b0 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.035+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ac00bd80 con 0x7fd0c815ebb0 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.036+0000 7fd0cd000640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0ac004d40 0x7fd0ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.036+0000 7fd0c7e00640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0ac0039b0 0x7fd0ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.036+0000 7fd0cd000640 1 -- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c815ebb0 msgr2=0x7fd0ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.036+0000 7fd0cd000640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c815ebb0 0x7fd0ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.036+0000 7fd0cd000640 1 -- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0ac0039b0 msgr2=0x7fd0ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.036+0000 7fd0cd000640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0ac0039b0 0x7fd0ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.036+0000 7fd0cd000640 1 -- 172.21.15.22:0/987577483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac003520 con 0x7fd0ac004d40 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.037+0000 7fd0cd000640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0ac004d40 0x7fd0ac0051c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00073b0 tx=0x7fd0ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ace315c83059cb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0039070 con 0x7fd0ac004d40 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c002cd90 con 0x7fd0ac004d40 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0c6a00640 1 -- 172.21.15.22:0/987577483 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0009c80 con 0x7fd0ac004d40 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0cda00640 1 -- 172.21.15.22:0/987577483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0ac004d40 msgr2=0x7fd0ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0cda00640 1 --2- 172.21.15.22:0/987577483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0ac004d40 0x7fd0ac0051c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00073b0 tx=0x7fd0ac005830 comp rx=0 tx=0).stop 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0cd000640 1 -- 172.21.15.22:0/987577483 reap_dead start 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0cda00640 1 -- 172.21.15.22:0/987577483 shutdown_connections 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0cda00640 1 -- 172.21.15.22:0/987577483 >> 172.21.15.22:0/987577483 conn(0x7fd0c8072460 msgr2=0x7fd0c8072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.038+0000 7fd0cda00640 1 -- 172.21.15.22:0/987577483 shutdown_connections 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.039+0000 7fd0cda00640 1 -- 172.21.15.22:0/987577483 wait complete. 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.040+0000 7fd0cda00640 1 Processor -- start 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.040+0000 7fd0cda00640 1 -- start start 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.041+0000 7fd0cda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0c814aca0 0x7fd0c80ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.041+0000 7fd0cda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c8156340 0x7fd0c80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.041+0000 7fd0cda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c815c550 0x7fd0c815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.041+0000 7fd0cda00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80d3df0 con 0x7fd0c815c550 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.041+0000 7fd0cda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80d3b10 con 0x7fd0c814aca0 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.041+0000 7fd0cda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c80d40d0 con 0x7fd0c8156340 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c815c550 0x7fd0c815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c815c550 0x7fd0c815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49594/0 (socket says 172.21.15.22:49594) 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 -- 172.21.15.22:0/4129861039 learned_addr learned my addr 172.21.15.22:0/4129861039 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0c7400640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c8156340 0x7fd0c80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0c7e00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0c814aca0 0x7fd0c80ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 -- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c8156340 msgr2=0x7fd0c80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c8156340 0x7fd0c80ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 -- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0c814aca0 msgr2=0x7fd0c80ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0c814aca0 0x7fd0c80ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0cd000640 1 -- 172.21.15.22:0/4129861039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c80cd2b0 con 0x7fd0c815c550 2024-04-16T16:20:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.042+0000 7fd0c7e00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0c814aca0 0x7fd0c80ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:17.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.043+0000 7fd0cd000640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c815c550 0x7fd0c815c9e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0037040 tx=0x7fd0c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:17.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.043+0000 7fd0bfe00640 1 -- 172.21.15.22:0/4129861039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0039070 con 0x7fd0c815c550 2024-04-16T16:20:17.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.043+0000 7fd0bfe00640 1 -- 172.21.15.22:0/4129861039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c0044070 con 0x7fd0c815c550 2024-04-16T16:20:17.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.043+0000 7fd0bfe00640 1 -- 172.21.15.22:0/4129861039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0009c80 con 0x7fd0c815c550 2024-04-16T16:20:17.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.043+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c80cd590 con 0x7fd0c815c550 2024-04-16T16:20:17.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.043+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c80cdb50 con 0x7fd0c815c550 2024-04-16T16:20:17.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.044+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c80d0a60 con 0x7fd0c815c550 2024-04-16T16:20:17.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.046+0000 7fd0bfe00640 1 -- 172.21.15.22:0/4129861039 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7fd0c003e830 con 0x7fd0c815c550 2024-04-16T16:20:17.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.046+0000 7fd0bfe00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0a806ce00 0x7fd0a806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:17.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.047+0000 7fd0bfe00640 1 -- 172.21.15.22:0/4129861039 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fd0c00ae500 con 0x7fd0c815c550 2024-04-16T16:20:17.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.047+0000 7fd0c7e00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0a806ce00 0x7fd0a806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:17.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.048+0000 7fd0c7e00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0a806ce00 0x7fd0a806f2c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009980 tx=0x7fd0b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:17.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.051+0000 7fd0bfe00640 1 -- 172.21.15.22:0/4129861039 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0c80d0a60 con 0x7fd0c815c550 2024-04-16T16:20:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.298+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11320", "target": ["mon-mgr", ""]}) -- 0x7fd0c8075f30 con 0x7fd0a806ce00 2024-04-16T16:20:17.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.308+0000 7fd0bfe00640 1 -- 172.21.15.22:0/4129861039 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7fd0c8075f30 con 0x7fd0a806ce00 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "pending", 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol64180", 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap76020" 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:17.307 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:17.308 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:20:17.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0a806ce00 msgr2=0x7fd0a806f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:17.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0a806ce00 0x7fd0a806f2c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009980 tx=0x7fd0b8008040 comp rx=0 tx=0).stop 2024-04-16T16:20:17.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c815c550 msgr2=0x7fd0c815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:17.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c815c550 0x7fd0c815c9e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0037040 tx=0x7fd0c0004ab0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 shutdown_connections 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd0a806ce00 0x7fd0a806f2c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c815c550 0x7fd0c815c9e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0c8156340 0x7fd0c80ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 --2- 172.21.15.22:0/4129861039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0c814aca0 0x7fd0c80ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 >> 172.21.15.22:0/4129861039 conn(0x7fd0c8072460 msgr2=0x7fd0c8072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 shutdown_connections 2024-04-16T16:20:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:17.311+0000 7fd0cda00640 1 -- 172.21.15.22:0/4129861039 wait complete. 2024-04-16T16:20:18.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11320 2024-04-16T16:20:18.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.570+0000 7f2c57000640 1 Processor -- start 2024-04-16T16:20:18.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.571+0000 7f2c57000640 1 -- start start 2024-04-16T16:20:18.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.572+0000 7f2c57000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c5015c570 0x7f2c5015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:18.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.572+0000 7f2c57000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:18.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.572+0000 7f2c57000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5006efd0 con 0x7f2c500b4500 2024-04-16T16:20:18.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.572+0000 7f2c57000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2c50075200 con 0x7f2c5015c570 2024-04-16T16:20:18.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.572+0000 7f2c57000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5006ed80 con 0x7f2c5015c950 2024-04-16T16:20:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.573+0000 7f2c4fe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c5015c570 0x7f2c5015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.573+0000 7f2c4f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.573+0000 7f2c4fe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c5015c570 0x7f2c5015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:45086/0 (socket says 172.21.15.22:45086) 2024-04-16T16:20:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.573+0000 7f2c4fe00640 1 -- 172.21.15.22:0/1558868893 learned_addr learned my addr 172.21.15.22:0/1558868893 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.573+0000 7f2c55000640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2c500b4500 0x7f2c500d0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:47134/0 (socket says 172.21.15.22:47134) 2024-04-16T16:20:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.574+0000 7f2c4fe00640 1 -- 172.21.15.22:0/1558868893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 msgr2=0x7f2c500b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.574+0000 7f2c4fe00640 1 --2- 172.21.15.22:0/1558868893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.574+0000 7f2c4fe00640 1 -- 172.21.15.22:0/1558868893 >> v1:172.21.15.43:6789/0 conn(0x7f2c500b4500 legacy=0x7f2c500d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.574+0000 7f2c4fe00640 1 -- 172.21.15.22:0/1558868893 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5006f2b0 con 0x7f2c5015c570 2024-04-16T16:20:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.574+0000 7f2c4ea00640 1 -- 172.21.15.22:0/1558868893 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476615354 0 0) 0x7f2c5006efd0 con 0x7f2c500b4500 2024-04-16T16:20:18.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.576+0000 7f2c4fe00640 1 --2- 172.21.15.22:0/1558868893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 0x7f2c5015f1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009870 tx=0x7f2c4002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c28c48d805fa520 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:18.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.576+0000 7f2c4ea00640 1 -- 172.21.15.22:0/1558868893 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40035020 con 0x7f2c5015c570 2024-04-16T16:20:18.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.576+0000 7f2c4ea00640 1 -- 172.21.15.22:0/1558868893 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40031640 con 0x7f2c5015c570 2024-04-16T16:20:18.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.576+0000 7f2c4ea00640 1 -- 172.21.15.22:0/1558868893 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4002d040 con 0x7f2c5015c570 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 -- 172.21.15.22:0/1558868893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 msgr2=0x7f2c5015f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 --2- 172.21.15.22:0/1558868893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 0x7f2c5015f1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009870 tx=0x7f2c4002b8f0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 -- 172.21.15.22:0/1558868893 shutdown_connections 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 --2- 172.21.15.22:0/1558868893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 --2- 172.21.15.22:0/1558868893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 0x7f2c5015f1c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 -- 172.21.15.22:0/1558868893 >> 172.21.15.22:0/1558868893 conn(0x7f2c5006dc70 msgr2=0x7f2c5006e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 -- 172.21.15.22:0/1558868893 shutdown_connections 2024-04-16T16:20:18.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.577+0000 7f2c57000640 1 -- 172.21.15.22:0/1558868893 wait complete. 2024-04-16T16:20:18.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.579+0000 7f2c57000640 1 Processor -- start 2024-04-16T16:20:18.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.579+0000 7f2c57000640 1 -- start start 2024-04-16T16:20:18.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.580+0000 7f2c57000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c500b4500 0x7f2c500cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:18.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.580+0000 7f2c57000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 0x7f2c500c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:18.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.580+0000 7f2c57000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.580+0000 7f2c57000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2c500d1690 con 0x7f2c500b4500 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.580+0000 7f2c57000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5006f870 con 0x7f2c5015c570 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.580+0000 7f2c57000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c500d1810 con 0x7f2c5015c950 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.580+0000 7f2c4fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c500b4500 0x7f2c500cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c500b4500 0x7f2c500cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49596/0 (socket says 172.21.15.22:49596) 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 -- 172.21.15.22:0/3958716963 learned_addr learned my addr 172.21.15.22:0/3958716963 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4f400640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 0x7f2c500c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c55000640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:18.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 -- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 msgr2=0x7f2c500c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 -- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 msgr2=0x7f2c500c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 0x7f2c500c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 -- 172.21.15.22:0/3958716963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c500b2950 con 0x7f2c500b4500 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.581+0000 7f2c4fe00640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c500b4500 0x7f2c500cf8c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2c40000c00 tx=0x7f2c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.582+0000 7f2c47e00640 1 -- 172.21.15.22:0/3958716963 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40040070 con 0x7f2c500b4500 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.582+0000 7f2c47e00640 1 -- 172.21.15.22:0/3958716963 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c400399f0 con 0x7f2c500b4500 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.582+0000 7f2c47e00640 1 -- 172.21.15.22:0/3958716963 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40035040 con 0x7f2c500b4500 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.582+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c500b2c30 con 0x7f2c500b4500 2024-04-16T16:20:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.582+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c500b31f0 con 0x7f2c500b4500 2024-04-16T16:20:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.583+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5004fd90 con 0x7f2c500b4500 2024-04-16T16:20:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.585+0000 7f2c47e00640 1 -- 172.21.15.22:0/3958716963 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7f2c4004b060 con 0x7f2c500b4500 2024-04-16T16:20:18.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.586+0000 7f2c47e00640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c2c06ce00 0x7f2c2c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:18.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.586+0000 7f2c47e00640 1 -- 172.21.15.22:0/3958716963 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f2c400add50 con 0x7f2c500b4500 2024-04-16T16:20:18.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.586+0000 7f2c4f400640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c2c06ce00 0x7f2c2c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:18.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.587+0000 7f2c4f400640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c2c06ce00 0x7f2c2c06f2c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c500c6090 tx=0x7f2c3800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:18.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.591+0000 7f2c47e00640 1 -- 172.21.15.22:0/3958716963 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c4007ba40 con 0x7f2c500b4500 2024-04-16T16:20:18.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.850+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11320", "target": ["mon-mgr", ""]}) -- 0x7f2c50070360 con 0x7f2c2c06ce00 2024-04-16T16:20:18.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.871+0000 7f2c47e00640 1 -- 172.21.15.22:0/3958716963 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+169 (secure 0 0 0) 0x7f2c50070360 con 0x7f2c2c06ce00 2024-04-16T16:20:18.870 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:20:18.870 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:20:18.870 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "in-progress", 2024-04-16T16:20:18.870 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:20:18.870 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:20:18.870 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol64180", 2024-04-16T16:20:18.871 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap76020" 2024-04-16T16:20:18.871 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:18.871 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:18.871 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:20:18.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c2c06ce00 msgr2=0x7f2c2c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:18.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c2c06ce00 0x7f2c2c06f2c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c500c6090 tx=0x7f2c3800b040 comp rx=0 tx=0).stop 2024-04-16T16:20:18.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c500b4500 msgr2=0x7f2c500cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:18.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c500b4500 0x7f2c500cf8c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2c40000c00 tx=0x7f2c400046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 shutdown_connections 2024-04-16T16:20:18.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f2c2c06ce00 0x7f2c2c06f2c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c5015c950 0x7f2c500c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c5015c570 0x7f2c500c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 --2- 172.21.15.22:0/3958716963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c500b4500 0x7f2c500cf8c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:18.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.874+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 >> 172.21.15.22:0/3958716963 conn(0x7f2c5006dc70 msgr2=0x7f2c5015bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:18.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.875+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 shutdown_connections 2024-04-16T16:20:18.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:18.875+0000 7f2c57000640 1 -- 172.21.15.22:0/3958716963 wait complete. 2024-04-16T16:20:18.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone11320 2024-04-16T16:20:19.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.112+0000 7f7462000640 1 Processor -- start 2024-04-16T16:20:19.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.112+0000 7f7462000640 1 -- start start 2024-04-16T16:20:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.113+0000 7f7462000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f745c155df0 0x7f745c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7462000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7462000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f745c15f240 0x7f745c15f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7462000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f745c15fc00 con 0x7f745c15f240 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7462000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f745c15c440 con 0x7f745c155df0 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7462000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f745c0ccd70 con 0x7f745c15c8d0 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7461600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f745c15f240 0x7f745c15f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7461600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f745c15f240 0x7f745c15f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49612/0 (socket says 172.21.15.22:49612) 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7461600640 1 -- 172.21.15.22:0/1375630457 learned_addr learned my addr 172.21.15.22:0/1375630457 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7460c00640 1 --2- 172.21.15.22:0/1375630457 >> v2:172.21.15.43:3300/0 conn(0x7f745c155df0 0x7f745c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f7461600640 1 -- 172.21.15.22:0/1375630457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 msgr2=0x7f745c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.114+0000 7f745be00640 1 --2- 172.21.15.22:0/1375630457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.115+0000 7f7461600640 1 --2- 172.21.15.22:0/1375630457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.115+0000 7f7461600640 1 -- 172.21.15.22:0/1375630457 >> v2:172.21.15.43:3300/0 conn(0x7f745c155df0 msgr2=0x7f745c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:19.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.115+0000 7f7461600640 1 --2- 172.21.15.22:0/1375630457 >> v2:172.21.15.43:3300/0 conn(0x7f745c155df0 0x7f745c0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.115+0000 7f7461600640 1 -- 172.21.15.22:0/1375630457 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c160100 con 0x7f745c15f240 2024-04-16T16:20:19.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.115+0000 7f7460c00640 1 --2- 172.21.15.22:0/1375630457 >> v2:172.21.15.43:3300/0 conn(0x7f745c155df0 0x7f745c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:19.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.115+0000 7f745be00640 1 --2- 172.21.15.22:0/1375630457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.116+0000 7f7461600640 1 --2- 172.21.15.22:0/1375630457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c15f6c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f745c06f330 tx=0x7f745402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67dda91df39eef75 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.116+0000 7f745b400640 1 -- 172.21.15.22:0/1375630457 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745402ea80 con 0x7f745c15f240 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.116+0000 7f745b400640 1 -- 172.21.15.22:0/1375630457 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745402ec20 con 0x7f745c15f240 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.116+0000 7f745b400640 1 -- 172.21.15.22:0/1375630457 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454009600 con 0x7f745c15f240 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 -- 172.21.15.22:0/1375630457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 msgr2=0x7f745c15f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 --2- 172.21.15.22:0/1375630457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c15f6c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f745c06f330 tx=0x7f745402e0e0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 -- 172.21.15.22:0/1375630457 shutdown_connections 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 --2- 172.21.15.22:0/1375630457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c15f6c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 --2- 172.21.15.22:0/1375630457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 --2- 172.21.15.22:0/1375630457 >> v2:172.21.15.43:3300/0 conn(0x7f745c155df0 0x7f745c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 -- 172.21.15.22:0/1375630457 >> 172.21.15.22:0/1375630457 conn(0x7f745c075070 msgr2=0x7f745c062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:19.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 -- 172.21.15.22:0/1375630457 shutdown_connections 2024-04-16T16:20:19.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.117+0000 7f7462000640 1 -- 172.21.15.22:0/1375630457 wait complete. 2024-04-16T16:20:19.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.119+0000 7f7462000640 1 Processor -- start 2024-04-16T16:20:19.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.119+0000 7f7462000640 1 -- start start 2024-04-16T16:20:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7462000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f745c155df0 0x7f745c1f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7462000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7462000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7462000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f745c15c0d0 con 0x7f745c15f240 2024-04-16T16:20:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7462000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f745c15bdf0 con 0x7f745c155df0 2024-04-16T16:20:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7462000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f745c06da30 con 0x7f745c15c8d0 2024-04-16T16:20:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7461600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7461600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c0ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49614/0 (socket says 172.21.15.22:49614) 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7461600640 1 -- 172.21.15.22:0/224006796 learned_addr learned my addr 172.21.15.22:0/224006796 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f7460c00640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f745c155df0 0x7f745c1f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.120+0000 7f745be00640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7461600640 1 -- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 msgr2=0x7f745c149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7461600640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7461600640 1 -- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f745c155df0 msgr2=0x7f745c1f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7461600640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f745c155df0 0x7f745c1f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7461600640 1 -- 172.21.15.22:0/224006796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c1f58f0 con 0x7f745c15f240 2024-04-16T16:20:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7461600640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c0ae860 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f745400d270 tx=0x7f7454004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7458c00640 1 -- 172.21.15.22:0/224006796 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454044020 con 0x7f745c15f240 2024-04-16T16:20:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7458c00640 1 -- 172.21.15.22:0/224006796 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745403f850 con 0x7f745c15f240 2024-04-16T16:20:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7458c00640 1 -- 172.21.15.22:0/224006796 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745402ea80 con 0x7f745c15f240 2024-04-16T16:20:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.121+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c14a3e0 con 0x7f745c15f240 2024-04-16T16:20:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.122+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c151d20 con 0x7f745c15f240 2024-04-16T16:20:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.123+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745c075f30 con 0x7f745c15f240 2024-04-16T16:20:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.124+0000 7f7458c00640 1 -- 172.21.15.22:0/224006796 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7f7454047020 con 0x7f745c15f240 2024-04-16T16:20:19.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.125+0000 7f7458c00640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f743c06ce00 0x7f743c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.125+0000 7f7458c00640 1 -- 172.21.15.22:0/224006796 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f74540af4c0 con 0x7f745c15f240 2024-04-16T16:20:19.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.125+0000 7f7460c00640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f743c06ce00 0x7f743c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.126+0000 7f7460c00640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f743c06ce00 0x7f743c06f2c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f745c0af740 tx=0x7f7450008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:19.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.130+0000 7f7458c00640 1 -- 172.21.15.22:0/224006796 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f745404e030 con 0x7f745c15f240 2024-04-16T16:20:19.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.375+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone11320", "target": ["mon-mgr", ""]}) -- 0x7f745c06d460 con 0x7f743c06ce00 2024-04-16T16:20:19.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.639+0000 7f7458c00640 1 -- 172.21.15.22:0/224006796 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f745c06d460 con 0x7f743c06ce00 2024-04-16T16:20:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f743c06ce00 msgr2=0x7f743c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f743c06ce00 0x7f743c06f2c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f745c0af740 tx=0x7f7450008040 comp rx=0 tx=0).stop 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 msgr2=0x7f745c0ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c0ae860 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f745400d270 tx=0x7f7454004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 shutdown_connections 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f743c06ce00 0x7f743c06f2c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f745c15f240 0x7f745c0ae860 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f745c15c8d0 0x7f745c149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 --2- 172.21.15.22:0/224006796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f745c155df0 0x7f745c1f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.642+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 >> 172.21.15.22:0/224006796 conn(0x7f745c075070 msgr2=0x7f745c1581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.643+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 shutdown_connections 2024-04-16T16:20:19.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.643+0000 7f7462000640 1 -- 172.21.15.22:0/224006796 wait complete. 2024-04-16T16:20:19.663 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11320 2024-04-16T16:20:19.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.885+0000 7f92d2000640 1 Processor -- start 2024-04-16T16:20:19.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.885+0000 7f92d2000640 1 -- start start 2024-04-16T16:20:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92d2000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92cc15fe30 0x7f92cc070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92d2000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92cc0715c0 con 0x7f92cc0b33a0 2024-04-16T16:20:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92d2000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92cc0718a0 con 0x7f92cc0b4fa0 2024-04-16T16:20:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92d2000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f92cc071360 con 0x7f92cc15fe30 2024-04-16T16:20:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92cbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92cc15fe30 0x7f92cc070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92cbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92cc15fe30 0x7f92cc070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45110/0 (socket says 172.21.15.22:45110) 2024-04-16T16:20:19.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92cbe00640 1 -- 172.21.15.22:0/4088445181 learned_addr learned my addr 172.21.15.22:0/4088445181 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:19.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.887+0000 7f92d1600640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f92cc0b33a0 0x7f92cc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50764/0 (socket says 172.21.15.22:50764) 2024-04-16T16:20:19.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.888+0000 7f92cbe00640 1 -- 172.21.15.22:0/4088445181 >> v1:172.21.15.43:6789/0 conn(0x7f92cc0b4fa0 legacy=0x7f92cc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:19.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.888+0000 7f92cbe00640 1 -- 172.21.15.22:0/4088445181 >> v1:172.21.15.22:6789/0 conn(0x7f92cc0b33a0 legacy=0x7f92cc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.888+0000 7f92cb400640 1 -- 172.21.15.22:0/4088445181 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810139085 0 0) 0x7f92cc0715c0 con 0x7f92cc0b33a0 2024-04-16T16:20:19.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.888+0000 7f92cbe00640 1 -- 172.21.15.22:0/4088445181 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc071b80 con 0x7f92cc15fe30 2024-04-16T16:20:19.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.889+0000 7f92cbe00640 1 --2- 172.21.15.22:0/4088445181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc070e20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009870 tx=0x7f92b802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284240e80a5e27a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:19.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.889+0000 7f92cb400640 1 -- 172.21.15.22:0/4088445181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b802f850 con 0x7f92cc15fe30 2024-04-16T16:20:19.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.889+0000 7f92cb400640 1 -- 172.21.15.22:0/4088445181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b802f9f0 con 0x7f92cc15fe30 2024-04-16T16:20:19.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.889+0000 7f92cb400640 1 -- 172.21.15.22:0/4088445181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b802fdc0 con 0x7f92cc15fe30 2024-04-16T16:20:19.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.890+0000 7f92d2000640 1 -- 172.21.15.22:0/4088445181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 msgr2=0x7f92cc070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.890+0000 7f92d2000640 1 --2- 172.21.15.22:0/4088445181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc070e20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009870 tx=0x7f92b802ba30 comp rx=0 tx=0).stop 2024-04-16T16:20:19.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.890+0000 7f92d2000640 1 -- 172.21.15.22:0/4088445181 shutdown_connections 2024-04-16T16:20:19.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.890+0000 7f92d2000640 1 --2- 172.21.15.22:0/4088445181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc070e20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.890+0000 7f92d2000640 1 -- 172.21.15.22:0/4088445181 >> 172.21.15.22:0/4088445181 conn(0x7f92cc075070 msgr2=0x7f92cc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:19.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.890+0000 7f92d2000640 1 -- 172.21.15.22:0/4088445181 shutdown_connections 2024-04-16T16:20:19.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.891+0000 7f92d2000640 1 -- 172.21.15.22:0/4088445181 wait complete. 2024-04-16T16:20:19.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.892+0000 7f92d2000640 1 Processor -- start 2024-04-16T16:20:19.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.892+0000 7f92d2000640 1 -- start start 2024-04-16T16:20:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.893+0000 7f92d2000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92cc0b33a0 0x7f92cc0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.893+0000 7f92d2000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92cc0b4fa0 0x7f92cc14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.893+0000 7f92d2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.893+0000 7f92d2000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc0b5380 con 0x7f92cc15fe30 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.893+0000 7f92d2000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc0ce630 con 0x7f92cc0b33a0 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.893+0000 7f92d2000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f92cc0b5500 con 0x7f92cc0b4fa0 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45120/0 (socket says 172.21.15.22:45120) 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 -- 172.21.15.22:0/1525105786 learned_addr learned my addr 172.21.15.22:0/1525105786 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d0c00640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92cc0b33a0 0x7f92cc0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92cbe00640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92cc0b4fa0 0x7f92cc14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 -- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92cc0b4fa0 msgr2=0x7f92cc14ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92cc0b4fa0 0x7f92cc14ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 -- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92cc0b33a0 msgr2=0x7f92cc0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92cc0b33a0 0x7f92cc0cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.894+0000 7f92d1600640 1 -- 172.21.15.22:0/1525105786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc158b70 con 0x7f92cc15fe30 2024-04-16T16:20:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.895+0000 7f92d1600640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc14bf60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f92c400c7a0 tx=0x7f92c400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.895+0000 7f92c8c00640 1 -- 172.21.15.22:0/1525105786 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4018070 con 0x7f92cc15fe30 2024-04-16T16:20:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.895+0000 7f92c8c00640 1 -- 172.21.15.22:0/1525105786 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c400a640 con 0x7f92cc15fe30 2024-04-16T16:20:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.895+0000 7f92c8c00640 1 -- 172.21.15.22:0/1525105786 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c400aab0 con 0x7f92cc15fe30 2024-04-16T16:20:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.895+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc158e50 con 0x7f92cc15fe30 2024-04-16T16:20:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.895+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc159410 con 0x7f92cc15fe30 2024-04-16T16:20:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.896+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc075f30 con 0x7f92cc15fe30 2024-04-16T16:20:19.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.897+0000 7f92c8c00640 1 -- 172.21.15.22:0/1525105786 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7f92c401b070 con 0x7f92cc15fe30 2024-04-16T16:20:19.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.899+0000 7f92c8c00640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92ac06ce00 0x7f92ac06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:19.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.899+0000 7f92c8c00640 1 -- 172.21.15.22:0/1525105786 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f92c408bb60 con 0x7f92cc15fe30 2024-04-16T16:20:19.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.899+0000 7f92d0c00640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92ac06ce00 0x7f92ac06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:19.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.900+0000 7f92d0c00640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92ac06ce00 0x7f92ac06f2c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f92c0000f60 tx=0x7f92c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:19.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:19.903+0000 7f92c8c00640 1 -- 172.21.15.22:0/1525105786 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92c40597c0 con 0x7f92cc15fe30 2024-04-16T16:20:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:20.147+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11320", "target": ["mon-mgr", ""]}) -- 0x7f92cc15b590 con 0x7f92ac06ce00 2024-04-16T16:20:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.437+0000 7f92c8c00640 1 -- 172.21.15.22:0/1525105786 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+264 (secure 0 0 0) 0x7f92cc15b590 con 0x7f92ac06ce00 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "status": { 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "canceled", 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "source": { 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "volume": "cephfs", 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "subvolume": "subvol64180", 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot": "subvol_snap76020" 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "failure": { 2024-04-16T16:20:24.437 INFO:teuthology.orchestra.run.smithi022.stdout: "errno": "4", 2024-04-16T16:20:24.438 INFO:teuthology.orchestra.run.smithi022.stdout: "error_msg": "user interrupted clone operation" 2024-04-16T16:20:24.438 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:24.438 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:24.438 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92ac06ce00 msgr2=0x7f92ac06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92ac06ce00 0x7f92ac06f2c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f92c0000f60 tx=0x7f92c0009040 comp rx=0 tx=0).stop 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 msgr2=0x7f92cc14bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc14bf60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f92c400c7a0 tx=0x7f92c400cc60 comp rx=0 tx=0).stop 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 shutdown_connections 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92ac06ce00 0x7f92ac06f2c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc15fe30 0x7f92cc14bf60 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92cc0b4fa0 0x7f92cc14ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 --2- 172.21.15.22:0/1525105786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92cc0b33a0 0x7f92cc0cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 >> 172.21.15.22:0/1525105786 conn(0x7f92cc075070 msgr2=0x7f92cc0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:24.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.441+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 shutdown_connections 2024-04-16T16:20:24.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.442+0000 7f92d2000640 1 -- 172.21.15.22:0/1525105786 wait complete. 2024-04-16T16:20:24.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone11320 --force 2024-04-16T16:20:24.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.681+0000 7fa8fda00640 1 Processor -- start 2024-04-16T16:20:24.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.682+0000 7fa8fda00640 1 -- start start 2024-04-16T16:20:24.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.683+0000 7fa8fda00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8f815c6e0 0x7fa8f806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.683+0000 7fa8fda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f8072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.683+0000 7fa8fda00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa8f8072c60 0x7fa8f8160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8fda00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f806cf80 con 0x7fa8f815c6e0 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8fda00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f806d260 con 0x7fa8f8072c60 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8fda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f806d540 con 0x7fa8f80af930 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8f7e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8f815c6e0 0x7fa8f806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8f7e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa8f815c6e0 0x7fa8f806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45134/0 (socket says 172.21.15.22:45134) 2024-04-16T16:20:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8f7e00640 1 -- 172.21.15.22:0/44118893 learned_addr learned my addr 172.21.15.22:0/44118893 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8fd000640 1 --2- 172.21.15.22:0/44118893 >> v2:172.21.15.43:3300/0 conn(0x7fa8f8072c60 0x7fa8f8160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8f7e00640 1 -- 172.21.15.22:0/44118893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 msgr2=0x7fa8f8072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.684+0000 7fa8efe00640 1 --2- 172.21.15.22:0/44118893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f8072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.685+0000 7fa8f7e00640 1 --2- 172.21.15.22:0/44118893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f8072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.685+0000 7fa8f7e00640 1 -- 172.21.15.22:0/44118893 >> v2:172.21.15.43:3300/0 conn(0x7fa8f8072c60 msgr2=0x7fa8f8160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:24.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.685+0000 7fa8f7e00640 1 --2- 172.21.15.22:0/44118893 >> v2:172.21.15.43:3300/0 conn(0x7fa8f8072c60 0x7fa8f8160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.685+0000 7fa8f7e00640 1 -- 172.21.15.22:0/44118893 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f806d820 con 0x7fa8f815c6e0 2024-04-16T16:20:24.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.685+0000 7fa8fd000640 1 --2- 172.21.15.22:0/44118893 >> v2:172.21.15.43:3300/0 conn(0x7fa8f8072c60 0x7fa8f8160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:24.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.685+0000 7fa8efe00640 1 --2- 172.21.15.22:0/44118893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f8072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:24.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.686+0000 7fa8f7e00640 1 --2- 172.21.15.22:0/44118893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f806e940 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806ce70 tx=0x7fa8e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f3a38d1121231f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.686+0000 7fa8f7400640 1 -- 172.21.15.22:0/44118893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8035020 con 0x7fa8f815c6e0 2024-04-16T16:20:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.686+0000 7fa8f7400640 1 -- 172.21.15.22:0/44118893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e8031870 con 0x7fa8f815c6e0 2024-04-16T16:20:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.686+0000 7fa8f7400640 1 -- 172.21.15.22:0/44118893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8031c40 con 0x7fa8f815c6e0 2024-04-16T16:20:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 -- 172.21.15.22:0/44118893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 msgr2=0x7fa8f806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 --2- 172.21.15.22:0/44118893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f806e940 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806ce70 tx=0x7fa8e802b910 comp rx=0 tx=0).stop 2024-04-16T16:20:24.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 -- 172.21.15.22:0/44118893 shutdown_connections 2024-04-16T16:20:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 --2- 172.21.15.22:0/44118893 >> v2:172.21.15.43:3300/0 conn(0x7fa8f8072c60 0x7fa8f8160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 --2- 172.21.15.22:0/44118893 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f8072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 --2- 172.21.15.22:0/44118893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f806e940 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 -- 172.21.15.22:0/44118893 >> 172.21.15.22:0/44118893 conn(0x7fa8f8062440 msgr2=0x7fa8f8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 -- 172.21.15.22:0/44118893 shutdown_connections 2024-04-16T16:20:24.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.687+0000 7fa8fda00640 1 -- 172.21.15.22:0/44118893 wait complete. 2024-04-16T16:20:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.690+0000 7fa8fda00640 1 Processor -- start 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.690+0000 7fa8fda00640 1 -- start start 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.691+0000 7fa8fda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8f8072c60 0x7fa8f81f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.691+0000 7fa8fda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f81f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.691+0000 7fa8fda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f81f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.691+0000 7fa8fda00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f815cc40 con 0x7fa8f815c6e0 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.691+0000 7fa8fda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f815cac0 con 0x7fa8f8072c60 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.691+0000 7fa8fda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f81608a0 con 0x7fa8f80af930 2024-04-16T16:20:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f81f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f81f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45142/0 (socket says 172.21.15.22:45142) 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 -- 172.21.15.22:0/1678642205 learned_addr learned my addr 172.21.15.22:0/1678642205 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8f7e00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8f8072c60 0x7fa8f81f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8efe00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f81f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 -- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 msgr2=0x7fa8f81f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f81f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 -- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8f8072c60 msgr2=0x7fa8f81f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8f8072c60 0x7fa8f81f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.692+0000 7fa8fd000640 1 -- 172.21.15.22:0/1678642205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f80b1020 con 0x7fa8f815c6e0 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.693+0000 7fa8fd000640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f81f5750 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000cef0 tx=0x7fa8f000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.693+0000 7fa8f4c00640 1 -- 172.21.15.22:0/1678642205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f001a070 con 0x7fa8f815c6e0 2024-04-16T16:20:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.693+0000 7fa8f4c00640 1 -- 172.21.15.22:0/1678642205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f000d840 con 0x7fa8f815c6e0 2024-04-16T16:20:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.693+0000 7fa8f4c00640 1 -- 172.21.15.22:0/1678642205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000dc30 con 0x7fa8f815c6e0 2024-04-16T16:20:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.693+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f80b1300 con 0x7fa8f815c6e0 2024-04-16T16:20:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.693+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f81f47b0 con 0x7fa8f815c6e0 2024-04-16T16:20:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.694+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f8075f30 con 0x7fa8f815c6e0 2024-04-16T16:20:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.695+0000 7fa8f4c00640 1 -- 172.21.15.22:0/1678642205 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7fa8f001d070 con 0x7fa8f815c6e0 2024-04-16T16:20:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.696+0000 7fa8f4c00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8d406ce00 0x7fa8d406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.696+0000 7fa8f4c00640 1 -- 172.21.15.22:0/1678642205 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fa8f008cd20 con 0x7fa8f815c6e0 2024-04-16T16:20:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.697+0000 7fa8f7e00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8d406ce00 0x7fa8d406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:24.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.697+0000 7fa8f7e00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8d406ce00 0x7fa8d406f2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8036000 tx=0x7fa8e803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:24.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.702+0000 7fa8f4c00640 1 -- 172.21.15.22:0/1678642205 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8f005a980 con 0x7fa8f815c6e0 2024-04-16T16:20:24.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.944+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone11320", "force": true, "target": ["mon-mgr", ""]}) -- 0x7fa8f8063230 con 0x7fa8d406ce00 2024-04-16T16:20:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.981+0000 7fa8f4c00640 1 -- 172.21.15.22:0/1678642205 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8f8063230 con 0x7fa8d406ce00 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8d406ce00 msgr2=0x7fa8d406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8d406ce00 0x7fa8d406f2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8036000 tx=0x7fa8e803c040 comp rx=0 tx=0).stop 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 msgr2=0x7fa8f81f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f81f5750 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000cef0 tx=0x7fa8f000a710 comp rx=0 tx=0).stop 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 shutdown_connections 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fa8d406ce00 0x7fa8d406f2c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f815c6e0 0x7fa8f81f5750 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa8f80af930 0x7fa8f81f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 --2- 172.21.15.22:0/1678642205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8f8072c60 0x7fa8f81f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 >> 172.21.15.22:0/1678642205 conn(0x7fa8f8062440 msgr2=0x7fa8f8071e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 shutdown_connections 2024-04-16T16:20:24.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:24.985+0000 7fa8fda00640 1 -- 172.21.15.22:0/1678642205 wait complete. 2024-04-16T16:20:25.002 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:25.003+0000 7f04e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:25.002 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:25.003+0000 7f04e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:25.002 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:25.003+0000 7f04e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:25.002 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:25.003+0000 7f04e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:25.002 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:20:25.003+0000 7f04e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:20:25.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol64180 subvol_snap76020 2024-04-16T16:20:25.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.206+0000 7f4d8b200640 1 Processor -- start 2024-04-16T16:20:25.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.206+0000 7f4d8b200640 1 -- start start 2024-04-16T16:20:25.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.208+0000 7f4d8b200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4d8c15e850 0x7f4d8c06df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.208+0000 7f4d8b200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d8c072680 0x7f4d8c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.208+0000 7f4d8b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c072d60 0x7f4d8c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.208+0000 7f4d8b200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4d8c06e4c0 con 0x7f4d8c072680 2024-04-16T16:20:25.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.208+0000 7f4d8b200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4d8c163170 con 0x7f4d8c15e850 2024-04-16T16:20:25.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.208+0000 7f4d8b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8c06d4a0 con 0x7f4d8c072d60 2024-04-16T16:20:25.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d8c072680 0x7f4d8c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d8c072680 0x7f4d8c0b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45170/0 (socket says 172.21.15.22:45170) 2024-04-16T16:20:25.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 -- 172.21.15.22:0/2367779694 learned_addr learned my addr 172.21.15.22:0/2367779694 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:25.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89e00640 1 --2- 172.21.15.22:0/2367779694 >> v2:172.21.15.43:3300/0 conn(0x7f4d8c15e850 0x7f4d8c06df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d8a800640 1 --2- 172.21.15.22:0/2367779694 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c072d60 0x7f4d8c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 -- 172.21.15.22:0/2367779694 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c072d60 msgr2=0x7f4d8c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:25.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 --2- 172.21.15.22:0/2367779694 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c072d60 0x7f4d8c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 -- 172.21.15.22:0/2367779694 >> v2:172.21.15.43:3300/0 conn(0x7f4d8c15e850 msgr2=0x7f4d8c06df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:25.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 --2- 172.21.15.22:0/2367779694 >> v2:172.21.15.43:3300/0 conn(0x7f4d8c15e850 0x7f4d8c06df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.209+0000 7f4d89400640 1 -- 172.21.15.22:0/2367779694 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c06d780 con 0x7f4d8c072680 2024-04-16T16:20:25.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.210+0000 7f4d89400640 1 --2- 172.21.15.22:0/2367779694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072680 0x7f4d8c0b36b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c063390 tx=0x7f4d7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf5ba5fa9697aa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:25.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.211+0000 7f4d88a00640 1 -- 172.21.15.22:0/2367779694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74035020 con 0x7f4d8c072680 2024-04-16T16:20:25.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.211+0000 7f4d88a00640 1 -- 172.21.15.22:0/2367779694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d74031870 con 0x7f4d8c072680 2024-04-16T16:20:25.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.211+0000 7f4d88a00640 1 -- 172.21.15.22:0/2367779694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74031c40 con 0x7f4d8c072680 2024-04-16T16:20:25.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.211+0000 7f4d8b200640 1 -- 172.21.15.22:0/2367779694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072680 msgr2=0x7f4d8c0b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.211+0000 7f4d8b200640 1 --2- 172.21.15.22:0/2367779694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072680 0x7f4d8c0b36b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c063390 tx=0x7f4d7402b910 comp rx=0 tx=0).stop 2024-04-16T16:20:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.212+0000 7f4d8b200640 1 -- 172.21.15.22:0/2367779694 shutdown_connections 2024-04-16T16:20:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.212+0000 7f4d8b200640 1 --2- 172.21.15.22:0/2367779694 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c072d60 0x7f4d8c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.212+0000 7f4d8b200640 1 --2- 172.21.15.22:0/2367779694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072680 0x7f4d8c0b36b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.212+0000 7f4d8b200640 1 --2- 172.21.15.22:0/2367779694 >> v2:172.21.15.43:3300/0 conn(0x7f4d8c15e850 0x7f4d8c06df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.212+0000 7f4d8b200640 1 -- 172.21.15.22:0/2367779694 >> 172.21.15.22:0/2367779694 conn(0x7f4d8c062440 msgr2=0x7f4d8c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.212+0000 7f4d8b200640 1 -- 172.21.15.22:0/2367779694 shutdown_connections 2024-04-16T16:20:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.212+0000 7f4d8b200640 1 -- 172.21.15.22:0/2367779694 wait complete. 2024-04-16T16:20:25.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.214+0000 7f4d8b200640 1 Processor -- start 2024-04-16T16:20:25.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.214+0000 7f4d8b200640 1 -- start start 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d8b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d8c072680 0x7f4d8c14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d8b200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072d60 0x7f4d8c15ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d8b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c15e850 0x7f4d8c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d8b200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c162e10 con 0x7f4d8c072d60 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d8b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c15ec30 con 0x7f4d8c072680 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d8b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8c070ea0 con 0x7f4d8c15e850 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072d60 0x7f4d8c15ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072d60 0x7f4d8c15ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45176/0 (socket says 172.21.15.22:45176) 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 -- 172.21.15.22:0/606642510 learned_addr learned my addr 172.21.15.22:0/606642510 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89e00640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d8c072680 0x7f4d8c14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d8a800640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c15e850 0x7f4d8c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 -- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c15e850 msgr2=0x7f4d8c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c15e850 0x7f4d8c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 -- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d8c072680 msgr2=0x7f4d8c14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d8c072680 0x7f4d8c14b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.215+0000 7f4d89400640 1 -- 172.21.15.22:0/606642510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c14b600 con 0x7f4d8c072d60 2024-04-16T16:20:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.216+0000 7f4d89400640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072d60 0x7f4d8c15ffb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.216+0000 7f4d82000640 1 -- 172.21.15.22:0/606642510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74035040 con 0x7f4d8c072d60 2024-04-16T16:20:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.216+0000 7f4d82000640 1 -- 172.21.15.22:0/606642510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d74030d00 con 0x7f4d8c072d60 2024-04-16T16:20:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.216+0000 7f4d82000640 1 -- 172.21.15.22:0/606642510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d740456a0 con 0x7f4d8c072d60 2024-04-16T16:20:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.216+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c160900 con 0x7f4d8c072d60 2024-04-16T16:20:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.216+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8c160ec0 con 0x7f4d8c072d60 2024-04-16T16:20:25.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.218+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d8c075f30 con 0x7f4d8c072d60 2024-04-16T16:20:25.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.219+0000 7f4d82000640 1 -- 172.21.15.22:0/606642510 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7f4d74038020 con 0x7f4d8c072d60 2024-04-16T16:20:25.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.219+0000 7f4d82000640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d6806ce30 0x7f4d6806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.220+0000 7f4d82000640 1 -- 172.21.15.22:0/606642510 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f4d740ae6a0 con 0x7f4d8c072d60 2024-04-16T16:20:25.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.220+0000 7f4d89e00640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d6806ce30 0x7f4d6806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.221+0000 7f4d89e00640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d6806ce30 0x7f4d6806f2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.224+0000 7f4d82000640 1 -- 172.21.15.22:0/606642510 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d7407c450 con 0x7f4d8c072d60 2024-04-16T16:20:25.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.467+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol64180", "snap_name": "subvol_snap76020", "target": ["mon-mgr", ""]}) -- 0x7f4d8c0afb80 con 0x7f4d6806ce30 2024-04-16T16:20:25.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.540+0000 7f4d82000640 1 -- 172.21.15.22:0/606642510 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4d8c0afb80 con 0x7f4d6806ce30 2024-04-16T16:20:25.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.543+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d6806ce30 msgr2=0x7f4d6806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.543+0000 7f4d8b200640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d6806ce30 0x7f4d6806f2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c008040 comp rx=0 tx=0).stop 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.543+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072d60 msgr2=0x7f4d8c15ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.543+0000 7f4d8b200640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072d60 0x7f4d8c15ffb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d740046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 shutdown_connections 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d6806ce30 0x7f4d6806f2f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d8c15e850 0x7f4d8c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d8c072d60 0x7f4d8c15ffb0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 --2- 172.21.15.22:0/606642510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d8c072680 0x7f4d8c14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 >> 172.21.15.22:0/606642510 conn(0x7f4d8c062440 msgr2=0x7f4d8c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 shutdown_connections 2024-04-16T16:20:25.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.544+0000 7f4d8b200640 1 -- 172.21.15.22:0/606642510 wait complete. 2024-04-16T16:20:25.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol64180 2024-04-16T16:20:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.787+0000 7fba48e00640 1 Processor -- start 2024-04-16T16:20:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.788+0000 7fba48e00640 1 -- start start 2024-04-16T16:20:25.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.789+0000 7fba48e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba4415eb60 0x7fba440cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.789+0000 7fba48e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba440d3ef0 con 0x7fba440d35f0 2024-04-16T16:20:25.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.789+0000 7fba48e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba440d41d0 con 0x7fba440d3a60 2024-04-16T16:20:25.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.789+0000 7fba48e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fba440d44b0 con 0x7fba4415eb60 2024-04-16T16:20:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.790+0000 7fba43400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba4415eb60 0x7fba440cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.790+0000 7fba42a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fba440d35f0 0x7fba440d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50778/0 (socket says 172.21.15.22:50778) 2024-04-16T16:20:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.790+0000 7fba42a00640 1 -- 172.21.15.22:0/363820774 learned_addr learned my addr 172.21.15.22:0/363820774 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.790+0000 7fba42000640 1 -- 172.21.15.22:0/363820774 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846071657 0 0) 0x7fba440d3ef0 con 0x7fba440d35f0 2024-04-16T16:20:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.790+0000 7fba43400640 1 -- 172.21.15.22:0/363820774 >> v1:172.21.15.43:6789/0 conn(0x7fba440d3a60 legacy=0x7fba440b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.790+0000 7fba43400640 1 -- 172.21.15.22:0/363820774 >> v1:172.21.15.22:6789/0 conn(0x7fba440d35f0 legacy=0x7fba440d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.790+0000 7fba43400640 1 -- 172.21.15.22:0/363820774 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba440b7db0 con 0x7fba4415eb60 2024-04-16T16:20:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.791+0000 7fba43400640 1 --2- 172.21.15.22:0/363820774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba4415eb60 0x7fba440cfcc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fba34009d90 tx=0x7fba3402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1581790ef860030c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba42000640 1 -- 172.21.15.22:0/363820774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34039070 con 0x7fba4415eb60 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba42000640 1 -- 172.21.15.22:0/363820774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3402cc60 con 0x7fba4415eb60 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba42000640 1 -- 172.21.15.22:0/363820774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34034660 con 0x7fba4415eb60 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba48e00640 1 -- 172.21.15.22:0/363820774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba4415eb60 msgr2=0x7fba440cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba48e00640 1 --2- 172.21.15.22:0/363820774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba4415eb60 0x7fba440cfcc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fba34009d90 tx=0x7fba3402beb0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba48e00640 1 -- 172.21.15.22:0/363820774 shutdown_connections 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba48e00640 1 --2- 172.21.15.22:0/363820774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba4415eb60 0x7fba440cfcc0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba48e00640 1 -- 172.21.15.22:0/363820774 >> 172.21.15.22:0/363820774 conn(0x7fba44072460 msgr2=0x7fba44072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba48e00640 1 -- 172.21.15.22:0/363820774 shutdown_connections 2024-04-16T16:20:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.792+0000 7fba48e00640 1 -- 172.21.15.22:0/363820774 wait complete. 2024-04-16T16:20:25.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.794+0000 7fba48e00640 1 Processor -- start 2024-04-16T16:20:25.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.794+0000 7fba48e00640 1 -- start start 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.795+0000 7fba48e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba440d35f0 0x7fba440ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.795+0000 7fba48e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba4415eb60 0x7fba441578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.795+0000 7fba48e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba44160480 0x7fba44160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.795+0000 7fba48e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba440d2030 con 0x7fba44160480 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.795+0000 7fba48e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba440d1eb0 con 0x7fba440d35f0 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.795+0000 7fba48e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fba440b89e0 con 0x7fba4415eb60 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba44160480 0x7fba44160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba44160480 0x7fba44160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45190/0 (socket says 172.21.15.22:45190) 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 -- 172.21.15.22:0/1295927242 learned_addr learned my addr 172.21.15.22:0/1295927242 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:25.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43400640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba440d35f0 0x7fba440ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba42a00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba4415eb60 0x7fba441578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 -- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba4415eb60 msgr2=0x7fba441578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba4415eb60 0x7fba441578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 -- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba440d35f0 msgr2=0x7fba440ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba440d35f0 0x7fba440ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.796+0000 7fba43e00640 1 -- 172.21.15.22:0/1295927242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba44160f20 con 0x7fba44160480 2024-04-16T16:20:25.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.797+0000 7fba43e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba44160480 0x7fba44160900 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c410 tx=0x7fba3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.797+0000 7fba3b400640 1 -- 172.21.15.22:0/1295927242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c017070 con 0x7fba44160480 2024-04-16T16:20:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.797+0000 7fba3b400640 1 -- 172.21.15.22:0/1295927242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c007230 con 0x7fba44160480 2024-04-16T16:20:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.797+0000 7fba3b400640 1 -- 172.21.15.22:0/1295927242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c007620 con 0x7fba44160480 2024-04-16T16:20:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.797+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba44161200 con 0x7fba44160480 2024-04-16T16:20:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.797+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba44158390 con 0x7fba44160480 2024-04-16T16:20:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.798+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba44075f30 con 0x7fba44160480 2024-04-16T16:20:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.799+0000 7fba3b400640 1 -- 172.21.15.22:0/1295927242 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) ==== 91499+0+0 (secure 0 0 0) 0x7fba3c01a070 con 0x7fba44160480 2024-04-16T16:20:25.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.800+0000 7fba3b400640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fba2006ce30 0x7fba2006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:25.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.800+0000 7fba3b400640 1 -- 172.21.15.22:0/1295927242 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fba3c08b6f0 con 0x7fba44160480 2024-04-16T16:20:25.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.800+0000 7fba43400640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fba2006ce30 0x7fba2006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:25.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.801+0000 7fba43400640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fba2006ce30 0x7fba2006f2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fba34036000 tx=0x7fba34030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:25.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:25.805+0000 7fba3b400640 1 -- 172.21.15.22:0/1295927242 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba3c0594a0 con 0x7fba44160480 2024-04-16T16:20:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.045+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol64180", "target": ["mon-mgr", ""]}) -- 0x7fba44068f70 con 0x7fba2006ce30 2024-04-16T16:20:26.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.085+0000 7fba3b400640 1 -- 172.21.15.22:0/1295927242 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fba44068f70 con 0x7fba2006ce30 2024-04-16T16:20:26.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.088+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fba2006ce30 msgr2=0x7fba2006f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:26.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.088+0000 7fba48e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fba2006ce30 0x7fba2006f2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fba34036000 tx=0x7fba34030000 comp rx=0 tx=0).stop 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.088+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba44160480 msgr2=0x7fba44160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.088+0000 7fba48e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba44160480 0x7fba44160900 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c410 tx=0x7fba3c00c8d0 comp rx=0 tx=0).stop 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 shutdown_connections 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fba2006ce30 0x7fba2006f2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba44160480 0x7fba44160900 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba4415eb60 0x7fba441578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 --2- 172.21.15.22:0/1295927242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba440d35f0 0x7fba440ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 >> 172.21.15.22:0/1295927242 conn(0x7fba44072460 msgr2=0x7fba4415de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 shutdown_connections 2024-04-16T16:20:26.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26.089+0000 7fba48e00640 1 -- 172.21.15.22:0/1295927242 wait complete. 2024-04-16T16:20:26.113 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-16T16:20:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:20:26.232 INFO:teuthology.orchestra.run.smithi022.stdout:3 2024-04-16T16:20:26.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:20:31.243 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-16T16:20:31.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T16:20:31.364 INFO:teuthology.orchestra.run.smithi022.stdout:2 2024-04-16T16:20:31.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T16:20:31.374 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T16:20:31.375 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:20:31.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:20:31.623 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T16:20:31.624 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:20:31.624 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:31.624 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:31.685 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:31.685 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:31.743 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.975+0000 7f6119200640 1 Processor -- start 2024-04-16T16:20:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.976+0000 7f6119200640 1 -- start start 2024-04-16T16:20:31.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.977+0000 7f6119200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f611415ed60 0x7f61140d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:31.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.977+0000 7f6119200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f61140cffa0 0x7f61140b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.977+0000 7f6119200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61140d39a0 con 0x7f61140d3420 2024-04-16T16:20:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.977+0000 7f6119200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f61140d3c80 con 0x7f611415ed60 2024-04-16T16:20:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.977+0000 7f6119200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f61140d3f60 con 0x7f61140cffa0 2024-04-16T16:20:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.978+0000 7f6111e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f611415ed60 0x7f61140d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.978+0000 7f6111e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f611415ed60 0x7f61140d2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45494/0 (socket says 172.21.15.22:45494) 2024-04-16T16:20:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.978+0000 7f6111e00640 1 -- 172.21.15.22:0/455878137 learned_addr learned my addr 172.21.15.22:0/455878137 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.978+0000 7f6112800640 1 --2- 172.21.15.22:0/455878137 >> v2:172.21.15.43:3300/0 conn(0x7f61140cffa0 0x7f61140b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.978+0000 7f6111e00640 1 -- 172.21.15.22:0/455878137 >> v2:172.21.15.43:3300/0 conn(0x7f61140cffa0 msgr2=0x7f61140b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.978+0000 7f6111e00640 1 --2- 172.21.15.22:0/455878137 >> v2:172.21.15.43:3300/0 conn(0x7f61140cffa0 0x7f61140b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.979+0000 7f6111e00640 1 -- 172.21.15.22:0/455878137 >> v1:172.21.15.43:6789/0 conn(0x7f61140d3420 legacy=0x7f61140cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.979+0000 7f6111e00640 1 -- 172.21.15.22:0/455878137 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61140d4240 con 0x7f611415ed60 2024-04-16T16:20:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.979+0000 7f6112800640 1 --2- 172.21.15.22:0/455878137 >> v2:172.21.15.43:3300/0 conn(0x7f61140cffa0 0x7f61140b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:31.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.980+0000 7f6111e00640 1 --2- 172.21.15.22:0/455878137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f611415ed60 0x7f61140d2ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e50 tx=0x7f610402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb732596bbab641 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:31.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6110a00640 1 -- 172.21.15.22:0/455878137 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610402cbb0 con 0x7f611415ed60 2024-04-16T16:20:31.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6110a00640 1 -- 172.21.15.22:0/455878137 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610402cd50 con 0x7f611415ed60 2024-04-16T16:20:31.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6110a00640 1 -- 172.21.15.22:0/455878137 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104034610 con 0x7f611415ed60 2024-04-16T16:20:31.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6119200640 1 -- 172.21.15.22:0/455878137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f611415ed60 msgr2=0x7f61140d2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:31.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6119200640 1 --2- 172.21.15.22:0/455878137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f611415ed60 0x7f61140d2ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e50 tx=0x7f610402c010 comp rx=0 tx=0).stop 2024-04-16T16:20:31.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6119200640 1 -- 172.21.15.22:0/455878137 shutdown_connections 2024-04-16T16:20:31.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6119200640 1 --2- 172.21.15.22:0/455878137 >> v2:172.21.15.43:3300/0 conn(0x7f61140cffa0 0x7f61140b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:31.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.981+0000 7f6119200640 1 --2- 172.21.15.22:0/455878137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f611415ed60 0x7f61140d2ee0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:31.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.982+0000 7f6119200640 1 -- 172.21.15.22:0/455878137 >> 172.21.15.22:0/455878137 conn(0x7f6114062620 msgr2=0x7f6114062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:31.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.982+0000 7f6119200640 1 -- 172.21.15.22:0/455878137 shutdown_connections 2024-04-16T16:20:31.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.982+0000 7f6119200640 1 -- 172.21.15.22:0/455878137 wait complete. 2024-04-16T16:20:31.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.983+0000 7f6119200640 1 Processor -- start 2024-04-16T16:20:31.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.984+0000 7f6119200640 1 -- start start 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.984+0000 7f6119200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61140cffa0 0x7f61141542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6119200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61140d3420 0x7f6114155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6119200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f611415ed60 0x7f611415f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6119200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61140ba970 con 0x7f61140cffa0 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6119200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f611415f140 con 0x7f61140d3420 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6119200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f61140b81a0 con 0x7f611415ed60 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61140cffa0 0x7f61141542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61140cffa0 0x7f61141542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45506/0 (socket says 172.21.15.22:45506) 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 -- 172.21.15.22:0/2171282048 learned_addr learned my addr 172.21.15.22:0/2171282048 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 -- 172.21.15.22:0/2171282048 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f611415ed60 msgr2=0x7f611415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f611415ed60 0x7f611415f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:31.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 -- 172.21.15.22:0/2171282048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61140d3420 msgr2=0x7f6114155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61140d3420 0x7f6114155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.985+0000 7f6111e00640 1 -- 172.21.15.22:0/2171282048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61141592a0 con 0x7f61140cffa0 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.986+0000 7f6111e00640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61140cffa0 0x7f61141542e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6104036040 tx=0x7f6104004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.986+0000 7f610a000640 1 -- 172.21.15.22:0/2171282048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104043020 con 0x7f61140cffa0 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.986+0000 7f610a000640 1 -- 172.21.15.22:0/2171282048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610403e450 con 0x7f61140cffa0 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.986+0000 7f610a000640 1 -- 172.21.15.22:0/2171282048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104009510 con 0x7f61140cffa0 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.986+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6114159580 con 0x7f61140cffa0 2024-04-16T16:20:31.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.986+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6114155960 con 0x7f61140cffa0 2024-04-16T16:20:31.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.987+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611404fd90 con 0x7f61140cffa0 2024-04-16T16:20:31.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.988+0000 7f610a000640 1 -- 172.21.15.22:0/2171282048 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f6104046020 con 0x7f61140cffa0 2024-04-16T16:20:31.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.989+0000 7f610a000640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f60f006cec0 0x7f60f006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:31.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.989+0000 7f610a000640 1 -- 172.21.15.22:0/2171282048 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f61040aede0 con 0x7f61140cffa0 2024-04-16T16:20:31.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.990+0000 7f6111400640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f60f006cec0 0x7f60f006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:31.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.990+0000 7f6111400640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f60f006cec0 0x7f60f006f380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000f60 tx=0x7f60fc0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:31.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:31.994+0000 7f610a000640 1 -- 172.21.15.22:0/2171282048 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61040b4020 con 0x7f61140cffa0 2024-04-16T16:20:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.199+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61140b9ca0 con 0x7f61140cffa0 2024-04-16T16:20:32.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.201+0000 7f610a000640 1 -- 172.21.15.22:0/2171282048 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16693 (secure 0 0 0) 0x7f610404d030 con 0x7f61140cffa0 2024-04-16T16:20:32.201 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:32.201 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:30.213166+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:32.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.204+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f60f006cec0 msgr2=0x7f60f006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.204+0000 7f6119200640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f60f006cec0 0x7f60f006f380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000f60 tx=0x7f60fc0079d0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.204+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61140cffa0 msgr2=0x7f61141542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.204+0000 7f6119200640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61140cffa0 0x7f61141542e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6104036040 tx=0x7f6104004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:32.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 shutdown_connections 2024-04-16T16:20:32.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f60f006cec0 0x7f60f006f380 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f611415ed60 0x7f611415f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61140d3420 0x7f6114155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 --2- 172.21.15.22:0/2171282048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61140cffa0 0x7f61141542e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 >> 172.21.15.22:0/2171282048 conn(0x7f6114062620 msgr2=0x7f61140d4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:32.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 shutdown_connections 2024-04-16T16:20:32.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.205+0000 7f6119200640 1 -- 172.21.15.22:0/2171282048 wait complete. 2024-04-16T16:20:32.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:19:28.116371+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:19:29.218326+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:20:32.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:20:32.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.455+0000 7f7c04000640 1 Processor -- start 2024-04-16T16:20:32.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.456+0000 7f7c04000640 1 -- start start 2024-04-16T16:20:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.457+0000 7f7c04000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 0x7f7bfc06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.457+0000 7f7c04000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7bfc0cf240 0x7f7bfc0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.457+0000 7f7c04000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc15c1a0 con 0x7f7bfc0d0b70 2024-04-16T16:20:32.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.457+0000 7f7c04000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc0d0fc0 con 0x7f7bfc0cf240 2024-04-16T16:20:32.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.457+0000 7f7c04000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc145680 con 0x7f7bfc1452a0 2024-04-16T16:20:32.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.458+0000 7f7c02000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7bfc0d0b70 0x7f7bfc06d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35618/0 (socket says 172.21.15.22:35618) 2024-04-16T16:20:32.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.458+0000 7f7c02000640 1 -- 172.21.15.22:0/2841500640 learned_addr learned my addr 172.21.15.22:0/2841500640 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.458+0000 7f7c01600640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 0x7f7bfc06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.458+0000 7f7c00c00640 1 --2- 172.21.15.22:0/2841500640 >> v2:172.21.15.43:3300/0 conn(0x7f7bfc0cf240 0x7f7bfc0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.458+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544037563 0 0) 0x7f7bfc15c1a0 con 0x7f7bfc0d0b70 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.458+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7be4003520 con 0x7f7bfc0d0b70 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749002030 0 0) 0x7f7be4003520 con 0x7f7bfc0d0b70 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 msgr2=0x7f7bfc06e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 0x7f7bfc06e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 >> v2:172.21.15.43:3300/0 conn(0x7f7bfc0cf240 msgr2=0x7f7bfc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:32.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/2841500640 >> v2:172.21.15.43:3300/0 conn(0x7f7bfc0cf240 0x7f7bfc0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc15c480 con 0x7f7bfc0d0b70 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f7bf40019f0 con 0x7f7bfc0d0b70 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 >> v1:172.21.15.22:6789/0 conn(0x7f7bfc0d0b70 legacy=0x7f7bfc06d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7be40039b0 0x7f7be4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be4004800 0x7f7be4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 0x7f7be40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0d0fc0 con 0x7f7be40039b0 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc145680 con 0x7f7be4004800 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7be400dc20 con 0x7f7bfc1452a0 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.459+0000 7f7c01600640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7be40039b0 0x7f7be4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c00c00640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be4004800 0x7f7be4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c02000640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 0x7f7be40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c01600640 1 -- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 msgr2=0x7f7be40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:32.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c01600640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 0x7f7be40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c01600640 1 -- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be4004800 msgr2=0x7f7be4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:32.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c01600640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be4004800 0x7f7be4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c01600640 1 -- 172.21.15.22:0/2841500640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be4003520 con 0x7f7be40039b0 2024-04-16T16:20:32.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.460+0000 7f7c02000640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc1452a0 0x7f7be40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.461+0000 7f7c01600640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7be40039b0 0x7f7be4003dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009ac0 tx=0x7f7be4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf4380a3746a66c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.461+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0039070 con 0x7f7be40039b0 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.461+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf002c6b0 con 0x7f7be40039b0 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.461+0000 7f7bfbe00640 1 -- 172.21.15.22:0/2841500640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0009690 con 0x7f7be40039b0 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.462+0000 7f7c04000640 1 -- 172.21.15.22:0/2841500640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7be40039b0 msgr2=0x7f7be4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.462+0000 7f7c04000640 1 --2- 172.21.15.22:0/2841500640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7be40039b0 0x7f7be4003dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009ac0 tx=0x7f7be4005830 comp rx=0 tx=0).stop 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.462+0000 7f7c02000640 1 -- 172.21.15.22:0/2841500640 reap_dead start 2024-04-16T16:20:32.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.462+0000 7f7c04000640 1 -- 172.21.15.22:0/2841500640 shutdown_connections 2024-04-16T16:20:32.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.462+0000 7f7c04000640 1 -- 172.21.15.22:0/2841500640 >> 172.21.15.22:0/2841500640 conn(0x7f7bfc0b37e0 msgr2=0x7f7bfc0b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:32.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.462+0000 7f7c04000640 1 -- 172.21.15.22:0/2841500640 shutdown_connections 2024-04-16T16:20:32.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.462+0000 7f7c04000640 1 -- 172.21.15.22:0/2841500640 wait complete. 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.464+0000 7f7c04000640 1 Processor -- start 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.464+0000 7f7c04000640 1 -- start start 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c04000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be40039b0 0x7f7bfc13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c04000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bfc15afb0 0x7f7bfc1f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c04000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc150ec0 0x7f7bfc13eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c04000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc15be50 con 0x7f7bfc15afb0 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c04000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc15ca40 con 0x7f7be40039b0 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c04000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc15df70 con 0x7f7bfc150ec0 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c00c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bfc15afb0 0x7f7bfc1f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c00c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bfc15afb0 0x7f7bfc1f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45532/0 (socket says 172.21.15.22:45532) 2024-04-16T16:20:32.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.465+0000 7f7c00c00640 1 -- 172.21.15.22:0/629072212 learned_addr learned my addr 172.21.15.22:0/629072212 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c01600640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be40039b0 0x7f7bfc13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c02000640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc150ec0 0x7f7bfc13eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c00c00640 1 -- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc150ec0 msgr2=0x7f7bfc13eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c00c00640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc150ec0 0x7f7bfc13eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c00c00640 1 -- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be40039b0 msgr2=0x7f7bfc13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c00c00640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be40039b0 0x7f7bfc13d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c00c00640 1 -- 172.21.15.22:0/629072212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc15b7b0 con 0x7f7bfc15afb0 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c00c00640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bfc15afb0 0x7f7bfc1f05d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7be800f600 tx=0x7f7be800fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7bf9600640 1 -- 172.21.15.22:0/629072212 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8019020 con 0x7f7bfc15afb0 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7bf9600640 1 -- 172.21.15.22:0/629072212 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be8014870 con 0x7f7bfc15afb0 2024-04-16T16:20:32.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7bf9600640 1 -- 172.21.15.22:0/629072212 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8014c20 con 0x7f7bfc15afb0 2024-04-16T16:20:32.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.466+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc13dad0 con 0x7f7bfc15afb0 2024-04-16T16:20:32.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.467+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc13e090 con 0x7f7bfc15afb0 2024-04-16T16:20:32.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.468+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bfc071200 con 0x7f7bfc15afb0 2024-04-16T16:20:32.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.469+0000 7f7bf9600640 1 -- 172.21.15.22:0/629072212 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f7be801c020 con 0x7f7bfc15afb0 2024-04-16T16:20:32.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.470+0000 7f7bf9600640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7bdc06cec0 0x7f7bdc06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.470+0000 7f7bf9600640 1 -- 172.21.15.22:0/629072212 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f7be808cdc0 con 0x7f7bfc15afb0 2024-04-16T16:20:32.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.470+0000 7f7c01600640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7bdc06cec0 0x7f7bdc06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.471+0000 7f7c01600640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7bdc06cec0 0x7f7bdc06f380 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0036000 tx=0x7f7bf0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.474+0000 7f7bf9600640 1 -- 172.21.15.22:0/629072212 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7bfc071200 con 0x7f7bfc15afb0 2024-04-16T16:20:32.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.677+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7bfc04fd90 con 0x7f7bfc15afb0 2024-04-16T16:20:32.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.678+0000 7f7bf9600640 1 -- 172.21.15.22:0/629072212 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7f7be8023020 con 0x7f7bfc15afb0 2024-04-16T16:20:32.676 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:20:32.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7bdc06cec0 msgr2=0x7f7bdc06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7bdc06cec0 0x7f7bdc06f380 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0036000 tx=0x7f7bf0030000 comp rx=0 tx=0).stop 2024-04-16T16:20:32.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bfc15afb0 msgr2=0x7f7bfc1f05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bfc15afb0 0x7f7bfc1f05d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7be800f600 tx=0x7f7be800fac0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 shutdown_connections 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7bdc06cec0 0x7f7bdc06f380 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bfc150ec0 0x7f7bfc13eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bfc15afb0 0x7f7bfc1f05d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 --2- 172.21.15.22:0/629072212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be40039b0 0x7f7bfc13d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.680+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 >> 172.21.15.22:0/629072212 conn(0x7f7bfc0b37e0 msgr2=0x7f7bfc15ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.681+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 shutdown_connections 2024-04-16T16:20:32.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.681+0000 7f7c04000640 1 -- 172.21.15.22:0/629072212 wait complete. 2024-04-16T16:20:32.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:20:32.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.922+0000 7f6499a00640 1 Processor -- start 2024-04-16T16:20:32.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.922+0000 7f6499a00640 1 -- start start 2024-04-16T16:20:32.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6499a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6499a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f64940b2960 0x7f6494071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6499a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6494073420 con 0x7f649415c8d0 2024-04-16T16:20:32.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6499a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f64940b2db0 con 0x7f64940b2960 2024-04-16T16:20:32.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6499a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6494072eb0 con 0x7f649415db60 2024-04-16T16:20:32.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6493400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f64940b2960 0x7f6494071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6493400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f64940b2960 0x7f6494071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45540/0 (socket says 172.21.15.22:45540) 2024-04-16T16:20:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.924+0000 7f6493400640 1 -- 172.21.15.22:0/339004693 learned_addr learned my addr 172.21.15.22:0/339004693 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.925+0000 7f6492000640 1 --2- 172.21.15.22:0/339004693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.925+0000 7f6493400640 1 -- 172.21.15.22:0/339004693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 msgr2=0x7f64940b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.925+0000 7f6493400640 1 --2- 172.21.15.22:0/339004693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.925+0000 7f6493400640 1 -- 172.21.15.22:0/339004693 >> v1:172.21.15.43:6789/0 conn(0x7f649415c8d0 legacy=0x7f64940727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.925+0000 7f6493400640 1 -- 172.21.15.22:0/339004693 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6494073140 con 0x7f64940b2960 2024-04-16T16:20:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.925+0000 7f6492000640 1 --2- 172.21.15.22:0/339004693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.926+0000 7f6493400640 1 --2- 172.21.15.22:0/339004693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64940b2960 0x7f6494071110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f648c009e50 tx=0x7f648c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b72c6e32af65342 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6491600640 1 -- 172.21.15.22:0/339004693 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c02cb00 con 0x7f64940b2960 2024-04-16T16:20:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6491600640 1 -- 172.21.15.22:0/339004693 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c02cca0 con 0x7f64940b2960 2024-04-16T16:20:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6491600640 1 -- 172.21.15.22:0/339004693 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c034610 con 0x7f64940b2960 2024-04-16T16:20:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6499a00640 1 -- 172.21.15.22:0/339004693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64940b2960 msgr2=0x7f6494071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6499a00640 1 --2- 172.21.15.22:0/339004693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64940b2960 0x7f6494071110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f648c009e50 tx=0x7f648c02bf60 comp rx=0 tx=0).stop 2024-04-16T16:20:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6499a00640 1 -- 172.21.15.22:0/339004693 shutdown_connections 2024-04-16T16:20:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6499a00640 1 --2- 172.21.15.22:0/339004693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64940b2960 0x7f6494071110 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6499a00640 1 --2- 172.21.15.22:0/339004693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6499a00640 1 -- 172.21.15.22:0/339004693 >> 172.21.15.22:0/339004693 conn(0x7f6494062440 msgr2=0x7f6494062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:32.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.927+0000 7f6499a00640 1 -- 172.21.15.22:0/339004693 shutdown_connections 2024-04-16T16:20:32.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.928+0000 7f6499a00640 1 -- 172.21.15.22:0/339004693 wait complete. 2024-04-16T16:20:32.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.929+0000 7f6499a00640 1 Processor -- start 2024-04-16T16:20:32.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.929+0000 7f6499a00640 1 -- start start 2024-04-16T16:20:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.930+0000 7f6499a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64940b2960 0x7f6494152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.930+0000 7f6499a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f649415c8d0 0x7f64940c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.930+0000 7f6499a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.930+0000 7f6499a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f649415d640 con 0x7f649415c8d0 2024-04-16T16:20:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.930+0000 7f6499a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f649415d360 con 0x7f64940b2960 2024-04-16T16:20:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.930+0000 7f6499a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f649415ccb0 con 0x7f649415db60 2024-04-16T16:20:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f649415c8d0 0x7f64940c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f649415c8d0 0x7f64940c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45550/0 (socket says 172.21.15.22:45550) 2024-04-16T16:20:32.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 -- 172.21.15.22:0/3356016838 learned_addr learned my addr 172.21.15.22:0/3356016838 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64940b2960 0x7f6494152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6493400640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 -- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 msgr2=0x7f64940cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 -- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64940b2960 msgr2=0x7f6494152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64940b2960 0x7f6494152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 -- 172.21.15.22:0/3356016838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64940c6000 con 0x7f649415c8d0 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6493400640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64940b2960 0x7f6494152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.931+0000 7f6492000640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f649415c8d0 0x7f64940c5700 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f648000d7d0 tx=0x7f648000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.932+0000 7f648aa00640 1 -- 172.21.15.22:0/3356016838 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480004030 con 0x7f649415c8d0 2024-04-16T16:20:32.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.932+0000 7f648aa00640 1 -- 172.21.15.22:0/3356016838 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64800041d0 con 0x7f649415c8d0 2024-04-16T16:20:32.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.932+0000 7f648aa00640 1 -- 172.21.15.22:0/3356016838 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648000b660 con 0x7f649415c8d0 2024-04-16T16:20:32.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.932+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64940c62e0 con 0x7f649415c8d0 2024-04-16T16:20:32.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.932+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64940c68a0 con 0x7f649415c8d0 2024-04-16T16:20:32.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.933+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649404fd90 con 0x7f649415c8d0 2024-04-16T16:20:32.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.934+0000 7f648aa00640 1 -- 172.21.15.22:0/3356016838 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f648000b800 con 0x7f649415c8d0 2024-04-16T16:20:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.935+0000 7f648aa00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f647406cec0 0x7f647406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.935+0000 7f648aa00640 1 -- 172.21.15.22:0/3356016838 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f648008c8b0 con 0x7f649415c8d0 2024-04-16T16:20:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.936+0000 7f6492a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f647406cec0 0x7f647406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.936+0000 7f6492a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f647406cec0 0x7f647406f380 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6484001680 tx=0x7f6484009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:32.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:32.940+0000 7f648aa00640 1 -- 172.21.15.22:0/3356016838 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f648005a400 con 0x7f649415c8d0 2024-04-16T16:20:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.144+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f649415ff80 con 0x7f649415c8d0 2024-04-16T16:20:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.145+0000 7f648aa00640 1 -- 172.21.15.22:0/3356016838 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) ==== 104+0+11 (secure 0 0 0) 0x7f6480059d00 con 0x7f649415c8d0 2024-04-16T16:20:33.144 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:20:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f647406cec0 msgr2=0x7f647406f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f647406cec0 0x7f647406f380 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6484001680 tx=0x7f6484009040 comp rx=0 tx=0).stop 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f649415c8d0 msgr2=0x7f64940c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f649415c8d0 0x7f64940c5700 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f648000d7d0 tx=0x7f648000dc90 comp rx=0 tx=0).stop 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 shutdown_connections 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f647406cec0 0x7f647406f380 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649415db60 0x7f64940cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f649415c8d0 0x7f64940c5700 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 --2- 172.21.15.22:0/3356016838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64940b2960 0x7f6494152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 >> 172.21.15.22:0/3356016838 conn(0x7f6494062440 msgr2=0x7f64940d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 shutdown_connections 2024-04-16T16:20:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.148+0000 7f6499a00640 1 -- 172.21.15.22:0/3356016838 wait complete. 2024-04-16T16:20:33.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:20:33.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.391+0000 7fb428c00640 1 Processor -- start 2024-04-16T16:20:33.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.391+0000 7fb428c00640 1 -- start start 2024-04-16T16:20:33.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb428c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb4240b4fa0 0x7fb424070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb428c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb42415fe30 0x7fb4240ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb428c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4240715c0 con 0x7fb4240b33a0 2024-04-16T16:20:33.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb428c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb424071360 con 0x7fb42415fe30 2024-04-16T16:20:33.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb428c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb4240718a0 con 0x7fb4240b4fa0 2024-04-16T16:20:33.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb41be00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb4240b33a0 0x7fb42415f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35634/0 (socket says 172.21.15.22:35634) 2024-04-16T16:20:33.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb41be00640 1 -- 172.21.15.22:0/1851921835 learned_addr learned my addr 172.21.15.22:0/1851921835 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:33.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb423e00640 1 --2- 172.21.15.22:0/1851921835 >> v2:172.21.15.22:3300/0 conn(0x7fb42415fe30 0x7fb4240ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.393+0000 7fb423400640 1 --2- 172.21.15.22:0/1851921835 >> v2:172.21.15.43:3300/0 conn(0x7fb4240b4fa0 0x7fb424070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.394+0000 7fb422a00640 1 -- 172.21.15.22:0/1851921835 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775932930 0 0) 0x7fb4240715c0 con 0x7fb4240b33a0 2024-04-16T16:20:33.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.394+0000 7fb423e00640 1 -- 172.21.15.22:0/1851921835 >> v2:172.21.15.43:3300/0 conn(0x7fb4240b4fa0 msgr2=0x7fb424070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:33.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.394+0000 7fb423e00640 1 --2- 172.21.15.22:0/1851921835 >> v2:172.21.15.43:3300/0 conn(0x7fb4240b4fa0 0x7fb424070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.394+0000 7fb423e00640 1 -- 172.21.15.22:0/1851921835 >> v1:172.21.15.22:6789/0 conn(0x7fb4240b33a0 legacy=0x7fb42415f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.394+0000 7fb423e00640 1 -- 172.21.15.22:0/1851921835 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb424071b80 con 0x7fb42415fe30 2024-04-16T16:20:33.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.395+0000 7fb423e00640 1 --2- 172.21.15.22:0/1851921835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42415fe30 0x7fb4240ceb30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb4240d1510 tx=0x7fb41c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2930b74ad5e0c895 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:33.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.395+0000 7fb422a00640 1 -- 172.21.15.22:0/1851921835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c039070 con 0x7fb42415fe30 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.395+0000 7fb422a00640 1 -- 172.21.15.22:0/1851921835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41c02cc80 con 0x7fb42415fe30 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.395+0000 7fb422a00640 1 -- 172.21.15.22:0/1851921835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c034660 con 0x7fb42415fe30 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 -- 172.21.15.22:0/1851921835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42415fe30 msgr2=0x7fb4240ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 --2- 172.21.15.22:0/1851921835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42415fe30 0x7fb4240ceb30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb4240d1510 tx=0x7fb41c02bed0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 -- 172.21.15.22:0/1851921835 shutdown_connections 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 --2- 172.21.15.22:0/1851921835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42415fe30 0x7fb4240ceb30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 --2- 172.21.15.22:0/1851921835 >> v2:172.21.15.43:3300/0 conn(0x7fb4240b4fa0 0x7fb424070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 -- 172.21.15.22:0/1851921835 >> 172.21.15.22:0/1851921835 conn(0x7fb424075070 msgr2=0x7fb424062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 -- 172.21.15.22:0/1851921835 shutdown_connections 2024-04-16T16:20:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.396+0000 7fb428c00640 1 -- 172.21.15.22:0/1851921835 wait complete. 2024-04-16T16:20:33.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.398+0000 7fb428c00640 1 Processor -- start 2024-04-16T16:20:33.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.398+0000 7fb428c00640 1 -- start start 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb428c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4240b33a0 0x7fb4241437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb428c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4240b4fa0 0x7fb4241461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb428c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb42415fe30 0x7fb4241521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb428c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb4240b5380 con 0x7fb4240b4fa0 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb428c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb4240ce630 con 0x7fb4240b33a0 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb428c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb4240b5500 con 0x7fb42415fe30 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb41be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4240b4fa0 0x7fb4241461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb41be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4240b4fa0 0x7fb4241461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45578/0 (socket says 172.21.15.22:45578) 2024-04-16T16:20:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.399+0000 7fb41be00640 1 -- 172.21.15.22:0/2703980289 learned_addr learned my addr 172.21.15.22:0/2703980289 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb423400640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4240b33a0 0x7fb4241437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41be00640 1 -- 172.21.15.22:0/2703980289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb42415fe30 msgr2=0x7fb4241521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41be00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb42415fe30 0x7fb4241521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41be00640 1 -- 172.21.15.22:0/2703980289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4240b33a0 msgr2=0x7fb4241437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41be00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4240b33a0 0x7fb4241437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41be00640 1 -- 172.21.15.22:0/2703980289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb424146ba0 con 0x7fb4240b4fa0 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41be00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4240b4fa0 0x7fb4241461c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c4d0 tx=0x7fb40c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41b400640 1 -- 172.21.15.22:0/2703980289 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c018070 con 0x7fb4240b4fa0 2024-04-16T16:20:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41b400640 1 -- 172.21.15.22:0/2703980289 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40c007500 con 0x7fb4240b4fa0 2024-04-16T16:20:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb424146e80 con 0x7fb4240b4fa0 2024-04-16T16:20:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.400+0000 7fb41b400640 1 -- 172.21.15.22:0/2703980289 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c004a20 con 0x7fb4240b4fa0 2024-04-16T16:20:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.401+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb424143d30 con 0x7fb4240b4fa0 2024-04-16T16:20:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.402+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb424075f30 con 0x7fb4240b4fa0 2024-04-16T16:20:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.403+0000 7fb41b400640 1 -- 172.21.15.22:0/2703980289 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fb40c01b070 con 0x7fb4240b4fa0 2024-04-16T16:20:33.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.404+0000 7fb41b400640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb40006ce90 0x7fb40006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.404+0000 7fb41b400640 1 -- 172.21.15.22:0/2703980289 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fb40c08b900 con 0x7fb4240b4fa0 2024-04-16T16:20:33.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.404+0000 7fb423400640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb40006ce90 0x7fb40006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.405+0000 7fb423400640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb40006ce90 0x7fb40006f350 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb414009a10 tx=0x7fb414008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:33.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.409+0000 7fb41b400640 1 -- 172.21.15.22:0/2703980289 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb40c0594e0 con 0x7fb4240b4fa0 2024-04-16T16:20:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.615+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb4240d0cf0 con 0x7fb4240b4fa0 2024-04-16T16:20:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.616+0000 7fb41b400640 1 -- 172.21.15.22:0/2703980289 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) ==== 100+0+11 (secure 0 0 0) 0x7fb40c058de0 con 0x7fb4240b4fa0 2024-04-16T16:20:33.615 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:20:33.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb40006ce90 msgr2=0x7fb40006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb40006ce90 0x7fb40006f350 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb414009a10 tx=0x7fb414008040 comp rx=0 tx=0).stop 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4240b4fa0 msgr2=0x7fb4241461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4240b4fa0 0x7fb4241461c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c4d0 tx=0x7fb40c00c990 comp rx=0 tx=0).stop 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 shutdown_connections 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb40006ce90 0x7fb40006f350 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb42415fe30 0x7fb4241521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4240b4fa0 0x7fb4241461c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 --2- 172.21.15.22:0/2703980289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4240b33a0 0x7fb4241437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.619+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 >> 172.21.15.22:0/2703980289 conn(0x7fb424075070 msgr2=0x7fb42415cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.620+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 shutdown_connections 2024-04-16T16:20:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.620+0000 7fb428c00640 1 -- 172.21.15.22:0/2703980289 wait complete. 2024-04-16T16:20:33.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:20:33.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.868+0000 7fbdeaa00640 1 Processor -- start 2024-04-16T16:20:33.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.869+0000 7fbdeaa00640 1 -- start start 2024-04-16T16:20:33.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.870+0000 7fbdeaa00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbde415eb30 0x7fbde40d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.870+0000 7fbdeaa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbde40d2fb0 0x7fbde40b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.870+0000 7fbdeaa00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde40d4650 con 0x7fbde40d1770 2024-04-16T16:20:33.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.870+0000 7fbdeaa00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbde415ef10 con 0x7fbde40d2fb0 2024-04-16T16:20:33.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.870+0000 7fbdeaa00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbde40d35b0 con 0x7fbde415eb30 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbdea000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbde40d2fb0 0x7fbde40b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbdea000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbde40d2fb0 0x7fbde40b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45584/0 (socket says 172.21.15.22:45584) 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbdea000640 1 -- 172.21.15.22:0/3322381093 learned_addr learned my addr 172.21.15.22:0/3322381093 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbde9600640 1 --2- 172.21.15.22:0/3322381093 >> v2:172.21.15.43:3300/0 conn(0x7fbde415eb30 0x7fbde40d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbdea000640 1 -- 172.21.15.22:0/3322381093 >> v2:172.21.15.43:3300/0 conn(0x7fbde415eb30 msgr2=0x7fbde40d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbdea000640 1 --2- 172.21.15.22:0/3322381093 >> v2:172.21.15.43:3300/0 conn(0x7fbde415eb30 0x7fbde40d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbdea000640 1 -- 172.21.15.22:0/3322381093 >> v1:172.21.15.43:6789/0 conn(0x7fbde40d1770 legacy=0x7fbde40d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:33.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.871+0000 7fbdea000640 1 -- 172.21.15.22:0/3322381093 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde40d1be0 con 0x7fbde40d2fb0 2024-04-16T16:20:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.872+0000 7fbdea000640 1 --2- 172.21.15.22:0/3322381093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde40d2fb0 0x7fbde40b7950 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbde40d1200 tx=0x7fbddc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7f8a24b6904226 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbde3e00640 1 -- 172.21.15.22:0/3322381093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc035020 con 0x7fbde40d2fb0 2024-04-16T16:20:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbde3e00640 1 -- 172.21.15.22:0/3322381093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc031870 con 0x7fbde40d2fb0 2024-04-16T16:20:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbde3e00640 1 -- 172.21.15.22:0/3322381093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc031c40 con 0x7fbde40d2fb0 2024-04-16T16:20:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbdeaa00640 1 -- 172.21.15.22:0/3322381093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde40d2fb0 msgr2=0x7fbde40b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/3322381093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde40d2fb0 0x7fbde40b7950 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbde40d1200 tx=0x7fbddc02b910 comp rx=0 tx=0).stop 2024-04-16T16:20:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbdeaa00640 1 -- 172.21.15.22:0/3322381093 shutdown_connections 2024-04-16T16:20:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/3322381093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde40d2fb0 0x7fbde40b7950 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/3322381093 >> v2:172.21.15.43:3300/0 conn(0x7fbde415eb30 0x7fbde40d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.873+0000 7fbdeaa00640 1 -- 172.21.15.22:0/3322381093 >> 172.21.15.22:0/3322381093 conn(0x7fbde4072670 msgr2=0x7fbde4062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:33.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.874+0000 7fbdeaa00640 1 -- 172.21.15.22:0/3322381093 shutdown_connections 2024-04-16T16:20:33.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.874+0000 7fbdeaa00640 1 -- 172.21.15.22:0/3322381093 wait complete. 2024-04-16T16:20:33.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.875+0000 7fbdeaa00640 1 Processor -- start 2024-04-16T16:20:33.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.876+0000 7fbdeaa00640 1 -- start start 2024-04-16T16:20:33.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.876+0000 7fbdeaa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbde40d1770 0x7fbde40b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdeaa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbde40d2fb0 0x7fbde414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdeaa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde415eb30 0x7fbde414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdeaa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbde40d3e50 con 0x7fbde415eb30 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdeaa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbde40d3b70 con 0x7fbde40d2fb0 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdeaa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbde40d4130 con 0x7fbde40d1770 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde415eb30 0x7fbde414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde415eb30 0x7fbde414d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45590/0 (socket says 172.21.15.22:45590) 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 -- 172.21.15.22:0/351516850 learned_addr learned my addr 172.21.15.22:0/351516850 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbde9600640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbde40d1770 0x7fbde40b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbde8c00640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbde40d2fb0 0x7fbde414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 -- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbde40d1770 msgr2=0x7fbde40b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbde40d1770 0x7fbde40b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 -- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbde40d2fb0 msgr2=0x7fbde414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:33.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbde40d2fb0 0x7fbde414d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.877+0000 7fbdea000640 1 -- 172.21.15.22:0/351516850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde40b5b00 con 0x7fbde415eb30 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.878+0000 7fbdea000640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde415eb30 0x7fbde414d890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbddc02b950 tx=0x7fbddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.878+0000 7fbde1600640 1 -- 172.21.15.22:0/351516850 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc040070 con 0x7fbde415eb30 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.878+0000 7fbde1600640 1 -- 172.21.15.22:0/351516850 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc030d00 con 0x7fbde415eb30 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.878+0000 7fbde1600640 1 -- 172.21.15.22:0/351516850 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc035040 con 0x7fbde415eb30 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.878+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde40b5de0 con 0x7fbde415eb30 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.878+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde40b63a0 con 0x7fbde415eb30 2024-04-16T16:20:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.880+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde4075f30 con 0x7fbde415eb30 2024-04-16T16:20:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.881+0000 7fbde1600640 1 -- 172.21.15.22:0/351516850 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fbddc038020 con 0x7fbde415eb30 2024-04-16T16:20:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.882+0000 7fbde1600640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbdc406ce90 0x7fbdc406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.882+0000 7fbde1600640 1 -- 172.21.15.22:0/351516850 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fbddc0ae490 con 0x7fbde415eb30 2024-04-16T16:20:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.882+0000 7fbde9600640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbdc406ce90 0x7fbdc406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.883+0000 7fbde9600640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbdc406ce90 0x7fbdc406f350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4006fd0 tx=0x7fbdd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:33.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:33.886+0000 7fbde1600640 1 -- 172.21.15.22:0/351516850 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbddc07bfe0 con 0x7fbde415eb30 2024-04-16T16:20:34.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.104+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbde40c8460 con 0x7fbde415eb30 2024-04-16T16:20:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.105+0000 7fbde1600640 1 -- 172.21.15.22:0/351516850 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) ==== 80+0+0 (secure 0 0 0) 0x7fbddc080e20 con 0x7fbde415eb30 2024-04-16T16:20:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:20:34.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbdc406ce90 msgr2=0x7fbdc406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:34.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbdc406ce90 0x7fbdc406f350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4006fd0 tx=0x7fbdd4008040 comp rx=0 tx=0).stop 2024-04-16T16:20:34.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde415eb30 msgr2=0x7fbde414d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:34.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde415eb30 0x7fbde414d890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbddc02b950 tx=0x7fbddc0046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 shutdown_connections 2024-04-16T16:20:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbdc406ce90 0x7fbdc406f350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde415eb30 0x7fbde414d890 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbde40d2fb0 0x7fbde414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 --2- 172.21.15.22:0/351516850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbde40d1770 0x7fbde40b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 >> 172.21.15.22:0/351516850 conn(0x7fbde4072670 msgr2=0x7fbde40cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 shutdown_connections 2024-04-16T16:20:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.108+0000 7fbdeaa00640 1 -- 172.21.15.22:0/351516850 wait complete. 2024-04-16T16:20:34.127 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-16T16:20:34.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:34.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-16T16:20:34.288 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:20:34.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:34.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T16:20:34.345 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:20:34.345 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:20:34.345 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:34.385 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:20:34.385 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:34.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:34.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.689+0000 7f8d73400640 1 Processor -- start 2024-04-16T16:20:34.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.689+0000 7f8d73400640 1 -- start start 2024-04-16T16:20:34.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.690+0000 7f8d73400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c0afd90 0x7f8d6c072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:34.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.690+0000 7f8d73400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c06dc80 0x7f8d6c0d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:34.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.690+0000 7f8d73400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6c1606d0 con 0x7f8d6c073050 2024-04-16T16:20:34.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.690+0000 7f8d73400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6c160480 con 0x7f8d6c0afd90 2024-04-16T16:20:34.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.690+0000 7f8d73400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6c1609b0 con 0x7f8d6c06dc80 2024-04-16T16:20:34.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d70a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c0afd90 0x7f8d6c072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:34.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d70a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c0afd90 0x7f8d6c072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45602/0 (socket says 172.21.15.22:45602) 2024-04-16T16:20:34.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d70a00640 1 -- 172.21.15.22:0/1965026476 learned_addr learned my addr 172.21.15.22:0/1965026476 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:34.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d6be00640 1 --2- 172.21.15.22:0/1965026476 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c06dc80 0x7f8d6c0d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d70a00640 1 -- 172.21.15.22:0/1965026476 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c06dc80 msgr2=0x7f8d6c0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d70a00640 1 --2- 172.21.15.22:0/1965026476 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c06dc80 0x7f8d6c0d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d70a00640 1 -- 172.21.15.22:0/1965026476 >> v1:172.21.15.43:6789/0 conn(0x7f8d6c073050 legacy=0x7f8d6c071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.691+0000 7f8d70a00640 1 -- 172.21.15.22:0/1965026476 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c160c90 con 0x7f8d6c0afd90 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.693+0000 7f8d70a00640 1 --2- 172.21.15.22:0/1965026476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c0afd90 0x7f8d6c072b10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009e50 tx=0x7f8d5c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc22f8f8878693a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.693+0000 7f8d6b400640 1 -- 172.21.15.22:0/1965026476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c02c9e0 con 0x7f8d6c0afd90 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.693+0000 7f8d6b400640 1 -- 172.21.15.22:0/1965026476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5c02cb80 con 0x7f8d6c0afd90 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.693+0000 7f8d6b400640 1 -- 172.21.15.22:0/1965026476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0343f0 con 0x7f8d6c0afd90 2024-04-16T16:20:34.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.693+0000 7f8d73400640 1 -- 172.21.15.22:0/1965026476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c0afd90 msgr2=0x7f8d6c072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.693+0000 7f8d73400640 1 --2- 172.21.15.22:0/1965026476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c0afd90 0x7f8d6c072b10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009e50 tx=0x7f8d5c02be40 comp rx=0 tx=0).stop 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.694+0000 7f8d73400640 1 -- 172.21.15.22:0/1965026476 shutdown_connections 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.694+0000 7f8d73400640 1 --2- 172.21.15.22:0/1965026476 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c06dc80 0x7f8d6c0d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.694+0000 7f8d73400640 1 --2- 172.21.15.22:0/1965026476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c0afd90 0x7f8d6c072b10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.694+0000 7f8d73400640 1 -- 172.21.15.22:0/1965026476 >> 172.21.15.22:0/1965026476 conn(0x7f8d6c062440 msgr2=0x7f8d6c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.694+0000 7f8d73400640 1 -- 172.21.15.22:0/1965026476 shutdown_connections 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.694+0000 7f8d73400640 1 -- 172.21.15.22:0/1965026476 wait complete. 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.695+0000 7f8d73400640 1 Processor -- start 2024-04-16T16:20:34.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.696+0000 7f8d73400640 1 -- start start 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d73400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d6c06dc80 0x7f8d6c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d73400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c073050 0x7f8d6c14e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d73400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c0afd90 0x7f8d6c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d73400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c0ce8a0 con 0x7f8d6c073050 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d73400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c0b0170 con 0x7f8d6c06dc80 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d73400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6c0cea20 con 0x7f8d6c0afd90 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c073050 0x7f8d6c14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c073050 0x7f8d6c14e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45604/0 (socket says 172.21.15.22:45604) 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 -- 172.21.15.22:0/2069524640 learned_addr learned my addr 172.21.15.22:0/2069524640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d70a00640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d6c06dc80 0x7f8d6c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d71400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c0afd90 0x7f8d6c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:34.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 -- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c0afd90 msgr2=0x7f8d6c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c0afd90 0x7f8d6c15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 -- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d6c06dc80 msgr2=0x7f8d6c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d6c06dc80 0x7f8d6c152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d6be00640 1 -- 172.21.15.22:0/2069524640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c15e700 con 0x7f8d6c073050 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.697+0000 7f8d71400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c0afd90 0x7f8d6c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.698+0000 7f8d6be00640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c073050 0x7f8d6c14e570 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400c820 tx=0x7f8d5400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.698+0000 7f8d68c00640 1 -- 172.21.15.22:0/2069524640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54015070 con 0x7f8d6c073050 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.698+0000 7f8d68c00640 1 -- 172.21.15.22:0/2069524640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d54004220 con 0x7f8d6c073050 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.698+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c15e9e0 con 0x7f8d6c073050 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.698+0000 7f8d68c00640 1 -- 172.21.15.22:0/2069524640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400ce10 con 0x7f8d6c073050 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.698+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c15efa0 con 0x7f8d6c073050 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.699+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c15f1a0 con 0x7f8d6c073050 2024-04-16T16:20:34.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.700+0000 7f8d68c00640 1 -- 172.21.15.22:0/2069524640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f8d540077d0 con 0x7f8d6c073050 2024-04-16T16:20:34.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.702+0000 7f8d68c00640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d4806ce90 0x7f8d4806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:34.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.702+0000 7f8d68c00640 1 -- 172.21.15.22:0/2069524640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f8d5408c470 con 0x7f8d6c073050 2024-04-16T16:20:34.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.702+0000 7f8d70a00640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d4806ce90 0x7f8d4806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:34.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.703+0000 7f8d70a00640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d4806ce90 0x7f8d4806f350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c035000 tx=0x7f8d5c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:34.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.706+0000 7f8d68c00640 1 -- 172.21.15.22:0/2069524640 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d6c15f1a0 con 0x7f8d6c073050 2024-04-16T16:20:34.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.910+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d6c04fd90 con 0x7f8d6c073050 2024-04-16T16:20:34.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.913+0000 7f8d68c00640 1 -- 172.21.15.22:0/2069524640 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16693 (secure 0 0 0) 0x7f8d54059f00 con 0x7f8d6c073050 2024-04-16T16:20:34.912 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:34.912 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:30.213166+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.915+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d4806ce90 msgr2=0x7f8d4806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d4806ce90 0x7f8d4806f350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c035000 tx=0x7f8d5c030000 comp rx=0 tx=0).stop 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c073050 msgr2=0x7f8d6c14e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c073050 0x7f8d6c14e570 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400c820 tx=0x7f8d5400cce0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 shutdown_connections 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8d4806ce90 0x7f8d4806f350 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d6c0afd90 0x7f8d6c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c073050 0x7f8d6c14e570 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 --2- 172.21.15.22:0/2069524640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d6c06dc80 0x7f8d6c152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 >> 172.21.15.22:0/2069524640 conn(0x7f8d6c062440 msgr2=0x7f8d6c15c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 shutdown_connections 2024-04-16T16:20:34.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:34.916+0000 7f8d73400640 1 -- 172.21.15.22:0/2069524640 wait complete. 2024-04-16T16:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:19:28.116371+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:19:29.218326+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:20:34.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:20:35.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.148+0000 7fdf66a00640 1 Processor -- start 2024-04-16T16:20:35.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.149+0000 7fdf66a00640 1 -- start start 2024-04-16T16:20:35.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.150+0000 7fdf66a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf6015eb40 0x7fdf600cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.150+0000 7fdf66a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf600d3ed0 con 0x7fdf600d3a40 2024-04-16T16:20:35.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.150+0000 7fdf66a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf600d41b0 con 0x7fdf600d35d0 2024-04-16T16:20:35.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.150+0000 7fdf66a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fdf600d4490 con 0x7fdf6015eb40 2024-04-16T16:20:35.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.150+0000 7fdf65600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf6015eb40 0x7fdf600cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.150+0000 7fdf65600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf6015eb40 0x7fdf600cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45614/0 (socket says 172.21.15.22:45614) 2024-04-16T16:20:35.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.150+0000 7fdf65600640 1 -- 172.21.15.22:0/1283791358 learned_addr learned my addr 172.21.15.22:0/1283791358 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:35.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.151+0000 7fdf65600640 1 -- 172.21.15.22:0/1283791358 >> v1:172.21.15.43:6789/0 conn(0x7fdf600d35d0 legacy=0x7fdf600d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:35.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.151+0000 7fdf65600640 1 -- 172.21.15.22:0/1283791358 >> v1:172.21.15.22:6789/0 conn(0x7fdf600d3a40 legacy=0x7fdf600b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.151+0000 7fdf65600640 1 -- 172.21.15.22:0/1283791358 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf600b7d90 con 0x7fdf6015eb40 2024-04-16T16:20:35.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.152+0000 7fdf65600640 1 --2- 172.21.15.22:0/1283791358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf6015eb40 0x7fdf600cfca0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009870 tx=0x7fdf5002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41e2860df64c985 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:35.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.152+0000 7fdf5fe00640 1 -- 172.21.15.22:0/1283791358 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50034070 con 0x7fdf6015eb40 2024-04-16T16:20:35.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.152+0000 7fdf5fe00640 1 -- 172.21.15.22:0/1283791358 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf50030860 con 0x7fdf6015eb40 2024-04-16T16:20:35.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.152+0000 7fdf5fe00640 1 -- 172.21.15.22:0/1283791358 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50030c30 con 0x7fdf6015eb40 2024-04-16T16:20:35.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.153+0000 7fdf66a00640 1 -- 172.21.15.22:0/1283791358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf6015eb40 msgr2=0x7fdf600cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.153+0000 7fdf66a00640 1 --2- 172.21.15.22:0/1283791358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf6015eb40 0x7fdf600cfca0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009870 tx=0x7fdf5002b9a0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.153+0000 7fdf66a00640 1 -- 172.21.15.22:0/1283791358 shutdown_connections 2024-04-16T16:20:35.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.153+0000 7fdf66a00640 1 --2- 172.21.15.22:0/1283791358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf6015eb40 0x7fdf600cfca0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.153+0000 7fdf66a00640 1 -- 172.21.15.22:0/1283791358 >> 172.21.15.22:0/1283791358 conn(0x7fdf60072460 msgr2=0x7fdf60072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:35.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.153+0000 7fdf66a00640 1 -- 172.21.15.22:0/1283791358 shutdown_connections 2024-04-16T16:20:35.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.153+0000 7fdf66a00640 1 -- 172.21.15.22:0/1283791358 wait complete. 2024-04-16T16:20:35.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.155+0000 7fdf66a00640 1 Processor -- start 2024-04-16T16:20:35.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.155+0000 7fdf66a00640 1 -- start start 2024-04-16T16:20:35.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.156+0000 7fdf66a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf600d35d0 0x7fdf60160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.156+0000 7fdf66a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6015eb40 0x7fdf600c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.156+0000 7fdf66a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf601528c0 0x7fdf600c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.156+0000 7fdf66a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdf600d2010 con 0x7fdf601528c0 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.156+0000 7fdf66a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdf600d1e90 con 0x7fdf6015eb40 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.156+0000 7fdf66a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdf600b89c0 con 0x7fdf600d35d0 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.156+0000 7fdf66000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf601528c0 0x7fdf600c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf601528c0 0x7fdf600c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45630/0 (socket says 172.21.15.22:45630) 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 -- 172.21.15.22:0/293638388 learned_addr learned my addr 172.21.15.22:0/293638388 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf64c00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6015eb40 0x7fdf600c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf65600640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf600d35d0 0x7fdf60160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 -- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf600d35d0 msgr2=0x7fdf60160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf600d35d0 0x7fdf60160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 -- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6015eb40 msgr2=0x7fdf600c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6015eb40 0x7fdf600c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 -- 172.21.15.22:0/293638388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf600caa90 con 0x7fdf601528c0 2024-04-16T16:20:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf65600640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf600d35d0 0x7fdf60160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf64c00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6015eb40 0x7fdf600c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.157+0000 7fdf66000640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf601528c0 0x7fdf600c9ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c730 tx=0x7fdf5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.158+0000 7fdf5d600640 1 -- 172.21.15.22:0/293638388 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58003b70 con 0x7fdf601528c0 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.158+0000 7fdf5d600640 1 -- 172.21.15.22:0/293638388 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf58003d10 con 0x7fdf601528c0 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.158+0000 7fdf5d600640 1 -- 172.21.15.22:0/293638388 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800aa90 con 0x7fdf601528c0 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.158+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf600cad70 con 0x7fdf601528c0 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.158+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf600c9a20 con 0x7fdf601528c0 2024-04-16T16:20:35.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.159+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf600c8dd0 con 0x7fdf601528c0 2024-04-16T16:20:35.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.160+0000 7fdf5d600640 1 -- 172.21.15.22:0/293638388 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fdf5800ac30 con 0x7fdf601528c0 2024-04-16T16:20:35.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.161+0000 7fdf5d600640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf4006ce90 0x7fdf4006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.161+0000 7fdf5d600640 1 -- 172.21.15.22:0/293638388 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fdf5808c610 con 0x7fdf601528c0 2024-04-16T16:20:35.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.161+0000 7fdf65600640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf4006ce90 0x7fdf4006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.162+0000 7fdf65600640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf4006ce90 0x7fdf4006f350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdf50036000 tx=0x7fdf5003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:35.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.166+0000 7fdf5d600640 1 -- 172.21.15.22:0/293638388 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf5805a120 con 0x7fdf601528c0 2024-04-16T16:20:35.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.370+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf60068f70 con 0x7fdf601528c0 2024-04-16T16:20:35.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.371+0000 7fdf5d600640 1 -- 172.21.15.22:0/293638388 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7fdf58059a20 con 0x7fdf601528c0 2024-04-16T16:20:35.370 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:20:35.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf4006ce90 msgr2=0x7fdf4006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf4006ce90 0x7fdf4006f350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdf50036000 tx=0x7fdf5003b040 comp rx=0 tx=0).stop 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf601528c0 msgr2=0x7fdf600c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf601528c0 0x7fdf600c9ec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c730 tx=0x7fdf5800cbf0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 shutdown_connections 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fdf4006ce90 0x7fdf4006f350 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf601528c0 0x7fdf600c9ec0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6015eb40 0x7fdf600c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.373+0000 7fdf66a00640 1 --2- 172.21.15.22:0/293638388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf600d35d0 0x7fdf60160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.374+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 >> 172.21.15.22:0/293638388 conn(0x7fdf60072460 msgr2=0x7fdf600b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.374+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 shutdown_connections 2024-04-16T16:20:35.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.374+0000 7fdf66a00640 1 -- 172.21.15.22:0/293638388 wait complete. 2024-04-16T16:20:35.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:20:35.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.613+0000 7f3029e00640 1 Processor -- start 2024-04-16T16:20:35.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.613+0000 7f3029e00640 1 -- start start 2024-04-16T16:20:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.614+0000 7f3029e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30240b3d60 0x7f30240d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.614+0000 7f3029e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30240cfb10 0x7f30240cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.614+0000 7f3029e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3024163a30 con 0x7f3024162d00 2024-04-16T16:20:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.614+0000 7f3029e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f30240d04e0 con 0x7f30240cfb10 2024-04-16T16:20:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.614+0000 7f3029e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f30240d2f70 con 0x7f30240b3d60 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f3023400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3024162d00 0x7f3024163170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35654/0 (socket says 172.21.15.22:35654) 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f3023400640 1 -- 172.21.15.22:0/572761504 learned_addr learned my addr 172.21.15.22:0/572761504 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f301a000640 1 --2- 172.21.15.22:0/572761504 >> v2:172.21.15.22:3300/0 conn(0x7f30240cfb10 0x7f30240cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f3022a00640 1 --2- 172.21.15.22:0/572761504 >> v2:172.21.15.43:3300/0 conn(0x7f30240b3d60 0x7f30240d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f301a000640 1 -- 172.21.15.22:0/572761504 >> v2:172.21.15.43:3300/0 conn(0x7f30240b3d60 msgr2=0x7f30240d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f301a000640 1 --2- 172.21.15.22:0/572761504 >> v2:172.21.15.43:3300/0 conn(0x7f30240b3d60 0x7f30240d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f301a000640 1 -- 172.21.15.22:0/572761504 >> v1:172.21.15.22:6789/0 conn(0x7f3024162d00 legacy=0x7f3024163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f301a000640 1 -- 172.21.15.22:0/572761504 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240d3250 con 0x7f30240cfb10 2024-04-16T16:20:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.615+0000 7f3022000640 1 -- 172.21.15.22:0/572761504 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110466162 0 0) 0x7f3024163a30 con 0x7f3024162d00 2024-04-16T16:20:35.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.616+0000 7f301a000640 1 --2- 172.21.15.22:0/572761504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240cfb10 0x7f30240cffa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f30240d1a30 tx=0x7f300c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d4eed351c6bdd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3022000640 1 -- 172.21.15.22:0/572761504 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0315a0 con 0x7f30240cfb10 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3022000640 1 -- 172.21.15.22:0/572761504 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c037070 con 0x7f30240cfb10 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3022000640 1 -- 172.21.15.22:0/572761504 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c031960 con 0x7f30240cfb10 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3029e00640 1 -- 172.21.15.22:0/572761504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240cfb10 msgr2=0x7f30240cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3029e00640 1 --2- 172.21.15.22:0/572761504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240cfb10 0x7f30240cffa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f30240d1a30 tx=0x7f300c02b840 comp rx=0 tx=0).stop 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3029e00640 1 -- 172.21.15.22:0/572761504 shutdown_connections 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3029e00640 1 --2- 172.21.15.22:0/572761504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240cfb10 0x7f30240cffa0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3029e00640 1 --2- 172.21.15.22:0/572761504 >> v2:172.21.15.43:3300/0 conn(0x7f30240b3d60 0x7f30240d3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3029e00640 1 -- 172.21.15.22:0/572761504 >> 172.21.15.22:0/572761504 conn(0x7f3024062860 msgr2=0x7f3024062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.617+0000 7f3029e00640 1 -- 172.21.15.22:0/572761504 shutdown_connections 2024-04-16T16:20:35.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.618+0000 7f3029e00640 1 -- 172.21.15.22:0/572761504 wait complete. 2024-04-16T16:20:35.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.619+0000 7f3029e00640 1 Processor -- start 2024-04-16T16:20:35.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.619+0000 7f3029e00640 1 -- start start 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.620+0000 7f3029e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240b3d60 0x7f3024156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.620+0000 7f3029e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30240cfb10 0x7f30240ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.620+0000 7f3029e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3024162d00 0x7f30240c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.620+0000 7f3029e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30240d4270 con 0x7f30240b3d60 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.620+0000 7f3029e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30240d3810 con 0x7f30240cfb10 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.620+0000 7f3029e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f30240b4140 con 0x7f3024162d00 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240b3d60 0x7f3024156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240b3d60 0x7f3024156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45654/0 (socket says 172.21.15.22:45654) 2024-04-16T16:20:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 -- 172.21.15.22:0/3229849436 learned_addr learned my addr 172.21.15.22:0/3229849436 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f301a000640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30240cfb10 0x7f30240ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3023400640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3024162d00 0x7f30240c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 -- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3024162d00 msgr2=0x7f30240c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3024162d00 0x7f30240c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 -- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30240cfb10 msgr2=0x7f30240ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30240cfb10 0x7f30240ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.621+0000 7f3022a00640 1 -- 172.21.15.22:0/3229849436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240cea40 con 0x7f30240b3d60 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.622+0000 7f3022a00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240b3d60 0x7f3024156fb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f301400d5f0 tx=0x7f301400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.622+0000 7f301be00640 1 -- 172.21.15.22:0/3229849436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140125f0 con 0x7f30240b3d60 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.622+0000 7f301be00640 1 -- 172.21.15.22:0/3229849436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3014019070 con 0x7f30240b3d60 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.622+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302415ad00 con 0x7f30240b3d60 2024-04-16T16:20:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.622+0000 7f301be00640 1 -- 172.21.15.22:0/3229849436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140129d0 con 0x7f30240b3d60 2024-04-16T16:20:35.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.622+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302415b2c0 con 0x7f30240b3d60 2024-04-16T16:20:35.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.623+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302404fd90 con 0x7f30240b3d60 2024-04-16T16:20:35.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.624+0000 7f301be00640 1 -- 172.21.15.22:0/3229849436 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f3014012b70 con 0x7f30240b3d60 2024-04-16T16:20:35.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.625+0000 7f301be00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f300006ce90 0x7f300006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:35.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.625+0000 7f301be00640 1 -- 172.21.15.22:0/3229849436 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f301408c9f0 con 0x7f30240b3d60 2024-04-16T16:20:35.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.625+0000 7f301a000640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f300006ce90 0x7f300006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:35.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.626+0000 7f301a000640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f300006ce90 0x7f300006f350 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f300c036000 tx=0x7f300c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:35.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.630+0000 7f301be00640 1 -- 172.21.15.22:0/3229849436 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f301405a590 con 0x7f30240b3d60 2024-04-16T16:20:35.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.836+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f30240d29f0 con 0x7f30240b3d60 2024-04-16T16:20:35.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.837+0000 7f301be00640 1 -- 172.21.15.22:0/3229849436 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) ==== 104+0+11 (secure 0 0 0) 0x7f3014059e90 con 0x7f30240b3d60 2024-04-16T16:20:35.836 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.839+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f300006ce90 msgr2=0x7f300006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.839+0000 7f3029e00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f300006ce90 0x7f300006f350 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f300c036000 tx=0x7f300c03d040 comp rx=0 tx=0).stop 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240b3d60 msgr2=0x7f3024156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240b3d60 0x7f3024156fb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f301400d5f0 tx=0x7f301400dab0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 shutdown_connections 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f300006ce90 0x7f300006f350 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3024162d00 0x7f30240c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30240cfb10 0x7f30240ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 --2- 172.21.15.22:0/3229849436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30240b3d60 0x7f3024156fb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 >> 172.21.15.22:0/3229849436 conn(0x7f3024062860 msgr2=0x7f3024062c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 shutdown_connections 2024-04-16T16:20:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:35.840+0000 7f3029e00640 1 -- 172.21.15.22:0/3229849436 wait complete. 2024-04-16T16:20:35.859 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:20:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.083+0000 7fe887200640 1 Processor -- start 2024-04-16T16:20:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.084+0000 7fe887200640 1 -- start start 2024-04-16T16:20:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.085+0000 7fe887200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe88815fe30 0x7fe888070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.085+0000 7fe887200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe8880b33a0 0x7fe8880ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.085+0000 7fe887200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880715c0 con 0x7fe8880b4fa0 2024-04-16T16:20:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.085+0000 7fe887200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe888071360 con 0x7fe8880b33a0 2024-04-16T16:20:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.085+0000 7fe887200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880718a0 con 0x7fe88815fe30 2024-04-16T16:20:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.086+0000 7fe886800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe8880b33a0 0x7fe8880ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.086+0000 7fe886800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe8880b33a0 0x7fe8880ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:53156/0 (socket says 172.21.15.22:53156) 2024-04-16T16:20:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.086+0000 7fe886800640 1 -- 172.21.15.22:0/889680866 learned_addr learned my addr 172.21.15.22:0/889680866 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.086+0000 7fe885400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe88815fe30 0x7fe888070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.087+0000 7fe886800640 1 -- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe88815fe30 msgr2=0x7fe888070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.087+0000 7fe886800640 1 --2- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe88815fe30 0x7fe888070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.087+0000 7fe886800640 1 -- 172.21.15.22:0/889680866 >> v1:172.21.15.43:6789/0 conn(0x7fe8880b4fa0 legacy=0x7fe88815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.087+0000 7fe886800640 1 -- 172.21.15.22:0/889680866 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe888071b80 con 0x7fe8880b33a0 2024-04-16T16:20:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.087+0000 7fe885400640 1 --2- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe88815fe30 0x7fe888070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:20:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.088+0000 7fe886800640 1 --2- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b33a0 0x7fe8880ceb30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe880009e50 tx=0x7fe88002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d01c05387ed1483 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.088+0000 7fe884a00640 1 -- 172.21.15.22:0/889680866 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88002cb00 con 0x7fe8880b33a0 2024-04-16T16:20:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe884a00640 1 -- 172.21.15.22:0/889680866 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88002cca0 con 0x7fe8880b33a0 2024-04-16T16:20:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe884a00640 1 -- 172.21.15.22:0/889680866 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880034610 con 0x7fe8880b33a0 2024-04-16T16:20:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 -- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b33a0 msgr2=0x7fe8880ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 --2- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b33a0 0x7fe8880ceb30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe880009e50 tx=0x7fe88002bf60 comp rx=0 tx=0).stop 2024-04-16T16:20:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 -- 172.21.15.22:0/889680866 shutdown_connections 2024-04-16T16:20:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 --2- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b33a0 0x7fe8880ceb30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 --2- 172.21.15.22:0/889680866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe88815fe30 0x7fe888070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 -- 172.21.15.22:0/889680866 >> 172.21.15.22:0/889680866 conn(0x7fe888075070 msgr2=0x7fe888062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 -- 172.21.15.22:0/889680866 shutdown_connections 2024-04-16T16:20:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.089+0000 7fe887200640 1 -- 172.21.15.22:0/889680866 wait complete. 2024-04-16T16:20:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.091+0000 7fe887200640 1 Processor -- start 2024-04-16T16:20:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.091+0000 7fe887200640 1 -- start start 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe887200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8880b33a0 0x7fe8881e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe887200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b4fa0 0x7fe88815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe887200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe88815fe30 0x7fe88814be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe887200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880b5380 con 0x7fe88815fe30 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe887200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880ce630 con 0x7fe8880b4fa0 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe887200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880b5500 con 0x7fe8880b33a0 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe886800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe88815fe30 0x7fe88814be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe886800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe88815fe30 0x7fe88814be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45656/0 (socket says 172.21.15.22:45656) 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.092+0000 7fe886800640 1 -- 172.21.15.22:0/151625983 learned_addr learned my addr 172.21.15.22:0/151625983 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe885400640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b4fa0 0x7fe88815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe885e00640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8880b33a0 0x7fe8881e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe886800640 1 -- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8880b33a0 msgr2=0x7fe8881e4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe886800640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8880b33a0 0x7fe8881e4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe886800640 1 -- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b4fa0 msgr2=0x7fe88815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe886800640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b4fa0 0x7fe88815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe886800640 1 -- 172.21.15.22:0/151625983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88814c340 con 0x7fe88815fe30 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe885e00640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8880b33a0 0x7fe8881e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.093+0000 7fe886800640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe88815fe30 0x7fe88814be00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe880009f70 tx=0x7fe880004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.094+0000 7fe87e000640 1 -- 172.21.15.22:0/151625983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880043020 con 0x7fe88815fe30 2024-04-16T16:20:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.094+0000 7fe87e000640 1 -- 172.21.15.22:0/151625983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88002ce50 con 0x7fe88815fe30 2024-04-16T16:20:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.094+0000 7fe87e000640 1 -- 172.21.15.22:0/151625983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880009510 con 0x7fe88815fe30 2024-04-16T16:20:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.094+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8881599c0 con 0x7fe88815fe30 2024-04-16T16:20:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.094+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe888159f80 con 0x7fe88815fe30 2024-04-16T16:20:36.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.095+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe888075f30 con 0x7fe88815fe30 2024-04-16T16:20:36.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.096+0000 7fe87e000640 1 -- 172.21.15.22:0/151625983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fe880046020 con 0x7fe88815fe30 2024-04-16T16:20:36.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.098+0000 7fe87e000640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe86806ce90 0x7fe86806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.098+0000 7fe87e000640 1 -- 172.21.15.22:0/151625983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7fe8800aecd0 con 0x7fe88815fe30 2024-04-16T16:20:36.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.098+0000 7fe885e00640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe86806ce90 0x7fe86806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.099+0000 7fe885e00640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe86806ce90 0x7fe86806f350 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe878001680 tx=0x7fe878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:36.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.102+0000 7fe87e000640 1 -- 172.21.15.22:0/151625983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe88004d030 con 0x7fe88815fe30 2024-04-16T16:20:36.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.308+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe88815ca00 con 0x7fe88815fe30 2024-04-16T16:20:36.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.309+0000 7fe87e000640 1 -- 172.21.15.22:0/151625983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) ==== 100+0+11 (secure 0 0 0) 0x7fe88003c350 con 0x7fe88815fe30 2024-04-16T16:20:36.308 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:20:36.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe86806ce90 msgr2=0x7fe86806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe86806ce90 0x7fe86806f350 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe878001680 tx=0x7fe878009040 comp rx=0 tx=0).stop 2024-04-16T16:20:36.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe88815fe30 msgr2=0x7fe88814be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe88815fe30 0x7fe88814be00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe880009f70 tx=0x7fe880004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:36.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 shutdown_connections 2024-04-16T16:20:36.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe86806ce90 0x7fe86806f350 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe88815fe30 0x7fe88814be00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880b4fa0 0x7fe88815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 --2- 172.21.15.22:0/151625983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8880b33a0 0x7fe8881e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.312+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 >> 172.21.15.22:0/151625983 conn(0x7fe888075070 msgr2=0x7fe88806d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:36.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.313+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 shutdown_connections 2024-04-16T16:20:36.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.313+0000 7fe887200640 1 -- 172.21.15.22:0/151625983 wait complete. 2024-04-16T16:20:36.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T16:20:36.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.561+0000 7f9252800640 1 Processor -- start 2024-04-16T16:20:36.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.561+0000 7f9252800640 1 -- start start 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f9252800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f924c0d0bc0 0x7f924c167760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f9252800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924c161540 con 0x7f924c15c990 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f9252800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924c0afd80 con 0x7f924c072fc0 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f9252800640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f924c160780 con 0x7f924c0d0bc0 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f924be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f924c0d0bc0 0x7f924c167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f924b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f924c15c990 0x7f924c0728b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35658/0 (socket says 172.21.15.22:35658) 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f924be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f924c0d0bc0 0x7f924c167760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45662/0 (socket says 172.21.15.22:45662) 2024-04-16T16:20:36.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.563+0000 7f924b400640 1 -- 172.21.15.22:0/1275384911 learned_addr learned my addr 172.21.15.22:0/1275384911 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:36.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.564+0000 7f924be00640 1 -- 172.21.15.22:0/1275384911 >> v1:172.21.15.43:6789/0 conn(0x7f924c072fc0 legacy=0x7f924c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.564+0000 7f924be00640 1 -- 172.21.15.22:0/1275384911 >> v1:172.21.15.22:6789/0 conn(0x7f924c15c990 legacy=0x7f924c0728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.564+0000 7f924be00640 1 -- 172.21.15.22:0/1275384911 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924c160a60 con 0x7f924c0d0bc0 2024-04-16T16:20:36.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.564+0000 7f924a000640 1 -- 172.21.15.22:0/1275384911 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834748430 0 0) 0x7f924c161540 con 0x7f924c15c990 2024-04-16T16:20:36.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.565+0000 7f924be00640 1 --2- 172.21.15.22:0/1275384911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c0d0bc0 0x7f924c167760 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f92440097a0 tx=0x7f924402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f499f912fefa8587 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:36.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f924a000640 1 -- 172.21.15.22:0/1275384911 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244035020 con 0x7f924c0d0bc0 2024-04-16T16:20:36.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f924a000640 1 -- 172.21.15.22:0/1275384911 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9244031830 con 0x7f924c0d0bc0 2024-04-16T16:20:36.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f924a000640 1 -- 172.21.15.22:0/1275384911 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244031c00 con 0x7f924c0d0bc0 2024-04-16T16:20:36.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f9252800640 1 -- 172.21.15.22:0/1275384911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c0d0bc0 msgr2=0x7f924c167760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f9252800640 1 --2- 172.21.15.22:0/1275384911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c0d0bc0 0x7f924c167760 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f92440097a0 tx=0x7f924402b8d0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f9252800640 1 -- 172.21.15.22:0/1275384911 shutdown_connections 2024-04-16T16:20:36.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f9252800640 1 --2- 172.21.15.22:0/1275384911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c0d0bc0 0x7f924c167760 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f9252800640 1 -- 172.21.15.22:0/1275384911 >> 172.21.15.22:0/1275384911 conn(0x7f924c062440 msgr2=0x7f924c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:36.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.566+0000 7f9252800640 1 -- 172.21.15.22:0/1275384911 shutdown_connections 2024-04-16T16:20:36.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.567+0000 7f9252800640 1 -- 172.21.15.22:0/1275384911 wait complete. 2024-04-16T16:20:36.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.569+0000 7f9252800640 1 Processor -- start 2024-04-16T16:20:36.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.569+0000 7f9252800640 1 -- start start 2024-04-16T16:20:36.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f9252800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f924c072fc0 0x7f924c15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f9252800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f924c0d0bc0 0x7f924c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f9252800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c15c990 0x7f924c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f9252800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f924c0b4630 con 0x7f924c15c990 2024-04-16T16:20:36.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f9252800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f924c161020 con 0x7f924c0d0bc0 2024-04-16T16:20:36.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f9252800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f924c15cd70 con 0x7f924c072fc0 2024-04-16T16:20:36.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f924be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c15c990 0x7f924c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f924be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c15c990 0x7f924c0b3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45676/0 (socket says 172.21.15.22:45676) 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.570+0000 7f924be00640 1 -- 172.21.15.22:0/188179983 learned_addr learned my addr 172.21.15.22:0/188179983 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924aa00640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f924c0d0bc0 0x7f924c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924b400640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f924c072fc0 0x7f924c15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924be00640 1 -- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f924c072fc0 msgr2=0x7f924c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924be00640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f924c072fc0 0x7f924c15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924be00640 1 -- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f924c0d0bc0 msgr2=0x7f924c14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924be00640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f924c0d0bc0 0x7f924c14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924be00640 1 -- 172.21.15.22:0/188179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924c15a090 con 0x7f924c15c990 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.571+0000 7f924be00640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c15c990 0x7f924c0b3370 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f92440097a0 tx=0x7f92440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.572+0000 7f9243400640 1 -- 172.21.15.22:0/188179983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244035050 con 0x7f924c15c990 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.572+0000 7f9243400640 1 -- 172.21.15.22:0/188179983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9244004270 con 0x7f924c15c990 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.572+0000 7f9243400640 1 -- 172.21.15.22:0/188179983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924403b880 con 0x7f924c15c990 2024-04-16T16:20:36.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.572+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924c15a370 con 0x7f924c15c990 2024-04-16T16:20:36.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.572+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924c15a930 con 0x7f924c15c990 2024-04-16T16:20:36.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.573+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924c04fd90 con 0x7f924c15c990 2024-04-16T16:20:36.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.574+0000 7f9243400640 1 -- 172.21.15.22:0/188179983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f9244038020 con 0x7f924c15c990 2024-04-16T16:20:36.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.575+0000 7f9243400640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f922806cec0 0x7f922806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:36.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.575+0000 7f9243400640 1 -- 172.21.15.22:0/188179983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f92440ae660 con 0x7f924c15c990 2024-04-16T16:20:36.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.575+0000 7f924b400640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f922806cec0 0x7f922806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:36.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.576+0000 7f924b400640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f922806cec0 0x7f922806f380 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f923c000f60 tx=0x7f923c007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:36.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.580+0000 7f9243400640 1 -- 172.21.15.22:0/188179983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9244040070 con 0x7f924c15c990 2024-04-16T16:20:36.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.797+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f924c160350 con 0x7f924c15c990 2024-04-16T16:20:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.798+0000 7f9243400640 1 -- 172.21.15.22:0/188179983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) ==== 80+0+0 (secure 0 0 0) 0x7f9244043e20 con 0x7f924c15c990 2024-04-16T16:20:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-04-16T16:20:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.800+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f922806cec0 msgr2=0x7f922806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.800+0000 7f9252800640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f922806cec0 0x7f922806f380 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f923c000f60 tx=0x7f923c007d00 comp rx=0 tx=0).stop 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.800+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c15c990 msgr2=0x7f924c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.800+0000 7f9252800640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c15c990 0x7f924c0b3370 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f92440097a0 tx=0x7f92440046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 shutdown_connections 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f922806cec0 0x7f922806f380 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f924c15c990 0x7f924c0b3370 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f924c0d0bc0 0x7f924c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 --2- 172.21.15.22:0/188179983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f924c072fc0 0x7f924c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 >> 172.21.15.22:0/188179983 conn(0x7f924c062440 msgr2=0x7f924c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 shutdown_connections 2024-04-16T16:20:36.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:36.801+0000 7f9252800640 1 -- 172.21.15.22:0/188179983 wait complete. 2024-04-16T16:20:36.820 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-16T16:20:36.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:36.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-16T16:20:36.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:20:36.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:20:36.934 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T16:20:36.994 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:20:36.994 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:36.994 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:37.051 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:20:37.051 INFO:tasks.cephfs.mount:Terminating background process 2024-04-16T16:20:37.051 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:20:37.051 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:37.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:20:37.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:20:37.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:20:37.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:20:37.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.343+0000 7f14cba00640 1 Processor -- start 2024-04-16T16:20:37.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.343+0000 7f14cba00640 1 -- start start 2024-04-16T16:20:37.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14cba00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14c415ee70 0x7f14c40ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14cba00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14cba00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c40d41b0 con 0x7f14c40b64e0 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14cba00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f14c415f250 con 0x7f14c415ee70 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14cba00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f14c40d01d0 con 0x7f14c40cf830 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14c9000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14c415ee70 0x7f14c40ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14c9a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f14c40b64e0 0x7f14c40b6970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35672/0 (socket says 172.21.15.22:35672) 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14c9a00640 1 -- 172.21.15.22:0/4134264709 learned_addr learned my addr 172.21.15.22:0/4134264709 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14c9000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14c415ee70 0x7f14c40ba380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45682/0 (socket says 172.21.15.22:45682) 2024-04-16T16:20:37.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14c9000640 1 -- 172.21.15.22:0/4134264709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 msgr2=0x7f14c40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:37.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.345+0000 7f14c3e00640 1 --2- 172.21.15.22:0/4134264709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.346+0000 7f14c3400640 1 -- 172.21.15.22:0/4134264709 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470971190 0 0) 0x7f14c40d41b0 con 0x7f14c40b64e0 2024-04-16T16:20:37.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.346+0000 7f14c9000640 1 --2- 172.21.15.22:0/4134264709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.346+0000 7f14c9000640 1 -- 172.21.15.22:0/4134264709 >> v1:172.21.15.22:6789/0 conn(0x7f14c40b64e0 legacy=0x7f14c40b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.346+0000 7f14c9000640 1 -- 172.21.15.22:0/4134264709 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c40d3110 con 0x7f14c415ee70 2024-04-16T16:20:37.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.346+0000 7f14c3e00640 1 --2- 172.21.15.22:0/4134264709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:37.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.347+0000 7f14c9000640 1 --2- 172.21.15.22:0/4134264709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c415ee70 0x7f14c40ba380 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f14b80097a0 tx=0x7f14b802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bce05891698bbc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.347+0000 7f14c3400640 1 -- 172.21.15.22:0/4134264709 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8031780 con 0x7f14c415ee70 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.347+0000 7f14c3400640 1 -- 172.21.15.22:0/4134264709 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b8037070 con 0x7f14c415ee70 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.347+0000 7f14c3400640 1 -- 172.21.15.22:0/4134264709 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8031b40 con 0x7f14c415ee70 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 -- 172.21.15.22:0/4134264709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c415ee70 msgr2=0x7f14c40ba380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 --2- 172.21.15.22:0/4134264709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c415ee70 0x7f14c40ba380 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f14b80097a0 tx=0x7f14b802b820 comp rx=0 tx=0).stop 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 -- 172.21.15.22:0/4134264709 shutdown_connections 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 --2- 172.21.15.22:0/4134264709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 --2- 172.21.15.22:0/4134264709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c415ee70 0x7f14c40ba380 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 -- 172.21.15.22:0/4134264709 >> 172.21.15.22:0/4134264709 conn(0x7f14c4072670 msgr2=0x7f14c4062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 -- 172.21.15.22:0/4134264709 shutdown_connections 2024-04-16T16:20:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.348+0000 7f14cba00640 1 -- 172.21.15.22:0/4134264709 wait complete. 2024-04-16T16:20:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.350+0000 7f14cba00640 1 Processor -- start 2024-04-16T16:20:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.350+0000 7f14cba00640 1 -- start start 2024-04-16T16:20:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14cba00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c40b64e0 0x7f14c4154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14cba00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14cba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14c415ee70 0x7f14c41f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14cba00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f14c40d36d0 con 0x7f14c40b64e0 2024-04-16T16:20:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14cba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f14c40d47c0 con 0x7f14c415ee70 2024-04-16T16:20:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14cba00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f14c40d39b0 con 0x7f14c40cf830 2024-04-16T16:20:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c40b64e0 0x7f14c4154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c40b64e0 0x7f14c4154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45694/0 (socket says 172.21.15.22:45694) 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 -- 172.21.15.22:0/3089493909 learned_addr learned my addr 172.21.15.22:0/3089493909 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c3e00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9a00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14c415ee70 0x7f14c41f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 -- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 msgr2=0x7f14c40cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 -- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14c415ee70 msgr2=0x7f14c41f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14c415ee70 0x7f14c41f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.351+0000 7f14c9000640 1 -- 172.21.15.22:0/3089493909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c41f50a0 con 0x7f14c40b64e0 2024-04-16T16:20:37.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.352+0000 7f14c9000640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c40b64e0 0x7f14c4154010 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f14b80097a0 tx=0x7f14b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.352+0000 7f14c0c00640 1 -- 172.21.15.22:0/3089493909 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8004230 con 0x7f14c40b64e0 2024-04-16T16:20:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.352+0000 7f14c0c00640 1 -- 172.21.15.22:0/3089493909 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b80043d0 con 0x7f14c40b64e0 2024-04-16T16:20:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.352+0000 7f14c0c00640 1 -- 172.21.15.22:0/3089493909 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8003850 con 0x7f14c40b64e0 2024-04-16T16:20:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.352+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c41f5380 con 0x7f14c40b64e0 2024-04-16T16:20:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.352+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c40cc9f0 con 0x7f14c40b64e0 2024-04-16T16:20:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.353+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c40d04a0 con 0x7f14c40b64e0 2024-04-16T16:20:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.354+0000 7f14c0c00640 1 -- 172.21.15.22:0/3089493909 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f14b80039f0 con 0x7f14c40b64e0 2024-04-16T16:20:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.355+0000 7f14c0c00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f14a406cee0 0x7f14a406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.355+0000 7f14c0c00640 1 -- 172.21.15.22:0/3089493909 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5823+0+0 (secure 0 0 0) 0x7f14b80ae5c0 con 0x7f14c40b64e0 2024-04-16T16:20:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.356+0000 7f14c3e00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f14a406cee0 0x7f14a406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.357+0000 7f14c3e00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f14a406cee0 0x7f14a406f3a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f14c40b6130 tx=0x7f14b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:37.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.360+0000 7f14c0c00640 1 -- 172.21.15.22:0/3089493909 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14c40d04a0 con 0x7f14c40b64e0 2024-04-16T16:20:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.600+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14c404fd90 con 0x7f14c40b64e0 2024-04-16T16:20:37.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.601+0000 7f14c0c00640 1 -- 172.21.15.22:0/3089493909 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5175 (secure 0 0 0) 0x7f14b8041070 con 0x7f14c40b64e0 2024-04-16T16:20:37.600 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:37.600 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3896039959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3896039959},{"type":"v1","addr":"172.21.15.22:6836","nonce":3896039959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/594862213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":594862213},{"type":"v1","addr":"172.21.15.43:6834","nonce":594862213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/754211698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":754211698},{"type":"v1","addr":"172.21.15.43:6835","nonce":754211698}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:19:30.225286+0000","modified":"2024-04-16T16:19:33.300977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5047},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5047":{"gid":5047,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/1166400952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1166400952},{"type":"v1","addr":"172.21.15.22:6837","nonce":1166400952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5047,"qdb_cluster":[5047]},"id":3}]} 2024-04-16T16:20:37.600 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 27 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f14a406cee0 msgr2=0x7f14a406f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f14a406cee0 0x7f14a406f3a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f14c40b6130 tx=0x7f14b0008040 comp rx=0 tx=0).stop 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c40b64e0 msgr2=0x7f14c4154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c40b64e0 0x7f14c4154010 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f14b80097a0 tx=0x7f14b80046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 shutdown_connections 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f14a406cee0 0x7f14a406f3a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14c415ee70 0x7f14c41f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14c40cf830 0x7f14c40cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 --2- 172.21.15.22:0/3089493909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14c40b64e0 0x7f14c4154010 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 >> 172.21.15.22:0/3089493909 conn(0x7f14c4072670 msgr2=0x7f14c40b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:37.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 shutdown_connections 2024-04-16T16:20:37.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.604+0000 7f14cba00640 1 -- 172.21.15.22:0/3089493909 wait complete. 2024-04-16T16:20:37.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:37.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.840+0000 7f96bda00640 1 Processor -- start 2024-04-16T16:20:37.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.840+0000 7f96bda00640 1 -- start start 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.842+0000 7f96bda00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96b815b790 0x7f96b815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.842+0000 7f96bda00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96b80728c0 0x7f96b80d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.842+0000 7f96bda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b80cc7c0 0x7f96b80d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.842+0000 7f96bda00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f96b8072430 con 0x7f96b815b790 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.842+0000 7f96bda00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f96b8071b00 con 0x7f96b80728c0 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.842+0000 7f96bda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f96b8071de0 con 0x7f96b80cc7c0 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.842+0000 7f96b7e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96b815b790 0x7f96b815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96b815b790 0x7f96b815fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45702/0 (socket says 172.21.15.22:45702) 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7e00640 1 -- 172.21.15.22:0/3684438316 learned_addr learned my addr 172.21.15.22:0/3684438316 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7400640 1 --2- 172.21.15.22:0/3684438316 >> v2:172.21.15.43:3300/0 conn(0x7f96b80728c0 0x7f96b80d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96bd000640 1 --2- 172.21.15.22:0/3684438316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b80cc7c0 0x7f96b80d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7e00640 1 -- 172.21.15.22:0/3684438316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b80cc7c0 msgr2=0x7f96b80d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:37.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7e00640 1 --2- 172.21.15.22:0/3684438316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b80cc7c0 0x7f96b80d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7e00640 1 -- 172.21.15.22:0/3684438316 >> v2:172.21.15.43:3300/0 conn(0x7f96b80728c0 msgr2=0x7f96b80d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:37.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7e00640 1 --2- 172.21.15.22:0/3684438316 >> v2:172.21.15.43:3300/0 conn(0x7f96b80728c0 0x7f96b80d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.843+0000 7f96b7e00640 1 -- 172.21.15.22:0/3684438316 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b80720c0 con 0x7f96b815b790 2024-04-16T16:20:37.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.845+0000 7f96b7e00640 1 --2- 172.21.15.22:0/3684438316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b815b790 0x7f96b815fd50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f96b815f2a0 tx=0x7f96a802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522aa2ae9193acd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:37.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.845+0000 7f96b6a00640 1 -- 172.21.15.22:0/3684438316 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8035020 con 0x7f96b815b790 2024-04-16T16:20:37.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.845+0000 7f96b6a00640 1 -- 172.21.15.22:0/3684438316 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a802d040 con 0x7f96b815b790 2024-04-16T16:20:37.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.845+0000 7f96b6a00640 1 -- 172.21.15.22:0/3684438316 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8031a80 con 0x7f96b815b790 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 -- 172.21.15.22:0/3684438316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b815b790 msgr2=0x7f96b815fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 --2- 172.21.15.22:0/3684438316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b815b790 0x7f96b815fd50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f96b815f2a0 tx=0x7f96a802b900 comp rx=0 tx=0).stop 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 -- 172.21.15.22:0/3684438316 shutdown_connections 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 --2- 172.21.15.22:0/3684438316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b80cc7c0 0x7f96b80d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 --2- 172.21.15.22:0/3684438316 >> v2:172.21.15.43:3300/0 conn(0x7f96b80728c0 0x7f96b80d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 --2- 172.21.15.22:0/3684438316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b815b790 0x7f96b815fd50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 -- 172.21.15.22:0/3684438316 >> 172.21.15.22:0/3684438316 conn(0x7f96b8062440 msgr2=0x7f96b8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 -- 172.21.15.22:0/3684438316 shutdown_connections 2024-04-16T16:20:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.846+0000 7f96bda00640 1 -- 172.21.15.22:0/3684438316 wait complete. 2024-04-16T16:20:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.848+0000 7f96bda00640 1 Processor -- start 2024-04-16T16:20:37.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.848+0000 7f96bda00640 1 -- start start 2024-04-16T16:20:37.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96bda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b80728c0 0x7f96b8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96bda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96b80cc7c0 0x7f96b815de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96bda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b815b790 0x7f96b815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96bda00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f96b806cf10 con 0x7f96b80728c0 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96bda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f96b80afde0 con 0x7f96b80cc7c0 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96bda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f96b806d090 con 0x7f96b815b790 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96b7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b80728c0 0x7f96b8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96b7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b80728c0 0x7f96b8159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45712/0 (socket says 172.21.15.22:45712) 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.849+0000 7f96b7e00640 1 -- 172.21.15.22:0/2794937738 learned_addr learned my addr 172.21.15.22:0/2794937738 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96b7400640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96b80cc7c0 0x7f96b815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96b7e00640 1 -- 172.21.15.22:0/2794937738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b815b790 msgr2=0x7f96b815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96b7e00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b815b790 0x7f96b815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96b7e00640 1 -- 172.21.15.22:0/2794937738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96b80cc7c0 msgr2=0x7f96b815de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96b7e00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96b80cc7c0 0x7f96b815de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:37.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96b7e00640 1 -- 172.21.15.22:0/2794937738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b815e9a0 con 0x7f96b80728c0 2024-04-16T16:20:37.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96b7e00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b80728c0 0x7f96b8159480 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f96a802b940 tx=0x7f96a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:37.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96afe00640 1 -- 172.21.15.22:0/2794937738 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8040070 con 0x7f96b80728c0 2024-04-16T16:20:37.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96afe00640 1 -- 172.21.15.22:0/2794937738 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a8039c10 con 0x7f96b80728c0 2024-04-16T16:20:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.850+0000 7f96afe00640 1 -- 172.21.15.22:0/2794937738 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8035040 con 0x7f96b80728c0 2024-04-16T16:20:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.851+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b81f81e0 con 0x7f96b80728c0 2024-04-16T16:20:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.851+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b81599c0 con 0x7f96b80728c0 2024-04-16T16:20:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.852+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b8075f30 con 0x7f96b80728c0 2024-04-16T16:20:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.853+0000 7f96afe00640 1 -- 172.21.15.22:0/2794937738 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f96a804b060 con 0x7f96b80728c0 2024-04-16T16:20:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.854+0000 7f96afe00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f969806ce90 0x7f969806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:37.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.854+0000 7f96afe00640 1 -- 172.21.15.22:0/2794937738 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f96a80ae1c0 con 0x7f96b80728c0 2024-04-16T16:20:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.854+0000 7f96b7400640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f969806ce90 0x7f969806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:37.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.855+0000 7f96b7400640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f969806ce90 0x7f969806f350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f96b8158a70 tx=0x7f96a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:37.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:37.859+0000 7f96afe00640 1 -- 172.21.15.22:0/2794937738 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96a807bd20 con 0x7f96b80728c0 2024-04-16T16:20:38.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.061+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96b8071530 con 0x7f96b80728c0 2024-04-16T16:20:38.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.063+0000 7f96afe00640 1 -- 172.21.15.22:0/2794937738 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16650 (secure 0 0 0) 0x7f96a807b620 con 0x7f96b80728c0 2024-04-16T16:20:38.063 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:38.063 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":51,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:37.505877+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f969806ce90 msgr2=0x7f969806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f969806ce90 0x7f969806f350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f96b8158a70 tx=0x7f96a4008040 comp rx=0 tx=0).stop 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b80728c0 msgr2=0x7f96b8159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b80728c0 0x7f96b8159480 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f96a802b940 tx=0x7f96a80046c0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 shutdown_connections 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f969806ce90 0x7f969806f350 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96b815b790 0x7f96b815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96b80cc7c0 0x7f96b815de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 --2- 172.21.15.22:0/2794937738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96b80728c0 0x7f96b8159480 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 >> 172.21.15.22:0/2794937738 conn(0x7f96b8062440 msgr2=0x7f96b80ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:38.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 shutdown_connections 2024-04-16T16:20:38.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.066+0000 7f96bda00640 1 -- 172.21.15.22:0/2794937738 wait complete. 2024-04-16T16:20:38.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T16:19:28.116371+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T16:19:29.218326+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:20:38.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:20:38.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.312+0000 7f1740600640 1 Processor -- start 2024-04-16T16:20:38.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.313+0000 7f1740600640 1 -- start start 2024-04-16T16:20:38.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.314+0000 7f1740600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f17380cf780 0x7f17380cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.314+0000 7f1740600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.314+0000 7f1740600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17380d00a0 con 0x7f17380b6530 2024-04-16T16:20:38.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.314+0000 7f1740600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f17380ba6b0 con 0x7f17380cf780 2024-04-16T16:20:38.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.314+0000 7f1740600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17380b9000 con 0x7f17380b8680 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.314+0000 7f173dc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f17380cf780 0x7f17380cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.315+0000 7f173dc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f17380cf780 0x7f17380cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45722/0 (socket says 172.21.15.22:45722) 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.315+0000 7f173dc00640 1 -- 172.21.15.22:0/552244006 learned_addr learned my addr 172.21.15.22:0/552244006 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.315+0000 7f173d200640 1 --2- 172.21.15.22:0/552244006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.315+0000 7f173dc00640 1 -- 172.21.15.22:0/552244006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 msgr2=0x7f17380b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.315+0000 7f173dc00640 1 --2- 172.21.15.22:0/552244006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380b8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.315+0000 7f173dc00640 1 -- 172.21.15.22:0/552244006 >> v1:172.21.15.22:6789/0 conn(0x7f17380b6530 legacy=0x7f17380b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.315+0000 7f173dc00640 1 -- 172.21.15.22:0/552244006 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17380b9240 con 0x7f17380cf780 2024-04-16T16:20:38.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.316+0000 7f173dc00640 1 --2- 172.21.15.22:0/552244006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380cf780 0x7f17380cfb60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f172c009e80 tx=0x7f172c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e060be10dd3d1a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:38.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1737e00640 1 -- 172.21.15.22:0/552244006 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c02cae0 con 0x7f17380cf780 2024-04-16T16:20:38.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1737e00640 1 -- 172.21.15.22:0/552244006 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c02cc80 con 0x7f17380cf780 2024-04-16T16:20:38.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1737e00640 1 -- 172.21.15.22:0/552244006 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c034610 con 0x7f17380cf780 2024-04-16T16:20:38.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 -- 172.21.15.22:0/552244006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380cf780 msgr2=0x7f17380cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 --2- 172.21.15.22:0/552244006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380cf780 0x7f17380cfb60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f172c009e80 tx=0x7f172c02bf40 comp rx=0 tx=0).stop 2024-04-16T16:20:38.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 -- 172.21.15.22:0/552244006 shutdown_connections 2024-04-16T16:20:38.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 --2- 172.21.15.22:0/552244006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 --2- 172.21.15.22:0/552244006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380cf780 0x7f17380cfb60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 -- 172.21.15.22:0/552244006 >> 172.21.15.22:0/552244006 conn(0x7f1738072460 msgr2=0x7f1738072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:38.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 -- 172.21.15.22:0/552244006 shutdown_connections 2024-04-16T16:20:38.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.317+0000 7f1740600640 1 -- 172.21.15.22:0/552244006 wait complete. 2024-04-16T16:20:38.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.319+0000 7f1740600640 1 Processor -- start 2024-04-16T16:20:38.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.319+0000 7f1740600640 1 -- start start 2024-04-16T16:20:38.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.320+0000 7f1740600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380b6530 0x7f17380caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.320+0000 7f1740600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.320+0000 7f1740600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17380cf780 0x7f1738144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.320+0000 7f1740600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17380b9800 con 0x7f17380b6530 2024-04-16T16:20:38.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.320+0000 7f1740600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17380b9e50 con 0x7f17380cf780 2024-04-16T16:20:38.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.320+0000 7f1740600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17380b9ae0 con 0x7f17380b8680 2024-04-16T16:20:38.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.320+0000 7f173dc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380b6530 0x7f17380caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380b6530 0x7f17380caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45730/0 (socket says 172.21.15.22:45730) 2024-04-16T16:20:38.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 -- 172.21.15.22:0/1229853630 learned_addr learned my addr 172.21.15.22:0/1229853630 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173e600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17380cf780 0x7f1738144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173d200640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 -- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 msgr2=0x7f17380c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 -- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17380cf780 msgr2=0x7f1738144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17380cf780 0x7f1738144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 -- 172.21.15.22:0/1229853630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173815f410 con 0x7f17380b6530 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.321+0000 7f173dc00640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380b6530 0x7f17380caf70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f172c036040 tx=0x7f172c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:38.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.322+0000 7f1735600640 1 -- 172.21.15.22:0/1229853630 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c043020 con 0x7f17380b6530 2024-04-16T16:20:38.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.322+0000 7f1735600640 1 -- 172.21.15.22:0/1229853630 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c03e450 con 0x7f17380b6530 2024-04-16T16:20:38.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.322+0000 7f1735600640 1 -- 172.21.15.22:0/1229853630 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c03e840 con 0x7f17380b6530 2024-04-16T16:20:38.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.322+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173815f6f0 con 0x7f17380b6530 2024-04-16T16:20:38.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.322+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173815fcb0 con 0x7f17380b6530 2024-04-16T16:20:38.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.323+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173804fd90 con 0x7f17380b6530 2024-04-16T16:20:38.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.324+0000 7f1735600640 1 -- 172.21.15.22:0/1229853630 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f172c046020 con 0x7f17380b6530 2024-04-16T16:20:38.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.325+0000 7f1735600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f171806ce90 0x7f171806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.326+0000 7f1735600640 1 -- 172.21.15.22:0/1229853630 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f172c0aee70 con 0x7f17380b6530 2024-04-16T16:20:38.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.326+0000 7f173d200640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f171806ce90 0x7f171806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.327+0000 7f173d200640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f171806ce90 0x7f171806f350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1724006fd0 tx=0x7f1724008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:38.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.330+0000 7f1735600640 1 -- 172.21.15.22:0/1229853630 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f172c04d030 con 0x7f17380b6530 2024-04-16T16:20:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.537+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f17380d50b0 con 0x7f17380b6530 2024-04-16T16:20:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.538+0000 7f1735600640 1 -- 172.21.15.22:0/1229853630 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f172c07c990 con 0x7f17380b6530 2024-04-16T16:20:38.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f171806ce90 msgr2=0x7f171806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f171806ce90 0x7f171806f350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1724006fd0 tx=0x7f1724008040 comp rx=0 tx=0).stop 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380b6530 msgr2=0x7f17380caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380b6530 0x7f17380caf70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f172c036040 tx=0x7f172c004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 shutdown_connections 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f171806ce90 0x7f171806f350 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17380cf780 0x7f1738144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17380b8680 0x7f17380c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 --2- 172.21.15.22:0/1229853630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17380b6530 0x7f17380caf70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 >> 172.21.15.22:0/1229853630 conn(0x7f1738072460 msgr2=0x7f17380b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 shutdown_connections 2024-04-16T16:20:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.541+0000 7f1740600640 1 -- 172.21.15.22:0/1229853630 wait complete. 2024-04-16T16:20:38.560 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T16:20:38.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.789+0000 7f9c67c00640 1 Processor -- start 2024-04-16T16:20:38.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.789+0000 7f9c67c00640 1 -- start start 2024-04-16T16:20:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c67c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6006e150 0x7f9c6006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c67c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c6015f3a0 0x7f9c6015f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c67c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c60160060 con 0x7f9c6015b750 2024-04-16T16:20:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c67c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6006eaf0 con 0x7f9c6015f3a0 2024-04-16T16:20:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c67c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9c600b4ae0 con 0x7f9c6006e150 2024-04-16T16:20:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c65c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c6015f3a0 0x7f9c6015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c65c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c6015f3a0 0x7f9c6015f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45746/0 (socket says 172.21.15.22:45746) 2024-04-16T16:20:38.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.791+0000 7f9c65c00640 1 -- 172.21.15.22:0/3140466845 learned_addr learned my addr 172.21.15.22:0/3140466845 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:38.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.792+0000 7f9c5fe00640 1 --2- 172.21.15.22:0/3140466845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6006e150 0x7f9c6006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.792+0000 7f9c65c00640 1 -- 172.21.15.22:0/3140466845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6006e150 msgr2=0x7f9c6006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.792+0000 7f9c65c00640 1 --2- 172.21.15.22:0/3140466845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6006e150 0x7f9c6006e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.792+0000 7f9c65c00640 1 -- 172.21.15.22:0/3140466845 >> v1:172.21.15.43:6789/0 conn(0x7f9c6015b750 legacy=0x7f9c600b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.792+0000 7f9c65c00640 1 -- 172.21.15.22:0/3140466845 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c600b4490 con 0x7f9c6015f3a0 2024-04-16T16:20:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.793+0000 7f9c65c00640 1 --2- 172.21.15.22:0/3140466845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c6015f830 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009e50 tx=0x7f9c5802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d467ccb083c535c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.793+0000 7f9c5f400640 1 -- 172.21.15.22:0/3140466845 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5802c9e0 con 0x7f9c6015f3a0 2024-04-16T16:20:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c5f400640 1 -- 172.21.15.22:0/3140466845 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5802cb80 con 0x7f9c6015f3a0 2024-04-16T16:20:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c5f400640 1 -- 172.21.15.22:0/3140466845 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580343f0 con 0x7f9c6015f3a0 2024-04-16T16:20:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c67c00640 1 -- 172.21.15.22:0/3140466845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 msgr2=0x7f9c6015f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c67c00640 1 --2- 172.21.15.22:0/3140466845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c6015f830 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009e50 tx=0x7f9c5802be40 comp rx=0 tx=0).stop 2024-04-16T16:20:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c67c00640 1 -- 172.21.15.22:0/3140466845 shutdown_connections 2024-04-16T16:20:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c67c00640 1 --2- 172.21.15.22:0/3140466845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c6015f830 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c67c00640 1 --2- 172.21.15.22:0/3140466845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6006e150 0x7f9c6006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.794+0000 7f9c67c00640 1 -- 172.21.15.22:0/3140466845 >> 172.21.15.22:0/3140466845 conn(0x7f9c60062440 msgr2=0x7f9c60062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.795+0000 7f9c67c00640 1 -- 172.21.15.22:0/3140466845 shutdown_connections 2024-04-16T16:20:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.795+0000 7f9c67c00640 1 -- 172.21.15.22:0/3140466845 wait complete. 2024-04-16T16:20:38.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.796+0000 7f9c67c00640 1 Processor -- start 2024-04-16T16:20:38.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.796+0000 7f9c67c00640 1 -- start start 2024-04-16T16:20:38.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.797+0000 7f9c67c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c6006e150 0x7f9c601e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.797+0000 7f9c67c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6015b750 0x7f9c600b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.797+0000 7f9c67c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c601f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.797+0000 7f9c67c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6015bb30 con 0x7f9c6015f3a0 2024-04-16T16:20:38.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.797+0000 7f9c67c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6015fd70 con 0x7f9c6006e150 2024-04-16T16:20:38.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.797+0000 7f9c67c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6015bcb0 con 0x7f9c6015b750 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c601f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c601f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45762/0 (socket says 172.21.15.22:45762) 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 -- 172.21.15.22:0/411845728 learned_addr learned my addr 172.21.15.22:0/411845728 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65200640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c6006e150 0x7f9c601e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c5fe00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6015b750 0x7f9c600b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 -- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6015b750 msgr2=0x7f9c600b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6015b750 0x7f9c600b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 -- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c6006e150 msgr2=0x7f9c601e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c6006e150 0x7f9c601e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c65c00640 1 -- 172.21.15.22:0/411845728 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c601e5e40 con 0x7f9c6015f3a0 2024-04-16T16:20:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.798+0000 7f9c5fe00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6015b750 0x7f9c600b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:38.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.799+0000 7f9c65c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c601f4b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009e50 tx=0x7f9c58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:38.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.799+0000 7f9c5cc00640 1 -- 172.21.15.22:0/411845728 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58043020 con 0x7f9c6015f3a0 2024-04-16T16:20:38.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.799+0000 7f9c5cc00640 1 -- 172.21.15.22:0/411845728 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5803e450 con 0x7f9c6015f3a0 2024-04-16T16:20:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.799+0000 7f9c5cc00640 1 -- 172.21.15.22:0/411845728 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58009510 con 0x7f9c6015f3a0 2024-04-16T16:20:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.799+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c601e6490 con 0x7f9c6015f3a0 2024-04-16T16:20:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.799+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c601e6a50 con 0x7f9c6015f3a0 2024-04-16T16:20:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.801+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6004fd90 con 0x7f9c6015f3a0 2024-04-16T16:20:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.801+0000 7f9c5cc00640 1 -- 172.21.15.22:0/411845728 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f9c58046020 con 0x7f9c6015f3a0 2024-04-16T16:20:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.802+0000 7f9c5cc00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c4406cec0 0x7f9c4406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.802+0000 7f9c5cc00640 1 -- 172.21.15.22:0/411845728 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f9c580aee00 con 0x7f9c6015f3a0 2024-04-16T16:20:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.803+0000 7f9c65200640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c4406cec0 0x7f9c4406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.803+0000 7f9c65200640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c4406cec0 0x7f9c4406f380 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c54004ea0 tx=0x7f9c54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:38.807+0000 7f9c5cc00640 1 -- 172.21.15.22:0/411845728 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c5804d030 con 0x7f9c6015f3a0 2024-04-16T16:20:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.010+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9c600725d0 con 0x7f9c6015f3a0 2024-04-16T16:20:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.011+0000 7f9c5cc00640 1 -- 172.21.15.22:0/411845728 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f9c5807c9b0 con 0x7f9c6015f3a0 2024-04-16T16:20:39.009 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.013+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c4406cec0 msgr2=0x7f9c4406f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.013+0000 7f9c67c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c4406cec0 0x7f9c4406f380 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c54004ea0 tx=0x7f9c54009040 comp rx=0 tx=0).stop 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.013+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 msgr2=0x7f9c601f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.013+0000 7f9c67c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c601f4b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009e50 tx=0x7f9c58004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 shutdown_connections 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f9c4406cec0 0x7f9c4406f380 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6015f3a0 0x7f9c601f4b00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c6015b750 0x7f9c600b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 --2- 172.21.15.22:0/411845728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c6006e150 0x7f9c601e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 >> 172.21.15.22:0/411845728 conn(0x7f9c60062440 msgr2=0x7f9c600af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 shutdown_connections 2024-04-16T16:20:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.014+0000 7f9c67c00640 1 -- 172.21.15.22:0/411845728 wait complete. 2024-04-16T16:20:39.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T16:20:39.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.251+0000 7f4975400640 1 Processor -- start 2024-04-16T16:20:39.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.251+0000 7f4975400640 1 -- start start 2024-04-16T16:20:39.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.252+0000 7f4975400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49700d1bb0 0x7f49700628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.252+0000 7f4975400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49700d2240 con 0x7f4970062440 2024-04-16T16:20:39.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.252+0000 7f4975400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49700721b0 con 0x7f49701461d0 2024-04-16T16:20:39.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.252+0000 7f4975400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f49700d2020 con 0x7f49700d1bb0 2024-04-16T16:20:39.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.253+0000 7f496f400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4970062440 0x7f49700d14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35688/0 (socket says 172.21.15.22:35688) 2024-04-16T16:20:39.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.253+0000 7f496f400640 1 -- 172.21.15.22:0/4224581286 learned_addr learned my addr 172.21.15.22:0/4224581286 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:39.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.253+0000 7f4974a00640 1 --2- 172.21.15.22:0/4224581286 >> v2:172.21.15.22:3300/0 conn(0x7f49700d1bb0 0x7f49700628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.253+0000 7f496ea00640 1 -- 172.21.15.22:0/4224581286 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439497043 0 0) 0x7f49700d2240 con 0x7f4970062440 2024-04-16T16:20:39.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.253+0000 7f496ea00640 1 -- 172.21.15.22:0/4224581286 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4954003520 con 0x7f4970062440 2024-04-16T16:20:39.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.253+0000 7f4974a00640 1 -- 172.21.15.22:0/4224581286 >> v1:172.21.15.43:6789/0 conn(0x7f49701461d0 legacy=0x7f4970072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.254+0000 7f4974a00640 1 -- 172.21.15.22:0/4224581286 >> v1:172.21.15.22:6789/0 conn(0x7f4970062440 legacy=0x7f49700d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.254+0000 7f4974a00640 1 -- 172.21.15.22:0/4224581286 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4970072490 con 0x7f49700d1bb0 2024-04-16T16:20:39.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.255+0000 7f4974a00640 1 --2- 172.21.15.22:0/4224581286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49700d1bb0 0x7f49700628f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4968009d90 tx=0x7f496802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52689809d80a6c05 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:39.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.255+0000 7f496ea00640 1 -- 172.21.15.22:0/4224581286 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968039070 con 0x7f49700d1bb0 2024-04-16T16:20:39.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f496ea00640 1 -- 172.21.15.22:0/4224581286 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496802cbd0 con 0x7f49700d1bb0 2024-04-16T16:20:39.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f496ea00640 1 -- 172.21.15.22:0/4224581286 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968034440 con 0x7f49700d1bb0 2024-04-16T16:20:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f4975400640 1 -- 172.21.15.22:0/4224581286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49700d1bb0 msgr2=0x7f49700628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f4975400640 1 --2- 172.21.15.22:0/4224581286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49700d1bb0 0x7f49700628f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4968009d90 tx=0x7f496802be20 comp rx=0 tx=0).stop 2024-04-16T16:20:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f4975400640 1 -- 172.21.15.22:0/4224581286 shutdown_connections 2024-04-16T16:20:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f4975400640 1 --2- 172.21.15.22:0/4224581286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49700d1bb0 0x7f49700628f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f4975400640 1 -- 172.21.15.22:0/4224581286 >> 172.21.15.22:0/4224581286 conn(0x7f4970074a40 msgr2=0x7f4970074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f4975400640 1 -- 172.21.15.22:0/4224581286 shutdown_connections 2024-04-16T16:20:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.256+0000 7f4975400640 1 -- 172.21.15.22:0/4224581286 wait complete. 2024-04-16T16:20:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.258+0000 7f4975400640 1 Processor -- start 2024-04-16T16:20:39.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.258+0000 7f4975400640 1 -- start start 2024-04-16T16:20:39.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f4975400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4970062440 0x7f49701f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f4975400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49700d1bb0 0x7f497015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f4975400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49701461d0 0x7f497015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f4975400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f497006e3c0 con 0x7f4970062440 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f4975400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f497006e240 con 0x7f49700d1bb0 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f4975400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f497006e540 con 0x7f49701461d0 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f496fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4970062440 0x7f49701f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f496fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4970062440 0x7f49701f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45786/0 (socket says 172.21.15.22:45786) 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.259+0000 7f496fe00640 1 -- 172.21.15.22:0/1411868835 learned_addr learned my addr 172.21.15.22:0/1411868835 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f496fe00640 1 -- 172.21.15.22:0/1411868835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49701461d0 msgr2=0x7f497015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f496fe00640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49701461d0 0x7f497015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f496fe00640 1 -- 172.21.15.22:0/1411868835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49700d1bb0 msgr2=0x7f497015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f496fe00640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49700d1bb0 0x7f497015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f496fe00640 1 -- 172.21.15.22:0/1411868835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49700c9800 con 0x7f4970062440 2024-04-16T16:20:39.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f496fe00640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4970062440 0x7f49701f5d10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f496000c3c0 tx=0x7f496000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f4967e00640 1 -- 172.21.15.22:0/1411868835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49600052d0 con 0x7f4970062440 2024-04-16T16:20:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f4967e00640 1 -- 172.21.15.22:0/1411868835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4960005490 con 0x7f4970062440 2024-04-16T16:20:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f4967e00640 1 -- 172.21.15.22:0/1411868835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960007260 con 0x7f4970062440 2024-04-16T16:20:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.260+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49700c9ae0 con 0x7f4970062440 2024-04-16T16:20:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.261+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49700ca0a0 con 0x7f4970062440 2024-04-16T16:20:39.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.262+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4970075f30 con 0x7f4970062440 2024-04-16T16:20:39.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.263+0000 7f4967e00640 1 -- 172.21.15.22:0/1411868835 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f4960007400 con 0x7f4970062440 2024-04-16T16:20:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.264+0000 7f4967e00640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f494c06ce90 0x7f494c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.264+0000 7f4967e00640 1 -- 172.21.15.22:0/1411868835 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f496008b9d0 con 0x7f4970062440 2024-04-16T16:20:39.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.264+0000 7f496f400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f494c06ce90 0x7f494c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.265+0000 7f496f400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f494c06ce90 0x7f494c06f350 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4958000f60 tx=0x7f49580078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:39.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.268+0000 7f4967e00640 1 -- 172.21.15.22:0/1411868835 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49600595c0 con 0x7f4970062440 2024-04-16T16:20:39.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.468+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f49700d0c30 con 0x7f4970062440 2024-04-16T16:20:39.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.469+0000 7f4967e00640 1 -- 172.21.15.22:0/1411868835 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f4960058ec0 con 0x7f4970062440 2024-04-16T16:20:39.468 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-04-16T16:20:39.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.471+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f494c06ce90 msgr2=0x7f494c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.471+0000 7f4975400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f494c06ce90 0x7f494c06f350 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4958000f60 tx=0x7f49580078f0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.471+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4970062440 msgr2=0x7f49701f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.471+0000 7f4975400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4970062440 0x7f49701f5d10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f496000c3c0 tx=0x7f496000c880 comp rx=0 tx=0).stop 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 shutdown_connections 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f494c06ce90 0x7f494c06f350 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f49701461d0 0x7f497015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49700d1bb0 0x7f497015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 --2- 172.21.15.22:0/1411868835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4970062440 0x7f49701f5d10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 >> 172.21.15.22:0/1411868835 conn(0x7f4970074a40 msgr2=0x7f497015f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 shutdown_connections 2024-04-16T16:20:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.472+0000 7f4975400640 1 -- 172.21.15.22:0/1411868835 wait complete. 2024-04-16T16:20:39.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:20:39.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.703+0000 7fde9b200640 1 Processor -- start 2024-04-16T16:20:39.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.704+0000 7fde9b200640 1 -- start start 2024-04-16T16:20:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.705+0000 7fde9b200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde9c15ea50 0x7fde9c0ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.705+0000 7fde9b200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde9c0cf630 0x7fde9c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.705+0000 7fde9b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.705+0000 7fde9b200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fde9c0cffe0 con 0x7fde9c0cf630 2024-04-16T16:20:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.705+0000 7fde9b200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fde9c0b9c90 con 0x7fde9c15ea50 2024-04-16T16:20:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.705+0000 7fde9b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c0b9080 con 0x7fde9c0d2dc0 2024-04-16T16:20:39.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde9c0cf630 0x7fde9c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde9a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde9c0cf630 0x7fde9c0cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45794/0 (socket says 172.21.15.22:45794) 2024-04-16T16:20:39.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 -- 172.21.15.22:0/386257693 learned_addr learned my addr 172.21.15.22:0/386257693 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99e00640 1 --2- 172.21.15.22:0/386257693 >> v2:172.21.15.43:3300/0 conn(0x7fde9c15ea50 0x7fde9c0ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 -- 172.21.15.22:0/386257693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 msgr2=0x7fde9c0d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 --2- 172.21.15.22:0/386257693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 -- 172.21.15.22:0/386257693 >> v2:172.21.15.43:3300/0 conn(0x7fde9c15ea50 msgr2=0x7fde9c0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 --2- 172.21.15.22:0/386257693 >> v2:172.21.15.43:3300/0 conn(0x7fde9c15ea50 0x7fde9c0ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99400640 1 -- 172.21.15.22:0/386257693 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c0b9360 con 0x7fde9c0cf630 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde99e00640 1 --2- 172.21.15.22:0/386257693 >> v2:172.21.15.43:3300/0 conn(0x7fde9c15ea50 0x7fde9c0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:39.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.706+0000 7fde9a800640 1 --2- 172.21.15.22:0/386257693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:39.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.708+0000 7fde99400640 1 --2- 172.21.15.22:0/386257693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c0cfaa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0d1340 tx=0x7fde8802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb56a99b7fdb6d65 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.708+0000 7fde98a00640 1 -- 172.21.15.22:0/386257693 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88038070 con 0x7fde9c0cf630 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.708+0000 7fde98a00640 1 -- 172.21.15.22:0/386257693 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde88031740 con 0x7fde9c0cf630 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.708+0000 7fde98a00640 1 -- 172.21.15.22:0/386257693 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8802f050 con 0x7fde9c0cf630 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 -- 172.21.15.22:0/386257693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 msgr2=0x7fde9c0cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 --2- 172.21.15.22:0/386257693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c0cfaa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0d1340 tx=0x7fde8802b7e0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 -- 172.21.15.22:0/386257693 shutdown_connections 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 --2- 172.21.15.22:0/386257693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 --2- 172.21.15.22:0/386257693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c0cfaa0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 --2- 172.21.15.22:0/386257693 >> v2:172.21.15.43:3300/0 conn(0x7fde9c15ea50 0x7fde9c0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 -- 172.21.15.22:0/386257693 >> 172.21.15.22:0/386257693 conn(0x7fde9c072430 msgr2=0x7fde9c072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 -- 172.21.15.22:0/386257693 shutdown_connections 2024-04-16T16:20:39.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.709+0000 7fde9b200640 1 -- 172.21.15.22:0/386257693 wait complete. 2024-04-16T16:20:39.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.711+0000 7fde9b200640 1 Processor -- start 2024-04-16T16:20:39.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.711+0000 7fde9b200640 1 -- start start 2024-04-16T16:20:39.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde9b200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde9b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde9b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde9c15ea50 0x7fde9c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde9b200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c15ee30 con 0x7fde9c0cf630 2024-04-16T16:20:39.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde9b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c0b9920 con 0x7fde9c15ea50 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde9b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c0ba7c0 con 0x7fde9c0d2dc0 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde99e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde99e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45804/0 (socket says 172.21.15.22:45804) 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.712+0000 7fde99e00640 1 -- 172.21.15.22:0/77187645 learned_addr learned my addr 172.21.15.22:0/77187645 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde99e00640 1 -- 172.21.15.22:0/77187645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 msgr2=0x7fde9c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde99e00640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde99e00640 1 -- 172.21.15.22:0/77187645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde9c15ea50 msgr2=0x7fde9c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde99e00640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde9c15ea50 0x7fde9c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde99e00640 1 -- 172.21.15.22:0/77187645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c0cd1c0 con 0x7fde9c0cf630 2024-04-16T16:20:39.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde99e00640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c151840 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00e730 tx=0x7fde8c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:39.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde92000640 1 -- 172.21.15.22:0/77187645 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00f040 con 0x7fde9c0cf630 2024-04-16T16:20:39.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde92000640 1 -- 172.21.15.22:0/77187645 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8c004230 con 0x7fde9c0cf630 2024-04-16T16:20:39.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde92000640 1 -- 172.21.15.22:0/77187645 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00ee40 con 0x7fde9c0cf630 2024-04-16T16:20:39.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c0cc4d0 con 0x7fde9c0cf630 2024-04-16T16:20:39.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.713+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9c0cd480 con 0x7fde9c0cf630 2024-04-16T16:20:39.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.715+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9c075f30 con 0x7fde9c0cf630 2024-04-16T16:20:39.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.716+0000 7fde92000640 1 -- 172.21.15.22:0/77187645 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fde8c00c6d0 con 0x7fde9c0cf630 2024-04-16T16:20:39.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.716+0000 7fde92000640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde7c06ce90 0x7fde7c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:39.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.717+0000 7fde92000640 1 -- 172.21.15.22:0/77187645 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7fde8c08c510 con 0x7fde9c0cf630 2024-04-16T16:20:39.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.717+0000 7fde99400640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde7c06ce90 0x7fde7c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:39.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.717+0000 7fde99400640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde7c06ce90 0x7fde7c06f350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fde88035000 tx=0x7fde88030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:39.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.721+0000 7fde92000640 1 -- 172.21.15.22:0/77187645 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde8c017020 con 0x7fde9c0cf630 2024-04-16T16:20:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.959+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde9c0d21e0 con 0x7fde9c0cf630 2024-04-16T16:20:39.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.960+0000 7fde92000640 1 -- 172.21.15.22:0/77187645 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5175 (secure 0 0 0) 0x7fde8c059e90 con 0x7fde9c0cf630 2024-04-16T16:20:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:39.959 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3896039959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3896039959},{"type":"v1","addr":"172.21.15.22:6836","nonce":3896039959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/594862213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":594862213},{"type":"v1","addr":"172.21.15.43:6834","nonce":594862213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/754211698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":754211698},{"type":"v1","addr":"172.21.15.43:6835","nonce":754211698}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:19:30.225286+0000","modified":"2024-04-16T16:19:33.300977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5047},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5047":{"gid":5047,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/1166400952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1166400952},{"type":"v1","addr":"172.21.15.22:6837","nonce":1166400952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5047,"qdb_cluster":[5047]},"id":3}]} 2024-04-16T16:20:39.959 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 27 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde7c06ce90 msgr2=0x7fde7c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde7c06ce90 0x7fde7c06f350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fde88035000 tx=0x7fde88030000 comp rx=0 tx=0).stop 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 msgr2=0x7fde9c151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c151840 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00e730 tx=0x7fde8c00ebf0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 shutdown_connections 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde7c06ce90 0x7fde7c06f350 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde9c15ea50 0x7fde9c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde9c0d2dc0 0x7fde9c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 --2- 172.21.15.22:0/77187645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde9c0cf630 0x7fde9c151840 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 >> 172.21.15.22:0/77187645 conn(0x7fde9c072430 msgr2=0x7fde9c0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 shutdown_connections 2024-04-16T16:20:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:39.963+0000 7fde9b200640 1 -- 172.21.15.22:0/77187645 wait complete. 2024-04-16T16:20:39.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:40.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.197+0000 7f7e76200640 1 Processor -- start 2024-04-16T16:20:40.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.197+0000 7f7e76200640 1 -- start start 2024-04-16T16:20:40.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.198+0000 7f7e76200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e700d24a0 0x7f7e70169860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.198+0000 7f7e76200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e700d2960 con 0x7f7e7015ef30 2024-04-16T16:20:40.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.198+0000 7f7e76200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e700d2c40 con 0x7f7e7015eb50 2024-04-16T16:20:40.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.198+0000 7f7e76200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7e700d2f20 con 0x7f7e700d24a0 2024-04-16T16:20:40.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.199+0000 7f7e75800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e700d24a0 0x7f7e70169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.199+0000 7f7e75800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e700d24a0 0x7f7e70169860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43702/0 (socket says 172.21.15.22:43702) 2024-04-16T16:20:40.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.199+0000 7f7e6fe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7e7015ef30 0x7f7e700d16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48076/0 (socket says 172.21.15.22:48076) 2024-04-16T16:20:40.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.199+0000 7f7e75800640 1 -- 172.21.15.22:0/217948025 learned_addr learned my addr 172.21.15.22:0/217948025 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:40.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.199+0000 7f7e75800640 1 -- 172.21.15.22:0/217948025 >> v1:172.21.15.43:6789/0 conn(0x7f7e7015eb50 legacy=0x7f7e700d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:40.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.199+0000 7f7e75800640 1 -- 172.21.15.22:0/217948025 >> v1:172.21.15.22:6789/0 conn(0x7f7e7015ef30 legacy=0x7f7e700d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.200+0000 7f7e75800640 1 -- 172.21.15.22:0/217948025 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e700d3200 con 0x7f7e700d24a0 2024-04-16T16:20:40.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.200+0000 7f7e6f400640 1 -- 172.21.15.22:0/217948025 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139814794 0 0) 0x7f7e700d2960 con 0x7f7e7015ef30 2024-04-16T16:20:40.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.201+0000 7f7e75800640 1 --2- 172.21.15.22:0/217948025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e700d24a0 0x7f7e70169860 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7e680098a0 tx=0x7f7e6802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba05c02cb71e8ec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:40.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.201+0000 7f7e6f400640 1 -- 172.21.15.22:0/217948025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6802f840 con 0x7f7e700d24a0 2024-04-16T16:20:40.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.201+0000 7f7e6f400640 1 -- 172.21.15.22:0/217948025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6802f9e0 con 0x7f7e700d24a0 2024-04-16T16:20:40.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.201+0000 7f7e6f400640 1 -- 172.21.15.22:0/217948025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6802fdb0 con 0x7f7e700d24a0 2024-04-16T16:20:40.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.202+0000 7f7e76200640 1 -- 172.21.15.22:0/217948025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e700d24a0 msgr2=0x7f7e70169860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.202+0000 7f7e76200640 1 --2- 172.21.15.22:0/217948025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e700d24a0 0x7f7e70169860 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7e680098a0 tx=0x7f7e6802ba20 comp rx=0 tx=0).stop 2024-04-16T16:20:40.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.202+0000 7f7e76200640 1 -- 172.21.15.22:0/217948025 shutdown_connections 2024-04-16T16:20:40.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.202+0000 7f7e76200640 1 --2- 172.21.15.22:0/217948025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e700d24a0 0x7f7e70169860 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.202+0000 7f7e76200640 1 -- 172.21.15.22:0/217948025 >> 172.21.15.22:0/217948025 conn(0x7f7e70072670 msgr2=0x7f7e70062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:40.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.202+0000 7f7e76200640 1 -- 172.21.15.22:0/217948025 shutdown_connections 2024-04-16T16:20:40.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.202+0000 7f7e76200640 1 -- 172.21.15.22:0/217948025 wait complete. 2024-04-16T16:20:40.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.204+0000 7f7e76200640 1 Processor -- start 2024-04-16T16:20:40.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.204+0000 7f7e76200640 1 -- start start 2024-04-16T16:20:40.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e76200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e700d24a0 0x7f7e70160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e76200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e7015eb50 0x7f7e70161840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e76200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7015f320 0x7f7e700cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e76200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700d50e0 con 0x7f7e7015f320 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e76200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700d1db0 con 0x7f7e700d24a0 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e76200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7e700d3a00 con 0x7f7e7015eb50 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e75800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7015f320 0x7f7e700cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e75800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7015f320 0x7f7e700cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43708/0 (socket says 172.21.15.22:43708) 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e75800640 1 -- 172.21.15.22:0/4072253564 learned_addr learned my addr 172.21.15.22:0/4072253564 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e74e00640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e700d24a0 0x7f7e70160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.205+0000 7f7e6fe00640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e7015eb50 0x7f7e70161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e75800640 1 -- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e7015eb50 msgr2=0x7f7e70161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e75800640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e7015eb50 0x7f7e70161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e75800640 1 -- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e700d24a0 msgr2=0x7f7e70160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e75800640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e700d24a0 0x7f7e70160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e75800640 1 -- 172.21.15.22:0/4072253564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e70160ab0 con 0x7f7e7015f320 2024-04-16T16:20:40.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e74e00640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e700d24a0 0x7f7e70160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:40.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e75800640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7015f320 0x7f7e700cc9f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7e6802ba60 tx=0x7f7e68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:40.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e6cc00640 1 -- 172.21.15.22:0/4072253564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68041400 con 0x7f7e7015f320 2024-04-16T16:20:40.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e6cc00640 1 -- 172.21.15.22:0/4072253564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e68046070 con 0x7f7e7015f320 2024-04-16T16:20:40.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e6cc00640 1 -- 172.21.15.22:0/4072253564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68041800 con 0x7f7e7015f320 2024-04-16T16:20:40.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.206+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e700c9870 con 0x7f7e7015f320 2024-04-16T16:20:40.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.207+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e700c9e30 con 0x7f7e7015f320 2024-04-16T16:20:40.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.208+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e700b75e0 con 0x7f7e7015f320 2024-04-16T16:20:40.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.209+0000 7f7e6cc00640 1 -- 172.21.15.22:0/4072253564 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f7e68040070 con 0x7f7e7015f320 2024-04-16T16:20:40.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.210+0000 7f7e6cc00640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e5006ce90 0x7f7e5006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.210+0000 7f7e6cc00640 1 -- 172.21.15.22:0/4072253564 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f7e680af060 con 0x7f7e7015f320 2024-04-16T16:20:40.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.210+0000 7f7e74e00640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e5006ce90 0x7f7e5006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.211+0000 7f7e74e00640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e5006ce90 0x7f7e5006f350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7e600012e0 tx=0x7f7e60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:40.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.215+0000 7f7e6cc00640 1 -- 172.21.15.22:0/4072253564 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e700b75e0 con 0x7f7e7015f320 2024-04-16T16:20:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.419+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e700d07c0 con 0x7f7e7015f320 2024-04-16T16:20:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.421+0000 7f7e6cc00640 1 -- 172.21.15.22:0/4072253564 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16650 (secure 0 0 0) 0x7f7e700d07c0 con 0x7f7e7015f320 2024-04-16T16:20:40.421 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:40.421 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":51,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:37.505877+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e5006ce90 msgr2=0x7f7e5006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e5006ce90 0x7f7e5006f350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7e600012e0 tx=0x7f7e60009040 comp rx=0 tx=0).stop 2024-04-16T16:20:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7015f320 msgr2=0x7f7e700cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7015f320 0x7f7e700cc9f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7e6802ba60 tx=0x7f7e68004730 comp rx=0 tx=0).stop 2024-04-16T16:20:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 shutdown_connections 2024-04-16T16:20:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7e5006ce90 0x7f7e5006f350 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7015f320 0x7f7e700cc9f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e7015eb50 0x7f7e70161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 --2- 172.21.15.22:0/4072253564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e700d24a0 0x7f7e70160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.424+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 >> 172.21.15.22:0/4072253564 conn(0x7f7e70072670 msgr2=0x7f7e700d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.425+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 shutdown_connections 2024-04-16T16:20:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.425+0000 7f7e76200640 1 -- 172.21.15.22:0/4072253564 wait complete. 2024-04-16T16:20:40.445 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T16:20:40.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:20:40.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.664+0000 7f17c3e00640 1 Processor -- start 2024-04-16T16:20:40.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.664+0000 7f17c3e00640 1 -- start start 2024-04-16T16:20:40.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.666+0000 7f17c3e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f17c40cc810 0x7f17c406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.666+0000 7f17c3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c406ee80 0x7f17c415c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.666+0000 7f17c3e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c406d160 con 0x7f17c406eaa0 2024-04-16T16:20:40.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.666+0000 7f17c3e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f17c406cf10 con 0x7f17c40cc810 2024-04-16T16:20:40.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.666+0000 7f17c3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17c406d440 con 0x7f17c406ee80 2024-04-16T16:20:40.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.666+0000 7f17c2a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f17c406eaa0 0x7f17c40b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48088/0 (socket says 172.21.15.22:48088) 2024-04-16T16:20:40.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.666+0000 7f17c2a00640 1 -- 172.21.15.22:0/1055971463 learned_addr learned my addr 172.21.15.22:0/1055971463 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:40.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c3400640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c406ee80 0x7f17c415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17ba000640 1 --2- 172.21.15.22:0/1055971463 >> v2:172.21.15.43:3300/0 conn(0x7f17c40cc810 0x7f17c406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520190333 0 0) 0x7f17c406d160 con 0x7f17c406eaa0 2024-04-16T16:20:40.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17a8003520 con 0x7f17c406eaa0 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3171627063 0 0) 0x7f17a8003520 con 0x7f17c406eaa0 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c406ee80 msgr2=0x7f17c415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c406ee80 0x7f17c415c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 >> v2:172.21.15.43:3300/0 conn(0x7f17c40cc810 msgr2=0x7f17c406df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 --2- 172.21.15.22:0/1055971463 >> v2:172.21.15.43:3300/0 conn(0x7f17c40cc810 0x7f17c406df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c406d720 con 0x7f17c406eaa0 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f17b40019f0 con 0x7f17c406eaa0 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 >> v1:172.21.15.22:6789/0 conn(0x7f17c406eaa0 legacy=0x7f17c40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a8004800 0x7f17a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c406ee80 0x7f17a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17c406cf10 con 0x7f17a80039b0 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17c406d440 con 0x7f17a8004800 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.667+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17a800b9c0 con 0x7f17c406ee80 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.668+0000 7f17c2a00640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.668+0000 7f17ba000640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a8004800 0x7f17a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.668+0000 7f17c2a00640 1 -- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c406ee80 msgr2=0x7f17a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.668+0000 7f17c2a00640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c406ee80 0x7f17a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.668+0000 7f17c2a00640 1 -- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a8004800 msgr2=0x7f17a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:40.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.668+0000 7f17c2a00640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a8004800 0x7f17a8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.668+0000 7f17c2a00640 1 -- 172.21.15.22:0/1055971463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a8003520 con 0x7f17a80039b0 2024-04-16T16:20:40.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.669+0000 7f17c2a00640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17a8003dd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f17b400a790 tx=0x7f17a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0af164f8b0ada16 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:40.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.669+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b400a3b0 con 0x7f17a80039b0 2024-04-16T16:20:40.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.669+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b4034430 con 0x7f17a80039b0 2024-04-16T16:20:40.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.669+0000 7f17c2000640 1 -- 172.21.15.22:0/1055971463 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b40348c0 con 0x7f17a80039b0 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.670+0000 7f17c3e00640 1 -- 172.21.15.22:0/1055971463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 msgr2=0x7f17a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.670+0000 7f17c3e00640 1 --2- 172.21.15.22:0/1055971463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17a8003dd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f17b400a790 tx=0x7f17a8005830 comp rx=0 tx=0).stop 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.670+0000 7f17c3400640 1 -- 172.21.15.22:0/1055971463 reap_dead start 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.670+0000 7f17c3e00640 1 -- 172.21.15.22:0/1055971463 shutdown_connections 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.670+0000 7f17c3e00640 1 -- 172.21.15.22:0/1055971463 >> 172.21.15.22:0/1055971463 conn(0x7f17c4062440 msgr2=0x7f17c4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.670+0000 7f17c3e00640 1 -- 172.21.15.22:0/1055971463 shutdown_connections 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.670+0000 7f17c3e00640 1 -- 172.21.15.22:0/1055971463 wait complete. 2024-04-16T16:20:40.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.672+0000 7f17c3e00640 1 Processor -- start 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.672+0000 7f17c3e00640 1 -- start start 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.673+0000 7f17c3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17c4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.673+0000 7f17c3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c41e6a70 0x7f17c41e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.673+0000 7f17c3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c41e7430 0x7f17c4156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.673+0000 7f17c3e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17c415c200 con 0x7f17a80039b0 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.673+0000 7f17c3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17c406e440 con 0x7f17c41e6a70 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.673+0000 7f17c3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17c415c380 con 0x7f17c41e7430 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17c4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17c4154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43728/0 (socket says 172.21.15.22:43728) 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 -- 172.21.15.22:0/3663620895 learned_addr learned my addr 172.21.15.22:0/3663620895 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17ba000640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c41e6a70 0x7f17c41e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c3400640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c41e7430 0x7f17c4156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 -- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c41e7430 msgr2=0x7f17c4156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c41e7430 0x7f17c4156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 -- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c41e6a70 msgr2=0x7f17c41e6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c41e6a70 0x7f17c41e6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 -- 172.21.15.22:0/3663620895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c4144420 con 0x7f17a80039b0 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.674+0000 7f17c2a00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17c4154a80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f17b402cbf0 tx=0x7f17c406d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.675+0000 7f17bb400640 1 -- 172.21.15.22:0/3663620895 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4045070 con 0x7f17a80039b0 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.675+0000 7f17bb400640 1 -- 172.21.15.22:0/3663620895 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b403a040 con 0x7f17a80039b0 2024-04-16T16:20:40.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.675+0000 7f17bb400640 1 -- 172.21.15.22:0/3663620895 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4034a00 con 0x7f17a80039b0 2024-04-16T16:20:40.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.675+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c4157bf0 con 0x7f17a80039b0 2024-04-16T16:20:40.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.675+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c40b1c00 con 0x7f17a80039b0 2024-04-16T16:20:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.676+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c41540d0 con 0x7f17a80039b0 2024-04-16T16:20:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.677+0000 7f17bb400640 1 -- 172.21.15.22:0/3663620895 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f17b4048070 con 0x7f17a80039b0 2024-04-16T16:20:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.678+0000 7f17bb400640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f17a006ce90 0x7f17a006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.678+0000 7f17bb400640 1 -- 172.21.15.22:0/3663620895 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f17b40ae560 con 0x7f17a80039b0 2024-04-16T16:20:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.678+0000 7f17ba000640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f17a006ce90 0x7f17a006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.679+0000 7f17ba000640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f17a006ce90 0x7f17a006f350 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f17c4072c10 tx=0x7f17ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:40.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.683+0000 7f17bb400640 1 -- 172.21.15.22:0/3663620895 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17c41540d0 con 0x7f17a80039b0 2024-04-16T16:20:40.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.928+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17c4075f30 con 0x7f17a80039b0 2024-04-16T16:20:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.929+0000 7f17bb400640 1 -- 172.21.15.22:0/3663620895 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5175 (secure 0 0 0) 0x7f17b407bfc0 con 0x7f17a80039b0 2024-04-16T16:20:40.928 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:40.929 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3896039959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3896039959},{"type":"v1","addr":"172.21.15.22:6836","nonce":3896039959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/594862213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":594862213},{"type":"v1","addr":"172.21.15.43:6834","nonce":594862213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/754211698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":754211698},{"type":"v1","addr":"172.21.15.43:6835","nonce":754211698}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:19:30.225286+0000","modified":"2024-04-16T16:19:33.300977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5047},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5047":{"gid":5047,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/1166400952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1166400952},{"type":"v1","addr":"172.21.15.22:6837","nonce":1166400952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5047,"qdb_cluster":[5047]},"id":3}]} 2024-04-16T16:20:40.929 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 27 2024-04-16T16:20:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f17a006ce90 msgr2=0x7f17a006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f17a006ce90 0x7f17a006f350 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f17c4072c10 tx=0x7f17ac008040 comp rx=0 tx=0).stop 2024-04-16T16:20:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 msgr2=0x7f17c4154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17c4154a80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f17b402cbf0 tx=0x7f17c406d330 comp rx=0 tx=0).stop 2024-04-16T16:20:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 shutdown_connections 2024-04-16T16:20:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f17a006ce90 0x7f17a006f350 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17c41e7430 0x7f17c4156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c41e6a70 0x7f17c41e6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 --2- 172.21.15.22:0/3663620895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17a80039b0 0x7f17c4154a80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 >> 172.21.15.22:0/3663620895 conn(0x7f17c4062440 msgr2=0x7f17c4070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 shutdown_connections 2024-04-16T16:20:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:40.932+0000 7f17c3e00640 1 -- 172.21.15.22:0/3663620895 wait complete. 2024-04-16T16:20:40.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:20:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.167+0000 7f8cdc000640 1 Processor -- start 2024-04-16T16:20:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.168+0000 7f8cdc000640 1 -- start start 2024-04-16T16:20:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.169+0000 7f8cdc000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cd40afd90 0x7f8cd4072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.169+0000 7f8cdc000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd4073050 0x7f8cd415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.169+0000 7f8cdc000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd41606d0 con 0x7f8cd406dc80 2024-04-16T16:20:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.169+0000 7f8cdc000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd4160480 con 0x7f8cd40afd90 2024-04-16T16:20:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.169+0000 7f8cdc000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd41609b0 con 0x7f8cd4073050 2024-04-16T16:20:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cd9600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cd40afd90 0x7f8cd4072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cd9600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cd40afd90 0x7f8cd4072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43736/0 (socket says 172.21.15.22:43736) 2024-04-16T16:20:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cd9600640 1 -- 172.21.15.22:0/1748835655 learned_addr learned my addr 172.21.15.22:0/1748835655 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cda000640 1 --2- 172.21.15.22:0/1748835655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd4073050 0x7f8cd415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cd9600640 1 -- 172.21.15.22:0/1748835655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd4073050 msgr2=0x7f8cd415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cd9600640 1 --2- 172.21.15.22:0/1748835655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd4073050 0x7f8cd415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cd9600640 1 -- 172.21.15.22:0/1748835655 >> v1:172.21.15.43:6789/0 conn(0x7f8cd406dc80 legacy=0x7f8cd40d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.170+0000 7f8cd9600640 1 -- 172.21.15.22:0/1748835655 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd4160c90 con 0x7f8cd40afd90 2024-04-16T16:20:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.172+0000 7f8cd9600640 1 --2- 172.21.15.22:0/1748835655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40afd90 0x7f8cd4072b10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009870 tx=0x7f8cc402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed0fc6499947bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.172+0000 7f8cd3e00640 1 -- 172.21.15.22:0/1748835655 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4035020 con 0x7f8cd40afd90 2024-04-16T16:20:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.172+0000 7f8cd3e00640 1 -- 172.21.15.22:0/1748835655 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc4031640 con 0x7f8cd40afd90 2024-04-16T16:20:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.172+0000 7f8cd3e00640 1 -- 172.21.15.22:0/1748835655 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc402d040 con 0x7f8cd40afd90 2024-04-16T16:20:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 -- 172.21.15.22:0/1748835655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40afd90 msgr2=0x7f8cd4072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 --2- 172.21.15.22:0/1748835655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40afd90 0x7f8cd4072b10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009870 tx=0x7f8cc402b8f0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 -- 172.21.15.22:0/1748835655 shutdown_connections 2024-04-16T16:20:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 --2- 172.21.15.22:0/1748835655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd4073050 0x7f8cd415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 --2- 172.21.15.22:0/1748835655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd40afd90 0x7f8cd4072b10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 -- 172.21.15.22:0/1748835655 >> 172.21.15.22:0/1748835655 conn(0x7f8cd4062440 msgr2=0x7f8cd4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 -- 172.21.15.22:0/1748835655 shutdown_connections 2024-04-16T16:20:41.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.173+0000 7f8cdc000640 1 -- 172.21.15.22:0/1748835655 wait complete. 2024-04-16T16:20:41.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.175+0000 7f8cdc000640 1 Processor -- start 2024-04-16T16:20:41.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.176+0000 7f8cdc000640 1 -- start start 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cdc000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd406dc80 0x7f8cd415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cdc000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd4073050 0x7f8cd4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cdc000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd40afd90 0x7f8cd415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cdc000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40ce8a0 con 0x7f8cd4073050 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cdc000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40b0170 con 0x7f8cd40afd90 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cdc000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd40cea20 con 0x7f8cd406dc80 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cd8c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd4073050 0x7f8cd4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cd8c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd4073050 0x7f8cd4155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43742/0 (socket says 172.21.15.22:43742) 2024-04-16T16:20:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.177+0000 7f8cd8c00640 1 -- 172.21.15.22:0/2637876870 learned_addr learned my addr 172.21.15.22:0/2637876870 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd9600640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd406dc80 0x7f8cd415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cda000640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd40afd90 0x7f8cd415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd8c00640 1 -- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd406dc80 msgr2=0x7f8cd415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd8c00640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd406dc80 0x7f8cd415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd8c00640 1 -- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd40afd90 msgr2=0x7f8cd415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd8c00640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd40afd90 0x7f8cd415d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd8c00640 1 -- 172.21.15.22:0/2637876870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd41f56c0 con 0x7f8cd4073050 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd8c00640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd4073050 0x7f8cd4155a50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800c390 tx=0x7f8cc800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd1600640 1 -- 172.21.15.22:0/2637876870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80052d0 con 0x7f8cd4073050 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd1600640 1 -- 172.21.15.22:0/2637876870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc8005470 con 0x7f8cd4073050 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd41f59a0 con 0x7f8cd4073050 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.178+0000 7f8cd1600640 1 -- 172.21.15.22:0/2637876870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8007260 con 0x7f8cd4073050 2024-04-16T16:20:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.179+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd41f6240 con 0x7f8cd4073050 2024-04-16T16:20:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.180+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd41f6440 con 0x7f8cd4073050 2024-04-16T16:20:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.181+0000 7f8cd1600640 1 -- 172.21.15.22:0/2637876870 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f8cc8007400 con 0x7f8cd4073050 2024-04-16T16:20:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.182+0000 7f8cd1600640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8cb806ce90 0x7f8cb806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.182+0000 7f8cd1600640 1 -- 172.21.15.22:0/2637876870 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f8cc808bac0 con 0x7f8cd4073050 2024-04-16T16:20:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.182+0000 7f8cd9600640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8cb806ce90 0x7f8cb806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.183+0000 7f8cd9600640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8cb806ce90 0x7f8cb806f350 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4036000 tx=0x7f8cc403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.187+0000 7f8cd1600640 1 -- 172.21.15.22:0/2637876870 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8cd41f6440 con 0x7f8cd4073050 2024-04-16T16:20:41.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.436+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cd404fd90 con 0x7f8cd4073050 2024-04-16T16:20:41.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.437+0000 7f8cd1600640 1 -- 172.21.15.22:0/2637876870 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5175 (secure 0 0 0) 0x7f8cc80595e0 con 0x7f8cd4073050 2024-04-16T16:20:41.437 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:41.437 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3896039959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3896039959},{"type":"v1","addr":"172.21.15.22:6836","nonce":3896039959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/594862213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":594862213},{"type":"v1","addr":"172.21.15.43:6834","nonce":594862213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/754211698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":754211698},{"type":"v1","addr":"172.21.15.43:6835","nonce":754211698}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:19:30.225286+0000","modified":"2024-04-16T16:19:33.300977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5047},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5047":{"gid":5047,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/1166400952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":1166400952},{"type":"v1","addr":"172.21.15.22:6837","nonce":1166400952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5047,"qdb_cluster":[5047]},"id":3}]} 2024-04-16T16:20:41.437 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 27 2024-04-16T16:20:41.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8cb806ce90 msgr2=0x7f8cb806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8cb806ce90 0x7f8cb806f350 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4036000 tx=0x7f8cc403c040 comp rx=0 tx=0).stop 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd4073050 msgr2=0x7f8cd4155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd4073050 0x7f8cd4155a50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800c390 tx=0x7f8cc800c790 comp rx=0 tx=0).stop 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 shutdown_connections 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8cb806ce90 0x7f8cb806f350 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd40afd90 0x7f8cd415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cd4073050 0x7f8cd4155a50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 --2- 172.21.15.22:0/2637876870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cd406dc80 0x7f8cd415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.440+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 >> 172.21.15.22:0/2637876870 conn(0x7f8cd4062440 msgr2=0x7f8cd415bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.441+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 shutdown_connections 2024-04-16T16:20:41.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.441+0000 7f8cdc000640 1 -- 172.21.15.22:0/2637876870 wait complete. 2024-04-16T16:20:41.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:41.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.680+0000 7f6afda00640 1 Processor -- start 2024-04-16T16:20:41.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.680+0000 7f6afda00640 1 -- start start 2024-04-16T16:20:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.681+0000 7f6afda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 0x7f6af80cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.681+0000 7f6afda00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af80b9080 con 0x7f6af815ea50 2024-04-16T16:20:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.681+0000 7f6afda00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af80b9360 con 0x7f6af80cfb70 2024-04-16T16:20:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.681+0000 7f6afda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6af80b9c90 con 0x7f6af80d3dd0 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.682+0000 7f6af7e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6af815ea50 0x7f6af80ba280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48090/0 (socket says 172.21.15.22:48090) 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.682+0000 7f6af7e00640 1 -- 172.21.15.22:0/2042371519 learned_addr learned my addr 172.21.15.22:0/2042371519 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.682+0000 7f6af7400640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 0x7f6af80cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.682+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161289761 0 0) 0x7f6af80b9080 con 0x7f6af815ea50 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.682+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad8003520 con 0x7f6af815ea50 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 751926560 0 0) 0x7f6ad8003520 con 0x7f6af815ea50 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 msgr2=0x7f6af80cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 0x7f6af80cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 >> v1:172.21.15.43:6789/0 conn(0x7f6af80cfb70 legacy=0x7f6af80b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af80b9640 con 0x7f6af815ea50 2024-04-16T16:20:41.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f6ae8001670 con 0x7f6af815ea50 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 >> v1:172.21.15.22:6789/0 conn(0x7f6af815ea50 legacy=0x7f6af80ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad80039e0 0x7f6ad8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8004800 0x7f6ad8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 0x7f6ad800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6af80b9c90 con 0x7f6ad80039e0 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8005550 con 0x7f6ad8004800 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad800bf00 con 0x7f6af80d3dd0 2024-04-16T16:20:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.683+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad80039e0 0x7f6ad8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6af7400640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8004800 0x7f6ad8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6afd000640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 0x7f6ad800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6af7e00640 1 -- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 msgr2=0x7f6ad800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 0x7f6ad800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6af7e00640 1 -- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8004800 msgr2=0x7f6ad8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8004800 0x7f6ad8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6af7e00640 1 -- 172.21.15.22:0/2042371519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad8003520 con 0x7f6ad80039e0 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.684+0000 7f6afd000640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6af80d3dd0 0x7f6ad800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.685+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad80039e0 0x7f6ad8003e00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800c0e0 tx=0x7f6ad8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904131fb1282e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.685+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8007c20 con 0x7f6ad80039e0 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.685+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae8030070 con 0x7f6ad80039e0 2024-04-16T16:20:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.685+0000 7f6af6a00640 1 -- 172.21.15.22:0/2042371519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8005d30 con 0x7f6ad80039e0 2024-04-16T16:20:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.686+0000 7f6afda00640 1 -- 172.21.15.22:0/2042371519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad80039e0 msgr2=0x7f6ad8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.686+0000 7f6afda00640 1 --2- 172.21.15.22:0/2042371519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad80039e0 0x7f6ad8003e00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800c0e0 tx=0x7f6ad8005830 comp rx=0 tx=0).stop 2024-04-16T16:20:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.686+0000 7f6afd000640 1 -- 172.21.15.22:0/2042371519 reap_dead start 2024-04-16T16:20:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.686+0000 7f6afda00640 1 -- 172.21.15.22:0/2042371519 shutdown_connections 2024-04-16T16:20:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.686+0000 7f6afda00640 1 -- 172.21.15.22:0/2042371519 >> 172.21.15.22:0/2042371519 conn(0x7f6af8072430 msgr2=0x7f6af8072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.686+0000 7f6afda00640 1 -- 172.21.15.22:0/2042371519 shutdown_connections 2024-04-16T16:20:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.686+0000 7f6afda00640 1 -- 172.21.15.22:0/2042371519 wait complete. 2024-04-16T16:20:41.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.688+0000 7f6afda00640 1 Processor -- start 2024-04-16T16:20:41.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.688+0000 7f6afda00640 1 -- start start 2024-04-16T16:20:41.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad80039e0 0x7f6af8154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6af8158430 0x7f6af80cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af8158890 0x7f6af80ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afda00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6af80cf630 con 0x7f6af8158890 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6af815ee30 con 0x7f6af8158430 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6af80cf7b0 con 0x7f6ad80039e0 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af8158890 0x7f6af80ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af8158890 0x7f6af80ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43768/0 (socket says 172.21.15.22:43768) 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afd000640 1 -- 172.21.15.22:0/2838704075 learned_addr learned my addr 172.21.15.22:0/2838704075 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6af7400640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6af8158430 0x7f6af80cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad80039e0 0x7f6af8154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.689+0000 7f6afd000640 1 -- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad80039e0 msgr2=0x7f6af8154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6afd000640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad80039e0 0x7f6af8154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6afd000640 1 -- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6af8158430 msgr2=0x7f6af80cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6afd000640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6af8158430 0x7f6af80cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6afd000640 1 -- 172.21.15.22:0/2838704075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af80c86e0 con 0x7f6af8158890 2024-04-16T16:20:41.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad80039e0 0x7f6af8154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:41.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6afd000640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af8158890 0x7f6af80ccfc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6af8069350 tx=0x7f6af000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:41.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6aefe00640 1 -- 172.21.15.22:0/2838704075 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0007030 con 0x7f6af8158890 2024-04-16T16:20:41.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6aefe00640 1 -- 172.21.15.22:0/2838704075 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af00071d0 con 0x7f6af8158890 2024-04-16T16:20:41.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6aefe00640 1 -- 172.21.15.22:0/2838704075 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0007600 con 0x7f6af8158890 2024-04-16T16:20:41.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af80c89c0 con 0x7f6af8158890 2024-04-16T16:20:41.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.690+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af80c8f80 con 0x7f6af8158890 2024-04-16T16:20:41.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.692+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af8075f30 con 0x7f6af8158890 2024-04-16T16:20:41.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.693+0000 7f6aefe00640 1 -- 172.21.15.22:0/2838704075 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f6af001b020 con 0x7f6af8158890 2024-04-16T16:20:41.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.694+0000 7f6aefe00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ad406ce90 0x7f6ad406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:41.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.694+0000 7f6aefe00640 1 -- 172.21.15.22:0/2838704075 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7f6af008c020 con 0x7f6af8158890 2024-04-16T16:20:41.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.694+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ad406ce90 0x7f6ad406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:41.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.695+0000 7f6af7e00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ad406ce90 0x7f6ad406f350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8034000 tx=0x7f6ae8007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:41.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.698+0000 7f6aefe00640 1 -- 172.21.15.22:0/2838704075 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6af0059c20 con 0x7f6af8158890 2024-04-16T16:20:41.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.908+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6af80d44c0 con 0x7f6af8158890 2024-04-16T16:20:41.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.911+0000 7f6aefe00640 1 -- 172.21.15.22:0/2838704075 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16650 (secure 0 0 0) 0x7f6af0059520 con 0x7f6af8158890 2024-04-16T16:20:41.911 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:41.911 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":51,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:37.505877+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:19:28.116371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-16T16:19:29.218326+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ad406ce90 msgr2=0x7f6ad406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ad406ce90 0x7f6ad406f350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8034000 tx=0x7f6ae8007000 comp rx=0 tx=0).stop 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af8158890 msgr2=0x7f6af80ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af8158890 0x7f6af80ccfc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6af8069350 tx=0x7f6af000d890 comp rx=0 tx=0).stop 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 shutdown_connections 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6ad406ce90 0x7f6ad406f350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af8158890 0x7f6af80ccfc0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6af8158430 0x7f6af80cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 --2- 172.21.15.22:0/2838704075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad80039e0 0x7f6af8154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 >> 172.21.15.22:0/2838704075 conn(0x7f6af8072430 msgr2=0x7f6af815d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 shutdown_connections 2024-04-16T16:20:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:41.914+0000 7f6afda00640 1 -- 172.21.15.22:0/2838704075 wait complete. 2024-04-16T16:20:41.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T16:20:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.150+0000 7faff3e00640 1 Processor -- start 2024-04-16T16:20:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.150+0000 7faff3e00640 1 -- start start 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fafec072fc0 0x7fafec0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff3e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fafec0d09f0 0x7fafec0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff3e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec161540 con 0x7fafec15c990 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff3e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fafec0afd80 con 0x7fafec072fc0 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff3e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fafec160780 con 0x7fafec0d09f0 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff1400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fafec15c990 0x7fafec0728b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48092/0 (socket says 172.21.15.22:48092) 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff1400640 1 -- 172.21.15.22:0/2586807511 learned_addr learned my addr 172.21.15.22:0/2586807511 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.152+0000 7faff0a00640 1 --2- 172.21.15.22:0/2586807511 >> v2:172.21.15.22:3300/0 conn(0x7fafec072fc0 0x7fafec0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.153+0000 7faff1e00640 1 --2- 172.21.15.22:0/2586807511 >> v2:172.21.15.43:3300/0 conn(0x7fafec0d09f0 0x7fafec0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.153+0000 7fafebe00640 1 -- 172.21.15.22:0/2586807511 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214262750 0 0) 0x7fafec161540 con 0x7fafec15c990 2024-04-16T16:20:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.153+0000 7fafebe00640 1 -- 172.21.15.22:0/2586807511 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd4003520 con 0x7fafec15c990 2024-04-16T16:20:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.153+0000 7faff0a00640 1 -- 172.21.15.22:0/2586807511 >> v2:172.21.15.43:3300/0 conn(0x7fafec0d09f0 msgr2=0x7fafec0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.153+0000 7faff0a00640 1 --2- 172.21.15.22:0/2586807511 >> v2:172.21.15.43:3300/0 conn(0x7fafec0d09f0 0x7fafec0b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.153+0000 7faff0a00640 1 -- 172.21.15.22:0/2586807511 >> v1:172.21.15.22:6789/0 conn(0x7fafec15c990 legacy=0x7fafec0728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.153+0000 7faff0a00640 1 -- 172.21.15.22:0/2586807511 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0d0e20 con 0x7fafec072fc0 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.154+0000 7faff0a00640 1 --2- 172.21.15.22:0/2586807511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0d04b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fafec0cd600 tx=0x7fafd802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caf7440d336a5ee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.154+0000 7fafebe00640 1 -- 172.21.15.22:0/2586807511 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd80315a0 con 0x7fafec072fc0 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.154+0000 7fafebe00640 1 -- 172.21.15.22:0/2586807511 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd8037070 con 0x7fafec072fc0 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7fafebe00640 1 -- 172.21.15.22:0/2586807511 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8031940 con 0x7fafec072fc0 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 -- 172.21.15.22:0/2586807511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 msgr2=0x7fafec0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 --2- 172.21.15.22:0/2586807511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0d04b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fafec0cd600 tx=0x7fafd802b840 comp rx=0 tx=0).stop 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 -- 172.21.15.22:0/2586807511 shutdown_connections 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 --2- 172.21.15.22:0/2586807511 >> v2:172.21.15.43:3300/0 conn(0x7fafec0d09f0 0x7fafec0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 --2- 172.21.15.22:0/2586807511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0d04b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 -- 172.21.15.22:0/2586807511 >> 172.21.15.22:0/2586807511 conn(0x7fafec062440 msgr2=0x7fafec062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 -- 172.21.15.22:0/2586807511 shutdown_connections 2024-04-16T16:20:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.155+0000 7faff3e00640 1 -- 172.21.15.22:0/2586807511 wait complete. 2024-04-16T16:20:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.157+0000 7faff3e00640 1 Processor -- start 2024-04-16T16:20:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.157+0000 7faff3e00640 1 -- start start 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafec0d09f0 0x7fafec14dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafec15c990 0x7fafec14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff3e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fafec161020 con 0x7fafec072fc0 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fafec160d40 con 0x7fafec0d09f0 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fafec15cd70 con 0x7fafec15c990 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff1400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff1400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43780/0 (socket says 172.21.15.22:43780) 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.158+0000 7faff1400640 1 -- 172.21.15.22:0/584233724 learned_addr learned my addr 172.21.15.22:0/584233724 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff1400640 1 -- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafec15c990 msgr2=0x7fafec14e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff1400640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafec15c990 0x7fafec14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff0a00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafec0d09f0 0x7fafec14dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff1400640 1 -- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafec0d09f0 msgr2=0x7fafec14dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff1400640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafec0d09f0 0x7fafec14dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff1400640 1 -- 172.21.15.22:0/584233724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec15d110 con 0x7fafec072fc0 2024-04-16T16:20:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff0a00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafec0d09f0 0x7fafec14dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7faff1400640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0aead0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c3c0 tx=0x7fafe000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.159+0000 7fafe9600640 1 -- 172.21.15.22:0/584233724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0017070 con 0x7fafec072fc0 2024-04-16T16:20:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.160+0000 7fafe9600640 1 -- 172.21.15.22:0/584233724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe0005ce0 con 0x7fafec072fc0 2024-04-16T16:20:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.160+0000 7fafe9600640 1 -- 172.21.15.22:0/584233724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe00072f0 con 0x7fafec072fc0 2024-04-16T16:20:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.160+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafec15d3f0 con 0x7fafec072fc0 2024-04-16T16:20:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.160+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafec15d9b0 con 0x7fafec072fc0 2024-04-16T16:20:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.161+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafec04fd90 con 0x7fafec072fc0 2024-04-16T16:20:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.162+0000 7fafe9600640 1 -- 172.21.15.22:0/584233724 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fafe001a070 con 0x7fafec072fc0 2024-04-16T16:20:42.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.163+0000 7fafe9600640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fafcc06ce90 0x7fafcc06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.163+0000 7fafe9600640 1 -- 172.21.15.22:0/584233724 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5795+0+0 (secure 0 0 0) 0x7fafe008b9f0 con 0x7fafec072fc0 2024-04-16T16:20:42.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.163+0000 7faff0a00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fafcc06ce90 0x7fafcc06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.164+0000 7faff0a00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fafcc06ce90 0x7fafcc06f350 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fafd8036000 tx=0x7fafd8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:42.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.167+0000 7fafe9600640 1 -- 172.21.15.22:0/584233724 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fafe00595a0 con 0x7fafec072fc0 2024-04-16T16:20:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.412+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fafec160350 con 0x7fafec072fc0 2024-04-16T16:20:42.413 INFO:tasks.ceph.mon.a.smithi022.stderr:2024-04-16T16:20:42.413+0000 7f6a16800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T16:20:42.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.416+0000 7fafe9600640 1 -- 172.21.15.22:0/584233724 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7fafe0058ea0 con 0x7fafec072fc0 2024-04-16T16:20:42.416 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.419+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fafcc06ce90 msgr2=0x7fafcc06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.419+0000 7faff3e00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fafcc06ce90 0x7fafcc06f350 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fafd8036000 tx=0x7fafd8008030 comp rx=0 tx=0).stop 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.419+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 msgr2=0x7fafec0aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.419+0000 7faff3e00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0aead0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c3c0 tx=0x7fafe000c880 comp rx=0 tx=0).stop 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.419+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 shutdown_connections 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.419+0000 7faff3e00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fafcc06ce90 0x7fafcc06f350 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.419+0000 7faff3e00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafec15c990 0x7fafec14e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.420+0000 7faff3e00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafec0d09f0 0x7fafec14dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.420+0000 7faff3e00640 1 --2- 172.21.15.22:0/584233724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafec072fc0 0x7fafec0aead0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.420+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 >> 172.21.15.22:0/584233724 conn(0x7fafec062440 msgr2=0x7fafec071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:42.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.420+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 shutdown_connections 2024-04-16T16:20:42.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.420+0000 7faff3e00640 1 -- 172.21.15.22:0/584233724 wait complete. 2024-04-16T16:20:42.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T16:20:42.514 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2024-04-16T16:20:42.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.645+0000 7f3cdbe00640 1 Processor -- start 2024-04-16T16:20:42.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.645+0000 7f3cdbe00640 1 -- start start 2024-04-16T16:20:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.647+0000 7f3cdbe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3cdc0b4fa0 0x7f3cdc070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.647+0000 7f3cdbe00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cdc0715c0 con 0x7f3cdc0b33a0 2024-04-16T16:20:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.647+0000 7f3cdbe00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cdc0718a0 con 0x7f3cdc15fe30 2024-04-16T16:20:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.647+0000 7f3cdbe00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3cdc071360 con 0x7f3cdc0b4fa0 2024-04-16T16:20:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.647+0000 7f3cd2000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3cdc0b33a0 0x7f3cdc15f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48104/0 (socket says 172.21.15.22:48104) 2024-04-16T16:20:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.647+0000 7f3cd2000640 1 -- 172.21.15.22:0/1882113605 learned_addr learned my addr 172.21.15.22:0/1882113605 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.647+0000 7f3cdaa00640 1 --2- 172.21.15.22:0/1882113605 >> v2:172.21.15.22:3300/0 conn(0x7f3cdc0b4fa0 0x7f3cdc070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.648+0000 7f3cda000640 1 -- 172.21.15.22:0/1882113605 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206943768 0 0) 0x7f3cdc0715c0 con 0x7f3cdc0b33a0 2024-04-16T16:20:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.648+0000 7f3cdaa00640 1 -- 172.21.15.22:0/1882113605 >> v1:172.21.15.43:6789/0 conn(0x7f3cdc15fe30 legacy=0x7f3cdc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.648+0000 7f3cdaa00640 1 -- 172.21.15.22:0/1882113605 >> v1:172.21.15.22:6789/0 conn(0x7f3cdc0b33a0 legacy=0x7f3cdc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.648+0000 7f3cdaa00640 1 -- 172.21.15.22:0/1882113605 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc071b80 con 0x7f3cdc0b4fa0 2024-04-16T16:20:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.649+0000 7f3cdaa00640 1 --2- 172.21.15.22:0/1882113605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc0b4fa0 0x7f3cdc070e20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0097a0 tx=0x7f3ccc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7691239d8b2fa5e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.649+0000 7f3cda000640 1 -- 172.21.15.22:0/1882113605 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc035020 con 0x7f3cdc0b4fa0 2024-04-16T16:20:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.649+0000 7f3cda000640 1 -- 172.21.15.22:0/1882113605 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc031830 con 0x7f3cdc0b4fa0 2024-04-16T16:20:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.649+0000 7f3cda000640 1 -- 172.21.15.22:0/1882113605 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc031c00 con 0x7f3cdc0b4fa0 2024-04-16T16:20:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.649+0000 7f3cdbe00640 1 -- 172.21.15.22:0/1882113605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc0b4fa0 msgr2=0x7f3cdc070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.649+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/1882113605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc0b4fa0 0x7f3cdc070e20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0097a0 tx=0x7f3ccc02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.650+0000 7f3cdbe00640 1 -- 172.21.15.22:0/1882113605 shutdown_connections 2024-04-16T16:20:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.650+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/1882113605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc0b4fa0 0x7f3cdc070e20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.650+0000 7f3cdbe00640 1 -- 172.21.15.22:0/1882113605 >> 172.21.15.22:0/1882113605 conn(0x7f3cdc075070 msgr2=0x7f3cdc062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.650+0000 7f3cdbe00640 1 -- 172.21.15.22:0/1882113605 shutdown_connections 2024-04-16T16:20:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.650+0000 7f3cdbe00640 1 -- 172.21.15.22:0/1882113605 wait complete. 2024-04-16T16:20:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.651+0000 7f3cdbe00640 1 Processor -- start 2024-04-16T16:20:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.651+0000 7f3cdbe00640 1 -- start start 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.652+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0b33a0 0x7f3cdc1e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.652+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc0b4fa0 0x7f3cdc1e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.652+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc15fe30 0x7f3cdc15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.652+0000 7f3cdbe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc0b5380 con 0x7f3cdc15fe30 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.652+0000 7f3cdbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc0ce630 con 0x7f3cdc0b33a0 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.652+0000 7f3cdbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc0b5500 con 0x7f3cdc0b4fa0 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc15fe30 0x7f3cdc15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc15fe30 0x7f3cdc15a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43826/0 (socket says 172.21.15.22:43826) 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 -- 172.21.15.22:0/2915482394 learned_addr learned my addr 172.21.15.22:0/2915482394 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdaa00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0b33a0 0x7f3cdc1e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cd2000640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc0b4fa0 0x7f3cdc1e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 -- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc0b4fa0 msgr2=0x7f3cdc1e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc0b4fa0 0x7f3cdc1e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 -- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0b33a0 msgr2=0x7f3cdc1e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0b33a0 0x7f3cdc1e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 -- 172.21.15.22:0/2915482394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc1e79b0 con 0x7f3cdc15fe30 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdaa00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0b33a0 0x7f3cdc1e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.653+0000 7f3cdb400640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc15fe30 0x7f3cdc15a410 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400b9a0 tx=0x7f3cd400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.654+0000 7f3cd3400640 1 -- 172.21.15.22:0/2915482394 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4019070 con 0x7f3cdc15fe30 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.654+0000 7f3cd3400640 1 -- 172.21.15.22:0/2915482394 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd400cb40 con 0x7f3cdc15fe30 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.654+0000 7f3cd3400640 1 -- 172.21.15.22:0/2915482394 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4014440 con 0x7f3cdc15fe30 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.654+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc1e7c90 con 0x7f3cdc15fe30 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.654+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc1e8250 con 0x7f3cdc15fe30 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.655+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cdc075f30 con 0x7f3cdc15fe30 2024-04-16T16:20:42.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.656+0000 7f3cd3400640 1 -- 172.21.15.22:0/2915482394 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f3cd401c070 con 0x7f3cdc15fe30 2024-04-16T16:20:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.657+0000 7f3cd3400640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3cb806ce90 0x7f3cb806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.657+0000 7f3cd3400640 1 -- 172.21.15.22:0/2915482394 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5853+0+0 (secure 0 0 0) 0x7f3cd408c240 con 0x7f3cdc15fe30 2024-04-16T16:20:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.657+0000 7f3cdaa00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3cb806ce90 0x7f3cb806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.658+0000 7f3cdaa00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3cb806ce90 0x7f3cb806f350 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc036000 tx=0x7f3ccc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:42.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.662+0000 7f3cd3400640 1 -- 172.21.15.22:0/2915482394 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3cd4059d30 con 0x7f3cdc15fe30 2024-04-16T16:20:42.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:42.906+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3cdc072560 con 0x7f3cdc15fe30 2024-04-16T16:20:43.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.420+0000 7f3cd3400640 1 -- 172.21.15.22:0/2915482394 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f3cd4059630 con 0x7f3cdc15fe30 2024-04-16T16:20:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3cb806ce90 msgr2=0x7f3cb806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3cb806ce90 0x7f3cb806f350 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc036000 tx=0x7f3ccc008030 comp rx=0 tx=0).stop 2024-04-16T16:20:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc15fe30 msgr2=0x7f3cdc15a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc15fe30 0x7f3cdc15a410 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400b9a0 tx=0x7f3cd400be60 comp rx=0 tx=0).stop 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 shutdown_connections 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f3cb806ce90 0x7f3cb806f350 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cdc15fe30 0x7f3cdc15a410 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc0b4fa0 0x7f3cdc1e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 --2- 172.21.15.22:0/2915482394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0b33a0 0x7f3cdc1e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.424+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 >> 172.21.15.22:0/2915482394 conn(0x7f3cdc075070 msgr2=0x7f3cdc0b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.425+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 shutdown_connections 2024-04-16T16:20:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.425+0000 7f3cdbe00640 1 -- 172.21.15.22:0/2915482394 wait complete. 2024-04-16T16:20:43.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T16:20:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.673+0000 7f21fb200640 1 Processor -- start 2024-04-16T16:20:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.673+0000 7f21fb200640 1 -- start start 2024-04-16T16:20:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.674+0000 7f21fb200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f21fc15eb00 0x7f21fc0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.674+0000 7f21fb200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21fc162bf0 con 0x7f21fc1626f0 2024-04-16T16:20:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.674+0000 7f21fb200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21fc162ed0 con 0x7f21fc0d1eb0 2024-04-16T16:20:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.674+0000 7f21fb200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f21fc0b3f40 con 0x7f21fc15eb00 2024-04-16T16:20:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.675+0000 7f21f9400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f21fc1626f0 0x7f21fc0d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48116/0 (socket says 172.21.15.22:48116) 2024-04-16T16:20:43.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.675+0000 7f21f9400640 1 -- 172.21.15.22:0/2039744965 learned_addr learned my addr 172.21.15.22:0/2039744965 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.675+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2039744965 >> v2:172.21.15.43:3300/0 conn(0x7f21fc15eb00 0x7f21fc0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.675+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544834640 0 0) 0x7f21fc162bf0 con 0x7f21fc1626f0 2024-04-16T16:20:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.675+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21e0003520 con 0x7f21fc1626f0 2024-04-16T16:20:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.675+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 74650956 0 0) 0x7f21e0003520 con 0x7f21fc1626f0 2024-04-16T16:20:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 >> v2:172.21.15.43:3300/0 conn(0x7f21fc15eb00 msgr2=0x7f21fc0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 --2- 172.21.15.22:0/2039744965 >> v2:172.21.15.43:3300/0 conn(0x7f21fc15eb00 0x7f21fc0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 >> v1:172.21.15.43:6789/0 conn(0x7f21fc0d1eb0 legacy=0x7f21fc0d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc1631b0 con 0x7f21fc1626f0 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f21e8001670 con 0x7f21fc1626f0 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 >> v1:172.21.15.22:6789/0 conn(0x7f21fc1626f0 legacy=0x7f21fc0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21e0004800 0x7f21e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00051c0 0x7f21e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21e000c090 con 0x7f21e0003a00 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21e000c240 con 0x7f21e00051c0 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f21e000c440 con 0x7f21e0004800 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f9e00640 1 -- 172.21.15.22:0/2039744965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21e0004800 msgr2=0x7f21e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21e0004800 0x7f21e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f9e00640 1 -- 172.21.15.22:0/2039744965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00051c0 msgr2=0x7f21e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00051c0 0x7f21e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21f9e00640 1 -- 172.21.15.22:0/2039744965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0003520 con 0x7f21e0003a00 2024-04-16T16:20:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.676+0000 7f21fa800640 1 -- 172.21.15.22:0/2039744965 reap_dead start 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.677+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21e0003e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009ac0 tx=0x7f21e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7da4123148ffe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec039070 con 0x7f21e0003a00 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec02c710 con 0x7f21e0003a00 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21f8a00640 1 -- 172.21.15.22:0/2039744965 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec009690 con 0x7f21e0003a00 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21fb200640 1 -- 172.21.15.22:0/2039744965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 msgr2=0x7f21e0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21fb200640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21e0003e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009ac0 tx=0x7f21e0005830 comp rx=0 tx=0).stop 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21fb200640 1 -- 172.21.15.22:0/2039744965 shutdown_connections 2024-04-16T16:20:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21fb200640 1 --2- 172.21.15.22:0/2039744965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21e0003e20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21fb200640 1 -- 172.21.15.22:0/2039744965 >> 172.21.15.22:0/2039744965 conn(0x7f21fc062860 msgr2=0x7f21fc062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21fb200640 1 -- 172.21.15.22:0/2039744965 shutdown_connections 2024-04-16T16:20:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.678+0000 7f21fb200640 1 -- 172.21.15.22:0/2039744965 wait complete. 2024-04-16T16:20:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.680+0000 7f21fb200640 1 Processor -- start 2024-04-16T16:20:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.680+0000 7f21fb200640 1 -- start start 2024-04-16T16:20:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21fb200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21fc0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21fb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21fc0b5cb0 0x7f21fc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21fb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0ce720 0x7f21fc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21fb200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc15eee0 con 0x7f21e0003a00 2024-04-16T16:20:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21fb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc0d2c50 con 0x7f21fc0ce720 2024-04-16T16:20:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21fb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc157e00 con 0x7f21fc0b5cb0 2024-04-16T16:20:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21f9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21fc0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21f9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21fc0cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43840/0 (socket says 172.21.15.22:43840) 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.681+0000 7f21f9e00640 1 -- 172.21.15.22:0/2449080427 learned_addr learned my addr 172.21.15.22:0/2449080427 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f9e00640 1 -- 172.21.15.22:0/2449080427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21fc0b5cb0 msgr2=0x7f21fc0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21fc0b5cb0 0x7f21fc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f9e00640 1 -- 172.21.15.22:0/2449080427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0ce720 msgr2=0x7f21fc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0ce720 0x7f21fc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f9e00640 1 -- 172.21.15.22:0/2449080427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc0b6820 con 0x7f21e0003a00 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f9e00640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21fc0cbb50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f21ec037040 tx=0x7f21ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f2000640 1 -- 172.21.15.22:0/2449080427 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec042020 con 0x7f21e0003a00 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f2000640 1 -- 172.21.15.22:0/2449080427 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec03a040 con 0x7f21e0003a00 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21f2000640 1 -- 172.21.15.22:0/2449080427 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec039070 con 0x7f21e0003a00 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.682+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21fc0b6b00 con 0x7f21e0003a00 2024-04-16T16:20:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.683+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21fc0ce200 con 0x7f21e0003a00 2024-04-16T16:20:43.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.684+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21fc075f30 con 0x7f21e0003a00 2024-04-16T16:20:43.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.685+0000 7f21f2000640 1 -- 172.21.15.22:0/2449080427 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f21ec045020 con 0x7f21e0003a00 2024-04-16T16:20:43.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.686+0000 7f21f2000640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21dc06ce90 0x7f21dc06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:43.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.686+0000 7f21f2000640 1 -- 172.21.15.22:0/2449080427 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5853+0+0 (secure 0 0 0) 0x7f21ec0adb10 con 0x7f21e0003a00 2024-04-16T16:20:43.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.686+0000 7f21f9400640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21dc06ce90 0x7f21dc06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.687+0000 7f21f9400640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21dc06ce90 0x7f21dc06f350 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f21e80018a0 tx=0x7f21e8001510 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:43.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.690+0000 7f21f2000640 1 -- 172.21.15.22:0/2449080427 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21ec04c070 con 0x7f21e0003a00 2024-04-16T16:20:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:43.897+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f21fc0d2520 con 0x7f21e0003a00 2024-04-16T16:20:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.558+0000 7f21f2000640 1 -- 172.21.15.22:0/2449080427 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7f21ec07b600 con 0x7f21e0003a00 2024-04-16T16:20:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-04-16T16:20:44.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21dc06ce90 msgr2=0x7f21dc06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21dc06ce90 0x7f21dc06f350 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f21e80018a0 tx=0x7f21e8001510 comp rx=0 tx=0).stop 2024-04-16T16:20:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 msgr2=0x7f21fc0cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21fc0cbb50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f21ec037040 tx=0x7f21ec004730 comp rx=0 tx=0).stop 2024-04-16T16:20:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 shutdown_connections 2024-04-16T16:20:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f21dc06ce90 0x7f21dc06f350 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0ce720 0x7f21fc0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21fc0b5cb0 0x7f21fc0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 --2- 172.21.15.22:0/2449080427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0003a00 0x7f21fc0cbb50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.563+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 >> 172.21.15.22:0/2449080427 conn(0x7f21fc062860 msgr2=0x7f21fc15f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.564+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 shutdown_connections 2024-04-16T16:20:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.564+0000 7f21fb200640 1 -- 172.21.15.22:0/2449080427 wait complete. 2024-04-16T16:20:44.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T16:20:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.817+0000 7f318ae00640 1 Processor -- start 2024-04-16T16:20:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.817+0000 7f318ae00640 1 -- start start 2024-04-16T16:20:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.818+0000 7f318ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31840b3d60 0x7f31840d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.818+0000 7f318ae00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f31840cfb10 0x7f31840cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.819+0000 7f318ae00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31840d04b0 con 0x7f3184162d00 2024-04-16T16:20:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.819+0000 7f318ae00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3184163a30 con 0x7f31840cfb10 2024-04-16T16:20:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.819+0000 7f318ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f31840d2f70 con 0x7f31840b3d60 2024-04-16T16:20:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f31840cfb10 0x7f31840cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31840b3d60 0x7f31840d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f31840cfb10 0x7f31840cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:38848/0 (socket says 172.21.15.22:38848) 2024-04-16T16:20:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183400640 1 -- 172.21.15.22:0/273722415 learned_addr learned my addr 172.21.15.22:0/273722415 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183e00640 1 --2- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31840b3d60 0x7f31840d3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:34748/0 (socket says 172.21.15.22:34748) 2024-04-16T16:20:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183400640 1 -- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31840b3d60 msgr2=0x7f31840d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183400640 1 --2- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31840b3d60 0x7f31840d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.820+0000 7f3183400640 1 -- 172.21.15.22:0/273722415 >> v1:172.21.15.43:6789/0 conn(0x7f3184162d00 legacy=0x7f3184163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.821+0000 7f3183400640 1 -- 172.21.15.22:0/273722415 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31840d3250 con 0x7f31840cfb10 2024-04-16T16:20:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.822+0000 7f3183400640 1 --2- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840cfb10 0x7f31840cff70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f316c009e50 tx=0x7f316c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac734232d4399e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.822+0000 7f3182a00640 1 -- 172.21.15.22:0/273722415 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c02ca80 con 0x7f31840cfb10 2024-04-16T16:20:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.822+0000 7f3182a00640 1 -- 172.21.15.22:0/273722415 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c02cc20 con 0x7f31840cfb10 2024-04-16T16:20:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.822+0000 7f3182a00640 1 -- 172.21.15.22:0/273722415 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c0343f0 con 0x7f31840cfb10 2024-04-16T16:20:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.823+0000 7f318ae00640 1 -- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840cfb10 msgr2=0x7f31840cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.823+0000 7f318ae00640 1 --2- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840cfb10 0x7f31840cff70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f316c009e50 tx=0x7f316c02bee0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.823+0000 7f318ae00640 1 -- 172.21.15.22:0/273722415 shutdown_connections 2024-04-16T16:20:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.823+0000 7f318ae00640 1 --2- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840cfb10 0x7f31840cff70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.823+0000 7f318ae00640 1 --2- 172.21.15.22:0/273722415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31840b3d60 0x7f31840d3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.823+0000 7f318ae00640 1 -- 172.21.15.22:0/273722415 >> 172.21.15.22:0/273722415 conn(0x7f3184062860 msgr2=0x7f3184062c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:44.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.823+0000 7f318ae00640 1 -- 172.21.15.22:0/273722415 shutdown_connections 2024-04-16T16:20:44.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.824+0000 7f318ae00640 1 -- 172.21.15.22:0/273722415 wait complete. 2024-04-16T16:20:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.825+0000 7f318ae00640 1 Processor -- start 2024-04-16T16:20:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.825+0000 7f318ae00640 1 -- start start 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.826+0000 7f318ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840b3d60 0x7f31840ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.826+0000 7f318ae00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31840cfb10 0x7f3184146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.826+0000 7f318ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3184162d00 0x7f31841472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.826+0000 7f318ae00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31840d4270 con 0x7f31840cfb10 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.826+0000 7f318ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f31840d3810 con 0x7f31840b3d60 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.826+0000 7f318ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f31840b4140 con 0x7f3184162d00 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31840cfb10 0x7f3184146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31840cfb10 0x7f3184146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43848/0 (socket says 172.21.15.22:43848) 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 -- 172.21.15.22:0/3284930444 learned_addr learned my addr 172.21.15.22:0/3284930444 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183e00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840b3d60 0x7f31840ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3188e00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3184162d00 0x7f31841472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:44.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 -- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3184162d00 msgr2=0x7f31841472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:44.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3184162d00 0x7f31841472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 -- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840b3d60 msgr2=0x7f31840ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:44.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840b3d60 0x7f31840ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:44.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.827+0000 7f3183400640 1 -- 172.21.15.22:0/3284930444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31840b4900 con 0x7f31840cfb10 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.828+0000 7f3183400640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31840cfb10 0x7f3184146d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f316c009e50 tx=0x7f316c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.828+0000 7f317be00640 1 -- 172.21.15.22:0/3284930444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c043020 con 0x7f31840cfb10 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.828+0000 7f317be00640 1 -- 172.21.15.22:0/3284930444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c03e450 con 0x7f31840cfb10 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.828+0000 7f317be00640 1 -- 172.21.15.22:0/3284930444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c009510 con 0x7f31840cfb10 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.828+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31841ea600 con 0x7f31840cfb10 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.828+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318415a5f0 con 0x7f31840cfb10 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.829+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318404fd90 con 0x7f31840cfb10 2024-04-16T16:20:44.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.830+0000 7f317be00640 1 -- 172.21.15.22:0/3284930444 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f316c046020 con 0x7f31840cfb10 2024-04-16T16:20:44.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.831+0000 7f317be00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f316006ce90 0x7f316006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:44.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.831+0000 7f317be00640 1 -- 172.21.15.22:0/3284930444 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5415+0+0 (secure 0 0 0) 0x7f316c0aed50 con 0x7f31840cfb10 2024-04-16T16:20:44.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.831+0000 7f3183e00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f316006ce90 0x7f316006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:44.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.832+0000 7f3183e00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f316006ce90 0x7f316006f350 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3174009a30 tx=0x7f3174008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:44.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:44.836+0000 7f317be00640 1 -- 172.21.15.22:0/3284930444 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f316c04d030 con 0x7f31840cfb10 2024-04-16T16:20:45.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.040+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f31840d29f0 con 0x7f31840cfb10 2024-04-16T16:20:45.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.571+0000 7f317be00640 1 -- 172.21.15.22:0/3284930444 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7f316c07ca00 con 0x7f31840cfb10 2024-04-16T16:20:45.571 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-04-16T16:20:45.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.575+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f316006ce90 msgr2=0x7f316006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:45.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.575+0000 7f318ae00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f316006ce90 0x7f316006f350 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3174009a30 tx=0x7f3174008040 comp rx=0 tx=0).stop 2024-04-16T16:20:45.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.575+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31840cfb10 msgr2=0x7f3184146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:45.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.575+0000 7f318ae00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31840cfb10 0x7f3184146d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f316c009e50 tx=0x7f316c004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:45.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 shutdown_connections 2024-04-16T16:20:45.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f316006ce90 0x7f316006f350 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3184162d00 0x7f31841472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31840cfb10 0x7f3184146d80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 --2- 172.21.15.22:0/3284930444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31840b3d60 0x7f31840ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 >> 172.21.15.22:0/3284930444 conn(0x7f3184062860 msgr2=0x7f31840c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:45.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 shutdown_connections 2024-04-16T16:20:45.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.576+0000 7f318ae00640 1 -- 172.21.15.22:0/3284930444 wait complete. 2024-04-16T16:20:45.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2024-04-16T16:20:45.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.800+0000 7f7116800640 1 Processor -- start 2024-04-16T16:20:45.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.800+0000 7f7116800640 1 -- start start 2024-04-16T16:20:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.802+0000 7f7116800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f71100d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.802+0000 7f7116800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71100cff80 0x7f71100d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.802+0000 7f7116800640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711006ed90 con 0x7f711015f0a0 2024-04-16T16:20:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.802+0000 7f7116800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f71100d11a0 con 0x7f71100cff80 2024-04-16T16:20:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.802+0000 7f7116800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f71100cc910 con 0x7f71100cc530 2024-04-16T16:20:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.803+0000 7f710fe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71100cff80 0x7f71100d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.803+0000 7f710f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f71100d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.803+0000 7f710fe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71100cff80 0x7f71100d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:38866/0 (socket says 172.21.15.22:38866) 2024-04-16T16:20:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.803+0000 7f710fe00640 1 -- 172.21.15.22:0/3199135073 learned_addr learned my addr 172.21.15.22:0/3199135073 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.804+0000 7f710fe00640 1 -- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 msgr2=0x7f71100d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.804+0000 7f710fe00640 1 --2- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f71100d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.804+0000 7f710fe00640 1 -- 172.21.15.22:0/3199135073 >> v1:172.21.15.43:6789/0 conn(0x7f711015f0a0 legacy=0x7f71100cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.804+0000 7f710fe00640 1 -- 172.21.15.22:0/3199135073 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711006d690 con 0x7f71100cff80 2024-04-16T16:20:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.804+0000 7f710f400640 1 --2- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f71100d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:20:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.805+0000 7f710fe00640 1 --2- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 0x7f71100d0b70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7108009e50 tx=0x7f710802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de849af72da4e6c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f710e000640 1 -- 172.21.15.22:0/3199135073 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710802cb00 con 0x7f71100cff80 2024-04-16T16:20:45.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f710e000640 1 -- 172.21.15.22:0/3199135073 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710802cca0 con 0x7f71100cff80 2024-04-16T16:20:45.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f710e000640 1 -- 172.21.15.22:0/3199135073 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108034610 con 0x7f71100cff80 2024-04-16T16:20:45.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f7116800640 1 -- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 msgr2=0x7f71100d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:45.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f7116800640 1 --2- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 0x7f71100d0b70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7108009e50 tx=0x7f710802bf60 comp rx=0 tx=0).stop 2024-04-16T16:20:45.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f7116800640 1 -- 172.21.15.22:0/3199135073 shutdown_connections 2024-04-16T16:20:45.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f7116800640 1 --2- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 0x7f71100d0b70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f7116800640 1 --2- 172.21.15.22:0/3199135073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f71100d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.806+0000 7f7116800640 1 -- 172.21.15.22:0/3199135073 >> 172.21.15.22:0/3199135073 conn(0x7f71100b37e0 msgr2=0x7f71100b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:45.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.807+0000 7f7116800640 1 -- 172.21.15.22:0/3199135073 shutdown_connections 2024-04-16T16:20:45.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.807+0000 7f7116800640 1 -- 172.21.15.22:0/3199135073 wait complete. 2024-04-16T16:20:45.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.808+0000 7f7116800640 1 Processor -- start 2024-04-16T16:20:45.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.808+0000 7f7116800640 1 -- start start 2024-04-16T16:20:45.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.809+0000 7f7116800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f7110159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:45.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.809+0000 7f7116800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 0x7f71100cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:45.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.809+0000 7f7116800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f711015a850 0x7f711013f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:45.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.809+0000 7f7116800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f711006dc50 con 0x7f711015a850 2024-04-16T16:20:45.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.809+0000 7f7116800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f711006dfc0 con 0x7f71100cff80 2024-04-16T16:20:45.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.809+0000 7f7116800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f71101626e0 con 0x7f71100cc530 2024-04-16T16:20:45.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f711015a850 0x7f711013f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:45.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f711015a850 0x7f711013f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43856/0 (socket says 172.21.15.22:43856) 2024-04-16T16:20:45.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 -- 172.21.15.22:0/3295858201 learned_addr learned my addr 172.21.15.22:0/3295858201 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:45.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710f400640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f7110159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:45.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710ea00640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 0x7f71100cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:45.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 -- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 msgr2=0x7f7110159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:45.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f7110159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 -- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 msgr2=0x7f71100cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 0x7f71100cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.810+0000 7f710fe00640 1 -- 172.21.15.22:0/3295858201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711015b280 con 0x7f711015a850 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.811+0000 7f710fe00640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f711015a850 0x7f711013f340 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7108009e50 tx=0x7f7108004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.811+0000 7f7107400640 1 -- 172.21.15.22:0/3295858201 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108043020 con 0x7f711015a850 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.811+0000 7f7107400640 1 -- 172.21.15.22:0/3295858201 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710802ce50 con 0x7f711015a850 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.811+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711015ace0 con 0x7f711015a850 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.811+0000 7f7107400640 1 -- 172.21.15.22:0/3295858201 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108009510 con 0x7f711015a850 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.811+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7110159510 con 0x7f711015a850 2024-04-16T16:20:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.812+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f711004fd90 con 0x7f711015a850 2024-04-16T16:20:45.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.813+0000 7f7107400640 1 -- 172.21.15.22:0/3295858201 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f7108005d10 con 0x7f711015a850 2024-04-16T16:20:45.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.814+0000 7f7107400640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f70f006cec0 0x7f70f006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:45.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.814+0000 7f7107400640 1 -- 172.21.15.22:0/3295858201 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f71080aeac0 con 0x7f711015a850 2024-04-16T16:20:45.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.815+0000 7f710f400640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f70f006cec0 0x7f70f006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.815+0000 7f710f400640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f70f006cec0 0x7f70f006f380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7100009a30 tx=0x7f7100008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:45.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:45.819+0000 7f7107400640 1 -- 172.21.15.22:0/3295858201 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71080333a0 con 0x7f711015a850 2024-04-16T16:20:46.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.022+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) -- 0x7f71100b5700 con 0x7f711015a850 2024-04-16T16:20:46.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.030+0000 7f7107400640 1 -- 172.21.15.22:0/3295858201 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v16) ==== 115+0+0 (secure 0 0 0) 0x7f710807c9d0 con 0x7f711015a850 2024-04-16T16:20:46.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.032+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f70f006cec0 msgr2=0x7f70f006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.032+0000 7f7116800640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f70f006cec0 0x7f70f006f380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7100009a30 tx=0x7f7100008040 comp rx=0 tx=0).stop 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f711015a850 msgr2=0x7f711013f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f711015a850 0x7f711013f340 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7108009e50 tx=0x7f7108004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 shutdown_connections 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f70f006cec0 0x7f70f006f380 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f711015a850 0x7f711013f340 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71100cff80 0x7f71100cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 --2- 172.21.15.22:0/3295858201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71100cc530 0x7f7110159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 >> 172.21.15.22:0/3295858201 conn(0x7f71100b37e0 msgr2=0x7f711015c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 shutdown_connections 2024-04-16T16:20:46.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.033+0000 7f7116800640 1 -- 172.21.15.22:0/3295858201 wait complete. 2024-04-16T16:20:46.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-16T16:20:46.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.276+0000 7f0b55400640 1 Processor -- start 2024-04-16T16:20:46.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.276+0000 7f0b55400640 1 -- start start 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b55400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b5015e9c0 0x7f0b50162fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b55400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b500b4790 0x7f0b500d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b55400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b50163520 con 0x7f0b500d0110 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b55400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0b500d0ab0 con 0x7f0b5015e9c0 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b55400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5006ce50 con 0x7f0b500b4790 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b4fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b5015e9c0 0x7f0b50162fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b4fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b5015e9c0 0x7f0b50162fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43860/0 (socket says 172.21.15.22:43860) 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b4fe00640 1 -- 172.21.15.22:0/1819453784 learned_addr learned my addr 172.21.15.22:0/1819453784 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:46.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.278+0000 7f0b54a00640 1 --2- 172.21.15.22:0/1819453784 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b500b4790 0x7f0b500d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.279+0000 7f0b4fe00640 1 -- 172.21.15.22:0/1819453784 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b500b4790 msgr2=0x7f0b500d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.279+0000 7f0b4fe00640 1 --2- 172.21.15.22:0/1819453784 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b500b4790 0x7f0b500d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.279+0000 7f0b4fe00640 1 -- 172.21.15.22:0/1819453784 >> v1:172.21.15.43:6789/0 conn(0x7f0b500d0110 legacy=0x7f0b500ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:46.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.279+0000 7f0b4fe00640 1 -- 172.21.15.22:0/1819453784 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5006d0f0 con 0x7f0b5015e9c0 2024-04-16T16:20:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.280+0000 7f0b4fe00640 1 --2- 172.21.15.22:0/1819453784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b5015e9c0 0x7f0b50162fe0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009870 tx=0x7f0b4002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e82a32ccb7669d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.280+0000 7f0b4f400640 1 -- 172.21.15.22:0/1819453784 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40035020 con 0x7f0b5015e9c0 2024-04-16T16:20:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.280+0000 7f0b4f400640 1 -- 172.21.15.22:0/1819453784 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b40031640 con 0x7f0b5015e9c0 2024-04-16T16:20:46.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.280+0000 7f0b4f400640 1 -- 172.21.15.22:0/1819453784 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4002d040 con 0x7f0b5015e9c0 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 -- 172.21.15.22:0/1819453784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b5015e9c0 msgr2=0x7f0b50162fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 --2- 172.21.15.22:0/1819453784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b5015e9c0 0x7f0b50162fe0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009870 tx=0x7f0b4002b8f0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 -- 172.21.15.22:0/1819453784 shutdown_connections 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 --2- 172.21.15.22:0/1819453784 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b500b4790 0x7f0b500d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 --2- 172.21.15.22:0/1819453784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b5015e9c0 0x7f0b50162fe0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 -- 172.21.15.22:0/1819453784 >> 172.21.15.22:0/1819453784 conn(0x7f0b50075070 msgr2=0x7f0b50062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 -- 172.21.15.22:0/1819453784 shutdown_connections 2024-04-16T16:20:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.281+0000 7f0b55400640 1 -- 172.21.15.22:0/1819453784 wait complete. 2024-04-16T16:20:46.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.283+0000 7f0b55400640 1 Processor -- start 2024-04-16T16:20:46.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.283+0000 7f0b55400640 1 -- start start 2024-04-16T16:20:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.284+0000 7f0b55400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b500b4790 0x7f0b500cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.284+0000 7f0b55400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b500d0110 0x7f0b50151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.284+0000 7f0b55400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b5015e9c0 0x7f0b50152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.284+0000 7f0b55400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5006d990 con 0x7f0b500d0110 2024-04-16T16:20:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.284+0000 7f0b55400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5006d6b0 con 0x7f0b500b4790 2024-04-16T16:20:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.284+0000 7f0b55400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5006dc70 con 0x7f0b5015e9c0 2024-04-16T16:20:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b500d0110 0x7f0b50151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b500d0110 0x7f0b50151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43876/0 (socket says 172.21.15.22:43876) 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 -- 172.21.15.22:0/214357271 learned_addr learned my addr 172.21.15.22:0/214357271 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b4fe00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b500b4790 0x7f0b500cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b54a00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b5015e9c0 0x7f0b50152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 -- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b5015e9c0 msgr2=0x7f0b50152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b5015e9c0 0x7f0b50152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 -- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b500b4790 msgr2=0x7f0b500cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b500b4790 0x7f0b500cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.285+0000 7f0b47e00640 1 -- 172.21.15.22:0/214357271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b500cf560 con 0x7f0b500d0110 2024-04-16T16:20:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.286+0000 7f0b47e00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b500d0110 0x7f0b50151fd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c430 tx=0x7f0b3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.286+0000 7f0b4cc00640 1 -- 172.21.15.22:0/214357271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38011790 con 0x7f0b500d0110 2024-04-16T16:20:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.286+0000 7f0b4cc00640 1 -- 172.21.15.22:0/214357271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b38017070 con 0x7f0b500d0110 2024-04-16T16:20:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.286+0000 7f0b4cc00640 1 -- 172.21.15.22:0/214357271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38011bb0 con 0x7f0b500d0110 2024-04-16T16:20:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.286+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b501e8540 con 0x7f0b500d0110 2024-04-16T16:20:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.286+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501e8b00 con 0x7f0b500d0110 2024-04-16T16:20:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.288+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b501e8d00 con 0x7f0b500d0110 2024-04-16T16:20:46.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.289+0000 7f0b4cc00640 1 -- 172.21.15.22:0/214357271 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f0b3801c460 con 0x7f0b500d0110 2024-04-16T16:20:46.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.289+0000 7f0b4cc00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0b2c06ce90 0x7f0b2c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.290+0000 7f0b4cc00640 1 -- 172.21.15.22:0/214357271 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f0b3808c190 con 0x7f0b500d0110 2024-04-16T16:20:46.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.290+0000 7f0b4fe00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0b2c06ce90 0x7f0b2c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.291+0000 7f0b4fe00640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0b2c06ce90 0x7f0b2c06f350 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b40036000 tx=0x7f0b40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:46.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.294+0000 7f0b4cc00640 1 -- 172.21.15.22:0/214357271 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b501e8d00 con 0x7f0b500d0110 2024-04-16T16:20:46.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.499+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0b50075f30 con 0x7f0b500d0110 2024-04-16T16:20:46.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.506+0000 7f0b4cc00640 1 -- 172.21.15.22:0/214357271 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f0b3805a0a0 con 0x7f0b500d0110 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0b2c06ce90 msgr2=0x7f0b2c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0b2c06ce90 0x7f0b2c06f350 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b40036000 tx=0x7f0b40008030 comp rx=0 tx=0).stop 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b500d0110 msgr2=0x7f0b50151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b500d0110 0x7f0b50151fd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c430 tx=0x7f0b3800c8f0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 shutdown_connections 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0b2c06ce90 0x7f0b2c06f350 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b5015e9c0 0x7f0b50152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b500d0110 0x7f0b50151fd0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 --2- 172.21.15.22:0/214357271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b500b4790 0x7f0b500cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 >> 172.21.15.22:0/214357271 conn(0x7f0b50075070 msgr2=0x7f0b50071640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:46.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 shutdown_connections 2024-04-16T16:20:46.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.509+0000 7f0b55400640 1 -- 172.21.15.22:0/214357271 wait complete. 2024-04-16T16:20:46.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2024-04-16T16:20:46.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.741+0000 7f82a8400640 1 Processor -- start 2024-04-16T16:20:46.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.742+0000 7f82a8400640 1 -- start start 2024-04-16T16:20:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.743+0000 7f82a8400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82a01478c0 0x7f82a0163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.743+0000 7f82a8400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f82a00d0c50 0x7f82a006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.743+0000 7f82a8400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a00af0b0 con 0x7f82a00ae860 2024-04-16T16:20:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.743+0000 7f82a8400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f82a00af950 con 0x7f82a01478c0 2024-04-16T16:20:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.743+0000 7f82a8400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f82a0147ca0 con 0x7f82a00d0c50 2024-04-16T16:20:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a5a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82a01478c0 0x7f82a0163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a5a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82a01478c0 0x7f82a0163340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43884/0 (socket says 172.21.15.22:43884) 2024-04-16T16:20:46.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a5a00640 1 -- 172.21.15.22:0/2165986392 learned_addr learned my addr 172.21.15.22:0/2165986392 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a6400640 1 --2- 172.21.15.22:0/2165986392 >> v2:172.21.15.43:3300/0 conn(0x7f82a00d0c50 0x7f82a006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a5a00640 1 -- 172.21.15.22:0/2165986392 >> v2:172.21.15.43:3300/0 conn(0x7f82a00d0c50 msgr2=0x7f82a006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a5a00640 1 --2- 172.21.15.22:0/2165986392 >> v2:172.21.15.43:3300/0 conn(0x7f82a00d0c50 0x7f82a006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a5a00640 1 -- 172.21.15.22:0/2165986392 >> v1:172.21.15.22:6789/0 conn(0x7f82a00ae860 legacy=0x7f82a00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a5a00640 1 -- 172.21.15.22:0/2165986392 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a00af390 con 0x7f82a01478c0 2024-04-16T16:20:46.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.744+0000 7f82a6400640 1 --2- 172.21.15.22:0/2165986392 >> v2:172.21.15.43:3300/0 conn(0x7f82a00d0c50 0x7f82a006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:46.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.746+0000 7f82a5a00640 1 --2- 172.21.15.22:0/2165986392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a01478c0 0x7f82a0163340 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f82a00d1740 tx=0x7f829002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0f5138330031ed server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:46.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.746+0000 7f829fe00640 1 -- 172.21.15.22:0/2165986392 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290035020 con 0x7f82a01478c0 2024-04-16T16:20:46.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.746+0000 7f829fe00640 1 -- 172.21.15.22:0/2165986392 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8290031870 con 0x7f82a01478c0 2024-04-16T16:20:46.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.746+0000 7f829fe00640 1 -- 172.21.15.22:0/2165986392 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290031c40 con 0x7f82a01478c0 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.746+0000 7f82a8400640 1 -- 172.21.15.22:0/2165986392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a01478c0 msgr2=0x7f82a0163340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.746+0000 7f82a8400640 1 --2- 172.21.15.22:0/2165986392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a01478c0 0x7f82a0163340 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f82a00d1740 tx=0x7f829002b910 comp rx=0 tx=0).stop 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.747+0000 7f82a8400640 1 -- 172.21.15.22:0/2165986392 shutdown_connections 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.747+0000 7f82a8400640 1 --2- 172.21.15.22:0/2165986392 >> v2:172.21.15.43:3300/0 conn(0x7f82a00d0c50 0x7f82a006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.747+0000 7f82a8400640 1 --2- 172.21.15.22:0/2165986392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a01478c0 0x7f82a0163340 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.747+0000 7f82a8400640 1 -- 172.21.15.22:0/2165986392 >> 172.21.15.22:0/2165986392 conn(0x7f82a0062440 msgr2=0x7f82a0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.747+0000 7f82a8400640 1 -- 172.21.15.22:0/2165986392 shutdown_connections 2024-04-16T16:20:46.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.747+0000 7f82a8400640 1 -- 172.21.15.22:0/2165986392 wait complete. 2024-04-16T16:20:46.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.748+0000 7f82a8400640 1 Processor -- start 2024-04-16T16:20:46.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.749+0000 7f82a8400640 1 -- start start 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.749+0000 7f82a8400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82a00ae860 0x7f82a015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.749+0000 7f82a8400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a00d0c50 0x7f82a00c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a8400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82a01478c0 0x7f82a00b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a8400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f82a00aee20 con 0x7f82a00d0c50 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a8400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82a00aeca0 con 0x7f82a00ae860 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a8400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f82a006dc40 con 0x7f82a01478c0 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a00d0c50 0x7f82a00c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a00d0c50 0x7f82a00c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43898/0 (socket says 172.21.15.22:43898) 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 -- 172.21.15.22:0/2808866282 learned_addr learned my addr 172.21.15.22:0/2808866282 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5a00640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82a00ae860 0x7f82a015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a6400640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82a01478c0 0x7f82a00b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 -- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82a01478c0 msgr2=0x7f82a00b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82a01478c0 0x7f82a00b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 -- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82a00ae860 msgr2=0x7f82a015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82a00ae860 0x7f82a015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.750+0000 7f82a5000640 1 -- 172.21.15.22:0/2808866282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a0160480 con 0x7f82a00d0c50 2024-04-16T16:20:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.751+0000 7f82a5000640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a00d0c50 0x7f82a00c6110 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f829400c430 tx=0x7f829400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.751+0000 7f829d600640 1 -- 172.21.15.22:0/2808866282 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940052d0 con 0x7f82a00d0c50 2024-04-16T16:20:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.751+0000 7f829d600640 1 -- 172.21.15.22:0/2808866282 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8294005490 con 0x7f82a00d0c50 2024-04-16T16:20:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.751+0000 7f829d600640 1 -- 172.21.15.22:0/2808866282 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294007260 con 0x7f82a00d0c50 2024-04-16T16:20:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.751+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a0134c90 con 0x7f82a00d0c50 2024-04-16T16:20:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.751+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a00c6cf0 con 0x7f82a00d0c50 2024-04-16T16:20:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.752+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a004fd90 con 0x7f82a00d0c50 2024-04-16T16:20:46.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.754+0000 7f829d600640 1 -- 172.21.15.22:0/2808866282 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f8294007400 con 0x7f82a00d0c50 2024-04-16T16:20:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.755+0000 7f829d600640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f828406ce90 0x7f828406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:46.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.755+0000 7f829d600640 1 -- 172.21.15.22:0/2808866282 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f829408b860 con 0x7f82a00d0c50 2024-04-16T16:20:46.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.755+0000 7f82a5a00640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f828406ce90 0x7f828406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:46.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.756+0000 7f82a5a00640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f828406ce90 0x7f828406f350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8290036000 tx=0x7f829003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:46.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:46.760+0000 7f829d600640 1 -- 172.21.15.22:0/2808866282 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f82940596e0 con 0x7f82a00d0c50 2024-04-16T16:20:47.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.042+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) -- 0x7f82a00afef0 con 0x7f82a00d0c50 2024-04-16T16:20:47.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.583+0000 7f829d600640 1 -- 172.21.15.22:0/2808866282 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v219) ==== 180+0+0 (secure 0 0 0) 0x7f8294058fe0 con 0x7f82a00d0c50 2024-04-16T16:20:47.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f828406ce90 msgr2=0x7f828406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f828406ce90 0x7f828406f350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8290036000 tx=0x7f829003c040 comp rx=0 tx=0).stop 2024-04-16T16:20:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a00d0c50 msgr2=0x7f82a00c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a00d0c50 0x7f82a00c6110 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f829400c430 tx=0x7f829400c8f0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 shutdown_connections 2024-04-16T16:20:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f828406ce90 0x7f828406f350 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82a01478c0 0x7f82a00b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a00d0c50 0x7f82a00c6110 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 --2- 172.21.15.22:0/2808866282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82a00ae860 0x7f82a015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 >> 172.21.15.22:0/2808866282 conn(0x7f82a0062440 msgr2=0x7f82a0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:47.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 shutdown_connections 2024-04-16T16:20:47.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.587+0000 7f82a8400640 1 -- 172.21.15.22:0/2808866282 wait complete. 2024-04-16T16:20:47.612 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during in-progress state and validate the reason ... ok 2024-04-16T16:20:47.612 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during pending state and validate the reason 2024-04-16T16:20:47.612 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-16T16:20:47.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:47.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.840+0000 7f1c47200640 1 Processor -- start 2024-04-16T16:20:47.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.841+0000 7f1c47200640 1 -- start start 2024-04-16T16:20:47.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.842+0000 7f1c47200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c48062440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.842+0000 7f1c47200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1c480b0960 0x7f1c48062980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.842+0000 7f1c47200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c480d09f0 con 0x7f1c4815c7c0 2024-04-16T16:20:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.842+0000 7f1c47200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1c480cf560 con 0x7f1c480b0960 2024-04-16T16:20:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.842+0000 7f1c47200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1c480d2230 con 0x7f1c480d1d30 2024-04-16T16:20:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.843+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c48062440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.843+0000 7f1c46800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1c480b0960 0x7f1c48062980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.843+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c48062440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:34786/0 (socket says 172.21.15.22:34786) 2024-04-16T16:20:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.843+0000 7f1c3fe00640 1 -- 172.21.15.22:0/2045721541 learned_addr learned my addr 172.21.15.22:0/2045721541 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.844+0000 7f1c3fe00640 1 -- 172.21.15.22:0/2045721541 >> v2:172.21.15.43:3300/0 conn(0x7f1c480b0960 msgr2=0x7f1c48062980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.844+0000 7f1c3fe00640 1 --2- 172.21.15.22:0/2045721541 >> v2:172.21.15.43:3300/0 conn(0x7f1c480b0960 0x7f1c48062980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.844+0000 7f1c3fe00640 1 -- 172.21.15.22:0/2045721541 >> v1:172.21.15.43:6789/0 conn(0x7f1c4815c7c0 legacy=0x7f1c480d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.844+0000 7f1c3fe00640 1 -- 172.21.15.22:0/2045721541 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c480cf800 con 0x7f1c480d1d30 2024-04-16T16:20:47.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.844+0000 7f1c45400640 1 -- 172.21.15.22:0/2045721541 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677157180 0 0) 0x7f1c480d09f0 con 0x7f1c4815c7c0 2024-04-16T16:20:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.845+0000 7f1c3fe00640 1 --2- 172.21.15.22:0/2045721541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c48062440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009870 tx=0x7f1c3002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0996bb9ce7cb83a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c45400640 1 -- 172.21.15.22:0/2045721541 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30035020 con 0x7f1c480d1d30 2024-04-16T16:20:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c45400640 1 -- 172.21.15.22:0/2045721541 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c30031640 con 0x7f1c480d1d30 2024-04-16T16:20:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c45400640 1 -- 172.21.15.22:0/2045721541 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3002d040 con 0x7f1c480d1d30 2024-04-16T16:20:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 -- 172.21.15.22:0/2045721541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 msgr2=0x7f1c48062440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 --2- 172.21.15.22:0/2045721541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c48062440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009870 tx=0x7f1c3002b8f0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 -- 172.21.15.22:0/2045721541 shutdown_connections 2024-04-16T16:20:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 --2- 172.21.15.22:0/2045721541 >> v2:172.21.15.43:3300/0 conn(0x7f1c480b0960 0x7f1c48062980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 --2- 172.21.15.22:0/2045721541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c48062440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 -- 172.21.15.22:0/2045721541 >> 172.21.15.22:0/2045721541 conn(0x7f1c4806ba20 msgr2=0x7f1c4806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 -- 172.21.15.22:0/2045721541 shutdown_connections 2024-04-16T16:20:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.846+0000 7f1c47200640 1 -- 172.21.15.22:0/2045721541 wait complete. 2024-04-16T16:20:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.848+0000 7f1c47200640 1 Processor -- start 2024-04-16T16:20:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.848+0000 7f1c47200640 1 -- start start 2024-04-16T16:20:47.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.849+0000 7f1c47200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c480b0960 0x7f1c4814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.849+0000 7f1c47200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c480b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.849+0000 7f1c47200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4815c7c0 0x7f1c480b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.849+0000 7f1c47200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4815cba0 con 0x7f1c480b0960 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.849+0000 7f1c47200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c480cfdc0 con 0x7f1c4815c7c0 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.849+0000 7f1c47200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1c480725d0 con 0x7f1c480d1d30 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.849+0000 7f1c45e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c480b0960 0x7f1c4814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c480b0960 0x7f1c4814d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43906/0 (socket says 172.21.15.22:43906) 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 -- 172.21.15.22:0/1186638600 learned_addr learned my addr 172.21.15.22:0/1186638600 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c46800640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4815c7c0 0x7f1c480b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c3fe00640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c480b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 -- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 msgr2=0x7f1c480b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:47.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c480b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 -- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4815c7c0 msgr2=0x7f1c480b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:47.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4815c7c0 0x7f1c480b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:47.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 -- 172.21.15.22:0/1186638600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c480b0f90 con 0x7f1c480b0960 2024-04-16T16:20:47.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c46800640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4815c7c0 0x7f1c480b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.850+0000 7f1c45e00640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c480b0960 0x7f1c4814d1d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800c4b0 tx=0x7f1c3800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.851+0000 7f1c3e000640 1 -- 172.21.15.22:0/1186638600 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38017070 con 0x7f1c480b0960 2024-04-16T16:20:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.851+0000 7f1c3e000640 1 -- 172.21.15.22:0/1186638600 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c38005480 con 0x7f1c480b0960 2024-04-16T16:20:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.851+0000 7f1c3e000640 1 -- 172.21.15.22:0/1186638600 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38003830 con 0x7f1c480b0960 2024-04-16T16:20:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.851+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c480b1270 con 0x7f1c480b0960 2024-04-16T16:20:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.851+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c480b1830 con 0x7f1c480b0960 2024-04-16T16:20:47.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.852+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4806c9b0 con 0x7f1c480b0960 2024-04-16T16:20:47.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.853+0000 7f1c3e000640 1 -- 172.21.15.22:0/1186638600 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f1c3801a070 con 0x7f1c480b0960 2024-04-16T16:20:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.854+0000 7f1c3e000640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c2406ce90 0x7f1c2406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.855+0000 7f1c3e000640 1 -- 172.21.15.22:0/1186638600 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f1c3808b700 con 0x7f1c480b0960 2024-04-16T16:20:47.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.855+0000 7f1c3fe00640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c2406ce90 0x7f1c2406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:47.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.855+0000 7f1c3fe00640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c2406ce90 0x7f1c2406f350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1c30036000 tx=0x7f1c3003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:47.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:47.859+0000 7f1c3e000640 1 -- 172.21.15.22:0/1186638600 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c38059580 con 0x7f1c480b0960 2024-04-16T16:20:48.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.069+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c48075f30 con 0x7f1c480b0960 2024-04-16T16:20:48.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.072+0000 7f1c3e000640 1 -- 172.21.15.22:0/1186638600 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+12900 (secure 0 0 0) 0x7f1c38058e80 con 0x7f1c480b0960 2024-04-16T16:20:48.072 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:48.072 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":54,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:45.560488+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6837/1166400952":"2024-04-17T16:20:42.414613+0000","172.21.15.22:6835/1166400952":"2024-04-17T16:20:42.414613+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c2406ce90 msgr2=0x7f1c2406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c2406ce90 0x7f1c2406f350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1c30036000 tx=0x7f1c3003c040 comp rx=0 tx=0).stop 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c480b0960 msgr2=0x7f1c4814d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c480b0960 0x7f1c4814d1d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800c4b0 tx=0x7f1c3800c970 comp rx=0 tx=0).stop 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 shutdown_connections 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c2406ce90 0x7f1c2406f350 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4815c7c0 0x7f1c480b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c480d1d30 0x7f1c480b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 --2- 172.21.15.22:0/1186638600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c480b0960 0x7f1c4814d1d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 >> 172.21.15.22:0/1186638600 conn(0x7f1c4806ba20 msgr2=0x7f1c480af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 shutdown_connections 2024-04-16T16:20:48.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.075+0000 7f1c47200640 1 -- 172.21.15.22:0/1186638600 wait complete. 2024-04-16T16:20:48.097 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:20:48.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:20:48.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.327+0000 7f48d3200640 1 Processor -- start 2024-04-16T16:20:48.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.327+0000 7f48d3200640 1 -- start start 2024-04-16T16:20:48.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.328+0000 7f48d3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 0x7f48d406df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.328+0000 7f48d3200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d4163170 con 0x7f48d415e850 2024-04-16T16:20:48.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.329+0000 7f48d3200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d406d4a0 con 0x7f48d4072680 2024-04-16T16:20:48.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.329+0000 7f48d3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f48d406e4c0 con 0x7f48d40b3dc0 2024-04-16T16:20:48.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.329+0000 7f48d1e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f48d415e850 0x7f48d40b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48140/0 (socket says 172.21.15.22:48140) 2024-04-16T16:20:48.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.329+0000 7f48d1e00640 1 -- 172.21.15.22:0/456023603 learned_addr learned my addr 172.21.15.22:0/456023603 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.329+0000 7f48cbe00640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 0x7f48d406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.329+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571416594 0 0) 0x7f48d4163170 con 0x7f48d415e850 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.329+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b8003520 con 0x7f48d415e850 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 46807698 0 0) 0x7f48b8003520 con 0x7f48d415e850 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 msgr2=0x7f48d406df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 0x7f48d406df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 >> v1:172.21.15.43:6789/0 conn(0x7f48d4072680 legacy=0x7f48d4070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d406d780 con 0x7f48d415e850 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f48c4001670 con 0x7f48d415e850 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 >> v1:172.21.15.22:6789/0 conn(0x7f48d415e850 legacy=0x7f48d40b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 0x7f48b80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48b8003fb0 0x7f48b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8004d40 0x7f48b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48d406e4c0 con 0x7f48b8003fb0 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48b800bb00 con 0x7f48b8004d40 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f48b800bd00 con 0x7f48d40b3dc0 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.330+0000 7f48cbe00640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48b8003fb0 0x7f48b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.331+0000 7f48d1e00640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 0x7f48b80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.331+0000 7f48cbe00640 1 -- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 msgr2=0x7f48b80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.331+0000 7f48cbe00640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 0x7f48b80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.331+0000 7f48cbe00640 1 -- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8004d40 msgr2=0x7f48b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.331+0000 7f48cbe00640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8004d40 0x7f48b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.331+0000 7f48cbe00640 1 -- 172.21.15.22:0/456023603 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b8003520 con 0x7f48b8003fb0 2024-04-16T16:20:48.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.331+0000 7f48d1e00640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b3dc0 0x7f48b80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:48.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.332+0000 7f48cbe00640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48b8003fb0 0x7f48b8004800 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009ac0 tx=0x7f48b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14034a52f7fc4b2c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.332+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc039070 con 0x7f48b8003fb0 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.332+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc02c600 con 0x7f48b8003fb0 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.332+0000 7f48d1400640 1 -- 172.21.15.22:0/456023603 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc009690 con 0x7f48b8003fb0 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.333+0000 7f48d3200640 1 -- 172.21.15.22:0/456023603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48b8003fb0 msgr2=0x7f48b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.333+0000 7f48d3200640 1 --2- 172.21.15.22:0/456023603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48b8003fb0 0x7f48b8004800 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009ac0 tx=0x7f48b8005830 comp rx=0 tx=0).stop 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.333+0000 7f48d2800640 1 -- 172.21.15.22:0/456023603 reap_dead start 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.333+0000 7f48d3200640 1 -- 172.21.15.22:0/456023603 shutdown_connections 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.333+0000 7f48d3200640 1 -- 172.21.15.22:0/456023603 >> 172.21.15.22:0/456023603 conn(0x7f48d4062440 msgr2=0x7f48d4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.333+0000 7f48d3200640 1 -- 172.21.15.22:0/456023603 shutdown_connections 2024-04-16T16:20:48.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.333+0000 7f48d3200640 1 -- 172.21.15.22:0/456023603 wait complete. 2024-04-16T16:20:48.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.335+0000 7f48d3200640 1 Processor -- start 2024-04-16T16:20:48.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.335+0000 7f48d3200640 1 -- start start 2024-04-16T16:20:48.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8003fb0 0x7f48d41f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b36f0 0x7f48d40b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d4152e30 0x7f48d415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4162e10 con 0x7f48d4152e30 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48d415ec30 con 0x7f48b8003fb0 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f48d4072d60 con 0x7f48d40b36f0 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d4152e30 0x7f48d415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d4152e30 0x7f48d415c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43926/0 (socket says 172.21.15.22:43926) 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.336+0000 7f48d2800640 1 -- 172.21.15.22:0/3688839188 learned_addr learned my addr 172.21.15.22:0/3688839188 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d1e00640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8003fb0 0x7f48d41f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48cbe00640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b36f0 0x7f48d40b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d2800640 1 -- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b36f0 msgr2=0x7f48d40b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d2800640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b36f0 0x7f48d40b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d2800640 1 -- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8003fb0 msgr2=0x7f48d41f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d2800640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8003fb0 0x7f48d41f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d2800640 1 -- 172.21.15.22:0/3688839188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d40b05d0 con 0x7f48d4152e30 2024-04-16T16:20:48.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d1e00640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8003fb0 0x7f48d41f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:48.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d2800640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d4152e30 0x7f48d415c7b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f48d4072af0 tx=0x7f48cc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:48.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48ca000640 1 -- 172.21.15.22:0/3688839188 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc005d40 con 0x7f48d4152e30 2024-04-16T16:20:48.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48ca000640 1 -- 172.21.15.22:0/3688839188 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc00a610 con 0x7f48d4152e30 2024-04-16T16:20:48.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48ca000640 1 -- 172.21.15.22:0/3688839188 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00aa00 con 0x7f48d4152e30 2024-04-16T16:20:48.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.337+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d40af3e0 con 0x7f48d4152e30 2024-04-16T16:20:48.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.338+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d40ae900 con 0x7f48d4152e30 2024-04-16T16:20:48.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.339+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d4075f30 con 0x7f48d4152e30 2024-04-16T16:20:48.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.340+0000 7f48ca000640 1 -- 172.21.15.22:0/3688839188 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f48cc011070 con 0x7f48d4152e30 2024-04-16T16:20:48.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.340+0000 7f48ca000640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f48b006ce90 0x7f48b006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.341+0000 7f48ca000640 1 -- 172.21.15.22:0/3688839188 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f48cc08b6d0 con 0x7f48d4152e30 2024-04-16T16:20:48.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.341+0000 7f48d1e00640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f48b006ce90 0x7f48b006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.341+0000 7f48d1e00640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f48b006ce90 0x7f48b006f350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f48c4001eb0 tx=0x7f48c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:48.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.345+0000 7f48ca000640 1 -- 172.21.15.22:0/3688839188 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48cc019060 con 0x7f48d4152e30 2024-04-16T16:20:48.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.552+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f48d4072250 con 0x7f48d4152e30 2024-04-16T16:20:48.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.553+0000 7f48ca000640 1 -- 172.21.15.22:0/3688839188 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f48cc0596e0 con 0x7f48d4152e30 2024-04-16T16:20:48.553 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f48b006ce90 msgr2=0x7f48b006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f48b006ce90 0x7f48b006f350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f48c4001eb0 tx=0x7f48c4009040 comp rx=0 tx=0).stop 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d4152e30 msgr2=0x7f48d415c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d4152e30 0x7f48d415c7b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f48d4072af0 tx=0x7f48cc00cb90 comp rx=0 tx=0).stop 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 shutdown_connections 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f48b006ce90 0x7f48b006f350 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d4152e30 0x7f48d415c7b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f48d40b36f0 0x7f48d40b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 --2- 172.21.15.22:0/3688839188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48b8003fb0 0x7f48d41f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 >> 172.21.15.22:0/3688839188 conn(0x7f48d4062440 msgr2=0x7f48d4160dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:48.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 shutdown_connections 2024-04-16T16:20:48.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.556+0000 7f48d3200640 1 -- 172.21.15.22:0/3688839188 wait complete. 2024-04-16T16:20:48.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2024-04-16T16:20:48.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.804+0000 7f7d76c00640 1 Processor -- start 2024-04-16T16:20:48.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.804+0000 7f7d76c00640 1 -- start start 2024-04-16T16:20:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.806+0000 7f7d76c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7d70062b50 0x7f7d700b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.806+0000 7f7d76c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700b4600 0x7f7d7006de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.806+0000 7f7d76c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d700d1370 con 0x7f7d7015e920 2024-04-16T16:20:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.806+0000 7f7d76c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7d700b09c0 con 0x7f7d70062b50 2024-04-16T16:20:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.806+0000 7f7d76c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7006e360 con 0x7f7d700b4600 2024-04-16T16:20:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.806+0000 7f7d75800640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7d7015e920 0x7f7d70062440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48142/0 (socket says 172.21.15.22:48142) 2024-04-16T16:20:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.806+0000 7f7d75800640 1 -- 172.21.15.22:0/1125250557 learned_addr learned my addr 172.21.15.22:0/1125250557 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d76200640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700b4600 0x7f7d7006de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d74e00640 1 --2- 172.21.15.22:0/1125250557 >> v2:172.21.15.43:3300/0 conn(0x7f7d70062b50 0x7f7d700b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538574610 0 0) 0x7f7d700d1370 con 0x7f7d7015e920 2024-04-16T16:20:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d58003520 con 0x7f7d7015e920 2024-04-16T16:20:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1023390828 0 0) 0x7f7d58003520 con 0x7f7d7015e920 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700b4600 msgr2=0x7f7d7006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700b4600 0x7f7d7006de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 >> v2:172.21.15.43:3300/0 conn(0x7f7d70062b50 msgr2=0x7f7d700b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 --2- 172.21.15.22:0/1125250557 >> v2:172.21.15.43:3300/0 conn(0x7f7d70062b50 0x7f7d700b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7006f870 con 0x7f7d7015e920 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f7d64001670 con 0x7f7d7015e920 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.807+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 >> v1:172.21.15.22:6789/0 conn(0x7f7d7015e920 legacy=0x7f7d70062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d6fe00640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d6fe00640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700b4600 0x7f7d58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d6fe00640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d58004d40 0x7f7d580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d700b09c0 con 0x7f7d580039b0 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5800b9c0 con 0x7f7d58004d40 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5800bb40 con 0x7f7d700b4600 2024-04-16T16:20:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d75800640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d75800640 1 -- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700b4600 msgr2=0x7f7d58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:48.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d75800640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700b4600 0x7f7d58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d75800640 1 -- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d58004d40 msgr2=0x7f7d580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:48.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d76200640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d58004d40 0x7f7d580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d75800640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d58004d40 0x7f7d580051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.808+0000 7f7d75800640 1 -- 172.21.15.22:0/1125250557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d58003520 con 0x7f7d580039b0 2024-04-16T16:20:48.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.810+0000 7f7d75800640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d58003dd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c190 tx=0x7f7d58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a450f394ec0dda9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:48.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.810+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64007c80 con 0x7f7d580039b0 2024-04-16T16:20:48.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.810+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d64030070 con 0x7f7d580039b0 2024-04-16T16:20:48.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.810+0000 7f7d6fe00640 1 -- 172.21.15.22:0/1125250557 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64005cd0 con 0x7f7d580039b0 2024-04-16T16:20:48.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.810+0000 7f7d76c00640 1 -- 172.21.15.22:0/1125250557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 msgr2=0x7f7d58003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.810+0000 7f7d76c00640 1 --2- 172.21.15.22:0/1125250557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d58003dd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c190 tx=0x7f7d58005830 comp rx=0 tx=0).stop 2024-04-16T16:20:48.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.811+0000 7f7d76200640 1 -- 172.21.15.22:0/1125250557 reap_dead start 2024-04-16T16:20:48.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.811+0000 7f7d76c00640 1 -- 172.21.15.22:0/1125250557 shutdown_connections 2024-04-16T16:20:48.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.811+0000 7f7d76c00640 1 -- 172.21.15.22:0/1125250557 >> 172.21.15.22:0/1125250557 conn(0x7f7d7006ba20 msgr2=0x7f7d7006be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:48.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.811+0000 7f7d76c00640 1 -- 172.21.15.22:0/1125250557 shutdown_connections 2024-04-16T16:20:48.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.811+0000 7f7d76c00640 1 -- 172.21.15.22:0/1125250557 wait complete. 2024-04-16T16:20:48.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.813+0000 7f7d76c00640 1 Processor -- start 2024-04-16T16:20:48.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.813+0000 7f7d76c00640 1 -- start start 2024-04-16T16:20:48.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d76c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d70150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d76c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700c6570 0x7f7d700c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d76c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d70159b50 0x7f7d701f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d76c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7006fe30 con 0x7f7d580039b0 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d76c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d700b0e00 con 0x7f7d70159b50 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d76c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d700b4b00 con 0x7f7d700c6570 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d75800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d70150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d75800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d70150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43954/0 (socket says 172.21.15.22:43954) 2024-04-16T16:20:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d75800640 1 -- 172.21.15.22:0/201114201 learned_addr learned my addr 172.21.15.22:0/201114201 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:48.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d75800640 1 -- 172.21.15.22:0/201114201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700c6570 msgr2=0x7f7d700c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d75800640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700c6570 0x7f7d700c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d75800640 1 -- 172.21.15.22:0/201114201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d70159b50 msgr2=0x7f7d701f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:48.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.814+0000 7f7d75800640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d70159b50 0x7f7d701f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.815+0000 7f7d75800640 1 -- 172.21.15.22:0/201114201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d70150660 con 0x7f7d580039b0 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.815+0000 7f7d75800640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d70150120 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c2b0 tx=0x7f7d7006fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.815+0000 7f7d6d600640 1 -- 172.21.15.22:0/201114201 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64046070 con 0x7f7d580039b0 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.815+0000 7f7d6d600640 1 -- 172.21.15.22:0/201114201 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d64004bf0 con 0x7f7d580039b0 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.815+0000 7f7d6d600640 1 -- 172.21.15.22:0/201114201 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64007c80 con 0x7f7d580039b0 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.815+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d700c6ae0 con 0x7f7d580039b0 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.815+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d700c70a0 con 0x7f7d580039b0 2024-04-16T16:20:48.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.817+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d700b5150 con 0x7f7d580039b0 2024-04-16T16:20:48.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.819+0000 7f7d6d600640 1 -- 172.21.15.22:0/201114201 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f7d64007070 con 0x7f7d580039b0 2024-04-16T16:20:48.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.820+0000 7f7d6d600640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d5006cec0 0x7f7d5006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:48.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.820+0000 7f7d6d600640 1 -- 172.21.15.22:0/201114201 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f7d640ad3a0 con 0x7f7d580039b0 2024-04-16T16:20:48.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.820+0000 7f7d74e00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d5006cec0 0x7f7d5006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:48.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.821+0000 7f7d74e00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d5006cec0 0x7f7d5006f380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0093d0 tx=0x7f7d5c009300 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:48.825+0000 7f7d6d600640 1 -- 172.21.15.22:0/201114201 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d70150660 con 0x7f7d580039b0 2024-04-16T16:20:49.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.104+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) -- 0x7f7d70075f30 con 0x7f7d580039b0 2024-04-16T16:20:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.595+0000 7f7d6d600640 1 -- 172.21.15.22:0/201114201 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v221) ==== 179+0+0 (secure 0 0 0) 0x7f7d6407b440 con 0x7f7d580039b0 2024-04-16T16:20:49.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d5006cec0 msgr2=0x7f7d5006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:49.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d5006cec0 0x7f7d5006f380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0093d0 tx=0x7f7d5c009300 comp rx=0 tx=0).stop 2024-04-16T16:20:49.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 msgr2=0x7f7d70150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:49.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d70150120 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c2b0 tx=0x7f7d7006fa40 comp rx=0 tx=0).stop 2024-04-16T16:20:49.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 shutdown_connections 2024-04-16T16:20:49.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d5006cec0 0x7f7d5006f380 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d70159b50 0x7f7d701f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d700c6570 0x7f7d700c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 --2- 172.21.15.22:0/201114201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d580039b0 0x7f7d70150120 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 >> 172.21.15.22:0/201114201 conn(0x7f7d7006ba20 msgr2=0x7f7d70062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:49.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 shutdown_connections 2024-04-16T16:20:49.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.599+0000 7f7d76c00640 1 -- 172.21.15.22:0/201114201 wait complete. 2024-04-16T16:20:49.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T16:20:49.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.849+0000 7efc3dc00640 1 Processor -- start 2024-04-16T16:20:49.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.849+0000 7efc3dc00640 1 -- start start 2024-04-16T16:20:49.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc3dc00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efc3813f820 0x7efc380afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc3dc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc380b0280 0x7efc3806ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc3dc00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc380b06d0 con 0x7efc3806f140 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc3dc00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7efc3806f940 con 0x7efc380b0280 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc3dc00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7efc3806fc20 con 0x7efc3813f820 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc37400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc380b0280 0x7efc3806ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc37400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc380b0280 0x7efc3806ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36234/0 (socket says 172.21.15.22:36234) 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc3d200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc3806f140 0x7efc381602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42122/0 (socket says 172.21.15.22:42122) 2024-04-16T16:20:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc37400640 1 -- 172.21.15.22:0/2881014399 learned_addr learned my addr 172.21.15.22:0/2881014399 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.851+0000 7efc37e00640 1 --2- 172.21.15.22:0/2881014399 >> v2:172.21.15.43:3300/0 conn(0x7efc3813f820 0x7efc380afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.852+0000 7efc37400640 1 -- 172.21.15.22:0/2881014399 >> v2:172.21.15.43:3300/0 conn(0x7efc3813f820 msgr2=0x7efc380afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.852+0000 7efc37400640 1 --2- 172.21.15.22:0/2881014399 >> v2:172.21.15.43:3300/0 conn(0x7efc3813f820 0x7efc380afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.852+0000 7efc37400640 1 -- 172.21.15.22:0/2881014399 >> v1:172.21.15.22:6789/0 conn(0x7efc3806f140 legacy=0x7efc381602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.852+0000 7efc37400640 1 -- 172.21.15.22:0/2881014399 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3806ff00 con 0x7efc380b0280 2024-04-16T16:20:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.852+0000 7efc37e00640 1 --2- 172.21.15.22:0/2881014399 >> v2:172.21.15.43:3300/0 conn(0x7efc3813f820 0x7efc380afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.852+0000 7efc36a00640 1 -- 172.21.15.22:0/2881014399 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811891054 0 0) 0x7efc30001110 con 0x7efc3806f140 2024-04-16T16:20:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.853+0000 7efc37400640 1 --2- 172.21.15.22:0/2881014399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc380b0280 0x7efc3806ec00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efc380751c0 tx=0x7efc2002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0a430e714a27db server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.853+0000 7efc36a00640 1 -- 172.21.15.22:0/2881014399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2002cb20 con 0x7efc380b0280 2024-04-16T16:20:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.853+0000 7efc36a00640 1 -- 172.21.15.22:0/2881014399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2002ccc0 con 0x7efc380b0280 2024-04-16T16:20:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.853+0000 7efc36a00640 1 -- 172.21.15.22:0/2881014399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20034610 con 0x7efc380b0280 2024-04-16T16:20:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 -- 172.21.15.22:0/2881014399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc380b0280 msgr2=0x7efc3806ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:49.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 --2- 172.21.15.22:0/2881014399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc380b0280 0x7efc3806ec00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efc380751c0 tx=0x7efc2002bf80 comp rx=0 tx=0).stop 2024-04-16T16:20:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 -- 172.21.15.22:0/2881014399 shutdown_connections 2024-04-16T16:20:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 --2- 172.21.15.22:0/2881014399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc380b0280 0x7efc3806ec00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 --2- 172.21.15.22:0/2881014399 >> v2:172.21.15.43:3300/0 conn(0x7efc3813f820 0x7efc380afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 -- 172.21.15.22:0/2881014399 >> 172.21.15.22:0/2881014399 conn(0x7efc380b2940 msgr2=0x7efc380b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:49.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 -- 172.21.15.22:0/2881014399 shutdown_connections 2024-04-16T16:20:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.854+0000 7efc3dc00640 1 -- 172.21.15.22:0/2881014399 wait complete. 2024-04-16T16:20:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.856+0000 7efc3dc00640 1 Processor -- start 2024-04-16T16:20:49.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.856+0000 7efc3dc00640 1 -- start start 2024-04-16T16:20:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc3dc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3806f140 0x7efc38141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc3dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc380b0280 0x7efc3813fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc3dc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc3813f820 0x7efc381426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc3dc00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc3806f5b0 con 0x7efc3806f140 2024-04-16T16:20:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc3dc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc3813fc00 con 0x7efc380b0280 2024-04-16T16:20:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc3dc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efc38072e90 con 0x7efc3813f820 2024-04-16T16:20:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3806f140 0x7efc38141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3806f140 0x7efc38141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36242/0 (socket says 172.21.15.22:36242) 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 -- 172.21.15.22:0/3540925225 learned_addr learned my addr 172.21.15.22:0/3540925225 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 -- 172.21.15.22:0/3540925225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc3813f820 msgr2=0x7efc381426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc3813f820 0x7efc381426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 -- 172.21.15.22:0/3540925225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc380b0280 msgr2=0x7efc3813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc380b0280 0x7efc3813fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.857+0000 7efc37e00640 1 -- 172.21.15.22:0/3540925225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc381402c0 con 0x7efc3806f140 2024-04-16T16:20:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.858+0000 7efc37e00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3806f140 0x7efc38141e60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c7f0 tx=0x7efc2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.858+0000 7efc2fe00640 1 -- 172.21.15.22:0/3540925225 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28015070 con 0x7efc3806f140 2024-04-16T16:20:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.858+0000 7efc2fe00640 1 -- 172.21.15.22:0/3540925225 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28007820 con 0x7efc3806f140 2024-04-16T16:20:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.858+0000 7efc2fe00640 1 -- 172.21.15.22:0/3540925225 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28007bd0 con 0x7efc3806f140 2024-04-16T16:20:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.858+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc381f8160 con 0x7efc3806f140 2024-04-16T16:20:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.858+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc381f8720 con 0x7efc3806f140 2024-04-16T16:20:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.859+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc38075f30 con 0x7efc3806f140 2024-04-16T16:20:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.860+0000 7efc2fe00640 1 -- 172.21.15.22:0/3540925225 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7efc28018070 con 0x7efc3806f140 2024-04-16T16:20:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.861+0000 7efc2fe00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efc1406cee0 0x7efc1406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.861+0000 7efc2fe00640 1 -- 172.21.15.22:0/3540925225 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7efc2808c500 con 0x7efc3806f140 2024-04-16T16:20:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.862+0000 7efc37400640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efc1406cee0 0x7efc1406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.863+0000 7efc37400640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efc1406cee0 0x7efc1406f3a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc20035000 tx=0x7efc2002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:49.866+0000 7efc2fe00640 1 -- 172.21.15.22:0/3540925225 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc2805a2f0 con 0x7efc3806f140 2024-04-16T16:20:50.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.068+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efc380734b0 con 0x7efc3806f140 2024-04-16T16:20:50.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.073+0000 7efc2fe00640 1 -- 172.21.15.22:0/3540925225 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7efc28059bf0 con 0x7efc3806f140 2024-04-16T16:20:50.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.076+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efc1406cee0 msgr2=0x7efc1406f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:50.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.076+0000 7efc3dc00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efc1406cee0 0x7efc1406f3a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc20035000 tx=0x7efc2002e000 comp rx=0 tx=0).stop 2024-04-16T16:20:50.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.076+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3806f140 msgr2=0x7efc38141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.076+0000 7efc3dc00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3806f140 0x7efc38141e60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c7f0 tx=0x7efc2800ccb0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.076+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 shutdown_connections 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.076+0000 7efc3dc00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7efc1406cee0 0x7efc1406f3a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.077+0000 7efc3dc00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc3813f820 0x7efc381426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.077+0000 7efc3dc00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc380b0280 0x7efc3813fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.077+0000 7efc3dc00640 1 --2- 172.21.15.22:0/3540925225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3806f140 0x7efc38141e60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.077+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 >> 172.21.15.22:0/3540925225 conn(0x7efc380b2940 msgr2=0x7efc3815dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.077+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 shutdown_connections 2024-04-16T16:20:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.077+0000 7efc3dc00640 1 -- 172.21.15.22:0/3540925225 wait complete. 2024-04-16T16:20:50.096 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T16:20:50.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:20:50.209 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T16:20:50.338 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T16:20:50.338 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:50.338 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:50.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:20:50.399 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:20:50.399 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:50.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:20:50.458 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:20:50.458 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:50.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:20:50.521 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:20:50.521 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:20:50.580 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:20:50.580 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-16T16:20:50.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:20:50.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.815+0000 7f5838400640 1 Processor -- start 2024-04-16T16:20:50.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.815+0000 7f5838400640 1 -- start start 2024-04-16T16:20:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.817+0000 7f5838400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f58300afd90 0x7f5830072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.817+0000 7f5838400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58301606d0 con 0x7f583006dc80 2024-04-16T16:20:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.817+0000 7f5838400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58301609b0 con 0x7f5830073050 2024-04-16T16:20:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.817+0000 7f5838400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5830160480 con 0x7f58300afd90 2024-04-16T16:20:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.817+0000 7f5835000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f583006dc80 0x7f58300d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42130/0 (socket says 172.21.15.22:42130) 2024-04-16T16:20:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.817+0000 7f5835000640 1 -- 172.21.15.22:0/3454179279 learned_addr learned my addr 172.21.15.22:0/3454179279 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f5835a00640 1 --2- 172.21.15.22:0/3454179279 >> v2:172.21.15.43:3300/0 conn(0x7f58300afd90 0x7f5830072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141928119 0 0) 0x7f58301606d0 con 0x7f583006dc80 2024-04-16T16:20:50.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5818003520 con 0x7f583006dc80 2024-04-16T16:20:50.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2478507464 0 0) 0x7f5818003520 con 0x7f583006dc80 2024-04-16T16:20:50.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 >> v2:172.21.15.43:3300/0 conn(0x7f58300afd90 msgr2=0x7f5830072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:50.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 --2- 172.21.15.22:0/3454179279 >> v2:172.21.15.43:3300/0 conn(0x7f58300afd90 0x7f5830072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 >> v1:172.21.15.43:6789/0 conn(0x7f5830073050 legacy=0x7f583015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5830160c90 con 0x7f583006dc80 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f581c001670 con 0x7f583006dc80 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 >> v1:172.21.15.22:6789/0 conn(0x7f583006dc80 legacy=0x7f58300d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818003a00 0x7f5818003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5818004800 0x7f5818004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5818005230 0x7f581800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5830160480 con 0x7f5818005230 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f581800c190 con 0x7f5818003a00 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.818+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f581800c390 con 0x7f5818004800 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5836400640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5818005230 0x7f581800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5835a00640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818003a00 0x7f5818003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5835000640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5818004800 0x7f5818004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5836400640 1 -- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5818004800 msgr2=0x7f5818004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5836400640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5818004800 0x7f5818004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5836400640 1 -- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818003a00 msgr2=0x7f5818003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:50.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5836400640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818003a00 0x7f5818003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.819+0000 7f5836400640 1 -- 172.21.15.22:0/3454179279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5818003520 con 0x7f5818005230 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.820+0000 7f5836400640 1 -- 172.21.15.22:0/3454179279 reap_dead start 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.820+0000 7f5836400640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5818005230 0x7f581800b9c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5828001720 tx=0x7f5818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63f04164d512813 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828001370 con 0x7f5818005230 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58280052d0 con 0x7f5818005230 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f582fe00640 1 -- 172.21.15.22:0/3454179279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828003830 con 0x7f5818005230 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f5838400640 1 -- 172.21.15.22:0/3454179279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5818005230 msgr2=0x7f581800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f5838400640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5818005230 0x7f581800b9c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5828001720 tx=0x7f5818005830 comp rx=0 tx=0).stop 2024-04-16T16:20:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f5838400640 1 -- 172.21.15.22:0/3454179279 shutdown_connections 2024-04-16T16:20:50.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f5838400640 1 --2- 172.21.15.22:0/3454179279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5818005230 0x7f581800b9c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f5838400640 1 -- 172.21.15.22:0/3454179279 >> 172.21.15.22:0/3454179279 conn(0x7f5830062440 msgr2=0x7f5830062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:50.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f5838400640 1 -- 172.21.15.22:0/3454179279 shutdown_connections 2024-04-16T16:20:50.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.821+0000 7f5838400640 1 -- 172.21.15.22:0/3454179279 wait complete. 2024-04-16T16:20:50.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.823+0000 7f5838400640 1 Processor -- start 2024-04-16T16:20:50.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.823+0000 7f5838400640 1 -- start start 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.824+0000 7f5838400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818005230 0x7f58300b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.824+0000 7f5838400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5830153bf0 0x7f5830142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.824+0000 7f5838400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5830142d60 0x7f58301f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.824+0000 7f5838400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f58300ce8a0 con 0x7f5830142d60 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.824+0000 7f5838400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f58300b0170 con 0x7f5818005230 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.824+0000 7f5838400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f58300cea20 con 0x7f5830153bf0 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5830142d60 0x7f58301f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5830142d60 0x7f58301f80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36262/0 (socket says 172.21.15.22:36262) 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 -- 172.21.15.22:0/860897835 learned_addr learned my addr 172.21.15.22:0/860897835 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:50.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5835a00640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818005230 0x7f58300b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5835000640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5830153bf0 0x7f5830142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 -- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5830153bf0 msgr2=0x7f5830142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5830153bf0 0x7f5830142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 -- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818005230 msgr2=0x7f58300b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818005230 0x7f58300b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 -- 172.21.15.22:0/860897835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5830154440 con 0x7f5830142d60 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5835000640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5830153bf0 0x7f5830142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5835a00640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818005230 0x7f58300b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.825+0000 7f5836400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5830142d60 0x7f58301f80f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f582802bc00 tx=0x7f5828001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:50.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.826+0000 7f582d600640 1 -- 172.21.15.22:0/860897835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828042070 con 0x7f5830142d60 2024-04-16T16:20:50.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.826+0000 7f582d600640 1 -- 172.21.15.22:0/860897835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5828005480 con 0x7f5830142d60 2024-04-16T16:20:50.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.826+0000 7f582d600640 1 -- 172.21.15.22:0/860897835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828007440 con 0x7f5830142d60 2024-04-16T16:20:50.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.826+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5830154720 con 0x7f5830142d60 2024-04-16T16:20:50.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.826+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5830154ce0 con 0x7f5830142d60 2024-04-16T16:20:50.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.827+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f583004fd90 con 0x7f5830142d60 2024-04-16T16:20:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.828+0000 7f582d600640 1 -- 172.21.15.22:0/860897835 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f5828045070 con 0x7f5830142d60 2024-04-16T16:20:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.829+0000 7f582d600640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f581006ce90 0x7f581006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.829+0000 7f582d600640 1 -- 172.21.15.22:0/860897835 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f58280ad030 con 0x7f5830142d60 2024-04-16T16:20:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.829+0000 7f5835a00640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f581006ce90 0x7f581006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.830+0000 7f5835a00640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f581006ce90 0x7f581006f350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5824007440 tx=0x7f582400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:50.834+0000 7f582d600640 1 -- 172.21.15.22:0/860897835 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5828039070 con 0x7f5830142d60 2024-04-16T16:20:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.076+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58301599d0 con 0x7f5830142d60 2024-04-16T16:20:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.077+0000 7f582d600640 1 -- 172.21.15.22:0/860897835 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3863 (secure 0 0 0) 0x7f582807aef0 con 0x7f5830142d60 2024-04-16T16:20:51.077 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:51.077 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/3896039959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3896039959},{"type":"v1","addr":"172.21.15.22:6836","nonce":3896039959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/594862213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":594862213},{"type":"v1","addr":"172.21.15.43:6834","nonce":594862213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/754211698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":754211698},{"type":"v1","addr":"172.21.15.43:6835","nonce":754211698}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2477628563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":2477628563},{"type":"v1","addr":"172.21.15.22:6837","nonce":2477628563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-04-16T16:20:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 29 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f581006ce90 msgr2=0x7f581006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f581006ce90 0x7f581006f350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5824007440 tx=0x7f582400b040 comp rx=0 tx=0).stop 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5830142d60 msgr2=0x7f58301f80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5830142d60 0x7f58301f80f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f582802bc00 tx=0x7f5828001120 comp rx=0 tx=0).stop 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 shutdown_connections 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f581006ce90 0x7f581006f350 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5830142d60 0x7f58301f80f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5830153bf0 0x7f5830142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 --2- 172.21.15.22:0/860897835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5818005230 0x7f58300b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.080+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 >> 172.21.15.22:0/860897835 conn(0x7f5830062440 msgr2=0x7f583015c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:51.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.081+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 shutdown_connections 2024-04-16T16:20:51.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.081+0000 7f5838400640 1 -- 172.21.15.22:0/860897835 wait complete. 2024-04-16T16:20:51.101 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T16:20:51.101 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T16:20:51.102 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T16:20:51.102 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:20:51.102 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T16:20:51.102 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-16T16:20:51.102 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T16:20:51.102 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:20:51.102 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T16:20:51.102 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T16:20:51.103 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T16:20:51.103 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:20:51.103 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T16:20:51.103 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-16T16:20:51.103 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T16:20:51.103 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:20:51.121 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T16:20:51.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T16:20:51.122 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T16:20:51.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T16:20:51.125 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T16:20:51.125 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T16:20:51.132 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T16:20:51.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T16:20:51.169 INFO:tasks.ceph.mds.c:Started 2024-04-16T16:20:51.169 DEBUG:teuthology.parallel:result is None 2024-04-16T16:20:51.175 INFO:tasks.ceph.mds.a:Started 2024-04-16T16:20:51.175 DEBUG:teuthology.parallel:result is None 2024-04-16T16:20:51.179 INFO:tasks.ceph.mds.b:Started 2024-04-16T16:20:51.179 DEBUG:teuthology.parallel:result is None 2024-04-16T16:20:51.185 INFO:tasks.ceph.mds.d:Started 2024-04-16T16:20:51.186 DEBUG:teuthology.parallel:result is None 2024-04-16T16:20:51.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T16:20:51.330 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2024-04-16T16:20:51.331 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2024-04-16T16:20:51.352 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-04-16T16:20:51.354 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-04-16T16:20:51.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.378+0000 7f7ffcc00640 1 Processor -- start 2024-04-16T16:20:51.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.378+0000 7f7ffcc00640 1 -- start start 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.379+0000 7f7ffcc00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7ff80d1940 0x7f7ff80d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.379+0000 7f7ffcc00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ff80d2de0 0x7f7ff80b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.379+0000 7f7ffcc00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff80d4650 con 0x7f7ff815eb30 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.379+0000 7f7ffcc00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff815ef10 con 0x7f7ff80d2de0 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.379+0000 7f7ffcc00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff80d35b0 con 0x7f7ff80d1940 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.379+0000 7f7ff7400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7ff815eb30 0x7f7ff80d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42156/0 (socket says 172.21.15.22:42156) 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.379+0000 7f7ff7400640 1 -- 172.21.15.22:0/2069086526 learned_addr learned my addr 172.21.15.22:0/2069086526 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:51.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.380+0000 7f7ff7e00640 1 --2- 172.21.15.22:0/2069086526 >> v2:172.21.15.22:3300/0 conn(0x7f7ff80d2de0 0x7f7ff80b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.380+0000 7f7ff6a00640 1 --2- 172.21.15.22:0/2069086526 >> v2:172.21.15.43:3300/0 conn(0x7f7ff80d1940 0x7f7ff80d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.380+0000 7f7ff7e00640 1 -- 172.21.15.22:0/2069086526 >> v2:172.21.15.43:3300/0 conn(0x7f7ff80d1940 msgr2=0x7f7ff80d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:51.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.380+0000 7f7ff7e00640 1 --2- 172.21.15.22:0/2069086526 >> v2:172.21.15.43:3300/0 conn(0x7f7ff80d1940 0x7f7ff80d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.380+0000 7f7ff6000640 1 -- 172.21.15.22:0/2069086526 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697731023 0 0) 0x7f7ff80d4650 con 0x7f7ff815eb30 2024-04-16T16:20:51.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.380+0000 7f7ff7e00640 1 -- 172.21.15.22:0/2069086526 >> v1:172.21.15.22:6789/0 conn(0x7f7ff815eb30 legacy=0x7f7ff80d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.380+0000 7f7ff7e00640 1 -- 172.21.15.22:0/2069086526 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff80d3890 con 0x7f7ff80d2de0 2024-04-16T16:20:51.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.381+0000 7f7ff7e00640 1 --2- 172.21.15.22:0/2069086526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80b7950 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80d0e70 tx=0x7f7ff002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a72b13995fc0b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:51.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.381+0000 7f7ff6000640 1 -- 172.21.15.22:0/2069086526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0039070 con 0x7f7ff80d2de0 2024-04-16T16:20:51.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ff6000640 1 -- 172.21.15.22:0/2069086526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff002cc80 con 0x7f7ff80d2de0 2024-04-16T16:20:51.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ff6000640 1 -- 172.21.15.22:0/2069086526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0034660 con 0x7f7ff80d2de0 2024-04-16T16:20:51.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 -- 172.21.15.22:0/2069086526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 msgr2=0x7f7ff80b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/2069086526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80b7950 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80d0e70 tx=0x7f7ff002bed0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 -- 172.21.15.22:0/2069086526 shutdown_connections 2024-04-16T16:20:51.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/2069086526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80b7950 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/2069086526 >> v2:172.21.15.43:3300/0 conn(0x7f7ff80d1940 0x7f7ff80d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 -- 172.21.15.22:0/2069086526 >> 172.21.15.22:0/2069086526 conn(0x7f7ff8072670 msgr2=0x7f7ff8062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:51.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 -- 172.21.15.22:0/2069086526 shutdown_connections 2024-04-16T16:20:51.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.382+0000 7f7ffcc00640 1 -- 172.21.15.22:0/2069086526 wait complete. 2024-04-16T16:20:51.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.384+0000 7f7ffcc00640 1 Processor -- start 2024-04-16T16:20:51.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.384+0000 7f7ffcc00640 1 -- start start 2024-04-16T16:20:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.385+0000 7f7ffcc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ff80d1940 0x7f7ff815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.385+0000 7f7ffcc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.385+0000 7f7ffcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ff815eb30 0x7f7ff80cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.385+0000 7f7ffcc00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff80d4130 con 0x7f7ff80d2de0 2024-04-16T16:20:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.385+0000 7f7ffcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff80d3e50 con 0x7f7ff815eb30 2024-04-16T16:20:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.385+0000 7f7ffcc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff80d3230 con 0x7f7ff80d1940 2024-04-16T16:20:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.385+0000 7f7ff6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80ac6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36312/0 (socket says 172.21.15.22:36312) 2024-04-16T16:20:51.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 -- 172.21.15.22:0/1848588356 learned_addr learned my addr 172.21.15.22:0/1848588356 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:51.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff7e00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ff815eb30 0x7f7ff80cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff7400640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ff80d1940 0x7f7ff815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 -- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ff80d1940 msgr2=0x7f7ff815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ff80d1940 0x7f7ff815c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 -- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ff815eb30 msgr2=0x7f7ff80cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ff815eb30 0x7f7ff80cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 -- 172.21.15.22:0/1848588356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff80b4730 con 0x7f7ff80d2de0 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.386+0000 7f7ff6a00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80ac6c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400e9b0 tx=0x7f7fe400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.387+0000 7f7fef400640 1 -- 172.21.15.22:0/1848588356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4017070 con 0x7f7ff80d2de0 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.387+0000 7f7fef400640 1 -- 172.21.15.22:0/1848588356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe400c9a0 con 0x7f7ff80d2de0 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.387+0000 7f7fef400640 1 -- 172.21.15.22:0/1848588356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400cd90 con 0x7f7ff80d2de0 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.387+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff80b4a10 con 0x7f7ff80d2de0 2024-04-16T16:20:51.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.387+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff80b4fd0 con 0x7f7ff80d2de0 2024-04-16T16:20:51.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.388+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff8075f30 con 0x7f7ff80d2de0 2024-04-16T16:20:51.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.389+0000 7f7fef400640 1 -- 172.21.15.22:0/1848588356 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f7fe401a070 con 0x7f7ff80d2de0 2024-04-16T16:20:51.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.390+0000 7f7fef400640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7fd806ce90 0x7f7fd806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.390+0000 7f7fef400640 1 -- 172.21.15.22:0/1848588356 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f7fe408c1f0 con 0x7f7ff80d2de0 2024-04-16T16:20:51.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.390+0000 7f7ff7400640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7fd806ce90 0x7f7fd806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.391+0000 7f7ff7400640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7fd806ce90 0x7f7fd806f350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8007fd0 tx=0x7f7fe8007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:51.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.394+0000 7f7fef400640 1 -- 172.21.15.22:0/1848588356 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7fe4059ab0 con 0x7f7ff80d2de0 2024-04-16T16:20:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.614+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7ff80d13b0 con 0x7f7ff80d2de0 2024-04-16T16:20:51.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.625+0000 7f7fef400640 1 -- 172.21.15.22:0/1848588356 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7f7fe405ddb0 con 0x7f7ff80d2de0 2024-04-16T16:20:51.625 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2024-04-16T16:20:51.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7fd806ce90 msgr2=0x7f7fd806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7fd806ce90 0x7f7fd806f350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8007fd0 tx=0x7f7fe8007de0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 msgr2=0x7f7ff80ac6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80ac6c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400e9b0 tx=0x7f7fe400ee70 comp rx=0 tx=0).stop 2024-04-16T16:20:51.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 shutdown_connections 2024-04-16T16:20:51.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7fd806ce90 0x7f7fd806f350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ff815eb30 0x7f7ff80cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ff80d2de0 0x7f7ff80ac6c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 --2- 172.21.15.22:0/1848588356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ff80d1940 0x7f7ff815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.628+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 >> 172.21.15.22:0/1848588356 conn(0x7f7ff8072670 msgr2=0x7f7ff81610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:51.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.629+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 shutdown_connections 2024-04-16T16:20:51.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.629+0000 7f7ffcc00640 1 -- 172.21.15.22:0/1848588356 wait complete. 2024-04-16T16:20:51.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T16:20:51.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.866+0000 7f1015a00640 1 Processor -- start 2024-04-16T16:20:51.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.866+0000 7f1015a00640 1 -- start start 2024-04-16T16:20:51.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f1015a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 0x7f101006da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f1015a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10100af2b0 con 0x7f10100d01a0 2024-04-16T16:20:51.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f1015a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10100af590 con 0x7f10100b3410 2024-04-16T16:20:51.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f1015a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f101006d020 con 0x7f10100b38a0 2024-04-16T16:20:51.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f100fe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f10100d01a0 0x7f10100d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42166/0 (socket says 172.21.15.22:42166) 2024-04-16T16:20:51.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f100fe00640 1 -- 172.21.15.22:0/1424771403 learned_addr learned my addr 172.21.15.22:0/1424771403 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486697220 0 0) 0x7f10100af2b0 con 0x7f10100d01a0 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff0003520 con 0x7f10100d01a0 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.868+0000 7f1015000640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 0x7f101006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1756209245 0 0) 0x7f0ff0003520 con 0x7f10100d01a0 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 msgr2=0x7f101006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 0x7f101006da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 >> v1:172.21.15.43:6789/0 conn(0x7f10100b3410 legacy=0x7f10100ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101006d250 con 0x7f10100d01a0 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f1000001670 con 0x7f10100d01a0 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 >> v1:172.21.15.22:6789/0 conn(0x7f10100d01a0 legacy=0x7f10100d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff00039e0 0x7f0ff0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f0ff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 0x7f0ff0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff000bb50 con 0x7f0ff0004800 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff000bd00 con 0x7f0ff00039e0 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff000bf00 con 0x7f10100b38a0 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.869+0000 7f1007e00640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f0ff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f100fe00640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff00039e0 0x7f0ff0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f1015000640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 0x7f0ff0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f1007e00640 1 -- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 msgr2=0x7f0ff0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f1007e00640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10100b38a0 0x7f0ff0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f1007e00640 1 -- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff00039e0 msgr2=0x7f0ff0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f1007e00640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff00039e0 0x7f0ff0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f1007e00640 1 -- 172.21.15.22:0/1424771403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff0003520 con 0x7f0ff0004800 2024-04-16T16:20:51.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.870+0000 7f100fe00640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff00039e0 0x7f0ff0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.871+0000 7f1007e00640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f0ff0004c80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8001750 tx=0x7f0ff0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda339ac57b5c7ab server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.871+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8001370 con 0x7f0ff0004800 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.871+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff80052d0 con 0x7f0ff0004800 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.871+0000 7f100f400640 1 -- 172.21.15.22:0/1424771403 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8003830 con 0x7f0ff0004800 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.872+0000 7f1015a00640 1 -- 172.21.15.22:0/1424771403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 msgr2=0x7f0ff0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.872+0000 7f1015a00640 1 --2- 172.21.15.22:0/1424771403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f0ff0004c80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8001750 tx=0x7f0ff0005830 comp rx=0 tx=0).stop 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.872+0000 7f1015000640 1 -- 172.21.15.22:0/1424771403 reap_dead start 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.872+0000 7f1015a00640 1 -- 172.21.15.22:0/1424771403 shutdown_connections 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.872+0000 7f1015a00640 1 -- 172.21.15.22:0/1424771403 >> 172.21.15.22:0/1424771403 conn(0x7f1010062440 msgr2=0x7f1010062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.872+0000 7f1015a00640 1 -- 172.21.15.22:0/1424771403 shutdown_connections 2024-04-16T16:20:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.872+0000 7f1015a00640 1 -- 172.21.15.22:0/1424771403 wait complete. 2024-04-16T16:20:51.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.874+0000 7f1015a00640 1 Processor -- start 2024-04-16T16:20:51.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.874+0000 7f1015a00640 1 -- start start 2024-04-16T16:20:51.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f1015a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f101013d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f1015a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1010143b00 0x7f10101f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f1015a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10101f39e0 0x7f10101f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f1015a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10100aef70 con 0x7f0ff0004800 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f1015a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f10100af870 con 0x7f1010143b00 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f1015a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1010162200 con 0x7f10101f39e0 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f100fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f101013d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f100fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f101013d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36324/0 (socket says 172.21.15.22:36324) 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.875+0000 7f100fe00640 1 -- 172.21.15.22:0/3187837681 learned_addr learned my addr 172.21.15.22:0/3187837681 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f1007e00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1010143b00 0x7f10101f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f1015000640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10101f39e0 0x7f10101f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f100fe00640 1 -- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10101f39e0 msgr2=0x7f10101f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f100fe00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10101f39e0 0x7f10101f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f100fe00640 1 -- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1010143b00 msgr2=0x7f10101f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:51.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f100fe00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1010143b00 0x7f10101f34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:51.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f100fe00640 1 -- 172.21.15.22:0/3187837681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101014f2c0 con 0x7f0ff0004800 2024-04-16T16:20:51.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f1015000640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10101f39e0 0x7f10101f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:51.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f100fe00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f101013d5f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f100000d810 tx=0x7f100000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:51.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.876+0000 7f100cc00640 1 -- 172.21.15.22:0/3187837681 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000019070 con 0x7f0ff0004800 2024-04-16T16:20:51.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.877+0000 7f100cc00640 1 -- 172.21.15.22:0/3187837681 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10000074e0 con 0x7f0ff0004800 2024-04-16T16:20:51.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.877+0000 7f100cc00640 1 -- 172.21.15.22:0/3187837681 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000049e0 con 0x7f0ff0004800 2024-04-16T16:20:51.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.877+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1010151700 con 0x7f0ff0004800 2024-04-16T16:20:51.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.877+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10101521e0 con 0x7f0ff0004800 2024-04-16T16:20:51.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.878+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1010075f30 con 0x7f0ff0004800 2024-04-16T16:20:51.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.879+0000 7f100cc00640 1 -- 172.21.15.22:0/3187837681 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f1000004b80 con 0x7f0ff0004800 2024-04-16T16:20:51.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.880+0000 7f100cc00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0fec06ce90 0x7f0fec06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:51.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.880+0000 7f100cc00640 1 -- 172.21.15.22:0/3187837681 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7f100008bdd0 con 0x7f0ff0004800 2024-04-16T16:20:51.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.880+0000 7f1007e00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0fec06ce90 0x7f0fec06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:51.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.881+0000 7f1007e00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0fec06ce90 0x7f0fec06f350 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8033000 tx=0x7f0ff8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:51.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:51.884+0000 7f100cc00640 1 -- 172.21.15.22:0/3187837681 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1000059c20 con 0x7f0ff0004800 2024-04-16T16:20:52.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.167+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f10101514b0 con 0x7f0ff0004800 2024-04-16T16:20:52.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.168+0000 7f100cc00640 1 -- 172.21.15.22:0/3187837681 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f1000059520 con 0x7f0ff0004800 2024-04-16T16:20:52.168 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:52.168 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5maPz2BxAAivyrcX8Q0RVwbHZKA4d4Qw==", 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2024-04-16T16:20:52.169 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5mWRiSKhAANQmBIwdBnXhI5EGtK2c86g==", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAspB5mqenxGBAAjtp8wD4KQJxzHvXwFiGhOw==", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:20:52.170 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mjhgTARAAGaEgDRX6W3PVFW0MCREAlg==", 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAvpB5mOTo2JxAAv8ODGhoblmotI4MCQe6yFg==", 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAypB5m+sawMxAAnAne7tM6gWBZtKrFrv53WA==", 2024-04-16T16:20:52.172 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA2pB5mr/n9BRAA8Cg5a95OxPY//SZrLgt5iQ==", 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.173 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA5pB5mzNRPFBAArNK/lgB2DkkAP/cZ8uD+Vg==", 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQA+pB5mW52mERAAub8dzTaWbs/HB3ZLiwua+Q==", 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.174 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBBpB5mXWImHRAAWuZAlqR/+YQikJD4n34FUQ==", 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.175 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBEpB5mgBf6KhAAqcT5kTzdBSoQR6+MdHRIBA==", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBIpB5mhwmwCxAA33jQ9ARJ1dCc0D2CjzyaZA==", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.176 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw==", 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mnxe/JxAAbmM9S9qN7oeLgRvCGkAxMA==", 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.177 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mfNS0GxAAeD6JDkePBk6Zlda+ku47+g==", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:20:52.178 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAtpB5mumHtMhAA4utGeU4f5JWOEHCvpo3Onw==", 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2024-04-16T16:20:52.179 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQAqpB5moKzeMxAAQT7umjghe+/+tmNzbOi7ZQ==", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQArpB5mApKSNhAAAgDOhVl6JdS2WqfiNmMpQQ==", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2024-04-16T16:20:52.180 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQArpB5mcdOSKRAAF92yoRpysHC1g6FsLdqIYw==", 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-16T16:20:52.181 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:20:52.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0fec06ce90 msgr2=0x7f0fec06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0fec06ce90 0x7f0fec06f350 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8033000 tx=0x7f0ff8009030 comp rx=0 tx=0).stop 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 msgr2=0x7f101013d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f101013d5f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f100000d810 tx=0x7f100000dcd0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 shutdown_connections 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f0fec06ce90 0x7f0fec06f350 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10101f39e0 0x7f10101f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1010143b00 0x7f10101f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 --2- 172.21.15.22:0/3187837681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff0004800 0x7f101013d5f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 >> 172.21.15.22:0/3187837681 conn(0x7f1010062440 msgr2=0x7f1010062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 shutdown_connections 2024-04-16T16:20:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.172+0000 7f1015a00640 1 -- 172.21.15.22:0/3187837681 wait complete. 2024-04-16T16:20:52.193 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.414+0000 7f1ca9000640 1 Processor -- start 2024-04-16T16:20:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.414+0000 7f1ca9000640 1 -- start start 2024-04-16T16:20:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.416+0000 7f1ca9000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ca406dc80 0x7f1ca40d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.416+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ca40d0b40 0x7f1ca415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.416+0000 7f1ca9000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca41606d0 con 0x7f1ca40afd90 2024-04-16T16:20:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.416+0000 7f1ca9000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca4160480 con 0x7f1ca406dc80 2024-04-16T16:20:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.416+0000 7f1ca9000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca40d0ff0 con 0x7f1ca40d0b40 2024-04-16T16:20:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.416+0000 7f1ca1e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1ca40afd90 0x7f1ca4072b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42182/0 (socket says 172.21.15.22:42182) 2024-04-16T16:20:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.416+0000 7f1ca1e00640 1 -- 172.21.15.22:0/3716157963 learned_addr learned my addr 172.21.15.22:0/3716157963 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1c99400640 1 --2- 172.21.15.22:0/3716157963 >> v2:172.21.15.43:3300/0 conn(0x7f1ca406dc80 0x7f1ca40d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca2800640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ca40d0b40 0x7f1ca415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355942437 0 0) 0x7f1ca41606d0 con 0x7f1ca40afd90 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c88003520 con 0x7f1ca40afd90 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3700838390 0 0) 0x7f1c88003520 con 0x7f1ca40afd90 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ca40d0b40 msgr2=0x7f1ca415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ca40d0b40 0x7f1ca415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 >> v2:172.21.15.43:3300/0 conn(0x7f1ca406dc80 msgr2=0x7f1ca40d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 --2- 172.21.15.22:0/3716157963 >> v2:172.21.15.43:3300/0 conn(0x7f1ca406dc80 0x7f1ca40d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.417+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca41609b0 con 0x7f1ca40afd90 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f1c94001670 con 0x7f1ca40afd90 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 >> v1:172.21.15.22:6789/0 conn(0x7f1ca40afd90 legacy=0x7f1ca4072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ca40d0b40 0x7f1c880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c88003f30 0x7f1c88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c88004d40 0x7f1c880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4160480 con 0x7f1c88004d40 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca40d0ff0 con 0x7f1c88003f30 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8800ba10 con 0x7f1ca40d0b40 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca2800640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c88004d40 0x7f1c880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1c99400640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c88003f30 0x7f1c88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca2800640 1 -- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ca40d0b40 msgr2=0x7f1c880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca2800640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ca40d0b40 0x7f1c880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca2800640 1 -- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c88003f30 msgr2=0x7f1c88004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca2800640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c88003f30 0x7f1c88004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1ca2800640 1 -- 172.21.15.22:0/3716157963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c88003520 con 0x7f1c88004d40 2024-04-16T16:20:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.418+0000 7f1c99400640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c88003f30 0x7f1c88004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.420+0000 7f1ca2800640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c88004d40 0x7f1c880051c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009af0 tx=0x7f1c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd92a2e155eceec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.420+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c039070 con 0x7f1c88004d40 2024-04-16T16:20:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.420+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c02c710 con 0x7f1c88004d40 2024-04-16T16:20:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.420+0000 7f1ca1400640 1 -- 172.21.15.22:0/3716157963 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c009690 con 0x7f1c88004d40 2024-04-16T16:20:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.421+0000 7f1ca9000640 1 -- 172.21.15.22:0/3716157963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c88004d40 msgr2=0x7f1c880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.421+0000 7f1ca9000640 1 --2- 172.21.15.22:0/3716157963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c88004d40 0x7f1c880051c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009af0 tx=0x7f1c88005830 comp rx=0 tx=0).stop 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.421+0000 7f1ca2800640 1 -- 172.21.15.22:0/3716157963 reap_dead start 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.421+0000 7f1ca9000640 1 -- 172.21.15.22:0/3716157963 shutdown_connections 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.421+0000 7f1ca9000640 1 -- 172.21.15.22:0/3716157963 >> 172.21.15.22:0/3716157963 conn(0x7f1ca4062440 msgr2=0x7f1ca4062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.421+0000 7f1ca9000640 1 -- 172.21.15.22:0/3716157963 shutdown_connections 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.421+0000 7f1ca9000640 1 -- 172.21.15.22:0/3716157963 wait complete. 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.423+0000 7f1ca9000640 1 Processor -- start 2024-04-16T16:20:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.423+0000 7f1ca9000640 1 -- start start 2024-04-16T16:20:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c88004d40 0x7f1ca40aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ca40cf1a0 0x7f1ca40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ca415cee0 0x7f1ca415d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca9000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca40b0170 con 0x7f1ca415cee0 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca9000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4160f70 con 0x7f1ca40cf1a0 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca9000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca4073220 con 0x7f1c88004d40 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ca415cee0 0x7f1ca415d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ca415cee0 0x7f1ca415d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36338/0 (socket says 172.21.15.22:36338) 2024-04-16T16:20:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca2800640 1 -- 172.21.15.22:0/4113313350 learned_addr learned my addr 172.21.15.22:0/4113313350 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:52.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1ca1e00640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c88004d40 0x7f1ca40aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.424+0000 7f1c99400640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ca40cf1a0 0x7f1ca40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca2800640 1 -- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c88004d40 msgr2=0x7f1ca40aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca2800640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c88004d40 0x7f1ca40aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca2800640 1 -- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ca40cf1a0 msgr2=0x7f1ca40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca2800640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ca40cf1a0 0x7f1ca40cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca2800640 1 -- 172.21.15.22:0/4113313350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca415d8a0 con 0x7f1ca415cee0 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca1e00640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c88004d40 0x7f1ca40aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca2800640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ca415cee0 0x7f1ca415d360 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009af0 tx=0x7f1c9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1c9aa00640 1 -- 172.21.15.22:0/4113313350 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c039070 con 0x7f1ca415cee0 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1c9aa00640 1 -- 172.21.15.22:0/4113313350 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c043070 con 0x7f1ca415cee0 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1c9aa00640 1 -- 172.21.15.22:0/4113313350 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c009690 con 0x7f1ca415cee0 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.425+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca40af230 con 0x7f1ca415cee0 2024-04-16T16:20:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.426+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca41f3cc0 con 0x7f1ca415cee0 2024-04-16T16:20:52.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.427+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca40cdf20 con 0x7f1ca415cee0 2024-04-16T16:20:52.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.428+0000 7f1c9aa00640 1 -- 172.21.15.22:0/4113313350 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f1c9c003a50 con 0x7f1ca415cee0 2024-04-16T16:20:52.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.429+0000 7f1c9aa00640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c8006cec0 0x7f1c8006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.429+0000 7f1c9aa00640 1 -- 172.21.15.22:0/4113313350 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7f1c9c0ad350 con 0x7f1ca415cee0 2024-04-16T16:20:52.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.429+0000 7f1ca1e00640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c8006cec0 0x7f1c8006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.430+0000 7f1ca1e00640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c8006cec0 0x7f1c8006f380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c94001eb0 tx=0x7f1c94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:52.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.434+0000 7f1c9aa00640 1 -- 172.21.15.22:0/4113313350 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ca40cdf20 con 0x7f1ca415cee0 2024-04-16T16:20:52.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.643+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ca404fd90 con 0x7f1ca415cee0 2024-04-16T16:20:52.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.645+0000 7f1c9aa00640 1 -- 172.21.15.22:0/4113313350 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+12771 (secure 0 0 0) 0x7f1c9c04c020 con 0x7f1ca415cee0 2024-04-16T16:20:52.645 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:52.645 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":58,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:51.638362+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:52.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c8006cec0 msgr2=0x7f1c8006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c8006cec0 0x7f1c8006f380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c94001eb0 tx=0x7f1c94009040 comp rx=0 tx=0).stop 2024-04-16T16:20:52.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ca415cee0 msgr2=0x7f1ca415d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ca415cee0 0x7f1ca415d360 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009af0 tx=0x7f1c9c004730 comp rx=0 tx=0).stop 2024-04-16T16:20:52.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 shutdown_connections 2024-04-16T16:20:52.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f1c8006cec0 0x7f1c8006f380 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ca415cee0 0x7f1ca415d360 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ca40cf1a0 0x7f1ca40cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 --2- 172.21.15.22:0/4113313350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c88004d40 0x7f1ca40aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 >> 172.21.15.22:0/4113313350 conn(0x7f1ca4062440 msgr2=0x7f1ca41595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:52.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 shutdown_connections 2024-04-16T16:20:52.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.648+0000 7f1ca9000640 1 -- 172.21.15.22:0/4113313350 wait complete. 2024-04-16T16:20:52.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T16:16:35.741414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T16:20:52.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T16:20:52.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.876+0000 7f1732600640 1 Processor -- start 2024-04-16T16:20:52.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.877+0000 7f1732600640 1 -- start start 2024-04-16T16:20:52.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.878+0000 7f1732600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 0x7f172c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.878+0000 7f1732600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172c15cc20 con 0x7f172c06e930 2024-04-16T16:20:52.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.878+0000 7f1732600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172c1611a0 con 0x7f172c0cc830 2024-04-16T16:20:52.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.878+0000 7f1732600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f172c0ce390 con 0x7f172c15c840 2024-04-16T16:20:52.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.879+0000 7f1731c00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f172c06e930 0x7f172c160a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42186/0 (socket says 172.21.15.22:42186) 2024-04-16T16:20:52.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.879+0000 7f1731c00640 1 -- 172.21.15.22:0/3571864536 learned_addr learned my addr 172.21.15.22:0/3571864536 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.879+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054483647 0 0) 0x7f1724001490 con 0x7f172c06e930 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.879+0000 7f1731200640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 0x7f172c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.879+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1714003520 con 0x7f172c06e930 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3526518069 0 0) 0x7f1714003520 con 0x7f172c06e930 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 msgr2=0x7f172c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 0x7f172c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 >> v1:172.21.15.43:6789/0 conn(0x7f172c0cc830 legacy=0x7f172c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c06dda0 con 0x7f172c06e930 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f1724001bc0 con 0x7f172c06e930 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 >> v1:172.21.15.22:6789/0 conn(0x7f172c06e930 legacy=0x7f172c160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 0x7f17140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1714004060 0x7f1714004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1714004d40 0x7f17140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f171400ffe0 con 0x7f1714004d40 2024-04-16T16:20:52.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1714010190 con 0x7f1714004060 2024-04-16T16:20:52.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1714010390 con 0x7f172c15c840 2024-04-16T16:20:52.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.880+0000 7f1731c00640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1714004d40 0x7f17140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.881+0000 7f172be00640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1714004060 0x7f1714004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.881+0000 7f1731200640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 0x7f17140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.881+0000 7f1731c00640 1 -- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 msgr2=0x7f17140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.881+0000 7f1731c00640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c15c840 0x7f17140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.881+0000 7f1731c00640 1 -- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1714004060 msgr2=0x7f1714004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.881+0000 7f1731c00640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1714004060 0x7f1714004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.881+0000 7f1731c00640 1 -- 172.21.15.22:0/3571864536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1714003520 con 0x7f1714004d40 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.882+0000 7f1731c00640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1714004d40 0x7f17140051c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f172400a960 tx=0x7f1714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1bbbe2c72c877 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.882+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172400a580 con 0x7f1714004d40 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.882+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724007270 con 0x7f1714004d40 2024-04-16T16:20:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.882+0000 7f172b400640 1 -- 172.21.15.22:0/3571864536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17240076c0 con 0x7f1714004d40 2024-04-16T16:20:52.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.883+0000 7f1732600640 1 -- 172.21.15.22:0/3571864536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1714004d40 msgr2=0x7f17140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.883+0000 7f1732600640 1 --2- 172.21.15.22:0/3571864536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1714004d40 0x7f17140051c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f172400a960 tx=0x7f1714005830 comp rx=0 tx=0).stop 2024-04-16T16:20:52.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.883+0000 7f1731c00640 1 -- 172.21.15.22:0/3571864536 reap_dead start 2024-04-16T16:20:52.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.883+0000 7f1732600640 1 -- 172.21.15.22:0/3571864536 shutdown_connections 2024-04-16T16:20:52.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.883+0000 7f1732600640 1 -- 172.21.15.22:0/3571864536 >> 172.21.15.22:0/3571864536 conn(0x7f172c062440 msgr2=0x7f172c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:52.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.883+0000 7f1732600640 1 -- 172.21.15.22:0/3571864536 shutdown_connections 2024-04-16T16:20:52.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.883+0000 7f1732600640 1 -- 172.21.15.22:0/3571864536 wait complete. 2024-04-16T16:20:52.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.885+0000 7f1732600640 1 Processor -- start 2024-04-16T16:20:52.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.885+0000 7f1732600640 1 -- start start 2024-04-16T16:20:52.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.886+0000 7f1732600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1714004d40 0x7f172c145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.886+0000 7f1732600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c157090 0x7f172c157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.886+0000 7f1732600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f172c15a420 0x7f172c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.886+0000 7f1732600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f172c0ce5c0 con 0x7f172c15a420 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.886+0000 7f1732600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f172c06dac0 con 0x7f172c157090 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.886+0000 7f1732600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f172c0ce8a0 con 0x7f1714004d40 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f172c15a420 0x7f172c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f172c15a420 0x7f172c15a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36364/0 (socket says 172.21.15.22:36364) 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 -- 172.21.15.22:0/1109068541 learned_addr learned my addr 172.21.15.22:0/1109068541 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731200640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1714004d40 0x7f172c145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f172be00640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c157090 0x7f172c157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 -- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1714004d40 msgr2=0x7f172c145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1714004d40 0x7f172c145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 -- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c157090 msgr2=0x7f172c157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:52.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c157090 0x7f172c157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:52.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731c00640 1 -- 172.21.15.22:0/1109068541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c145ff0 con 0x7f172c15a420 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.887+0000 7f1731200640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1714004d40 0x7f172c145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.888+0000 7f1731c00640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f172c15a420 0x7f172c15a8a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f172400aa50 tx=0x7f172c06edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.888+0000 7f1728c00640 1 -- 172.21.15.22:0/1109068541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172400a580 con 0x7f172c15a420 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.888+0000 7f1728c00640 1 -- 172.21.15.22:0/1109068541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172403b040 con 0x7f172c15a420 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.888+0000 7f1728c00640 1 -- 172.21.15.22:0/1109068541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724001490 con 0x7f172c15a420 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.888+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c1f4130 con 0x7f172c15a420 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.888+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c1f46f0 con 0x7f172c15a420 2024-04-16T16:20:52.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.890+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c075f30 con 0x7f172c15a420 2024-04-16T16:20:52.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.891+0000 7f1728c00640 1 -- 172.21.15.22:0/1109068541 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f1724007860 con 0x7f172c15a420 2024-04-16T16:20:52.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.892+0000 7f1728c00640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f170c06ce90 0x7f170c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:52.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.892+0000 7f1728c00640 1 -- 172.21.15.22:0/1109068541 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7f17240ae180 con 0x7f172c15a420 2024-04-16T16:20:52.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.892+0000 7f1731200640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f170c06ce90 0x7f170c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:52.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.893+0000 7f1731200640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f170c06ce90 0x7f170c06f350 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1720006fd0 tx=0x7f1720008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:52.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:52.897+0000 7f1728c00640 1 -- 172.21.15.22:0/1109068541 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f172c15cc20 con 0x7f172c15a420 2024-04-16T16:20:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.099+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f172c154ad0 con 0x7f172c15a420 2024-04-16T16:20:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.099+0000 7f1728c00640 1 -- 172.21.15.22:0/1109068541 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (secure 0 0 0) 0x7f172407b8f0 con 0x7f172c15a420 2024-04-16T16:20:53.099 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-16T16:20:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.102+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f170c06ce90 msgr2=0x7f170c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.102+0000 7f1732600640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f170c06ce90 0x7f170c06f350 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1720006fd0 tx=0x7f1720008040 comp rx=0 tx=0).stop 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.102+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f172c15a420 msgr2=0x7f172c15a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.102+0000 7f1732600640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f172c15a420 0x7f172c15a8a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f172400aa50 tx=0x7f172c06edc0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.102+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 shutdown_connections 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.103+0000 7f1732600640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f170c06ce90 0x7f170c06f350 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.103+0000 7f1732600640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f172c15a420 0x7f172c15a8a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.103+0000 7f1732600640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c157090 0x7f172c157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.103+0000 7f1732600640 1 --2- 172.21.15.22:0/1109068541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1714004d40 0x7f172c145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.103+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 >> 172.21.15.22:0/1109068541 conn(0x7f172c062440 msgr2=0x7f172c0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.103+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 shutdown_connections 2024-04-16T16:20:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.103+0000 7f1732600640 1 -- 172.21.15.22:0/1109068541 wait complete. 2024-04-16T16:20:53.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T16:20:53.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.350+0000 7f7532c00640 1 Processor -- start 2024-04-16T16:20:53.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.350+0000 7f7532c00640 1 -- start start 2024-04-16T16:20:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f7532c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 0x7f752c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f7532c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f752c0b9080 con 0x7f752c0d3dd0 2024-04-16T16:20:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f7532c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f752c0b9360 con 0x7f752c15ea50 2024-04-16T16:20:53.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f7532c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f752c0b9c90 con 0x7f752c0cfd40 2024-04-16T16:20:53.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f7530e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f752c0d3dd0 0x7f752c0cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42188/0 (socket says 172.21.15.22:42188) 2024-04-16T16:20:53.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f7530e00640 1 -- 172.21.15.22:0/792709238 learned_addr learned my addr 172.21.15.22:0/792709238 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724936026 0 0) 0x7f752c0b9080 con 0x7f752c0d3dd0 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.353+0000 7f7532200640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 0x7f752c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7514003520 con 0x7f752c0d3dd0 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4124601174 0 0) 0x7f7514003520 con 0x7f752c0d3dd0 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 msgr2=0x7f752c0b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 0x7f752c0b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 >> v1:172.21.15.43:6789/0 conn(0x7f752c15ea50 legacy=0x7f752c0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c0b9640 con 0x7f752c0d3dd0 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f7518001670 con 0x7f752c0d3dd0 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 >> v1:172.21.15.22:6789/0 conn(0x7f752c0d3dd0 legacy=0x7f752c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 0x7f75140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514003fb0 0x7f7514004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7514004d40 0x7f75140051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f752c0b9c90 con 0x7f7514004d40 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f751400bc50 con 0x7f7514003fb0 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.354+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f751400be50 con 0x7f752c0cfd40 2024-04-16T16:20:53.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7532200640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7514004d40 0x7f75140051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7530e00640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514003fb0 0x7f7514004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7531800640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 0x7f75140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7532200640 1 -- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 msgr2=0x7f75140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:53.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7532200640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 0x7f75140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7532200640 1 -- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514003fb0 msgr2=0x7f7514004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7532200640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514003fb0 0x7f7514004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7532200640 1 -- 172.21.15.22:0/792709238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7514003520 con 0x7f7514004d40 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.355+0000 7f7531800640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0cfd40 0x7f75140039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.356+0000 7f7532200640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7514004d40 0x7f75140051a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7524009f90 tx=0x7f7514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef01976966f4884b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.357+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524039070 con 0x7f7514004d40 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.357+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752402cbd0 con 0x7f7514004d40 2024-04-16T16:20:53.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.357+0000 7f752be00640 1 -- 172.21.15.22:0/792709238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524009c10 con 0x7f7514004d40 2024-04-16T16:20:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.357+0000 7f7532c00640 1 -- 172.21.15.22:0/792709238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7514004d40 msgr2=0x7f75140051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.357+0000 7f7532c00640 1 --2- 172.21.15.22:0/792709238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7514004d40 0x7f75140051a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7524009f90 tx=0x7f7514005830 comp rx=0 tx=0).stop 2024-04-16T16:20:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.357+0000 7f7532200640 1 -- 172.21.15.22:0/792709238 reap_dead start 2024-04-16T16:20:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.358+0000 7f7532c00640 1 -- 172.21.15.22:0/792709238 shutdown_connections 2024-04-16T16:20:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.358+0000 7f7532c00640 1 -- 172.21.15.22:0/792709238 >> 172.21.15.22:0/792709238 conn(0x7f752c072430 msgr2=0x7f752c072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.358+0000 7f7532c00640 1 -- 172.21.15.22:0/792709238 shutdown_connections 2024-04-16T16:20:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.358+0000 7f7532c00640 1 -- 172.21.15.22:0/792709238 wait complete. 2024-04-16T16:20:53.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.360+0000 7f7532c00640 1 Processor -- start 2024-04-16T16:20:53.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.360+0000 7f7532c00640 1 -- start start 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7532c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514004d40 0x7f752c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7532c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f752c152330 0x7f752c0d3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7532c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0d37a0 0x7f752c0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7532c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f752c0b8aa0 con 0x7f752c152330 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7532c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f752c15ee30 con 0x7f7514004d40 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7532c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f752c0b8c20 con 0x7f752c0d37a0 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7530e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f752c152330 0x7f752c0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7530e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f752c152330 0x7f752c0d3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36382/0 (socket says 172.21.15.22:36382) 2024-04-16T16:20:53.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.361+0000 7f7530e00640 1 -- 172.21.15.22:0/1877568008 learned_addr learned my addr 172.21.15.22:0/1877568008 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:53.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7531800640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514004d40 0x7f752c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7532200640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0d37a0 0x7f752c0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7530e00640 1 -- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0d37a0 msgr2=0x7f752c0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7530e00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0d37a0 0x7f752c0ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7530e00640 1 -- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514004d40 msgr2=0x7f752c0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7530e00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514004d40 0x7f752c0c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7530e00640 1 -- 172.21.15.22:0/1877568008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c15f150 con 0x7f752c152330 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7531800640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514004d40 0x7f752c0c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7530e00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f752c152330 0x7f752c0d3260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f751800e760 tx=0x7f751800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.362+0000 7f7529600640 1 -- 172.21.15.22:0/1877568008 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751800ee70 con 0x7f752c152330 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.363+0000 7f7529600640 1 -- 172.21.15.22:0/1877568008 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7518018070 con 0x7f752c152330 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.363+0000 7f7529600640 1 -- 172.21.15.22:0/1877568008 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751800cad0 con 0x7f752c152330 2024-04-16T16:20:53.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.363+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752c15f430 con 0x7f752c152330 2024-04-16T16:20:53.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.363+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752c15f9f0 con 0x7f752c152330 2024-04-16T16:20:53.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.364+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f752c075f30 con 0x7f752c152330 2024-04-16T16:20:53.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.365+0000 7f7529600640 1 -- 172.21.15.22:0/1877568008 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f751800cc70 con 0x7f752c152330 2024-04-16T16:20:53.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.366+0000 7f7529600640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f750c06cec0 0x7f750c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.366+0000 7f7529600640 1 -- 172.21.15.22:0/1877568008 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7f751808bdf0 con 0x7f752c152330 2024-04-16T16:20:53.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.366+0000 7f7531800640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f750c06cec0 0x7f750c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.367+0000 7f7531800640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f750c06cec0 0x7f750c06f380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f75200016f0 tx=0x7f7520009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:53.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.371+0000 7f7529600640 1 -- 172.21.15.22:0/1877568008 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7518059c70 con 0x7f752c152330 2024-04-16T16:20:53.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.577+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f752c0d5020 con 0x7f752c152330 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.578+0000 7f7529600640 1 -- 172.21.15.22:0/1877568008 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7f7518059570 con 0x7f752c152330 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-16T16:20:53.578 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f750c06cec0 msgr2=0x7f750c06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f750c06cec0 0x7f750c06f380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f75200016f0 tx=0x7f7520009040 comp rx=0 tx=0).stop 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f752c152330 msgr2=0x7f752c0d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f752c152330 0x7f752c0d3260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f751800e760 tx=0x7f751800ec20 comp rx=0 tx=0).stop 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 shutdown_connections 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f750c06cec0 0x7f750c06f380 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f752c0d37a0 0x7f752c0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f752c152330 0x7f752c0d3260 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 --2- 172.21.15.22:0/1877568008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7514004d40 0x7f752c0c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 >> 172.21.15.22:0/1877568008 conn(0x7f752c072430 msgr2=0x7f752c15c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 shutdown_connections 2024-04-16T16:20:53.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.581+0000 7f7532c00640 1 -- 172.21.15.22:0/1877568008 wait complete. 2024-04-16T16:20:53.600 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T16:20:53.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T16:20:53.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.832+0000 7f4d78400640 1 Processor -- start 2024-04-16T16:20:53.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.832+0000 7f4d78400640 1 -- start start 2024-04-16T16:20:53.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d78400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4d70164030 0x7f4d700711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d78400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d700b2b30 0x7f4d70160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d78400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700b5a70 con 0x7f4d700b41a0 2024-04-16T16:20:53.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d78400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4d70071700 con 0x7f4d700b2b30 2024-04-16T16:20:53.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d78400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4d70072b00 con 0x7f4d70164030 2024-04-16T16:20:53.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d75000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4d700b41a0 0x7f4d700b2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42204/0 (socket says 172.21.15.22:42204) 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d75000640 1 -- 172.21.15.22:0/2361084324 learned_addr learned my addr 172.21.15.22:0/2361084324 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.834+0000 7f4d76400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d700b2b30 0x7f4d70160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.835+0000 7f4d75a00640 1 --2- 172.21.15.22:0/2361084324 >> v2:172.21.15.43:3300/0 conn(0x7f4d70164030 0x7f4d700711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.835+0000 7f4d76400640 1 -- 172.21.15.22:0/2361084324 >> v2:172.21.15.43:3300/0 conn(0x7f4d70164030 msgr2=0x7f4d700711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.835+0000 7f4d76400640 1 --2- 172.21.15.22:0/2361084324 >> v2:172.21.15.43:3300/0 conn(0x7f4d70164030 0x7f4d700711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.835+0000 7f4d76400640 1 -- 172.21.15.22:0/2361084324 >> v1:172.21.15.22:6789/0 conn(0x7f4d700b41a0 legacy=0x7f4d700b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.835+0000 7f4d76400640 1 -- 172.21.15.22:0/2361084324 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70164410 con 0x7f4d700b2b30 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.835+0000 7f4d6fe00640 1 -- 172.21.15.22:0/2361084324 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664222088 0 0) 0x7f4d700b5a70 con 0x7f4d700b41a0 2024-04-16T16:20:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.836+0000 7f4d76400640 1 --2- 172.21.15.22:0/2361084324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b2b30 0x7f4d70160160 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4d700b3270 tx=0x7f4d6802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b099a42fad03e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:53.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.836+0000 7f4d6fe00640 1 -- 172.21.15.22:0/2361084324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68039070 con 0x7f4d700b2b30 2024-04-16T16:20:53.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.836+0000 7f4d6fe00640 1 -- 172.21.15.22:0/2361084324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6802cc80 con 0x7f4d700b2b30 2024-04-16T16:20:53.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.836+0000 7f4d6fe00640 1 -- 172.21.15.22:0/2361084324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68034660 con 0x7f4d700b2b30 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 -- 172.21.15.22:0/2361084324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b2b30 msgr2=0x7f4d70160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 --2- 172.21.15.22:0/2361084324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b2b30 0x7f4d70160160 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4d700b3270 tx=0x7f4d6802bed0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 -- 172.21.15.22:0/2361084324 shutdown_connections 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 --2- 172.21.15.22:0/2361084324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b2b30 0x7f4d70160160 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 --2- 172.21.15.22:0/2361084324 >> v2:172.21.15.43:3300/0 conn(0x7f4d70164030 0x7f4d700711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 -- 172.21.15.22:0/2361084324 >> 172.21.15.22:0/2361084324 conn(0x7f4d70062440 msgr2=0x7f4d70062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 -- 172.21.15.22:0/2361084324 shutdown_connections 2024-04-16T16:20:53.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.837+0000 7f4d78400640 1 -- 172.21.15.22:0/2361084324 wait complete. 2024-04-16T16:20:53.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.839+0000 7f4d78400640 1 Processor -- start 2024-04-16T16:20:53.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.839+0000 7f4d78400640 1 -- start start 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d78400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d700b2b30 0x7f4d700c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d78400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b41a0 0x7f4d70154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d78400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d70164030 0x7f4d701f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d78400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4d70072d30 con 0x7f4d700b41a0 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d78400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700b5290 con 0x7f4d70164030 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d78400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4d70073010 con 0x7f4d700b2b30 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d75000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b41a0 0x7f4d70154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d75000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b41a0 0x7f4d70154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36402/0 (socket says 172.21.15.22:36402) 2024-04-16T16:20:53.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.840+0000 7f4d75000640 1 -- 172.21.15.22:0/1295255865 learned_addr learned my addr 172.21.15.22:0/1295255865 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d76400640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d70164030 0x7f4d701f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75a00640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d700b2b30 0x7f4d700c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75000640 1 -- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d700b2b30 msgr2=0x7f4d700c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75000640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d700b2b30 0x7f4d700c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75000640 1 -- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d70164030 msgr2=0x7f4d701f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75000640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d70164030 0x7f4d701f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75000640 1 -- 172.21.15.22:0/1295255865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700ab200 con 0x7f4d700b41a0 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75a00640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d700b2b30 0x7f4d700c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.841+0000 7f4d75000640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b41a0 0x7f4d70154480 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c4d0 tx=0x7f4d5c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:53.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.842+0000 7f4d6d600640 1 -- 172.21.15.22:0/1295255865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c018070 con 0x7f4d700b41a0 2024-04-16T16:20:53.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.842+0000 7f4d6d600640 1 -- 172.21.15.22:0/1295255865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c007500 con 0x7f4d700b41a0 2024-04-16T16:20:53.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.842+0000 7f4d6d600640 1 -- 172.21.15.22:0/1295255865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c004a20 con 0x7f4d700b41a0 2024-04-16T16:20:53.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.842+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d700ab4e0 con 0x7f4d700b41a0 2024-04-16T16:20:53.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.842+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d700abaa0 con 0x7f4d700b41a0 2024-04-16T16:20:53.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.843+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7004fd90 con 0x7f4d700b41a0 2024-04-16T16:20:53.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.844+0000 7f4d6d600640 1 -- 172.21.15.22:0/1295255865 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f4d5c01b070 con 0x7f4d700b41a0 2024-04-16T16:20:53.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.845+0000 7f4d6d600640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d5006cee0 0x7f4d5006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:53.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.845+0000 7f4d6d600640 1 -- 172.21.15.22:0/1295255865 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7f4d5c08b6d0 con 0x7f4d700b41a0 2024-04-16T16:20:53.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.845+0000 7f4d75a00640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d5006cee0 0x7f4d5006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:53.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.846+0000 7f4d75a00640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d5006cee0 0x7f4d5006f3a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d64006fd0 tx=0x7f4d64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:53.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:53.850+0000 7f4d6d600640 1 -- 172.21.15.22:0/1295255865 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d5c059620 con 0x7f4d700b41a0 2024-04-16T16:20:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.056+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4d700afe40 con 0x7f4d700b41a0 2024-04-16T16:20:54.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.647+0000 7f4d6d600640 1 -- 172.21.15.22:0/1295255865 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7f4d5c058f20 con 0x7f4d700b41a0 2024-04-16T16:20:54.647 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-04-16T16:20:54.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.651+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d5006cee0 msgr2=0x7f4d5006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:54.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.651+0000 7f4d78400640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d5006cee0 0x7f4d5006f3a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d64006fd0 tx=0x7f4d64008040 comp rx=0 tx=0).stop 2024-04-16T16:20:54.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b41a0 msgr2=0x7f4d70154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:54.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b41a0 0x7f4d70154480 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c4d0 tx=0x7f4d5c00c990 comp rx=0 tx=0).stop 2024-04-16T16:20:54.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 shutdown_connections 2024-04-16T16:20:54.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f4d5006cee0 0x7f4d5006f3a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d70164030 0x7f4d701f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d700b41a0 0x7f4d70154480 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 --2- 172.21.15.22:0/1295255865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d700b2b30 0x7f4d700c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 >> 172.21.15.22:0/1295255865 conn(0x7f4d70062440 msgr2=0x7f4d700b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:54.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 shutdown_connections 2024-04-16T16:20:54.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.652+0000 7f4d78400640 1 -- 172.21.15.22:0/1295255865 wait complete. 2024-04-16T16:20:54.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T16:20:54.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.903+0000 7fc99d200640 1 Processor -- start 2024-04-16T16:20:54.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.903+0000 7fc99d200640 1 -- start start 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc99d200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9980b6640 0x7fc9980cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc99d200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc9980b3b80 0x7fc9980d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc99d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6a20 0x7fc9980b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc99d200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc9980d3d20 con 0x7fc9980b6640 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc99d200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc9980cfee0 con 0x7fc9980b3b80 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc99d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980cfc00 con 0x7fc9980b6a20 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc997400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9980b6640 0x7fc9980cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc997400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9980b6640 0x7fc9980cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36404/0 (socket says 172.21.15.22:36404) 2024-04-16T16:20:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc997400640 1 -- 172.21.15.22:0/1974006971 learned_addr learned my addr 172.21.15.22:0/1974006971 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc98fe00640 1 --2- 172.21.15.22:0/1974006971 >> v2:172.21.15.43:3300/0 conn(0x7fc9980b3b80 0x7fc9980d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc997400640 1 -- 172.21.15.22:0/1974006971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6a20 msgr2=0x7fc9980b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc997400640 1 --2- 172.21.15.22:0/1974006971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6a20 0x7fc9980b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.905+0000 7fc997400640 1 -- 172.21.15.22:0/1974006971 >> v2:172.21.15.43:3300/0 conn(0x7fc9980b3b80 msgr2=0x7fc9980d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.906+0000 7fc997400640 1 --2- 172.21.15.22:0/1974006971 >> v2:172.21.15.43:3300/0 conn(0x7fc9980b3b80 0x7fc9980d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.906+0000 7fc997400640 1 -- 172.21.15.22:0/1974006971 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9980d36d0 con 0x7fc9980b6640 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.907+0000 7fc997400640 1 --2- 172.21.15.22:0/1974006971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6640 0x7fc9980cf090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc9980c8160 tx=0x7fc98802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f133998f21d6a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.907+0000 7fc996a00640 1 -- 172.21.15.22:0/1974006971 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988035020 con 0x7fc9980b6640 2024-04-16T16:20:54.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.907+0000 7fc996a00640 1 -- 172.21.15.22:0/1974006971 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc988031870 con 0x7fc9980b6640 2024-04-16T16:20:54.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.907+0000 7fc996a00640 1 -- 172.21.15.22:0/1974006971 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988031c40 con 0x7fc9980b6640 2024-04-16T16:20:54.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 -- 172.21.15.22:0/1974006971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6640 msgr2=0x7fc9980cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:54.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 --2- 172.21.15.22:0/1974006971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6640 0x7fc9980cf090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc9980c8160 tx=0x7fc98802b910 comp rx=0 tx=0).stop 2024-04-16T16:20:54.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 -- 172.21.15.22:0/1974006971 shutdown_connections 2024-04-16T16:20:54.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 --2- 172.21.15.22:0/1974006971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6a20 0x7fc9980b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 --2- 172.21.15.22:0/1974006971 >> v2:172.21.15.43:3300/0 conn(0x7fc9980b3b80 0x7fc9980d41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 --2- 172.21.15.22:0/1974006971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6640 0x7fc9980cf090 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 -- 172.21.15.22:0/1974006971 >> 172.21.15.22:0/1974006971 conn(0x7fc998062620 msgr2=0x7fc998062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:54.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 -- 172.21.15.22:0/1974006971 shutdown_connections 2024-04-16T16:20:54.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.908+0000 7fc99d200640 1 -- 172.21.15.22:0/1974006971 wait complete. 2024-04-16T16:20:54.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.910+0000 7fc99d200640 1 Processor -- start 2024-04-16T16:20:54.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.910+0000 7fc99d200640 1 -- start start 2024-04-16T16:20:54.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc99d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9980b3b80 0x7fc9980c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:54.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc99d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6640 0x7fc9980cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:54.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc99d200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6a20 0x7fc9980ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:54.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc99d200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980b6eb0 con 0x7fc9980b6a20 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc99d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980cf890 con 0x7fc9980b3b80 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc99d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980b7f30 con 0x7fc9980b6640 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc997e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6a20 0x7fc9980ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc997e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6a20 0x7fc9980ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36410/0 (socket says 172.21.15.22:36410) 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.911+0000 7fc997e00640 1 -- 172.21.15.22:0/3826050053 learned_addr learned my addr 172.21.15.22:0/3826050053 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc997400640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9980b3b80 0x7fc9980c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc98fe00640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6640 0x7fc9980cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc997e00640 1 -- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6640 msgr2=0x7fc9980cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc997e00640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6640 0x7fc9980cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc997e00640 1 -- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9980b3b80 msgr2=0x7fc9980c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc997e00640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9980b3b80 0x7fc9980c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:54.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc997e00640 1 -- 172.21.15.22:0/3826050053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9981f5610 con 0x7fc9980b6a20 2024-04-16T16:20:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc997e00640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6a20 0x7fc9980ce010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b9a0 tx=0x7fc99000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc98f400640 1 -- 172.21.15.22:0/3826050053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990019070 con 0x7fc9980b6a20 2024-04-16T16:20:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.912+0000 7fc98f400640 1 -- 172.21.15.22:0/3826050053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99000cbc0 con 0x7fc9980b6a20 2024-04-16T16:20:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.913+0000 7fc98f400640 1 -- 172.21.15.22:0/3826050053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990014440 con 0x7fc9980b6a20 2024-04-16T16:20:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.913+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9981f5330 con 0x7fc9980b6a20 2024-04-16T16:20:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.913+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9980c86c0 con 0x7fc9980b6a20 2024-04-16T16:20:54.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.914+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc998075f30 con 0x7fc9980b6a20 2024-04-16T16:20:54.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.915+0000 7fc98f400640 1 -- 172.21.15.22:0/3826050053 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fc99001c070 con 0x7fc9980b6a20 2024-04-16T16:20:54.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.916+0000 7fc98f400640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc97406ce90 0x7fc97406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:54.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.916+0000 7fc98f400640 1 -- 172.21.15.22:0/3826050053 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5227+0+0 (secure 0 0 0) 0x7fc99008c4e0 con 0x7fc9980b6a20 2024-04-16T16:20:54.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.917+0000 7fc997400640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc97406ce90 0x7fc97406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:54.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.918+0000 7fc997400640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc97406ce90 0x7fc97406f350 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc988036000 tx=0x7fc98803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:54.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:54.921+0000 7fc98f400640 1 -- 172.21.15.22:0/3826050053 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc990023020 con 0x7fc9980b6a20 2024-04-16T16:20:55.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.124+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc9980cb190 con 0x7fc9980b6a20 2024-04-16T16:20:55.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.665+0000 7fc98f400640 1 -- 172.21.15.22:0/3826050053 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7fc99005a380 con 0x7fc9980b6a20 2024-04-16T16:20:55.665 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc97406ce90 msgr2=0x7fc97406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc97406ce90 0x7fc97406f350 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc988036000 tx=0x7fc98803c040 comp rx=0 tx=0).stop 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6a20 msgr2=0x7fc9980ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6a20 0x7fc9980ce010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b9a0 tx=0x7fc99000be60 comp rx=0 tx=0).stop 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 shutdown_connections 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc97406ce90 0x7fc97406f350 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9980b6a20 0x7fc9980ce010 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9980b6640 0x7fc9980cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 --2- 172.21.15.22:0/3826050053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9980b3b80 0x7fc9980c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 >> 172.21.15.22:0/3826050053 conn(0x7fc998062620 msgr2=0x7fc9980b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:55.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 shutdown_connections 2024-04-16T16:20:55.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.669+0000 7fc99d200640 1 -- 172.21.15.22:0/3826050053 wait complete. 2024-04-16T16:20:55.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T16:20:55.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.894+0000 7f5456400640 1 Processor -- start 2024-04-16T16:20:55.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.895+0000 7f5456400640 1 -- start start 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.896+0000 7f5456400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f54500cfca0 0x7f54500d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.896+0000 7f5456400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500d1cc0 0x7f54500b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.896+0000 7f5456400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54500d3ed0 con 0x7f545015eb40 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.896+0000 7f5456400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f54500d2110 con 0x7f54500cfca0 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.896+0000 7f5456400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f54500d41b0 con 0x7f54500d1cc0 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.896+0000 7f5455000640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f545015eb40 0x7f54500d35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42218/0 (socket says 172.21.15.22:42218) 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.896+0000 7f5455000640 1 -- 172.21.15.22:0/3777181295 learned_addr learned my addr 172.21.15.22:0/3777181295 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:55.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f544fe00640 1 --2- 172.21.15.22:0/3777181295 >> v2:172.21.15.22:3300/0 conn(0x7f54500cfca0 0x7f54500d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f5455a00640 1 --2- 172.21.15.22:0/3777181295 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500d1cc0 0x7f54500b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f544f400640 1 -- 172.21.15.22:0/3777181295 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3163172408 0 0) 0x7f54500d3ed0 con 0x7f545015eb40 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f544f400640 1 -- 172.21.15.22:0/3777181295 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5434003520 con 0x7f545015eb40 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f544fe00640 1 -- 172.21.15.22:0/3777181295 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500d1cc0 msgr2=0x7f54500b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f544fe00640 1 --2- 172.21.15.22:0/3777181295 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500d1cc0 0x7f54500b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f544fe00640 1 -- 172.21.15.22:0/3777181295 >> v1:172.21.15.22:6789/0 conn(0x7f545015eb40 legacy=0x7f54500d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f544fe00640 1 -- 172.21.15.22:0/3777181295 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54500d4490 con 0x7f54500cfca0 2024-04-16T16:20:55.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.897+0000 7f5455a00640 1 --2- 172.21.15.22:0/3777181295 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500d1cc0 0x7f54500b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T16:20:55.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.898+0000 7f544fe00640 1 --2- 172.21.15.22:0/3777181295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54500cfca0 0x7f54500d1780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f54380097a0 tx=0x7f543802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2ce65d8adccc07 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:55.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f544f400640 1 -- 172.21.15.22:0/3777181295 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438035020 con 0x7f54500cfca0 2024-04-16T16:20:55.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f544f400640 1 -- 172.21.15.22:0/3777181295 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5438031810 con 0x7f54500cfca0 2024-04-16T16:20:55.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f544f400640 1 -- 172.21.15.22:0/3777181295 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438031bc0 con 0x7f54500cfca0 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f5456400640 1 -- 172.21.15.22:0/3777181295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54500cfca0 msgr2=0x7f54500d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f5456400640 1 --2- 172.21.15.22:0/3777181295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54500cfca0 0x7f54500d1780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f54380097a0 tx=0x7f543802b8b0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f5456400640 1 -- 172.21.15.22:0/3777181295 shutdown_connections 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f5456400640 1 --2- 172.21.15.22:0/3777181295 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500d1cc0 0x7f54500b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f5456400640 1 --2- 172.21.15.22:0/3777181295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54500cfca0 0x7f54500d1780 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.899+0000 7f5456400640 1 -- 172.21.15.22:0/3777181295 >> 172.21.15.22:0/3777181295 conn(0x7f5450072460 msgr2=0x7f5450072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.900+0000 7f5456400640 1 -- 172.21.15.22:0/3777181295 shutdown_connections 2024-04-16T16:20:55.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.900+0000 7f5456400640 1 -- 172.21.15.22:0/3777181295 wait complete. 2024-04-16T16:20:55.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.901+0000 7f5456400640 1 Processor -- start 2024-04-16T16:20:55.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.902+0000 7f5456400640 1 -- start start 2024-04-16T16:20:55.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.902+0000 7f5456400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500cfca0 0x7f54500cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:55.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.902+0000 7f5456400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54500d1cc0 0x7f5450153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5456400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f545015eb40 0x7f5450160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5456400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f54500b7b50 con 0x7f545015eb40 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5456400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f54500b79d0 con 0x7f54500d1cc0 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5456400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f54500b87f0 con 0x7f54500cfca0 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5455a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f545015eb40 0x7f5450160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5455a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f545015eb40 0x7f5450160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36418/0 (socket says 172.21.15.22:36418) 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5455a00640 1 -- 172.21.15.22:0/1855202359 learned_addr learned my addr 172.21.15.22:0/1855202359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5455a00640 1 -- 172.21.15.22:0/1855202359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500cfca0 msgr2=0x7f54500cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5455a00640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500cfca0 0x7f54500cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5455a00640 1 -- 172.21.15.22:0/1855202359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54500d1cc0 msgr2=0x7f5450153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f544fe00640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54500d1cc0 0x7f5450153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.903+0000 7f5455a00640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54500d1cc0 0x7f5450153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.904+0000 7f5455a00640 1 -- 172.21.15.22:0/1855202359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54500c9dd0 con 0x7f545015eb40 2024-04-16T16:20:55.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.904+0000 7f5455a00640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f545015eb40 0x7f5450160f30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f544800e7e0 tx=0x7f544800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:55.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.904+0000 7f544cc00640 1 -- 172.21.15.22:0/1855202359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544800f040 con 0x7f545015eb40 2024-04-16T16:20:55.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.904+0000 7f544cc00640 1 -- 172.21.15.22:0/1855202359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5448004030 con 0x7f545015eb40 2024-04-16T16:20:55.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.904+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54500ca0b0 con 0x7f545015eb40 2024-04-16T16:20:55.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.904+0000 7f544cc00640 1 -- 172.21.15.22:0/1855202359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480043e0 con 0x7f545015eb40 2024-04-16T16:20:55.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.904+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54500ca670 con 0x7f545015eb40 2024-04-16T16:20:55.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.906+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5450075f30 con 0x7f545015eb40 2024-04-16T16:20:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.907+0000 7f544cc00640 1 -- 172.21.15.22:0/1855202359 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f544800c6d0 con 0x7f545015eb40 2024-04-16T16:20:55.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.909+0000 7f544cc00640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f542c06ce90 0x7f542c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.909+0000 7f544cc00640 1 -- 172.21.15.22:0/1855202359 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5609+0+0 (secure 0 0 0) 0x7f544808c810 con 0x7f545015eb40 2024-04-16T16:20:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.909+0000 7f5455000640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f542c06ce90 0x7f542c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.910+0000 7f5455000640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f542c06ce90 0x7f542c06f350 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f54400012e0 tx=0x7f54400015b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:55.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:55.914+0000 7f544cc00640 1 -- 172.21.15.22:0/1855202359 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5448017020 con 0x7f545015eb40 2024-04-16T16:20:56.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.162+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5450068f70 con 0x7f545015eb40 2024-04-16T16:20:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.669+0000 7f544cc00640 1 -- 172.21.15.22:0/1855202359 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v32) ==== 172+0+0 (secure 0 0 0) 0x7f544805a250 con 0x7f545015eb40 2024-04-16T16:20:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 8 and data pool 9 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f542c06ce90 msgr2=0x7f542c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f542c06ce90 0x7f542c06f350 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f54400012e0 tx=0x7f54400015b0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f545015eb40 msgr2=0x7f5450160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f545015eb40 0x7f5450160f30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f544800e7e0 tx=0x7f544800eca0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 shutdown_connections 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f542c06ce90 0x7f542c06f350 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f545015eb40 0x7f5450160f30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54500d1cc0 0x7f5450153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 --2- 172.21.15.22:0/1855202359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54500cfca0 0x7f54500cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.674+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 >> 172.21.15.22:0/1855202359 conn(0x7f5450072460 msgr2=0x7f54500b9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.675+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 shutdown_connections 2024-04-16T16:20:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.675+0000 7f5456400640 1 -- 172.21.15.22:0/1855202359 wait complete. 2024-04-16T16:20:56.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.892+0000 7f5fe2800640 1 Processor -- start 2024-04-16T16:20:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.892+0000 7f5fe2800640 1 -- start start 2024-04-16T16:20:56.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.893+0000 7f5fe2800640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5fdc06dc80 0x7f5fdc0d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.893+0000 7f5fe2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 0x7f5fdc15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.893+0000 7f5fe2800640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fdc1606d0 con 0x7f5fdc0afd90 2024-04-16T16:20:56.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.893+0000 7f5fe2800640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5fdc160480 con 0x7f5fdc06dc80 2024-04-16T16:20:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.893+0000 7f5fe2800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5fdc0d0ff0 con 0x7f5fdc0d0b40 2024-04-16T16:20:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fdb400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5fdc0afd90 0x7f5fdc072b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42222/0 (socket says 172.21.15.22:42222) 2024-04-16T16:20:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fdb400640 1 -- 172.21.15.22:0/3560309359 learned_addr learned my addr 172.21.15.22:0/3560309359 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806421240 0 0) 0x7f5fdc1606d0 con 0x7f5fdc0afd90 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fc0003520 con 0x7f5fdc0afd90 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fdbe00640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 0x7f5fdc15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fdaa00640 1 --2- 172.21.15.22:0/3560309359 >> v2:172.21.15.43:3300/0 conn(0x7f5fdc06dc80 0x7f5fdc0d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2039916797 0 0) 0x7f5fc0003520 con 0x7f5fdc0afd90 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 msgr2=0x7f5fdc15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.894+0000 7f5fda000640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 0x7f5fdc15ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 >> v2:172.21.15.43:3300/0 conn(0x7f5fdc06dc80 msgr2=0x7f5fdc0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 --2- 172.21.15.22:0/3560309359 >> v2:172.21.15.43:3300/0 conn(0x7f5fdc06dc80 0x7f5fdc0d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fdc1609b0 con 0x7f5fdc0afd90 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f5fcc001670 con 0x7f5fdc0afd90 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 >> v1:172.21.15.22:6789/0 conn(0x7f5fdc0afd90 legacy=0x7f5fdc072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 0x7f5fc00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fc0003fe0 0x7f5fc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc0004d40 0x7f5fc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc160480 con 0x7f5fc0004d40 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc0d0ff0 con 0x7f5fc0003fe0 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc000bc50 con 0x7f5fdc0d0b40 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fdbe00640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc0004d40 0x7f5fc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fdb400640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 0x7f5fc00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fdaa00640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fc0003fe0 0x7f5fc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fdbe00640 1 -- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 msgr2=0x7f5fc00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fdbe00640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0d0b40 0x7f5fc00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fdbe00640 1 -- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fc0003fe0 msgr2=0x7f5fc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.895+0000 7f5fdbe00640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fc0003fe0 0x7f5fc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.896+0000 7f5fdbe00640 1 -- 172.21.15.22:0/3560309359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc0003520 con 0x7f5fc0004d40 2024-04-16T16:20:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.896+0000 7f5fdaa00640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fc0003fe0 0x7f5fc0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fdbe00640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc0004d40 0x7f5fc00051c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4007f60 tx=0x7f5fc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aa3c86083079e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4007b30 con 0x7f5fc0004d40 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd4033600 con 0x7f5fc0004d40 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fda000640 1 -- 172.21.15.22:0/3560309359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40339f0 con 0x7f5fc0004d40 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fe2800640 1 -- 172.21.15.22:0/3560309359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc0004d40 msgr2=0x7f5fc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fe2800640 1 --2- 172.21.15.22:0/3560309359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc0004d40 0x7f5fc00051c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4007f60 tx=0x7f5fc0005830 comp rx=0 tx=0).stop 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fdbe00640 1 -- 172.21.15.22:0/3560309359 reap_dead start 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fe2800640 1 -- 172.21.15.22:0/3560309359 shutdown_connections 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.897+0000 7f5fe2800640 1 -- 172.21.15.22:0/3560309359 >> 172.21.15.22:0/3560309359 conn(0x7f5fdc062440 msgr2=0x7f5fdc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:56.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.898+0000 7f5fe2800640 1 -- 172.21.15.22:0/3560309359 shutdown_connections 2024-04-16T16:20:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.898+0000 7f5fe2800640 1 -- 172.21.15.22:0/3560309359 wait complete. 2024-04-16T16:20:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.899+0000 7f5fe2800640 1 Processor -- start 2024-04-16T16:20:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.899+0000 7f5fe2800640 1 -- start start 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.900+0000 7f5fe2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc15f350 0x7f5fdc146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.900+0000 7f5fe2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fdc155cf0 0x7f5fdc0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.900+0000 7f5fe2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0cede0 0x7f5fdc145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.900+0000 7f5fe2800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc0b0170 con 0x7f5fdc155cf0 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.900+0000 7f5fe2800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc160f70 con 0x7f5fdc15f350 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.900+0000 7f5fe2800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5fdc073220 con 0x7f5fdc0cede0 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fdc155cf0 0x7f5fdc0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fdc155cf0 0x7f5fdc0ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36446/0 (socket says 172.21.15.22:36446) 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 -- 172.21.15.22:0/4142107926 learned_addr learned my addr 172.21.15.22:0/4142107926 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdb400640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc15f350 0x7f5fdc146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdbe00640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0cede0 0x7f5fdc145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 -- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0cede0 msgr2=0x7f5fdc145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0cede0 0x7f5fdc145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 -- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc15f350 msgr2=0x7f5fdc146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc15f350 0x7f5fdc146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.901+0000 7f5fdaa00640 1 -- 172.21.15.22:0/4142107926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fdc147260 con 0x7f5fdc155cf0 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.902+0000 7f5fdaa00640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fdc155cf0 0x7f5fdc0ce8a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800e840 tx=0x7f5fc800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.902+0000 7f5fd3400640 1 -- 172.21.15.22:0/4142107926 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8017070 con 0x7f5fdc155cf0 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.902+0000 7f5fd3400640 1 -- 172.21.15.22:0/4142107926 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc800c670 con 0x7f5fdc155cf0 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.902+0000 7f5fd3400640 1 -- 172.21.15.22:0/4142107926 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc800f040 con 0x7f5fdc155cf0 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.902+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fdc1f8780 con 0x7f5fdc155cf0 2024-04-16T16:20:56.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.902+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fdc1f8d40 con 0x7f5fdc155cf0 2024-04-16T16:20:56.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.903+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fdc04fd90 con 0x7f5fdc155cf0 2024-04-16T16:20:56.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.904+0000 7f5fd3400640 1 -- 172.21.15.22:0/4142107926 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f5fc801a070 con 0x7f5fdc155cf0 2024-04-16T16:20:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.905+0000 7f5fd3400640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5fbc06ce90 0x7f5fbc06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.905+0000 7f5fd3400640 1 -- 172.21.15.22:0/4142107926 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f5fc808c250 con 0x7f5fdc155cf0 2024-04-16T16:20:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.906+0000 7f5fdb400640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5fbc06ce90 0x7f5fbc06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.906+0000 7f5fdb400640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5fbc06ce90 0x7f5fbc06f350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc004840 tx=0x7f5fcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:56.910+0000 7f5fd3400640 1 -- 172.21.15.22:0/4142107926 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fc8059d50 con 0x7f5fdc155cf0 2024-04-16T16:20:57.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.108+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fdc0cf1c0 con 0x7f5fdc155cf0 2024-04-16T16:20:57.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.111+0000 7f5fd3400640 1 -- 172.21.15.22:0/4142107926 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16558 (secure 0 0 0) 0x7f5fc8059650 con 0x7f5fdc155cf0 2024-04-16T16:20:57.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:56.164280+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:20:54.072603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-16T16:20:55.142667+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.113+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5fbc06ce90 msgr2=0x7f5fbc06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.113+0000 7f5fe2800640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5fbc06ce90 0x7f5fbc06f350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc004840 tx=0x7f5fcc009040 comp rx=0 tx=0).stop 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.113+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fdc155cf0 msgr2=0x7f5fdc0ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.113+0000 7f5fe2800640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fdc155cf0 0x7f5fdc0ce8a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800e840 tx=0x7f5fc800ed00 comp rx=0 tx=0).stop 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 shutdown_connections 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5fbc06ce90 0x7f5fbc06f350 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0cede0 0x7f5fdc145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fdc155cf0 0x7f5fdc0ce8a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 --2- 172.21.15.22:0/4142107926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc15f350 0x7f5fdc146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 >> 172.21.15.22:0/4142107926 conn(0x7f5fdc062440 msgr2=0x7f5fdc159340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 shutdown_connections 2024-04-16T16:20:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.114+0000 7f5fe2800640 1 -- 172.21.15.22:0/4142107926 wait complete. 2024-04-16T16:20:57.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:20:57.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.352+0000 7f589be00640 1 Processor -- start 2024-04-16T16:20:57.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.352+0000 7f589be00640 1 -- start start 2024-04-16T16:20:57.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.354+0000 7f589be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f589c06eaa0 0x7f589c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.354+0000 7f589be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f589c0cc810 0x7f589c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.354+0000 7f589be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589c06d160 con 0x7f589c06ee80 2024-04-16T16:20:57.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.354+0000 7f589be00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f589c06cf10 con 0x7f589c0cc810 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.354+0000 7f589be00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f589c06d440 con 0x7f589c06eaa0 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f589b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f589c06ee80 0x7f589c15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42238/0 (socket says 172.21.15.22:42238) 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f589b400640 1 -- 172.21.15.22:0/3593273264 learned_addr learned my addr 172.21.15.22:0/3593273264 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f5892000640 1 --2- 172.21.15.22:0/3593273264 >> v2:172.21.15.22:3300/0 conn(0x7f589c0cc810 0x7f589c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f589aa00640 1 --2- 172.21.15.22:0/3593273264 >> v2:172.21.15.43:3300/0 conn(0x7f589c06eaa0 0x7f589c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f5892000640 1 -- 172.21.15.22:0/3593273264 >> v2:172.21.15.43:3300/0 conn(0x7f589c06eaa0 msgr2=0x7f589c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f5892000640 1 --2- 172.21.15.22:0/3593273264 >> v2:172.21.15.43:3300/0 conn(0x7f589c06eaa0 0x7f589c0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f5892000640 1 -- 172.21.15.22:0/3593273264 >> v1:172.21.15.22:6789/0 conn(0x7f589c06ee80 legacy=0x7f589c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.355+0000 7f5892000640 1 -- 172.21.15.22:0/3593273264 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c06d720 con 0x7f589c0cc810 2024-04-16T16:20:57.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.356+0000 7f5892000640 1 --2- 172.21.15.22:0/3593273264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c06df00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188bd740279294fa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:57.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589a000640 1 -- 172.21.15.22:0/3593273264 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884035020 con 0x7f589c0cc810 2024-04-16T16:20:57.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589a000640 1 -- 172.21.15.22:0/3593273264 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884031830 con 0x7f589c0cc810 2024-04-16T16:20:57.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589a000640 1 -- 172.21.15.22:0/3593273264 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884031c00 con 0x7f589c0cc810 2024-04-16T16:20:57.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 -- 172.21.15.22:0/3593273264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 msgr2=0x7f589c06df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 --2- 172.21.15.22:0/3593273264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c06df00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402b8d0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 -- 172.21.15.22:0/3593273264 shutdown_connections 2024-04-16T16:20:57.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 --2- 172.21.15.22:0/3593273264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c06df00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 --2- 172.21.15.22:0/3593273264 >> v2:172.21.15.43:3300/0 conn(0x7f589c06eaa0 0x7f589c0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 -- 172.21.15.22:0/3593273264 >> 172.21.15.22:0/3593273264 conn(0x7f589c062440 msgr2=0x7f589c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:57.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 -- 172.21.15.22:0/3593273264 shutdown_connections 2024-04-16T16:20:57.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.357+0000 7f589be00640 1 -- 172.21.15.22:0/3593273264 wait complete. 2024-04-16T16:20:57.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.359+0000 7f589be00640 1 Processor -- start 2024-04-16T16:20:57.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.359+0000 7f589be00640 1 -- start start 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.360+0000 7f589be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f589c06eaa0 0x7f589c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.360+0000 7f589be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f589c06ee80 0x7f589c0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.360+0000 7f589be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.360+0000 7f589be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f589c06e440 con 0x7f589c0cc810 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.360+0000 7f589be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f589c0b4360 con 0x7f589c06eaa0 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.360+0000 7f589be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f589c15c910 con 0x7f589c06ee80 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.360+0000 7f589b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c0b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36458/0 (socket says 172.21.15.22:36458) 2024-04-16T16:20:57.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 -- 172.21.15.22:0/3285620991 learned_addr learned my addr 172.21.15.22:0/3285620991 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f5892000640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f589c06ee80 0x7f589c0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589aa00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f589c06eaa0 0x7f589c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 -- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f589c06ee80 msgr2=0x7f589c0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f589c06ee80 0x7f589c0b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 -- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f589c06eaa0 msgr2=0x7f589c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f589c06eaa0 0x7f589c159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 -- 172.21.15.22:0/3285620991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c1489e0 con 0x7f589c0cc810 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589aa00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f589c06eaa0 0x7f589c159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.361+0000 7f589b400640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c0b27f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f589400cbc0 tx=0x7f589400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.362+0000 7f5893e00640 1 -- 172.21.15.22:0/3285620991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894017070 con 0x7f589c0cc810 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.362+0000 7f5893e00640 1 -- 172.21.15.22:0/3285620991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589400ad40 con 0x7f589c0cc810 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.362+0000 7f5893e00640 1 -- 172.21.15.22:0/3285620991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894012600 con 0x7f589c0cc810 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.362+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589c148cc0 con 0x7f589c0cc810 2024-04-16T16:20:57.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.362+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589c149280 con 0x7f589c0cc810 2024-04-16T16:20:57.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.363+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589c06e5c0 con 0x7f589c0cc810 2024-04-16T16:20:57.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.364+0000 7f5893e00640 1 -- 172.21.15.22:0/3285620991 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f589401a070 con 0x7f589c0cc810 2024-04-16T16:20:57.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.365+0000 7f5893e00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f587806cee0 0x7f587806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.365+0000 7f5893e00640 1 -- 172.21.15.22:0/3285620991 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f589408c2e0 con 0x7f589c0cc810 2024-04-16T16:20:57.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.365+0000 7f589aa00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f587806cee0 0x7f587806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.366+0000 7f589aa00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f587806cee0 0x7f587806f3a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:57.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.370+0000 7f5893e00640 1 -- 172.21.15.22:0/3285620991 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f589c06e5c0 con 0x7f589c0cc810 2024-04-16T16:20:57.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.575+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f589c0cdb90 con 0x7f589c0cc810 2024-04-16T16:20:57.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.578+0000 7f5893e00640 1 -- 172.21.15.22:0/3285620991 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16558 (secure 0 0 0) 0x7f589c0cdb90 con 0x7f589c0cc810 2024-04-16T16:20:57.578 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:20:57.578 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:56.164280+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:20:54.072603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-16T16:20:55.142667+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:20:57.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.580+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f587806cee0 msgr2=0x7f587806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.580+0000 7f589be00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f587806cee0 0x7f587806f3a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c008040 comp rx=0 tx=0).stop 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 msgr2=0x7f589c0b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c0b27f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f589400cbc0 tx=0x7f589400a430 comp rx=0 tx=0).stop 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 shutdown_connections 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f587806cee0 0x7f587806f3a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f589c0cc810 0x7f589c0b27f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f589c06ee80 0x7f589c0b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 --2- 172.21.15.22:0/3285620991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f589c06eaa0 0x7f589c159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 >> 172.21.15.22:0/3285620991 conn(0x7f589c062440 msgr2=0x7f589c0d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 shutdown_connections 2024-04-16T16:20:57.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.581+0000 7f589be00640 1 -- 172.21.15.22:0/3285620991 wait complete. 2024-04-16T16:20:57.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T16:20:57.640 INFO:tasks.ceph.mds.c.smithi022.stderr:2024-04-16T16:20:57.640+0000 7f084e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:20:57.692 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f084bc00640 time 2024-04-16T16:20:57.694593+0000 2024-04-16T16:20:57.692 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T16:20:57.693 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0858581f4c] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr:2024-04-16T16:20:57.694+0000 7f084bc00640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f084bc00640 time 2024-04-16T16:20:57.694593+0000 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0858581f4c] 2024-04-16T16:20:57.694 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr:*** Caught signal (Aborted) ** 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7f084bc00640 thread_name:ms_dispatch 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.695 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0857c54db0] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0857ca154c] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: raise() 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: abort() 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0858581fa6] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.696 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr:2024-04-16T16:20:57.697+0000 7f084bc00640 -1 *** Caught signal (Aborted) ** 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7f084bc00640 thread_name:ms_dispatch 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0857c54db0] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0857ca154c] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: raise() 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: abort() 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0858581fa6] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.697 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.698 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.698 INFO:tasks.ceph.mds.c.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T16:20:57.698 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.712 INFO:tasks.ceph.mds.c.smithi022.stderr: -5> 2024-04-16T16:20:57.640+0000 7f084e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:20:57.712 INFO:tasks.ceph.mds.c.smithi022.stderr: -2> 2024-04-16T16:20:57.694+0000 7f084bc00640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f084bc00640 time 2024-04-16T16:20:57.694593+0000 2024-04-16T16:20:57.712 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T16:20:57.712 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.712 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0858581f4c] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 0> 2024-04-16T16:20:57.697+0000 7f084bc00640 -1 *** Caught signal (Aborted) ** 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7f084bc00640 thread_name:ms_dispatch 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0857c54db0] 2024-04-16T16:20:57.713 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0857ca154c] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: raise() 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: abort() 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0858581fa6] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T16:20:57.714 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: -5> 2024-04-16T16:20:57.640+0000 7f084e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: -2> 2024-04-16T16:20:57.694+0000 7f084bc00640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f084bc00640 time 2024-04-16T16:20:57.694593+0000 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0858581f4c] 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.723 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 0> 2024-04-16T16:20:57.697+0000 7f084bc00640 -1 *** Caught signal (Aborted) ** 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7f084bc00640 thread_name:ms_dispatch 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0857c54db0] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0857ca154c] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: raise() 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: abort() 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0858581fa6] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f085858210a] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDLog::trim()+0xf2a) [0x5647f5c581aa] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x5647f5c58559] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f08580db924] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0857c9f802] 2024-04-16T16:20:57.724 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0857c3f450] 2024-04-16T16:20:57.725 INFO:tasks.ceph.mds.c.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T16:20:57.725 INFO:tasks.ceph.mds.c.smithi022.stderr: 2024-04-16T16:20:57.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.828+0000 7f3947e00640 1 Processor -- start 2024-04-16T16:20:57.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.828+0000 7f3947e00640 1 -- start start 2024-04-16T16:20:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.829+0000 7f3947e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3940162220 0x7f39401631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.829+0000 7f3947e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3940163710 con 0x7f39400b37a0 2024-04-16T16:20:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.829+0000 7f3947e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39400cf310 con 0x7f39400d1ff0 2024-04-16T16:20:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.829+0000 7f3947e00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f39400cff20 con 0x7f3940162220 2024-04-16T16:20:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.829+0000 7f3944a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f39400b37a0 0x7f39400d18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42242/0 (socket says 172.21.15.22:42242) 2024-04-16T16:20:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f3944a00640 1 -- 172.21.15.22:0/2431583051 learned_addr learned my addr 172.21.15.22:0/2431583051 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f3945400640 1 --2- 172.21.15.22:0/2431583051 >> v2:172.21.15.43:3300/0 conn(0x7f3940162220 0x7f39401631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048559590 0 0) 0x7f3940163710 con 0x7f39400b37a0 2024-04-16T16:20:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003520 con 0x7f39400b37a0 2024-04-16T16:20:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3874651788 0 0) 0x7f3928003520 con 0x7f39400b37a0 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 >> v2:172.21.15.43:3300/0 conn(0x7f3940162220 msgr2=0x7f39401631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 --2- 172.21.15.22:0/2431583051 >> v2:172.21.15.43:3300/0 conn(0x7f3940162220 0x7f39401631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 >> v1:172.21.15.43:6789/0 conn(0x7f39400d1ff0 legacy=0x7f39400d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400cf5f0 con 0x7f39400b37a0 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f392c001670 con 0x7f39400b37a0 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.830+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 >> v1:172.21.15.22:6789/0 conn(0x7f39400b37a0 legacy=0x7f39400d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f393fe00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39280039b0 0x7f3928003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f393fe00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f393fe00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39400cff20 con 0x7f39280051c0 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f392800c160 con 0x7f3928004800 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f392800c360 con 0x7f39280039b0 2024-04-16T16:20:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3945e00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3944a00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3945e00640 1 -- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39280039b0 msgr2=0x7f3928003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:57.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3945e00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39280039b0 0x7f3928003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3945e00640 1 -- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3928004800 msgr2=0x7f3928004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:57.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3945e00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3945e00640 1 -- 172.21.15.22:0/2431583051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928003520 con 0x7f39280051c0 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.831+0000 7f3944a00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.832+0000 7f3945e00640 1 -- 172.21.15.22:0/2431583051 reap_dead start 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.833+0000 7f3945e00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3938004480 tx=0x7f3928005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc6087785954387 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.833+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938034070 con 0x7f39280051c0 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.833+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3938006b50 con 0x7f39280051c0 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.833+0000 7f393fe00640 1 -- 172.21.15.22:0/2431583051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938004080 con 0x7f39280051c0 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.833+0000 7f3947e00640 1 -- 172.21.15.22:0/2431583051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280051c0 msgr2=0x7f392800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.833+0000 7f3947e00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3938004480 tx=0x7f3928005830 comp rx=0 tx=0).stop 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.834+0000 7f3947e00640 1 -- 172.21.15.22:0/2431583051 shutdown_connections 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.834+0000 7f3947e00640 1 --2- 172.21.15.22:0/2431583051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.834+0000 7f3947e00640 1 -- 172.21.15.22:0/2431583051 >> 172.21.15.22:0/2431583051 conn(0x7f3940062620 msgr2=0x7f3940062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.834+0000 7f3947e00640 1 -- 172.21.15.22:0/2431583051 shutdown_connections 2024-04-16T16:20:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.834+0000 7f3947e00640 1 -- 172.21.15.22:0/2431583051 wait complete. 2024-04-16T16:20:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.836+0000 7f3947e00640 1 Processor -- start 2024-04-16T16:20:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.836+0000 7f3947e00640 1 -- start start 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3947e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39280051c0 0x7f39400b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3947e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39400b61a0 0x7f394015c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3947e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39400b65e0 0x7f394015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3947e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39400cfbb0 con 0x7f39400b65e0 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3947e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f39400d03b0 con 0x7f39280051c0 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3947e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f39401631d0 con 0x7f39400b61a0 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3945e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39400b65e0 0x7f394015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3945e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39400b65e0 0x7f394015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36482/0 (socket says 172.21.15.22:36482) 2024-04-16T16:20:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.837+0000 7f3945e00640 1 -- 172.21.15.22:0/4059072922 learned_addr learned my addr 172.21.15.22:0/4059072922 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3945e00640 1 -- 172.21.15.22:0/4059072922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39400b61a0 msgr2=0x7f394015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3945e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39400b61a0 0x7f394015c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3945e00640 1 -- 172.21.15.22:0/4059072922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39280051c0 msgr2=0x7f39400b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3945400640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39280051c0 0x7f39400b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3945e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39280051c0 0x7f39400b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3945e00640 1 -- 172.21.15.22:0/4059072922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400ce7a0 con 0x7f39400b65e0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3945e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39400b65e0 0x7f394015cc90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3938004480 tx=0x7f3938003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f393d600640 1 -- 172.21.15.22:0/4059072922 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938034040 con 0x7f39400b65e0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f393d600640 1 -- 172.21.15.22:0/4059072922 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3938038600 con 0x7f39400b65e0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39400ccc40 con 0x7f39400b65e0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f393d600640 1 -- 172.21.15.22:0/4059072922 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938007df0 con 0x7f39400b65e0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.838+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39400cd200 con 0x7f39400b65e0 2024-04-16T16:20:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.840+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394004fd90 con 0x7f39400b65e0 2024-04-16T16:20:57.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.841+0000 7f393d600640 1 -- 172.21.15.22:0/4059072922 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f39380389f0 con 0x7f39400b65e0 2024-04-16T16:20:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.842+0000 7f393d600640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f392006ce90 0x7f392006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.842+0000 7f393d600640 1 -- 172.21.15.22:0/4059072922 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f39380adfe0 con 0x7f39400b65e0 2024-04-16T16:20:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.842+0000 7f3945400640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f392006ce90 0x7f392006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:57.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.843+0000 7f3945400640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f392006ce90 0x7f392006f350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3934009970 tx=0x7f3934008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:57.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:57.846+0000 7f393d600640 1 -- 172.21.15.22:0/4059072922 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f393803d070 con 0x7f39400b65e0 2024-04-16T16:20:57.903 INFO:tasks.ceph.mds.c.smithi022.stderr:daemon-helper: command crashed with signal 6 2024-04-16T16:20:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.096+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f39400d28a0 con 0x7f39400b65e0 2024-04-16T16:20:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.707+0000 7f393d600640 1 -- 172.21.15.22:0/4059072922 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7f393807ba50 con 0x7f39400b65e0 2024-04-16T16:20:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.710+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f392006ce90 msgr2=0x7f392006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.710+0000 7f3947e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f392006ce90 0x7f392006f350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3934009970 tx=0x7f3934008040 comp rx=0 tx=0).stop 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.710+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39400b65e0 msgr2=0x7f394015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.710+0000 7f3947e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39400b65e0 0x7f394015cc90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3938004480 tx=0x7f3938003a70 comp rx=0 tx=0).stop 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 shutdown_connections 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f392006ce90 0x7f392006f350 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39400b65e0 0x7f394015cc90 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39400b61a0 0x7f394015c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 --2- 172.21.15.22:0/4059072922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39280051c0 0x7f39400b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 >> 172.21.15.22:0/4059072922 conn(0x7f3940062620 msgr2=0x7f394015fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 shutdown_connections 2024-04-16T16:20:58.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.711+0000 7f3947e00640 1 -- 172.21.15.22:0/4059072922 wait complete. 2024-04-16T16:20:58.730 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T16:20:58.731 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T16:20:58.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.955+0000 7f005f600640 1 Processor -- start 2024-04-16T16:20:58.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.955+0000 7f005f600640 1 -- start start 2024-04-16T16:20:58.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.957+0000 7f005f600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f005815a540 0x7f00580cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.957+0000 7f005f600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0058073120 0x7f00580628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.957+0000 7f005f600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f005806bb50 con 0x7f0058062440 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.957+0000 7f005f600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f00580ce5d0 con 0x7f0058073120 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.957+0000 7f005f600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0058062de0 con 0x7f005815a540 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.957+0000 7f005d600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0058073120 0x7f00580628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.958+0000 7f005d600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0058073120 0x7f00580628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36496/0 (socket says 172.21.15.22:36496) 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.958+0000 7f005d600640 1 -- 172.21.15.22:0/2084155594 learned_addr learned my addr 172.21.15.22:0/2084155594 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.958+0000 7f005cc00640 1 --2- 172.21.15.22:0/2084155594 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f005815a540 0x7f00580cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.958+0000 7f005d600640 1 -- 172.21.15.22:0/2084155594 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f005815a540 msgr2=0x7f00580cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.958+0000 7f005d600640 1 --2- 172.21.15.22:0/2084155594 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f005815a540 0x7f00580cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.958+0000 7f005d600640 1 -- 172.21.15.22:0/2084155594 >> v1:172.21.15.43:6789/0 conn(0x7f0058062440 legacy=0x7f0058072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:58.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.958+0000 7f005d600640 1 -- 172.21.15.22:0/2084155594 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005806be30 con 0x7f0058073120 2024-04-16T16:20:58.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.959+0000 7f005d600640 1 --2- 172.21.15.22:0/2084155594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0058073120 0x7f00580628a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e50 tx=0x7f005002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d7785dd2e2a64b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:58.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.960+0000 7f0057400640 1 -- 172.21.15.22:0/2084155594 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005002c9e0 con 0x7f0058073120 2024-04-16T16:20:58.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.960+0000 7f0057400640 1 -- 172.21.15.22:0/2084155594 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005002cb80 con 0x7f0058073120 2024-04-16T16:20:58.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.960+0000 7f0057400640 1 -- 172.21.15.22:0/2084155594 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00500343f0 con 0x7f0058073120 2024-04-16T16:20:58.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.960+0000 7f005f600640 1 -- 172.21.15.22:0/2084155594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0058073120 msgr2=0x7f00580628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:58.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.960+0000 7f005f600640 1 --2- 172.21.15.22:0/2084155594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0058073120 0x7f00580628a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e50 tx=0x7f005002be40 comp rx=0 tx=0).stop 2024-04-16T16:20:58.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.961+0000 7f005f600640 1 -- 172.21.15.22:0/2084155594 shutdown_connections 2024-04-16T16:20:58.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.961+0000 7f005f600640 1 --2- 172.21.15.22:0/2084155594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0058073120 0x7f00580628a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.961+0000 7f005f600640 1 --2- 172.21.15.22:0/2084155594 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f005815a540 0x7f00580cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.961+0000 7f005f600640 1 -- 172.21.15.22:0/2084155594 >> 172.21.15.22:0/2084155594 conn(0x7f00580b3410 msgr2=0x7f00580b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:58.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.961+0000 7f005f600640 1 -- 172.21.15.22:0/2084155594 shutdown_connections 2024-04-16T16:20:58.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.961+0000 7f005f600640 1 -- 172.21.15.22:0/2084155594 wait complete. 2024-04-16T16:20:58.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.962+0000 7f005f600640 1 Processor -- start 2024-04-16T16:20:58.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.963+0000 7f005f600640 1 -- start start 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.963+0000 7f005f600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0058062440 0x7f00580c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.963+0000 7f005f600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0058073120 0x7f00580c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.963+0000 7f005f600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005815a540 0x7f00581f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.963+0000 7f005f600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f005806c6d0 con 0x7f005815a540 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.963+0000 7f005f600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f005806c3f0 con 0x7f0058062440 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.963+0000 7f005f600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f005815a920 con 0x7f0058073120 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005815a540 0x7f00581f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005815a540 0x7f00581f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36508/0 (socket says 172.21.15.22:36508) 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 -- 172.21.15.22:0/3286672941 learned_addr learned my addr 172.21.15.22:0/3286672941 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:58.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005cc00640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0058062440 0x7f00580c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:58.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f0057e00640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0058073120 0x7f00580c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:58.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 -- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0058073120 msgr2=0x7f00580c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:58.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0058073120 0x7f00580c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 -- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0058062440 msgr2=0x7f00580c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:58.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0058062440 0x7f00580c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:58.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.964+0000 7f005d600640 1 -- 172.21.15.22:0/3286672941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00580d0d10 con 0x7f005815a540 2024-04-16T16:20:58.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.965+0000 7f005d600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005815a540 0x7f00581f7e30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0050036040 tx=0x7f0050004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:58.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.965+0000 7f0054c00640 1 -- 172.21.15.22:0/3286672941 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050043020 con 0x7f005815a540 2024-04-16T16:20:58.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.965+0000 7f0054c00640 1 -- 172.21.15.22:0/3286672941 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005003e450 con 0x7f005815a540 2024-04-16T16:20:58.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.965+0000 7f0054c00640 1 -- 172.21.15.22:0/3286672941 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050009510 con 0x7f005815a540 2024-04-16T16:20:58.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.965+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00580d0ff0 con 0x7f005815a540 2024-04-16T16:20:58.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.965+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0058153610 con 0x7f005815a540 2024-04-16T16:20:58.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.967+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00580b4500 con 0x7f005815a540 2024-04-16T16:20:58.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.968+0000 7f0054c00640 1 -- 172.21.15.22:0/3286672941 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f0050046020 con 0x7f005815a540 2024-04-16T16:20:58.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.969+0000 7f0054c00640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f003406cec0 0x7f003406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:58.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.969+0000 7f0054c00640 1 -- 172.21.15.22:0/3286672941 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f00500aeab0 con 0x7f005815a540 2024-04-16T16:20:58.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.969+0000 7f005cc00640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f003406cec0 0x7f003406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:58.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.970+0000 7f005cc00640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f003406cec0 0x7f003406f380 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0048006fd0 tx=0x7f0048008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:58.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:58.974+0000 7f0054c00640 1 -- 172.21.15.22:0/3286672941 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f00580b4500 con 0x7f005815a540 2024-04-16T16:20:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.219+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f005804fd90 con 0x7f005815a540 2024-04-16T16:20:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.710+0000 7f0054c00640 1 -- 172.21.15.22:0/3286672941 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7f005004d070 con 0x7f005815a540 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.715+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f003406cec0 msgr2=0x7f003406f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.715+0000 7f005f600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f003406cec0 0x7f003406f380 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0048006fd0 tx=0x7f0048008040 comp rx=0 tx=0).stop 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.715+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005815a540 msgr2=0x7f00581f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.715+0000 7f005f600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005815a540 0x7f00581f7e30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0050036040 tx=0x7f0050004a40 comp rx=0 tx=0).stop 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 shutdown_connections 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f003406cec0 0x7f003406f380 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f005815a540 0x7f00581f7e30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0058073120 0x7f00580c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 --2- 172.21.15.22:0/3286672941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0058062440 0x7f00580c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 >> 172.21.15.22:0/3286672941 conn(0x7f00580b3410 msgr2=0x7f00580aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 shutdown_connections 2024-04-16T16:20:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.716+0000 7f005f600640 1 -- 172.21.15.22:0/3286672941 wait complete. 2024-04-16T16:20:59.739 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T16:20:59.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:20:59.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.964+0000 7f05f7e00640 1 Processor -- start 2024-04-16T16:20:59.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.964+0000 7f05f7e00640 1 -- start start 2024-04-16T16:20:59.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.965+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f015b7e0 0x7f05f015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:59.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.965+0000 7f05f7e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05f006e860 0x7f05f0071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:59.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.965+0000 7f05f7e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f00b47f0 con 0x7f05f00af6b0 2024-04-16T16:20:59.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.965+0000 7f05f7e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f05f00b45c0 con 0x7f05f006e860 2024-04-16T16:20:59.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.965+0000 7f05f7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f05f00b4ad0 con 0x7f05f015b7e0 2024-04-16T16:20:59.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05f5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05f006e860 0x7f05f0071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:59.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05f4a00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f05f00af6b0 0x7f05f006e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33082/0 (socket says 172.21.15.22:33082) 2024-04-16T16:20:59.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05f4a00640 1 -- 172.21.15.22:0/975821053 learned_addr learned my addr 172.21.15.22:0/975821053 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:20:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05efe00640 1 -- 172.21.15.22:0/975821053 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655348791 0 0) 0x7f05f00b47f0 con 0x7f05f00af6b0 2024-04-16T16:20:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05f5400640 1 --2- 172.21.15.22:0/975821053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f015b7e0 0x7f05f015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05f5e00640 1 -- 172.21.15.22:0/975821053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f015b7e0 msgr2=0x7f05f015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:20:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05f5e00640 1 --2- 172.21.15.22:0/975821053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f015b7e0 0x7f05f015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.966+0000 7f05f5e00640 1 -- 172.21.15.22:0/975821053 >> v1:172.21.15.22:6789/0 conn(0x7f05f00af6b0 legacy=0x7f05f006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.967+0000 7f05f5e00640 1 -- 172.21.15.22:0/975821053 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f00b4db0 con 0x7f05f006e860 2024-04-16T16:20:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.967+0000 7f05f5400640 1 --2- 172.21.15.22:0/975821053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f015b7e0 0x7f05f015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:59.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.968+0000 7f05f5e00640 1 --2- 172.21.15.22:0/975821053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f006e860 0x7f05f0071700 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d90 tx=0x7f05e802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133e2cd0e0e83cce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:59.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.968+0000 7f05efe00640 1 -- 172.21.15.22:0/975821053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8039070 con 0x7f05f006e860 2024-04-16T16:20:59.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.968+0000 7f05efe00640 1 -- 172.21.15.22:0/975821053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e802cbd0 con 0x7f05f006e860 2024-04-16T16:20:59.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.968+0000 7f05efe00640 1 -- 172.21.15.22:0/975821053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8034440 con 0x7f05f006e860 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 -- 172.21.15.22:0/975821053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f006e860 msgr2=0x7f05f0071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 --2- 172.21.15.22:0/975821053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f006e860 0x7f05f0071700 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d90 tx=0x7f05e802be20 comp rx=0 tx=0).stop 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 -- 172.21.15.22:0/975821053 shutdown_connections 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 --2- 172.21.15.22:0/975821053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f006e860 0x7f05f0071700 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 --2- 172.21.15.22:0/975821053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f015b7e0 0x7f05f015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 -- 172.21.15.22:0/975821053 >> 172.21.15.22:0/975821053 conn(0x7f05f0062440 msgr2=0x7f05f0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 -- 172.21.15.22:0/975821053 shutdown_connections 2024-04-16T16:20:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.969+0000 7f05f7e00640 1 -- 172.21.15.22:0/975821053 wait complete. 2024-04-16T16:20:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.971+0000 7f05f7e00640 1 Processor -- start 2024-04-16T16:20:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.971+0000 7f05f7e00640 1 -- start start 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f006e860 0x7f05f014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f00af6b0 0x7f05f00b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f015b7e0 0x7f05f015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f7e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f05f015bd40 con 0x7f05f015b7e0 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f05f015bbc0 con 0x7f05f00af6b0 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f05f00afb10 con 0x7f05f006e860 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f015b7e0 0x7f05f015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f015b7e0 0x7f05f015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49088/0 (socket says 172.21.15.22:49088) 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.972+0000 7f05f5e00640 1 -- 172.21.15.22:0/4191045797 learned_addr learned my addr 172.21.15.22:0/4191045797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f5400640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f006e860 0x7f05f014c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f4a00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f00af6b0 0x7f05f00b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f5e00640 1 -- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f006e860 msgr2=0x7f05f014c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:59.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f5e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f006e860 0x7f05f014c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f5e00640 1 -- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f00af6b0 msgr2=0x7f05f00b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:20:59.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f5e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f00af6b0 0x7f05f00b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:20:59.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f5e00640 1 -- 172.21.15.22:0/4191045797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f014c620 con 0x7f05f015b7e0 2024-04-16T16:20:59.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f4a00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f00af6b0 0x7f05f00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:20:59.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.973+0000 7f05f5e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f015b7e0 0x7f05f015a1b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d90 tx=0x7f05e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:59.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.974+0000 7f05ed600640 1 -- 172.21.15.22:0/4191045797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8044020 con 0x7f05f015b7e0 2024-04-16T16:20:59.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.974+0000 7f05ed600640 1 -- 172.21.15.22:0/4191045797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e803a040 con 0x7f05f015b7e0 2024-04-16T16:20:59.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.974+0000 7f05ed600640 1 -- 172.21.15.22:0/4191045797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8039050 con 0x7f05f015b7e0 2024-04-16T16:20:59.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.974+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f00b0e80 con 0x7f05f015b7e0 2024-04-16T16:20:59.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.974+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f00b16c0 con 0x7f05f015b7e0 2024-04-16T16:20:59.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.975+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f004fd90 con 0x7f05f015b7e0 2024-04-16T16:20:59.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.976+0000 7f05ed600640 1 -- 172.21.15.22:0/4191045797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f05e8003bd0 con 0x7f05f015b7e0 2024-04-16T16:20:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.977+0000 7f05ed600640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f05d006ce90 0x7f05d006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:20:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.977+0000 7f05ed600640 1 -- 172.21.15.22:0/4191045797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f05e80aec80 con 0x7f05f015b7e0 2024-04-16T16:20:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.977+0000 7f05f5400640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f05d006ce90 0x7f05d006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:20:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.978+0000 7f05f5400640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f05d006ce90 0x7f05d006f350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05e400a950 tx=0x7f05e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:20:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:20:59.981+0000 7f05ed600640 1 -- 172.21.15.22:0/4191045797 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05e804e060 con 0x7f05f015b7e0 2024-04-16T16:21:00.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.224+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05f00b00e0 con 0x7f05f015b7e0 2024-04-16T16:21:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.226+0000 7f05ed600640 1 -- 172.21.15.22:0/4191045797 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5178 (secure 0 0 0) 0x7f05f00b0e80 con 0x7f05f015b7e0 2024-04-16T16:21:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:00.226 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4005390609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4005390609},{"type":"v1","addr":"172.21.15.43:6835","nonce":4005390609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5350,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3406985834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3406985834},{"type":"v1","addr":"172.21.15.43:6833","nonce":3406985834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1482042737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1482042737},{"type":"v1","addr":"172.21.15.22:6836","nonce":1482042737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:20:56.164231+0000","modified":"2024-04-16T16:20:59.221283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/540536764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":540536764},{"type":"v1","addr":"172.21.15.22:6837","nonce":540536764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6267,"qdb_cluster":[6267]},"id":4}]} 2024-04-16T16:21:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 35 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f05d006ce90 msgr2=0x7f05d006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f05d006ce90 0x7f05d006f350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05e400a950 tx=0x7f05e4008040 comp rx=0 tx=0).stop 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f015b7e0 msgr2=0x7f05f015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f015b7e0 0x7f05f015a1b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d90 tx=0x7f05e8004a40 comp rx=0 tx=0).stop 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 shutdown_connections 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f05d006ce90 0x7f05d006f350 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05f015b7e0 0x7f05f015a1b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f00af6b0 0x7f05f00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 --2- 172.21.15.22:0/4191045797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05f006e860 0x7f05f014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 >> 172.21.15.22:0/4191045797 conn(0x7f05f0062440 msgr2=0x7f05f0072250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 shutdown_connections 2024-04-16T16:21:00.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.230+0000 7f05f7e00640 1 -- 172.21.15.22:0/4191045797 wait complete. 2024-04-16T16:21:00.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:21:00.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.476+0000 7f7d58200640 1 Processor -- start 2024-04-16T16:21:00.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.477+0000 7f7d58200640 1 -- start start 2024-04-16T16:21:00.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d58200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7d5015eca0 0x7f7d500ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d58200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d50075060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d58200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d50072d30 con 0x7f7d500b0540 2024-04-16T16:21:00.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d58200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7d50072fd0 con 0x7f7d5015eca0 2024-04-16T16:21:00.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d58200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d500732b0 con 0x7f7d50074bd0 2024-04-16T16:21:00.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d55800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7d5015eca0 0x7f7d500ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d55800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7d5015eca0 0x7f7d500ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49098/0 (socket says 172.21.15.22:49098) 2024-04-16T16:21:00.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.478+0000 7f7d55800640 1 -- 172.21.15.22:0/1268372751 learned_addr learned my addr 172.21.15.22:0/1268372751 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:00.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.479+0000 7f7d56200640 1 --2- 172.21.15.22:0/1268372751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d50075060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.479+0000 7f7d55800640 1 -- 172.21.15.22:0/1268372751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 msgr2=0x7f7d50075060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:00.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.479+0000 7f7d55800640 1 --2- 172.21.15.22:0/1268372751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d50075060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.479+0000 7f7d55800640 1 -- 172.21.15.22:0/1268372751 >> v1:172.21.15.43:6789/0 conn(0x7f7d500b0540 legacy=0x7f7d500ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:00.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.479+0000 7f7d55800640 1 -- 172.21.15.22:0/1268372751 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d50073590 con 0x7f7d5015eca0 2024-04-16T16:21:00.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.480+0000 7f7d55800640 1 --2- 172.21.15.22:0/1268372751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d5015eca0 0x7f7d500ceba0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009e50 tx=0x7f7d4402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0cb6a853287763 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:00.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.480+0000 7f7d4fe00640 1 -- 172.21.15.22:0/1268372751 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4402c9e0 con 0x7f7d5015eca0 2024-04-16T16:21:00.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.480+0000 7f7d4fe00640 1 -- 172.21.15.22:0/1268372751 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4402cb80 con 0x7f7d5015eca0 2024-04-16T16:21:00.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.480+0000 7f7d4fe00640 1 -- 172.21.15.22:0/1268372751 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440343f0 con 0x7f7d5015eca0 2024-04-16T16:21:00.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 -- 172.21.15.22:0/1268372751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d5015eca0 msgr2=0x7f7d500ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 --2- 172.21.15.22:0/1268372751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d5015eca0 0x7f7d500ceba0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009e50 tx=0x7f7d4402be40 comp rx=0 tx=0).stop 2024-04-16T16:21:00.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 -- 172.21.15.22:0/1268372751 shutdown_connections 2024-04-16T16:21:00.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 --2- 172.21.15.22:0/1268372751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d50075060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 --2- 172.21.15.22:0/1268372751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d5015eca0 0x7f7d500ceba0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 -- 172.21.15.22:0/1268372751 >> 172.21.15.22:0/1268372751 conn(0x7f7d500b2b20 msgr2=0x7f7d500b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:00.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 -- 172.21.15.22:0/1268372751 shutdown_connections 2024-04-16T16:21:00.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.481+0000 7f7d58200640 1 -- 172.21.15.22:0/1268372751 wait complete. 2024-04-16T16:21:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.483+0000 7f7d58200640 1 Processor -- start 2024-04-16T16:21:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.484+0000 7f7d58200640 1 -- start start 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d58200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d5009f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d58200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d500b0540 0x7f7d5014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d58200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5015eca0 0x7f7d500b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d58200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5015f080 con 0x7f7d500b0540 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d58200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50073b50 con 0x7f7d5015eca0 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d58200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5015f200 con 0x7f7d50074bd0 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d54e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d500b0540 0x7f7d5014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d54e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d500b0540 0x7f7d5014ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49112/0 (socket says 172.21.15.22:49112) 2024-04-16T16:21:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.485+0000 7f7d54e00640 1 -- 172.21.15.22:0/3445167521 learned_addr learned my addr 172.21.15.22:0/3445167521 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d56200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5015eca0 0x7f7d500b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d55800640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d5009f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d54e00640 1 -- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 msgr2=0x7f7d5009f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d54e00640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d5009f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d54e00640 1 -- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5015eca0 msgr2=0x7f7d500b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d54e00640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5015eca0 0x7f7d500b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d54e00640 1 -- 172.21.15.22:0/3445167521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5009f8d0 con 0x7f7d500b0540 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d56200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5015eca0 0x7f7d500b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d54e00640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d500b0540 0x7f7d5014ebf0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00b3f0 tx=0x7f7d3c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d4d600640 1 -- 172.21.15.22:0/3445167521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c015020 con 0x7f7d500b0540 2024-04-16T16:21:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d4d600640 1 -- 172.21.15.22:0/3445167521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3c011830 con 0x7f7d500b0540 2024-04-16T16:21:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.486+0000 7f7d4d600640 1 -- 172.21.15.22:0/3445167521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c011c20 con 0x7f7d500b0540 2024-04-16T16:21:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.487+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d500a2330 con 0x7f7d500b0540 2024-04-16T16:21:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.487+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d500b6ae0 con 0x7f7d500b0540 2024-04-16T16:21:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.488+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5004fd90 con 0x7f7d500b0540 2024-04-16T16:21:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.489+0000 7f7d4d600640 1 -- 172.21.15.22:0/3445167521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f7d3c018020 con 0x7f7d500b0540 2024-04-16T16:21:00.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.490+0000 7f7d4d600640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d3006ce90 0x7f7d3006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.490+0000 7f7d4d600640 1 -- 172.21.15.22:0/3445167521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f7d3c08c200 con 0x7f7d500b0540 2024-04-16T16:21:00.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.490+0000 7f7d55800640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d3006ce90 0x7f7d3006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.491+0000 7f7d55800640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d3006ce90 0x7f7d3006f350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d44035000 tx=0x7f7d44030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:00.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.495+0000 7f7d4d600640 1 -- 172.21.15.22:0/3445167521 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d3c01f030 con 0x7f7d500b0540 2024-04-16T16:21:00.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.700+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d5015dcc0 con 0x7f7d500b0540 2024-04-16T16:21:00.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.703+0000 7f7d4d600640 1 -- 172.21.15.22:0/3445167521 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16545 (secure 0 0 0) 0x7f7d3c0172c0 con 0x7f7d500b0540 2024-04-16T16:21:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:00.703 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":62,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:57.686813+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:20:54.072603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-16T16:20:55.142667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:21:00.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.705+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d3006ce90 msgr2=0x7f7d3006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.705+0000 7f7d58200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d3006ce90 0x7f7d3006f350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d44035000 tx=0x7f7d44030000 comp rx=0 tx=0).stop 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d500b0540 msgr2=0x7f7d5014ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d500b0540 0x7f7d5014ebf0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00b3f0 tx=0x7f7d3c00b8b0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 shutdown_connections 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7d3006ce90 0x7f7d3006f350 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5015eca0 0x7f7d500b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d500b0540 0x7f7d5014ebf0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 --2- 172.21.15.22:0/3445167521 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d50074bd0 0x7f7d5009f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 >> 172.21.15.22:0/3445167521 conn(0x7f7d500b2b20 msgr2=0x7f7d500b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 shutdown_connections 2024-04-16T16:21:00.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.706+0000 7f7d58200640 1 -- 172.21.15.22:0/3445167521 wait complete. 2024-04-16T16:21:00.726 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T16:21:00.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:00.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.950+0000 7f5f37200640 1 Processor -- start 2024-04-16T16:21:00.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.950+0000 7f5f37200640 1 -- start start 2024-04-16T16:21:00.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f37200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f380d2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f37200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f380cfd50 0x7f5f380b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f37200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f380b8590 con 0x7f5f380b3ae0 2024-04-16T16:21:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f37200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5f380b8ba0 con 0x7f5f380cfd50 2024-04-16T16:21:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f37200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5f380ba5b0 con 0x7f5f3815ea40 2024-04-16T16:21:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f36800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f380cfd50 0x7f5f380b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f36800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f380cfd50 0x7f5f380b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49120/0 (socket says 172.21.15.22:49120) 2024-04-16T16:21:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.952+0000 7f5f36800640 1 -- 172.21.15.22:0/1648203228 learned_addr learned my addr 172.21.15.22:0/1648203228 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:00.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.953+0000 7f5f36800640 1 -- 172.21.15.22:0/1648203228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 msgr2=0x7f5f380d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:00.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.953+0000 7f5f35e00640 1 --2- 172.21.15.22:0/1648203228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f380d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.953+0000 7f5f36800640 1 --2- 172.21.15.22:0/1648203228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f380d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.953+0000 7f5f36800640 1 -- 172.21.15.22:0/1648203228 >> v1:172.21.15.43:6789/0 conn(0x7f5f380b3ae0 legacy=0x7f5f380cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:00.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.953+0000 7f5f36800640 1 -- 172.21.15.22:0/1648203228 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f380b8830 con 0x7f5f380cfd50 2024-04-16T16:21:00.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.953+0000 7f5f35e00640 1 --2- 172.21.15.22:0/1648203228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f380d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:00.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.954+0000 7f5f36800640 1 --2- 172.21.15.22:0/1648203228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380b9030 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009e50 tx=0x7f5f3002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce75be65ee8357d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:00.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.954+0000 7f5f34a00640 1 -- 172.21.15.22:0/1648203228 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3002cb00 con 0x7f5f380cfd50 2024-04-16T16:21:00.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.954+0000 7f5f34a00640 1 -- 172.21.15.22:0/1648203228 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3002cca0 con 0x7f5f380cfd50 2024-04-16T16:21:00.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.954+0000 7f5f34a00640 1 -- 172.21.15.22:0/1648203228 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30034610 con 0x7f5f380cfd50 2024-04-16T16:21:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 -- 172.21.15.22:0/1648203228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 msgr2=0x7f5f380b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 --2- 172.21.15.22:0/1648203228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380b9030 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009e50 tx=0x7f5f3002bf60 comp rx=0 tx=0).stop 2024-04-16T16:21:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 -- 172.21.15.22:0/1648203228 shutdown_connections 2024-04-16T16:21:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 --2- 172.21.15.22:0/1648203228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380b9030 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 --2- 172.21.15.22:0/1648203228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f380d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 -- 172.21.15.22:0/1648203228 >> 172.21.15.22:0/1648203228 conn(0x7f5f38072460 msgr2=0x7f5f38072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 -- 172.21.15.22:0/1648203228 shutdown_connections 2024-04-16T16:21:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.955+0000 7f5f37200640 1 -- 172.21.15.22:0/1648203228 wait complete. 2024-04-16T16:21:00.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.958+0000 7f5f37200640 1 Processor -- start 2024-04-16T16:21:00.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.958+0000 7f5f37200640 1 -- start start 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.959+0000 7f5f37200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f380b3ae0 0x7f5f381ee380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.959+0000 7f5f37200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.959+0000 7f5f37200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f381f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.959+0000 7f5f37200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5f380ba1d0 con 0x7f5f380cfd50 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.959+0000 7f5f37200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3815ee20 con 0x7f5f380b3ae0 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.959+0000 7f5f37200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5f380ba350 con 0x7f5f3815ea40 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.959+0000 7f5f35400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49136/0 (socket says 172.21.15.22:49136) 2024-04-16T16:21:00.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35400640 1 -- 172.21.15.22:0/1293218686 learned_addr learned my addr 172.21.15.22:0/1293218686 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35e00640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f380b3ae0 0x7f5f381ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f36800640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f381f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35400640 1 -- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 msgr2=0x7f5f381f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35400640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f381f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35400640 1 -- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f380b3ae0 msgr2=0x7f5f381ee380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35400640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f380b3ae0 0x7f5f381ee380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35400640 1 -- 172.21.15.22:0/1293218686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f381ee8c0 con 0x7f5f380cfd50 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.960+0000 7f5f35e00640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f380b3ae0 0x7f5f381ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.961+0000 7f5f35400640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380ce690 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000b3c0 tx=0x7f5f2000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.961+0000 7f5f2e000640 1 -- 172.21.15.22:0/1293218686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20011830 con 0x7f5f380cfd50 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.961+0000 7f5f2e000640 1 -- 172.21.15.22:0/1293218686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f20016070 con 0x7f5f380cfd50 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.961+0000 7f5f2e000640 1 -- 172.21.15.22:0/1293218686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20011c50 con 0x7f5f380cfd50 2024-04-16T16:21:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.961+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f380cbf80 con 0x7f5f380cfd50 2024-04-16T16:21:00.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.961+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f380cc540 con 0x7f5f380cfd50 2024-04-16T16:21:00.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.962+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f38075f30 con 0x7f5f380cfd50 2024-04-16T16:21:00.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.963+0000 7f5f2e000640 1 -- 172.21.15.22:0/1293218686 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f5f2001b460 con 0x7f5f380cfd50 2024-04-16T16:21:00.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.964+0000 7f5f2e000640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5f1406ce90 0x7f5f1406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:00.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.964+0000 7f5f2e000640 1 -- 172.21.15.22:0/1293218686 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f5f2008c020 con 0x7f5f380cfd50 2024-04-16T16:21:00.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.964+0000 7f5f35e00640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5f1406ce90 0x7f5f1406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.965+0000 7f5f35e00640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5f1406ce90 0x7f5f1406f350 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f28006fd0 tx=0x7f5f28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:00.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:00.969+0000 7f5f2e000640 1 -- 172.21.15.22:0/1293218686 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f20020020 con 0x7f5f380cfd50 2024-04-16T16:21:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.170+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f3806c050 con 0x7f5f1406ce90 2024-04-16T16:21:01.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.188+0000 7f5f2e000640 1 -- 172.21.15.22:0/1293218686 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242375 (secure 0 0 0) 0x7f5f3806c050 con 0x7f5f1406ce90 2024-04-16T16:21:01.191 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5f1406ce90 msgr2=0x7f5f1406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5f1406ce90 0x7f5f1406f350 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f28006fd0 tx=0x7f5f28008040 comp rx=0 tx=0).stop 2024-04-16T16:21:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 msgr2=0x7f5f380ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380ce690 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000b3c0 tx=0x7f5f2000b880 comp rx=0 tx=0).stop 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 shutdown_connections 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f5f1406ce90 0x7f5f1406f350 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f3815ea40 0x7f5f381f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f380cfd50 0x7f5f380ce690 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 --2- 172.21.15.22:0/1293218686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f380b3ae0 0x7f5f381ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 >> 172.21.15.22:0/1293218686 conn(0x7f5f38072460 msgr2=0x7f5f3815ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.194+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 shutdown_connections 2024-04-16T16:21:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.195+0000 7f5f37200640 1 -- 172.21.15.22:0/1293218686 wait complete. 2024-04-16T16:21:01.214 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-04-16T16:20:59.792113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":256180,"kb_used_data":6712,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718540,"statfs":{"total":773094113280,"available":772831784960,"internally_reserved":0,"allocated":6873088,"data_stored":3543348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.142008"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657559+0000","last_change":"2024-04-16T16:20:54.657559+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657559+0000","last_undegraded":"2024-04-16T16:20:54.657559+0000","last_fullsized":"2024-04-16T16:20:54.657559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.662633+0000","last_change":"2024-04-16T16:20:54.662633+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.662633+0000","last_undegraded":"2024-04-16T16:20:54.662633+0000","last_fullsized":"2024-04-16T16:20:54.662633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657567+0000","last_change":"2024-04-16T16:20:54.657567+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657567+0000","last_undegraded":"2024-04-16T16:20:54.657567+0000","last_fullsized":"2024-04-16T16:20:54.657567+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.658614+0000","last_change":"2024-04-16T16:20:54.658614+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.658614+0000","last_undegraded":"2024-04-16T16:20:54.658614+0000","last_fullsized":"2024-04-16T16:20:54.658614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657562+0000","last_change":"2024-04-16T16:20:54.657562+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657562+0000","last_undegraded":"2024-04-16T16:20:54.657562+0000","last_fullsized":"2024-04-16T16:20:54.657562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.659447+0000","last_change":"2024-04-16T16:20:54.659447+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.659447+0000","last_undegraded":"2024-04-16T16:20:54.659447+0000","last_fullsized":"2024-04-16T16:20:54.659447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.666441+0000","last_change":"2024-04-16T16:20:54.666441+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.666441+0000","last_undegraded":"2024-04-16T16:20:54.666441+0000","last_fullsized":"2024-04-16T16:20:54.666441+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661908+0000","last_change":"2024-04-16T16:20:54.661908+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661908+0000","last_undegraded":"2024-04-16T16:20:54.661908+0000","last_fullsized":"2024-04-16T16:20:54.661908+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.665755+0000","last_change":"2024-04-16T16:20:54.665755+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.665755+0000","last_undegraded":"2024-04-16T16:20:54.665755+0000","last_fullsized":"2024-04-16T16:20:54.665755+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.663121+0000","last_change":"2024-04-16T16:20:54.663121+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.663121+0000","last_undegraded":"2024-04-16T16:20:54.663121+0000","last_fullsized":"2024-04-16T16:20:54.663121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.667718+0000","last_change":"2024-04-16T16:20:54.667718+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.667718+0000","last_undegraded":"2024-04-16T16:20:54.667718+0000","last_fullsized":"2024-04-16T16:20:54.667718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657204+0000","last_change":"2024-04-16T16:20:54.657204+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657204+0000","last_undegraded":"2024-04-16T16:20:54.657204+0000","last_fullsized":"2024-04-16T16:20:54.657204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.665620+0000","last_change":"2024-04-16T16:20:54.665620+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.665620+0000","last_undegraded":"2024-04-16T16:20:54.665620+0000","last_fullsized":"2024-04-16T16:20:54.665620+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661925+0000","last_change":"2024-04-16T16:20:54.661925+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661925+0000","last_undegraded":"2024-04-16T16:20:54.661925+0000","last_fullsized":"2024-04-16T16:20:54.661925+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.659015+0000","last_change":"2024-04-16T16:20:54.659015+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.659015+0000","last_undegraded":"2024-04-16T16:20:54.659015+0000","last_fullsized":"2024-04-16T16:20:54.659015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657163+0000","last_change":"2024-04-16T16:20:54.657163+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657163+0000","last_undegraded":"2024-04-16T16:20:54.657163+0000","last_fullsized":"2024-04-16T16:20:54.657163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657451+0000","last_change":"2024-04-16T16:20:54.657451+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657451+0000","last_undegraded":"2024-04-16T16:20:54.657451+0000","last_fullsized":"2024-04-16T16:20:54.657451+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661843+0000","last_change":"2024-04-16T16:20:54.661843+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661843+0000","last_undegraded":"2024-04-16T16:20:54.661843+0000","last_fullsized":"2024-04-16T16:20:54.661843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657886+0000","last_change":"2024-04-16T16:20:54.657886+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657886+0000","last_undegraded":"2024-04-16T16:20:54.657886+0000","last_fullsized":"2024-04-16T16:20:54.657886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657574+0000","last_change":"2024-04-16T16:20:54.657574+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657574+0000","last_undegraded":"2024-04-16T16:20:54.657574+0000","last_fullsized":"2024-04-16T16:20:54.657574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.667744+0000","last_change":"2024-04-16T16:20:54.667744+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.667744+0000","last_undegraded":"2024-04-16T16:20:54.667744+0000","last_fullsized":"2024-04-16T16:20:54.667744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657278+0000","last_change":"2024-04-16T16:20:54.657278+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657278+0000","last_undegraded":"2024-04-16T16:20:54.657278+0000","last_fullsized":"2024-04-16T16:20:54.657278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661882+0000","last_change":"2024-04-16T16:20:54.661882+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661882+0000","last_undegraded":"2024-04-16T16:20:54.661882+0000","last_fullsized":"2024-04-16T16:20:54.661882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.666062+0000","last_change":"2024-04-16T16:20:54.666062+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.666062+0000","last_undegraded":"2024-04-16T16:20:54.666062+0000","last_fullsized":"2024-04-16T16:20:54.666062+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-16T16:20:54.667781+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:54.667781+0000","last_peered":"2024-04-16T16:20:54.667781+0000","last_clean":"2024-04-16T16:20:54.667781+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:54.667781+0000","last_undegraded":"2024-04-16T16:20:54.667781+0000","last_fullsized":"2024-04-16T16:20:54.667781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":879192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":879192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:01.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.482+0000 7fe1c3c00640 1 Processor -- start 2024-04-16T16:21:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.482+0000 7fe1c3c00640 1 -- start start 2024-04-16T16:21:01.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.484+0000 7fe1c3c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe1bc163340 0x7fe1bc0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.484+0000 7fe1c3c00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1bc0d0e80 con 0x7fe1bc1478c0 2024-04-16T16:21:01.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.484+0000 7fe1c3c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1bc0af0b0 con 0x7fe1bc0d0a80 2024-04-16T16:21:01.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.484+0000 7fe1c3c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe1bc0af950 con 0x7fe1bc163340 2024-04-16T16:21:01.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.484+0000 7fe1c1200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe1bc1478c0 0x7fe1bc0ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33094/0 (socket says 172.21.15.22:33094) 2024-04-16T16:21:01.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.484+0000 7fe1c1200640 1 -- 172.21.15.22:0/749136884 learned_addr learned my addr 172.21.15.22:0/749136884 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:01.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bbe00640 1 --2- 172.21.15.22:0/749136884 >> v2:172.21.15.43:3300/0 conn(0x7fe1bc163340 0x7fe1bc0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:01.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245885058 0 0) 0x7fe1bc0d0e80 con 0x7fe1bc1478c0 2024-04-16T16:21:01.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a4003520 con 0x7fe1bc1478c0 2024-04-16T16:21:01.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 792669321 0 0) 0x7fe1a4003520 con 0x7fe1bc1478c0 2024-04-16T16:21:01.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 >> v2:172.21.15.43:3300/0 conn(0x7fe1bc163340 msgr2=0x7fe1bc0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:01.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 --2- 172.21.15.22:0/749136884 >> v2:172.21.15.43:3300/0 conn(0x7fe1bc163340 0x7fe1bc0d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 >> v1:172.21.15.43:6789/0 conn(0x7fe1bc0d0a80 legacy=0x7fe1bc06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc0af390 con 0x7fe1bc1478c0 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fe1b0001670 con 0x7fe1bc1478c0 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 >> v1:172.21.15.22:6789/0 conn(0x7fe1bc1478c0 legacy=0x7fe1bc0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a4003a00 0x7fe1a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a4004800 0x7fe1a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4005210 0x7fe1a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a400c130 con 0x7fe1a4004800 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a400c2e0 con 0x7fe1a4003a00 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.485+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a400c4e0 con 0x7fe1a4005210 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1bbe00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a4004800 0x7fe1a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:01.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1c1200640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a4003a00 0x7fe1a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1c1c00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4005210 0x7fe1a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1bbe00640 1 -- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4005210 msgr2=0x7fe1a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1bbe00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4005210 0x7fe1a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1bbe00640 1 -- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a4003a00 msgr2=0x7fe1a4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1bbe00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a4003a00 0x7fe1a4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1bbe00640 1 -- 172.21.15.22:0/749136884 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a4003520 con 0x7fe1a4004800 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1c1c00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4005210 0x7fe1a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1c1200640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a4003a00 0x7fe1a4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.486+0000 7fe1c1c00640 1 -- 172.21.15.22:0/749136884 reap_dead start 2024-04-16T16:21:01.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.487+0000 7fe1bbe00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a4004800 0x7fe1a4004c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009a90 tx=0x7fe1a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d50c7a16f9b6e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:01.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8039070 con 0x7fe1a4004800 2024-04-16T16:21:01.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a802c680 con 0x7fe1a4004800 2024-04-16T16:21:01.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1bb400640 1 -- 172.21.15.22:0/749136884 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8009690 con 0x7fe1a4004800 2024-04-16T16:21:01.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1c3c00640 1 -- 172.21.15.22:0/749136884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a4004800 msgr2=0x7fe1a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a4004800 0x7fe1a4004c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009a90 tx=0x7fe1a4005830 comp rx=0 tx=0).stop 2024-04-16T16:21:01.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1c3c00640 1 -- 172.21.15.22:0/749136884 shutdown_connections 2024-04-16T16:21:01.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/749136884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a4004800 0x7fe1a4004c80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1c3c00640 1 -- 172.21.15.22:0/749136884 >> 172.21.15.22:0/749136884 conn(0x7fe1bc062440 msgr2=0x7fe1bc062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:01.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1c3c00640 1 -- 172.21.15.22:0/749136884 shutdown_connections 2024-04-16T16:21:01.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.488+0000 7fe1c3c00640 1 -- 172.21.15.22:0/749136884 wait complete. 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.490+0000 7fe1c3c00640 1 Processor -- start 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.490+0000 7fe1c3c00640 1 -- start start 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.491+0000 7fe1c3c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4004800 0x7fe1bc0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.491+0000 7fe1c3c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc161d10 0x7fe1bc160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.491+0000 7fe1c3c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1bc15e2f0 0x7fe1bc142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.491+0000 7fe1c3c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc0d0540 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.491+0000 7fe1c3c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc147ca0 con 0x7fe1bc161d10 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.491+0000 7fe1c3c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc0d06c0 con 0x7fe1a4004800 2024-04-16T16:21:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.491+0000 7fe1c1c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1bc15e2f0 0x7fe1bc142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:01.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1bc15e2f0 0x7fe1bc142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49162/0 (socket says 172.21.15.22:49162) 2024-04-16T16:21:01.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 -- 172.21.15.22:0/724422564 learned_addr learned my addr 172.21.15.22:0/724422564 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1200640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4004800 0x7fe1bc0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 -- 172.21.15.22:0/724422564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4004800 msgr2=0x7fe1bc0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4004800 0x7fe1bc0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 -- 172.21.15.22:0/724422564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc161d10 msgr2=0x7fe1bc160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc161d10 0x7fe1bc160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 -- 172.21.15.22:0/724422564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc1609d0 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.492+0000 7fe1c1c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1bc15e2f0 0x7fe1bc142db0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0b58a0 tx=0x7fe1b400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.493+0000 7fe1b8c00640 1 -- 172.21.15.22:0/724422564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4018070 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.493+0000 7fe1b8c00640 1 -- 172.21.15.22:0/724422564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b4003dc0 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.493+0000 7fe1b8c00640 1 -- 172.21.15.22:0/724422564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40052b0 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.493+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc160c70 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.493+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc161230 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.494+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc04fd90 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.495+0000 7fe1b8c00640 1 -- 172.21.15.22:0/724422564 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fe1b401b070 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.496+0000 7fe1b8c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe19c06ce90 0x7fe19c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:01.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.496+0000 7fe1b8c00640 1 -- 172.21.15.22:0/724422564 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fe1b408bbd0 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.496+0000 7fe1c1200640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe19c06ce90 0x7fe19c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:01.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.497+0000 7fe1c1200640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe19c06ce90 0x7fe19c06f350 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0001eb0 tx=0x7fe1b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:01.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.501+0000 7fe1b8c00640 1 -- 172.21.15.22:0/724422564 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1b4059030 con 0x7fe1bc15e2f0 2024-04-16T16:21:01.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.701+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1bc062a30 con 0x7fe19c06ce90 2024-04-16T16:21:01.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.719+0000 7fe1b8c00640 1 -- 172.21.15.22:0/724422564 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242375 (secure 0 0 0) 0x7fe1bc062a30 con 0x7fe19c06ce90 2024-04-16T16:21:01.720 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:01.723 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:01.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.725+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe19c06ce90 msgr2=0x7fe19c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.725+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe19c06ce90 0x7fe19c06f350 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0001eb0 tx=0x7fe1b0009040 comp rx=0 tx=0).stop 2024-04-16T16:21:01.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.725+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1bc15e2f0 msgr2=0x7fe1bc142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:01.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.725+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1bc15e2f0 0x7fe1bc142db0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0b58a0 tx=0x7fe1b400d9d0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.725+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 shutdown_connections 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.726+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe19c06ce90 0x7fe19c06f350 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.726+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1bc15e2f0 0x7fe1bc142db0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.726+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc161d10 0x7fe1bc160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.726+0000 7fe1c3c00640 1 --2- 172.21.15.22:0/724422564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a4004800 0x7fe1bc0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.726+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 >> 172.21.15.22:0/724422564 conn(0x7fe1bc062440 msgr2=0x7fe1bc06e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.726+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 shutdown_connections 2024-04-16T16:21:01.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:01.726+0000 7fe1c3c00640 1 -- 172.21.15.22:0/724422564 wait complete. 2024-04-16T16:21:01.746 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-04-16T16:20:59.792113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":256180,"kb_used_data":6712,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718540,"statfs":{"total":773094113280,"available":772831784960,"internally_reserved":0,"allocated":6873088,"data_stored":3543348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.142008"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657559+0000","last_change":"2024-04-16T16:20:54.657559+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657559+0000","last_undegraded":"2024-04-16T16:20:54.657559+0000","last_fullsized":"2024-04-16T16:20:54.657559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.662633+0000","last_change":"2024-04-16T16:20:54.662633+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.662633+0000","last_undegraded":"2024-04-16T16:20:54.662633+0000","last_fullsized":"2024-04-16T16:20:54.662633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657567+0000","last_change":"2024-04-16T16:20:54.657567+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657567+0000","last_undegraded":"2024-04-16T16:20:54.657567+0000","last_fullsized":"2024-04-16T16:20:54.657567+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.658614+0000","last_change":"2024-04-16T16:20:54.658614+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.658614+0000","last_undegraded":"2024-04-16T16:20:54.658614+0000","last_fullsized":"2024-04-16T16:20:54.658614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657562+0000","last_change":"2024-04-16T16:20:54.657562+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657562+0000","last_undegraded":"2024-04-16T16:20:54.657562+0000","last_fullsized":"2024-04-16T16:20:54.657562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.659447+0000","last_change":"2024-04-16T16:20:54.659447+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.659447+0000","last_undegraded":"2024-04-16T16:20:54.659447+0000","last_fullsized":"2024-04-16T16:20:54.659447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.666441+0000","last_change":"2024-04-16T16:20:54.666441+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.666441+0000","last_undegraded":"2024-04-16T16:20:54.666441+0000","last_fullsized":"2024-04-16T16:20:54.666441+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661908+0000","last_change":"2024-04-16T16:20:54.661908+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661908+0000","last_undegraded":"2024-04-16T16:20:54.661908+0000","last_fullsized":"2024-04-16T16:20:54.661908+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.665755+0000","last_change":"2024-04-16T16:20:54.665755+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.665755+0000","last_undegraded":"2024-04-16T16:20:54.665755+0000","last_fullsized":"2024-04-16T16:20:54.665755+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.663121+0000","last_change":"2024-04-16T16:20:54.663121+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.663121+0000","last_undegraded":"2024-04-16T16:20:54.663121+0000","last_fullsized":"2024-04-16T16:20:54.663121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.667718+0000","last_change":"2024-04-16T16:20:54.667718+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.667718+0000","last_undegraded":"2024-04-16T16:20:54.667718+0000","last_fullsized":"2024-04-16T16:20:54.667718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657204+0000","last_change":"2024-04-16T16:20:54.657204+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657204+0000","last_undegraded":"2024-04-16T16:20:54.657204+0000","last_fullsized":"2024-04-16T16:20:54.657204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.665620+0000","last_change":"2024-04-16T16:20:54.665620+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.665620+0000","last_undegraded":"2024-04-16T16:20:54.665620+0000","last_fullsized":"2024-04-16T16:20:54.665620+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661925+0000","last_change":"2024-04-16T16:20:54.661925+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661925+0000","last_undegraded":"2024-04-16T16:20:54.661925+0000","last_fullsized":"2024-04-16T16:20:54.661925+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.659015+0000","last_change":"2024-04-16T16:20:54.659015+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.659015+0000","last_undegraded":"2024-04-16T16:20:54.659015+0000","last_fullsized":"2024-04-16T16:20:54.659015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657163+0000","last_change":"2024-04-16T16:20:54.657163+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657163+0000","last_undegraded":"2024-04-16T16:20:54.657163+0000","last_fullsized":"2024-04-16T16:20:54.657163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657451+0000","last_change":"2024-04-16T16:20:54.657451+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657451+0000","last_undegraded":"2024-04-16T16:20:54.657451+0000","last_fullsized":"2024-04-16T16:20:54.657451+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661843+0000","last_change":"2024-04-16T16:20:54.661843+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661843+0000","last_undegraded":"2024-04-16T16:20:54.661843+0000","last_fullsized":"2024-04-16T16:20:54.661843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657886+0000","last_change":"2024-04-16T16:20:54.657886+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657886+0000","last_undegraded":"2024-04-16T16:20:54.657886+0000","last_fullsized":"2024-04-16T16:20:54.657886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657574+0000","last_change":"2024-04-16T16:20:54.657574+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657574+0000","last_undegraded":"2024-04-16T16:20:54.657574+0000","last_fullsized":"2024-04-16T16:20:54.657574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.667744+0000","last_change":"2024-04-16T16:20:54.667744+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.667744+0000","last_undegraded":"2024-04-16T16:20:54.667744+0000","last_fullsized":"2024-04-16T16:20:54.667744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.657278+0000","last_change":"2024-04-16T16:20:54.657278+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.657278+0000","last_undegraded":"2024-04-16T16:20:54.657278+0000","last_fullsized":"2024-04-16T16:20:54.657278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.661882+0000","last_change":"2024-04-16T16:20:54.661882+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.661882+0000","last_undegraded":"2024-04-16T16:20:54.661882+0000","last_fullsized":"2024-04-16T16:20:54.661882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T16:20:55.649605+0000","last_change":"2024-04-16T16:20:55.649605+0000","last_active":"2024-04-16T16:20:55.649605+0000","last_peered":"2024-04-16T16:20:55.649605+0000","last_clean":"2024-04-16T16:20:55.649605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:55.649605+0000","last_undegraded":"2024-04-16T16:20:55.649605+0000","last_fullsized":"2024-04-16T16:20:55.649605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-04-16T16:20:54.666062+0000","last_change":"2024-04-16T16:20:54.666062+0000","last_active":"2024-04-16T16:20:54.635176+0000","last_peered":"2024-04-16T16:20:54.635176+0000","last_clean":"2024-04-16T16:20:54.635176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T16:20:54.666062+0000","last_undegraded":"2024-04-16T16:20:54.666062+0000","last_fullsized":"2024-04-16T16:20:54.666062+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-16T16:20:54.667781+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:54.667781+0000","last_peered":"2024-04-16T16:20:54.667781+0000","last_clean":"2024-04-16T16:20:54.667781+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:54.667781+0000","last_undegraded":"2024-04-16T16:20:54.667781+0000","last_fullsized":"2024-04-16T16:20:54.667781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":879192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31860,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":696320,"data_stored":288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":879192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:01.750 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:02.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.018+0000 7f1849a00640 1 Processor -- start 2024-04-16T16:21:02.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.018+0000 7f1849a00640 1 -- start start 2024-04-16T16:21:02.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.019+0000 7f1849a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f184415ea50 0x7f18440ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.019+0000 7f1849a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f18440cf630 0x7f18440cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.019+0000 7f1849a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18440b9080 con 0x7f18440d2dc0 2024-04-16T16:21:02.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.019+0000 7f1849a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f18440b9c90 con 0x7f18440cf630 2024-04-16T16:21:02.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.019+0000 7f1849a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f18440cffb0 con 0x7f184415ea50 2024-04-16T16:21:02.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.020+0000 7f1843e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f184415ea50 0x7f18440ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.020+0000 7f1843e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f184415ea50 0x7f18440ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.22:53382/0 (socket says 172.21.15.22:53382) 2024-04-16T16:21:02.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.020+0000 7f1843e00640 1 -- 172.21.15.22:0/2800653829 learned_addr learned my addr 172.21.15.22:0/2800653829 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:02.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.020+0000 7f1843400640 1 --2- 172.21.15.22:0/2800653829 >> v2:172.21.15.43:3300/0 conn(0x7f18440cf630 0x7f18440cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.021+0000 7f1843e00640 1 -- 172.21.15.22:0/2800653829 >> v2:172.21.15.43:3300/0 conn(0x7f18440cf630 msgr2=0x7f18440cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:02.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.021+0000 7f1843e00640 1 --2- 172.21.15.22:0/2800653829 >> v2:172.21.15.43:3300/0 conn(0x7f18440cf630 0x7f18440cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.021+0000 7f1843e00640 1 -- 172.21.15.22:0/2800653829 >> v1:172.21.15.43:6789/0 conn(0x7f18440d2dc0 legacy=0x7f18440d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.021+0000 7f1843e00640 1 -- 172.21.15.22:0/2800653829 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18440b9360 con 0x7f184415ea50 2024-04-16T16:21:02.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.022+0000 7f1843e00640 1 --2- 172.21.15.22:0/2800653829 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f184415ea50 0x7f18440ba280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1834009e80 tx=0x7f183402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0ce3d0ee4dfba02 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:02.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.023+0000 7f1842a00640 1 -- 172.21.15.22:0/2800653829 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183402c9c0 con 0x7f184415ea50 2024-04-16T16:21:02.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.023+0000 7f1842a00640 1 -- 172.21.15.22:0/2800653829 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183402cb60 con 0x7f184415ea50 2024-04-16T16:21:02.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.023+0000 7f1842a00640 1 -- 172.21.15.22:0/2800653829 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340343f0 con 0x7f184415ea50 2024-04-16T16:21:02.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 -- 172.21.15.22:0/2800653829 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f184415ea50 msgr2=0x7f18440ba280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 --2- 172.21.15.22:0/2800653829 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f184415ea50 0x7f18440ba280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1834009e80 tx=0x7f183402be20 comp rx=0 tx=0).stop 2024-04-16T16:21:02.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 -- 172.21.15.22:0/2800653829 shutdown_connections 2024-04-16T16:21:02.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 --2- 172.21.15.22:0/2800653829 >> v2:172.21.15.43:3300/0 conn(0x7f18440cf630 0x7f18440cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 --2- 172.21.15.22:0/2800653829 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f184415ea50 0x7f18440ba280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 -- 172.21.15.22:0/2800653829 >> 172.21.15.22:0/2800653829 conn(0x7f1844072430 msgr2=0x7f1844072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:02.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 -- 172.21.15.22:0/2800653829 shutdown_connections 2024-04-16T16:21:02.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.024+0000 7f1849a00640 1 -- 172.21.15.22:0/2800653829 wait complete. 2024-04-16T16:21:02.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.026+0000 7f1849a00640 1 Processor -- start 2024-04-16T16:21:02.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.026+0000 7f1849a00640 1 -- start start 2024-04-16T16:21:02.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1849a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18440cf630 0x7f184414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1849a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f18440d2dc0 0x7f18440cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1849a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f184415ea50 0x7f18440ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1849a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f184415ee30 con 0x7f18440cf630 2024-04-16T16:21:02.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1849a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18440b9920 con 0x7f184415ea50 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1849a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f18440ba7c0 con 0x7f18440d2dc0 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1843e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18440cf630 0x7f184414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1843e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18440cf630 0x7f184414fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49176/0 (socket says 172.21.15.22:49176) 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.027+0000 7f1843e00640 1 -- 172.21.15.22:0/3856616934 learned_addr learned my addr 172.21.15.22:0/3856616934 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843400640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f18440d2dc0 0x7f18440cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1849000640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f184415ea50 0x7f18440ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843e00640 1 -- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f18440d2dc0 msgr2=0x7f18440cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843e00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f18440d2dc0 0x7f18440cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843e00640 1 -- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f184415ea50 msgr2=0x7f18440ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843e00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f184415ea50 0x7f18440ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843e00640 1 -- 172.21.15.22:0/3856616934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18440cc660 con 0x7f18440cf630 2024-04-16T16:21:02.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843400640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f18440d2dc0 0x7f18440cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:02.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1843e00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18440cf630 0x7f184414fe40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1834009fa0 tx=0x7f1834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:02.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f183be00640 1 -- 172.21.15.22:0/3856616934 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834044020 con 0x7f18440cf630 2024-04-16T16:21:02.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f183be00640 1 -- 172.21.15.22:0/3856616934 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18340406b0 con 0x7f18440cf630 2024-04-16T16:21:02.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f183be00640 1 -- 172.21.15.22:0/3856616934 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834040aa0 con 0x7f18440cf630 2024-04-16T16:21:02.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.028+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18440cc940 con 0x7f18440cf630 2024-04-16T16:21:02.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.029+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18441604d0 con 0x7f18440cf630 2024-04-16T16:21:02.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.030+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1844075f30 con 0x7f18440cf630 2024-04-16T16:21:02.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.031+0000 7f183be00640 1 -- 172.21.15.22:0/3856616934 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f1834047020 con 0x7f18440cf630 2024-04-16T16:21:02.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.031+0000 7f183be00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182006ce90 0x7f182006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.032+0000 7f183be00640 1 -- 172.21.15.22:0/3856616934 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f18340af160 con 0x7f18440cf630 2024-04-16T16:21:02.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.032+0000 7f1843400640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182006ce90 0x7f182006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.033+0000 7f1843400640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182006ce90 0x7f182006f350 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f18440cac70 tx=0x7f182c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:02.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.037+0000 7f183be00640 1 -- 172.21.15.22:0/3856616934 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f183404e030 con 0x7f18440cf630 2024-04-16T16:21:02.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.237+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1844160710 con 0x7f182006ce90 2024-04-16T16:21:02.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.257+0000 7f183be00640 1 -- 172.21.15.22:0/3856616934 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7f1844160710 con 0x7f182006ce90 2024-04-16T16:21:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:02.262 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:02.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182006ce90 msgr2=0x7f182006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182006ce90 0x7f182006f350 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f18440cac70 tx=0x7f182c008040 comp rx=0 tx=0).stop 2024-04-16T16:21:02.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18440cf630 msgr2=0x7f184414fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18440cf630 0x7f184414fe40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1834009fa0 tx=0x7f1834004a40 comp rx=0 tx=0).stop 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 shutdown_connections 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f182006ce90 0x7f182006f350 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f184415ea50 0x7f18440ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f18440d2dc0 0x7f18440cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 --2- 172.21.15.22:0/3856616934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18440cf630 0x7f184414fe40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.262+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 >> 172.21.15.22:0/3856616934 conn(0x7f1844072430 msgr2=0x7f18440d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.263+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 shutdown_connections 2024-04-16T16:21:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.263+0000 7f1849a00640 1 -- 172.21.15.22:0/3856616934 wait complete. 2024-04-16T16:21:02.281 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-04-16T16:21:01.792817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256512,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718208,"statfs":{"total":773094113280,"available":772831444992,"internally_reserved":0,"allocated":7217152,"data_stored":3697420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.124804"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373919+0000","last_change":"2024-04-16T16:20:56.700692+0000","last_active":"2024-04-16T16:20:58.373919+0000","last_peered":"2024-04-16T16:20:58.373919+0000","last_clean":"2024-04-16T16:20:58.373919+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:20:58.373919+0000","last_undegraded":"2024-04-16T16:20:58.373919+0000","last_fullsized":"2024-04-16T16:20:58.373919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:01.405645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375924+0000","last_change":"2024-04-16T16:20:56.704487+0000","last_active":"2024-04-16T16:20:58.375924+0000","last_peered":"2024-04-16T16:20:58.375924+0000","last_clean":"2024-04-16T16:20:58.375924+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:20:58.375924+0000","last_undegraded":"2024-04-16T16:20:58.375924+0000","last_fullsized":"2024-04-16T16:20:58.375924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:18.892594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374985+0000","last_change":"2024-04-16T16:20:56.710584+0000","last_active":"2024-04-16T16:20:58.374985+0000","last_peered":"2024-04-16T16:20:58.374985+0000","last_clean":"2024-04-16T16:20:58.374985+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:20:58.374985+0000","last_undegraded":"2024-04-16T16:20:58.374985+0000","last_fullsized":"2024-04-16T16:20:58.374985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708372+0000","last_change":"2024-04-16T16:20:56.694479+0000","last_active":"2024-04-16T16:20:57.708372+0000","last_peered":"2024-04-16T16:20:57.708372+0000","last_clean":"2024-04-16T16:20:57.708372+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:20:57.708372+0000","last_undegraded":"2024-04-16T16:20:57.708372+0000","last_fullsized":"2024-04-16T16:20:57.708372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373184+0000","last_change":"2024-04-16T16:20:56.687650+0000","last_active":"2024-04-16T16:20:58.373184+0000","last_peered":"2024-04-16T16:20:58.373184+0000","last_clean":"2024-04-16T16:20:58.373184+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:20:58.373184+0000","last_undegraded":"2024-04-16T16:20:58.373184+0000","last_fullsized":"2024-04-16T16:20:58.373184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:24.566878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374109+0000","last_change":"2024-04-16T16:20:56.696467+0000","last_active":"2024-04-16T16:20:58.374109+0000","last_peered":"2024-04-16T16:20:58.374109+0000","last_clean":"2024-04-16T16:20:58.374109+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:20:58.374109+0000","last_undegraded":"2024-04-16T16:20:58.374109+0000","last_fullsized":"2024-04-16T16:20:58.374109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372576+0000","last_change":"2024-04-16T16:20:56.711962+0000","last_active":"2024-04-16T16:20:58.372576+0000","last_peered":"2024-04-16T16:20:58.372576+0000","last_clean":"2024-04-16T16:20:58.372576+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:20:58.372576+0000","last_undegraded":"2024-04-16T16:20:58.372576+0000","last_fullsized":"2024-04-16T16:20:58.372576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:34.290551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.702421+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373554+0000","last_change":"2024-04-16T16:20:56.705792+0000","last_active":"2024-04-16T16:20:58.373554+0000","last_peered":"2024-04-16T16:20:58.373554+0000","last_clean":"2024-04-16T16:20:58.373554+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:20:58.373554+0000","last_undegraded":"2024-04-16T16:20:58.373554+0000","last_fullsized":"2024-04-16T16:20:58.373554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373773+0000","last_change":"2024-04-16T16:20:56.716792+0000","last_active":"2024-04-16T16:20:58.373773+0000","last_peered":"2024-04-16T16:20:58.373773+0000","last_clean":"2024-04-16T16:20:58.373773+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:20:58.373773+0000","last_undegraded":"2024-04-16T16:20:58.373773+0000","last_fullsized":"2024-04-16T16:20:58.373773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375444+0000","last_change":"2024-04-16T16:20:56.709293+0000","last_active":"2024-04-16T16:20:58.375444+0000","last_peered":"2024-04-16T16:20:58.375444+0000","last_clean":"2024-04-16T16:20:58.375444+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:20:58.375444+0000","last_undegraded":"2024-04-16T16:20:58.375444+0000","last_fullsized":"2024-04-16T16:20:58.375444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:47.440922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374963+0000","last_change":"2024-04-16T16:20:56.722078+0000","last_active":"2024-04-16T16:20:58.374963+0000","last_peered":"2024-04-16T16:20:58.374963+0000","last_clean":"2024-04-16T16:20:58.374963+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:20:58.374963+0000","last_undegraded":"2024-04-16T16:20:58.374963+0000","last_fullsized":"2024-04-16T16:20:58.374963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372189+0000","last_change":"2024-04-16T16:20:56.703752+0000","last_active":"2024-04-16T16:20:58.372189+0000","last_peered":"2024-04-16T16:20:58.372189+0000","last_clean":"2024-04-16T16:20:58.372189+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:20:58.372189+0000","last_undegraded":"2024-04-16T16:20:58.372189+0000","last_fullsized":"2024-04-16T16:20:58.372189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:32.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374871+0000","last_change":"2024-04-16T16:20:56.718849+0000","last_active":"2024-04-16T16:20:58.374871+0000","last_peered":"2024-04-16T16:20:58.374871+0000","last_clean":"2024-04-16T16:20:58.374871+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:20:58.374871+0000","last_undegraded":"2024-04-16T16:20:58.374871+0000","last_fullsized":"2024-04-16T16:20:58.374871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.829545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374676+0000","last_change":"2024-04-16T16:20:56.715256+0000","last_active":"2024-04-16T16:20:58.374676+0000","last_peered":"2024-04-16T16:20:58.374676+0000","last_clean":"2024-04-16T16:20:58.374676+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:20:58.374676+0000","last_undegraded":"2024-04-16T16:20:58.374676+0000","last_fullsized":"2024-04-16T16:20:58.374676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374265+0000","last_change":"2024-04-16T16:20:56.703517+0000","last_active":"2024-04-16T16:20:58.374265+0000","last_peered":"2024-04-16T16:20:58.374265+0000","last_clean":"2024-04-16T16:20:58.374265+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:20:58.374265+0000","last_undegraded":"2024-04-16T16:20:58.374265+0000","last_fullsized":"2024-04-16T16:20:58.374265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:28.081709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374176+0000","last_change":"2024-04-16T16:20:56.719987+0000","last_active":"2024-04-16T16:20:58.374176+0000","last_peered":"2024-04-16T16:20:58.374176+0000","last_clean":"2024-04-16T16:20:58.374176+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:20:58.374176+0000","last_undegraded":"2024-04-16T16:20:58.374176+0000","last_fullsized":"2024-04-16T16:20:58.374176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373168+0000","last_change":"2024-04-16T16:20:56.720302+0000","last_active":"2024-04-16T16:20:58.373168+0000","last_peered":"2024-04-16T16:20:58.373168+0000","last_clean":"2024-04-16T16:20:58.373168+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:20:58.373168+0000","last_undegraded":"2024-04-16T16:20:58.373168+0000","last_fullsized":"2024-04-16T16:20:58.373168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374304+0000","last_change":"2024-04-16T16:20:56.711031+0000","last_active":"2024-04-16T16:20:58.374304+0000","last_peered":"2024-04-16T16:20:58.374304+0000","last_clean":"2024-04-16T16:20:58.374304+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:20:58.374304+0000","last_undegraded":"2024-04-16T16:20:58.374304+0000","last_fullsized":"2024-04-16T16:20:58.374304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:24.434925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708201+0000","last_change":"2024-04-16T16:20:56.699535+0000","last_active":"2024-04-16T16:20:57.708201+0000","last_peered":"2024-04-16T16:20:57.708201+0000","last_clean":"2024-04-16T16:20:57.708201+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:20:57.708201+0000","last_undegraded":"2024-04-16T16:20:57.708201+0000","last_fullsized":"2024-04-16T16:20:57.708201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376001+0000","last_change":"2024-04-16T16:20:56.716226+0000","last_active":"2024-04-16T16:20:58.376001+0000","last_peered":"2024-04-16T16:20:58.376001+0000","last_clean":"2024-04-16T16:20:58.376001+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:20:58.376001+0000","last_undegraded":"2024-04-16T16:20:58.376001+0000","last_fullsized":"2024-04-16T16:20:58.376001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373175+0000","last_change":"2024-04-16T16:20:56.690730+0000","last_active":"2024-04-16T16:20:58.373175+0000","last_peered":"2024-04-16T16:20:58.373175+0000","last_clean":"2024-04-16T16:20:58.373175+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:20:58.373175+0000","last_undegraded":"2024-04-16T16:20:58.373175+0000","last_fullsized":"2024-04-16T16:20:58.373175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:22.566150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374342+0000","last_change":"2024-04-16T16:20:56.708786+0000","last_active":"2024-04-16T16:20:58.374342+0000","last_peered":"2024-04-16T16:20:58.374342+0000","last_clean":"2024-04-16T16:20:58.374342+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:20:58.374342+0000","last_undegraded":"2024-04-16T16:20:58.374342+0000","last_fullsized":"2024-04-16T16:20:58.374342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:51.397773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374485+0000","last_change":"2024-04-16T16:20:56.720038+0000","last_active":"2024-04-16T16:20:58.374485+0000","last_peered":"2024-04-16T16:20:58.374485+0000","last_clean":"2024-04-16T16:20:58.374485+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:20:58.374485+0000","last_undegraded":"2024-04-16T16:20:58.374485+0000","last_fullsized":"2024-04-16T16:20:58.374485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.371823+0000","last_change":"2024-04-16T16:20:56.706135+0000","last_active":"2024-04-16T16:20:58.371823+0000","last_peered":"2024-04-16T16:20:58.371823+0000","last_clean":"2024-04-16T16:20:58.371823+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:20:58.371823+0000","last_undegraded":"2024-04-16T16:20:58.371823+0000","last_fullsized":"2024-04-16T16:20:58.371823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:10:18.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374185+0000","last_change":"2024-04-16T16:20:56.707138+0000","last_active":"2024-04-16T16:20:58.374185+0000","last_peered":"2024-04-16T16:20:58.374185+0000","last_clean":"2024-04-16T16:20:58.374185+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:20:58.374185+0000","last_undegraded":"2024-04-16T16:20:58.374185+0000","last_fullsized":"2024-04-16T16:20:58.374185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376195+0000","last_change":"2024-04-16T16:20:56.714674+0000","last_active":"2024-04-16T16:20:58.376195+0000","last_peered":"2024-04-16T16:20:58.376195+0000","last_clean":"2024-04-16T16:20:58.376195+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:20:58.376195+0000","last_undegraded":"2024-04-16T16:20:58.376195+0000","last_fullsized":"2024-04-16T16:20:58.376195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:47.291306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375823+0000","last_change":"2024-04-16T16:20:55.704083+0000","last_active":"2024-04-16T16:20:58.375823+0000","last_peered":"2024-04-16T16:20:58.375823+0000","last_clean":"2024-04-16T16:20:58.375823+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:20:58.375823+0000","last_undegraded":"2024-04-16T16:20:58.375823+0000","last_fullsized":"2024-04-16T16:20:58.375823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:34.565386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375090+0000","last_change":"2024-04-16T16:20:55.700645+0000","last_active":"2024-04-16T16:20:58.375090+0000","last_peered":"2024-04-16T16:20:58.375090+0000","last_clean":"2024-04-16T16:20:58.375090+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:20:58.375090+0000","last_undegraded":"2024-04-16T16:20:58.375090+0000","last_fullsized":"2024-04-16T16:20:58.375090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:56.588790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376827+0000","last_change":"2024-04-16T16:20:56.717040+0000","last_active":"2024-04-16T16:20:58.376827+0000","last_peered":"2024-04-16T16:20:58.376827+0000","last_clean":"2024-04-16T16:20:58.376827+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:20:58.376827+0000","last_undegraded":"2024-04-16T16:20:58.376827+0000","last_fullsized":"2024-04-16T16:20:58.376827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:57.603218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.698501+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:40.710552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376219+0000","last_change":"2024-04-16T16:20:56.708709+0000","last_active":"2024-04-16T16:20:58.376219+0000","last_peered":"2024-04-16T16:20:58.376219+0000","last_clean":"2024-04-16T16:20:58.376219+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:20:58.376219+0000","last_undegraded":"2024-04-16T16:20:58.376219+0000","last_fullsized":"2024-04-16T16:20:58.376219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:35.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707688+0000","last_change":"2024-04-16T16:20:55.703384+0000","last_active":"2024-04-16T16:20:57.707688+0000","last_peered":"2024-04-16T16:20:57.707688+0000","last_clean":"2024-04-16T16:20:57.707688+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:20:57.707688+0000","last_undegraded":"2024-04-16T16:20:57.707688+0000","last_fullsized":"2024-04-16T16:20:57.707688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373769+0000","last_change":"2024-04-16T16:20:56.703273+0000","last_active":"2024-04-16T16:20:58.373769+0000","last_peered":"2024-04-16T16:20:58.373769+0000","last_clean":"2024-04-16T16:20:58.373769+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:20:58.373769+0000","last_undegraded":"2024-04-16T16:20:58.373769+0000","last_fullsized":"2024-04-16T16:20:58.373769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:37.220892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373915+0000","last_change":"2024-04-16T16:20:56.706317+0000","last_active":"2024-04-16T16:20:58.373915+0000","last_peered":"2024-04-16T16:20:58.373915+0000","last_clean":"2024-04-16T16:20:58.373915+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:20:58.373915+0000","last_undegraded":"2024-04-16T16:20:58.373915+0000","last_fullsized":"2024-04-16T16:20:58.373915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:18.555574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374892+0000","last_change":"2024-04-16T16:20:55.703837+0000","last_active":"2024-04-16T16:20:58.374892+0000","last_peered":"2024-04-16T16:20:58.374892+0000","last_clean":"2024-04-16T16:20:58.374892+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:20:58.374892+0000","last_undegraded":"2024-04-16T16:20:58.374892+0000","last_fullsized":"2024-04-16T16:20:58.374892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:13.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372897+0000","last_change":"2024-04-16T16:20:56.716680+0000","last_active":"2024-04-16T16:20:58.372897+0000","last_peered":"2024-04-16T16:20:58.372897+0000","last_clean":"2024-04-16T16:20:58.372897+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:20:58.372897+0000","last_undegraded":"2024-04-16T16:20:58.372897+0000","last_fullsized":"2024-04-16T16:20:58.372897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705691+0000","last_change":"2024-04-16T16:20:55.699938+0000","last_active":"2024-04-16T16:20:57.705691+0000","last_peered":"2024-04-16T16:20:57.705691+0000","last_clean":"2024-04-16T16:20:57.705691+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:20:57.705691+0000","last_undegraded":"2024-04-16T16:20:57.705691+0000","last_fullsized":"2024-04-16T16:20:57.705691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373328+0000","last_change":"2024-04-16T16:20:56.709848+0000","last_active":"2024-04-16T16:20:58.373328+0000","last_peered":"2024-04-16T16:20:58.373328+0000","last_clean":"2024-04-16T16:20:58.373328+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:20:58.373328+0000","last_undegraded":"2024-04-16T16:20:58.373328+0000","last_fullsized":"2024-04-16T16:20:58.373328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:46.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375190+0000","last_change":"2024-04-16T16:20:55.703623+0000","last_active":"2024-04-16T16:20:58.375190+0000","last_peered":"2024-04-16T16:20:58.375190+0000","last_clean":"2024-04-16T16:20:58.375190+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:20:58.375190+0000","last_undegraded":"2024-04-16T16:20:58.375190+0000","last_fullsized":"2024-04-16T16:20:58.375190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374994+0000","last_change":"2024-04-16T16:20:56.723400+0000","last_active":"2024-04-16T16:20:58.374994+0000","last_peered":"2024-04-16T16:20:58.374994+0000","last_clean":"2024-04-16T16:20:58.374994+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:20:58.374994+0000","last_undegraded":"2024-04-16T16:20:58.374994+0000","last_fullsized":"2024-04-16T16:20:58.374994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375368+0000","last_change":"2024-04-16T16:20:55.694413+0000","last_active":"2024-04-16T16:20:58.375368+0000","last_peered":"2024-04-16T16:20:58.375368+0000","last_clean":"2024-04-16T16:20:58.375368+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:20:58.375368+0000","last_undegraded":"2024-04-16T16:20:58.375368+0000","last_fullsized":"2024-04-16T16:20:58.375368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:21.591232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375589+0000","last_change":"2024-04-16T16:20:55.702261+0000","last_active":"2024-04-16T16:20:58.375589+0000","last_peered":"2024-04-16T16:20:58.375589+0000","last_clean":"2024-04-16T16:20:58.375589+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:20:58.375589+0000","last_undegraded":"2024-04-16T16:20:58.375589+0000","last_fullsized":"2024-04-16T16:20:58.375589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375450+0000","last_change":"2024-04-16T16:20:56.712767+0000","last_active":"2024-04-16T16:20:58.375450+0000","last_peered":"2024-04-16T16:20:58.375450+0000","last_clean":"2024-04-16T16:20:58.375450+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:20:58.375450+0000","last_undegraded":"2024-04-16T16:20:58.375450+0000","last_fullsized":"2024-04-16T16:20:58.375450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706177+0000","last_change":"2024-04-16T16:20:56.704028+0000","last_active":"2024-04-16T16:20:57.706177+0000","last_peered":"2024-04-16T16:20:57.706177+0000","last_clean":"2024-04-16T16:20:57.706177+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:20:57.706177+0000","last_undegraded":"2024-04-16T16:20:57.706177+0000","last_fullsized":"2024-04-16T16:20:57.706177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373761+0000","last_change":"2024-04-16T16:20:55.691499+0000","last_active":"2024-04-16T16:20:58.373761+0000","last_peered":"2024-04-16T16:20:58.373761+0000","last_clean":"2024-04-16T16:20:58.373761+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:20:58.373761+0000","last_undegraded":"2024-04-16T16:20:58.373761+0000","last_fullsized":"2024-04-16T16:20:58.373761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:46.276878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374544+0000","last_change":"2024-04-16T16:20:56.718537+0000","last_active":"2024-04-16T16:20:58.374544+0000","last_peered":"2024-04-16T16:20:58.374544+0000","last_clean":"2024-04-16T16:20:58.374544+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:20:58.374544+0000","last_undegraded":"2024-04-16T16:20:58.374544+0000","last_fullsized":"2024-04-16T16:20:58.374544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372802+0000","last_change":"2024-04-16T16:20:55.700778+0000","last_active":"2024-04-16T16:20:58.372802+0000","last_peered":"2024-04-16T16:20:58.372802+0000","last_clean":"2024-04-16T16:20:58.372802+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:20:58.372802+0000","last_undegraded":"2024-04-16T16:20:58.372802+0000","last_fullsized":"2024-04-16T16:20:58.372802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:21.223928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705837+0000","last_change":"2024-04-16T16:20:55.700889+0000","last_active":"2024-04-16T16:20:57.705837+0000","last_peered":"2024-04-16T16:20:57.705837+0000","last_clean":"2024-04-16T16:20:57.705837+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:20:57.705837+0000","last_undegraded":"2024-04-16T16:20:57.705837+0000","last_fullsized":"2024-04-16T16:20:57.705837+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374373+0000","last_change":"2024-04-16T16:20:56.720365+0000","last_active":"2024-04-16T16:20:58.374373+0000","last_peered":"2024-04-16T16:20:58.374373+0000","last_clean":"2024-04-16T16:20:58.374373+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:20:58.374373+0000","last_undegraded":"2024-04-16T16:20:58.374373+0000","last_fullsized":"2024-04-16T16:20:58.374373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373392+0000","last_change":"2024-04-16T16:20:55.705450+0000","last_active":"2024-04-16T16:20:58.373392+0000","last_peered":"2024-04-16T16:20:58.373392+0000","last_clean":"2024-04-16T16:20:58.373392+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:20:58.373392+0000","last_undegraded":"2024-04-16T16:20:58.373392+0000","last_fullsized":"2024-04-16T16:20:58.373392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375228+0000","last_change":"2024-04-16T16:20:56.721758+0000","last_active":"2024-04-16T16:20:58.375228+0000","last_peered":"2024-04-16T16:20:58.375228+0000","last_clean":"2024-04-16T16:20:58.375228+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:20:58.375228+0000","last_undegraded":"2024-04-16T16:20:58.375228+0000","last_fullsized":"2024-04-16T16:20:58.375228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375245+0000","last_change":"2024-04-16T16:20:55.691154+0000","last_active":"2024-04-16T16:20:58.375245+0000","last_peered":"2024-04-16T16:20:58.375245+0000","last_clean":"2024-04-16T16:20:58.375245+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:20:58.375245+0000","last_undegraded":"2024-04-16T16:20:58.375245+0000","last_fullsized":"2024-04-16T16:20:58.375245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:48.698225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708411+0000","last_change":"2024-04-16T16:20:56.708684+0000","last_active":"2024-04-16T16:20:57.708411+0000","last_peered":"2024-04-16T16:20:57.708411+0000","last_clean":"2024-04-16T16:20:57.708411+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:20:57.708411+0000","last_undegraded":"2024-04-16T16:20:57.708411+0000","last_fullsized":"2024-04-16T16:20:57.708411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.699664+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375214+0000","last_change":"2024-04-16T16:20:56.712157+0000","last_active":"2024-04-16T16:20:58.375214+0000","last_peered":"2024-04-16T16:20:58.375214+0000","last_clean":"2024-04-16T16:20:58.375214+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:20:58.375214+0000","last_undegraded":"2024-04-16T16:20:58.375214+0000","last_fullsized":"2024-04-16T16:20:58.375214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707746+0000","last_change":"2024-04-16T16:20:55.702354+0000","last_active":"2024-04-16T16:20:57.707746+0000","last_peered":"2024-04-16T16:20:57.707746+0000","last_clean":"2024-04-16T16:20:57.707746+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:20:57.707746+0000","last_undegraded":"2024-04-16T16:20:57.707746+0000","last_fullsized":"2024-04-16T16:20:57.707746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:50.973007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375511+0000","last_change":"2024-04-16T16:20:56.712536+0000","last_active":"2024-04-16T16:20:58.375511+0000","last_peered":"2024-04-16T16:20:58.375511+0000","last_clean":"2024-04-16T16:20:58.375511+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:20:58.375511+0000","last_undegraded":"2024-04-16T16:20:58.375511+0000","last_fullsized":"2024-04-16T16:20:58.375511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375548+0000","last_change":"2024-04-16T16:20:55.697400+0000","last_active":"2024-04-16T16:20:58.375548+0000","last_peered":"2024-04-16T16:20:58.375548+0000","last_clean":"2024-04-16T16:20:58.375548+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:20:58.375548+0000","last_undegraded":"2024-04-16T16:20:58.375548+0000","last_fullsized":"2024-04-16T16:20:58.375548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:32.224244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706503+0000","last_change":"2024-04-16T16:20:56.705284+0000","last_active":"2024-04-16T16:20:57.706503+0000","last_peered":"2024-04-16T16:20:57.706503+0000","last_clean":"2024-04-16T16:20:57.706503+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:20:57.706503+0000","last_undegraded":"2024-04-16T16:20:57.706503+0000","last_fullsized":"2024-04-16T16:20:57.706503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374874+0000","last_change":"2024-04-16T16:20:55.691520+0000","last_active":"2024-04-16T16:20:58.374874+0000","last_peered":"2024-04-16T16:20:58.374874+0000","last_clean":"2024-04-16T16:20:58.374874+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:20:58.374874+0000","last_undegraded":"2024-04-16T16:20:58.374874+0000","last_fullsized":"2024-04-16T16:20:58.374874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:34.964542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376142+0000","last_change":"2024-04-16T16:20:56.714025+0000","last_active":"2024-04-16T16:20:58.376142+0000","last_peered":"2024-04-16T16:20:58.376142+0000","last_clean":"2024-04-16T16:20:58.376142+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:20:58.376142+0000","last_undegraded":"2024-04-16T16:20:58.376142+0000","last_fullsized":"2024-04-16T16:20:58.376142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374747+0000","last_change":"2024-04-16T16:20:56.715573+0000","last_active":"2024-04-16T16:20:58.374747+0000","last_peered":"2024-04-16T16:20:58.374747+0000","last_clean":"2024-04-16T16:20:58.374747+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:20:58.374747+0000","last_undegraded":"2024-04-16T16:20:58.374747+0000","last_fullsized":"2024-04-16T16:20:58.374747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705507+0000","last_change":"2024-04-16T16:20:55.700653+0000","last_active":"2024-04-16T16:20:57.705507+0000","last_peered":"2024-04-16T16:20:57.705507+0000","last_clean":"2024-04-16T16:20:57.705507+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:20:57.705507+0000","last_undegraded":"2024-04-16T16:20:57.705507+0000","last_fullsized":"2024-04-16T16:20:57.705507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:30.271546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708260+0000","last_change":"2024-04-16T16:20:56.691557+0000","last_active":"2024-04-16T16:20:57.708260+0000","last_peered":"2024-04-16T16:20:57.708260+0000","last_clean":"2024-04-16T16:20:57.708260+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:20:57.708260+0000","last_undegraded":"2024-04-16T16:20:57.708260+0000","last_fullsized":"2024-04-16T16:20:57.708260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708599+0000","last_change":"2024-04-16T16:20:56.714215+0000","last_active":"2024-04-16T16:20:57.708599+0000","last_peered":"2024-04-16T16:20:57.708599+0000","last_clean":"2024-04-16T16:20:57.708599+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:20:57.708599+0000","last_undegraded":"2024-04-16T16:20:57.708599+0000","last_fullsized":"2024-04-16T16:20:57.708599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376396+0000","last_change":"2024-04-16T16:20:55.704363+0000","last_active":"2024-04-16T16:20:58.376396+0000","last_peered":"2024-04-16T16:20:58.376396+0000","last_clean":"2024-04-16T16:20:58.376396+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:20:58.376396+0000","last_undegraded":"2024-04-16T16:20:58.376396+0000","last_fullsized":"2024-04-16T16:20:58.376396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372943+0000","last_change":"2024-04-16T16:20:55.703477+0000","last_active":"2024-04-16T16:20:58.372943+0000","last_peered":"2024-04-16T16:20:58.372943+0000","last_clean":"2024-04-16T16:20:58.372943+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:20:58.372943+0000","last_undegraded":"2024-04-16T16:20:58.372943+0000","last_fullsized":"2024-04-16T16:20:58.372943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:15.228538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376581+0000","last_change":"2024-04-16T16:20:56.707864+0000","last_active":"2024-04-16T16:20:58.376581+0000","last_peered":"2024-04-16T16:20:58.376581+0000","last_clean":"2024-04-16T16:20:58.376581+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:20:58.376581+0000","last_undegraded":"2024-04-16T16:20:58.376581+0000","last_fullsized":"2024-04-16T16:20:58.376581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:21.749618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707985+0000","last_change":"2024-04-16T16:20:55.701244+0000","last_active":"2024-04-16T16:20:57.707985+0000","last_peered":"2024-04-16T16:20:57.707985+0000","last_clean":"2024-04-16T16:20:57.707985+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:20:57.707985+0000","last_undegraded":"2024-04-16T16:20:57.707985+0000","last_fullsized":"2024-04-16T16:20:57.707985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374179+0000","last_change":"2024-04-16T16:20:56.707897+0000","last_active":"2024-04-16T16:20:58.374179+0000","last_peered":"2024-04-16T16:20:58.374179+0000","last_clean":"2024-04-16T16:20:58.374179+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:20:58.374179+0000","last_undegraded":"2024-04-16T16:20:58.374179+0000","last_fullsized":"2024-04-16T16:20:58.374179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:42.907490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374977+0000","last_change":"2024-04-16T16:20:56.720972+0000","last_active":"2024-04-16T16:20:58.374977+0000","last_peered":"2024-04-16T16:20:58.374977+0000","last_clean":"2024-04-16T16:20:58.374977+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:20:58.374977+0000","last_undegraded":"2024-04-16T16:20:58.374977+0000","last_fullsized":"2024-04-16T16:20:58.374977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373562+0000","last_change":"2024-04-16T16:20:56.708340+0000","last_active":"2024-04-16T16:20:58.373562+0000","last_peered":"2024-04-16T16:20:58.373562+0000","last_clean":"2024-04-16T16:20:58.373562+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:20:58.373562+0000","last_undegraded":"2024-04-16T16:20:58.373562+0000","last_fullsized":"2024-04-16T16:20:58.373562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:07.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372721+0000","last_change":"2024-04-16T16:20:55.692470+0000","last_active":"2024-04-16T16:20:58.372721+0000","last_peered":"2024-04-16T16:20:58.372721+0000","last_clean":"2024-04-16T16:20:58.372721+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:20:58.372721+0000","last_undegraded":"2024-04-16T16:20:58.372721+0000","last_fullsized":"2024-04-16T16:20:58.372721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:20.735190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372709+0000","last_change":"2024-04-16T16:20:56.720232+0000","last_active":"2024-04-16T16:20:58.372709+0000","last_peered":"2024-04-16T16:20:58.372709+0000","last_clean":"2024-04-16T16:20:58.372709+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:20:58.372709+0000","last_undegraded":"2024-04-16T16:20:58.372709+0000","last_fullsized":"2024-04-16T16:20:58.372709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:34.266414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372516+0000","last_change":"2024-04-16T16:20:55.702982+0000","last_active":"2024-04-16T16:20:58.372516+0000","last_peered":"2024-04-16T16:20:58.372516+0000","last_clean":"2024-04-16T16:20:58.372516+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:20:58.372516+0000","last_undegraded":"2024-04-16T16:20:58.372516+0000","last_fullsized":"2024-04-16T16:20:58.372516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:05.020022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373594+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:58.373594+0000","last_peered":"2024-04-16T16:20:58.373594+0000","last_clean":"2024-04-16T16:20:58.373594+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:58.373594+0000","last_undegraded":"2024-04-16T16:20:58.373594+0000","last_fullsized":"2024-04-16T16:20:58.373594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":904511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":313983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":753664,"data_stored":314635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":906545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:02.286 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-16T16:21:02.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.549+0000 7f65c0400640 1 Processor -- start 2024-04-16T16:21:02.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.549+0000 7f65c0400640 1 -- start start 2024-04-16T16:21:02.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65c0400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65b80afd90 0x7f65b8072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65c0400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65c0400640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b81606d0 con 0x7f65b806dc80 2024-04-16T16:21:02.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65c0400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f65b8160480 con 0x7f65b80afd90 2024-04-16T16:21:02.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65c0400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f65b81609b0 con 0x7f65b8073050 2024-04-16T16:21:02.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65bda00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65b80afd90 0x7f65b8072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65bda00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65b80afd90 0x7f65b8072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49186/0 (socket says 172.21.15.22:49186) 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.551+0000 7f65bda00640 1 -- 172.21.15.22:0/943059906 learned_addr learned my addr 172.21.15.22:0/943059906 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.552+0000 7f65be400640 1 --2- 172.21.15.22:0/943059906 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.552+0000 7f65bda00640 1 -- 172.21.15.22:0/943059906 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 msgr2=0x7f65b815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.552+0000 7f65bda00640 1 --2- 172.21.15.22:0/943059906 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.552+0000 7f65bda00640 1 -- 172.21.15.22:0/943059906 >> v1:172.21.15.43:6789/0 conn(0x7f65b806dc80 legacy=0x7f65b80d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.552+0000 7f65bda00640 1 -- 172.21.15.22:0/943059906 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b8160c90 con 0x7f65b80afd90 2024-04-16T16:21:02.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.553+0000 7f65bda00640 1 --2- 172.21.15.22:0/943059906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b80afd90 0x7f65b8072b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009870 tx=0x7f65ac02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e2c294752206ad server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.553+0000 7f65b7e00640 1 -- 172.21.15.22:0/943059906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0317c0 con 0x7f65b80afd90 2024-04-16T16:21:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.553+0000 7f65b7e00640 1 -- 172.21.15.22:0/943059906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac037070 con 0x7f65b80afd90 2024-04-16T16:21:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.553+0000 7f65b7e00640 1 -- 172.21.15.22:0/943059906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac031b80 con 0x7f65b80afd90 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 -- 172.21.15.22:0/943059906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b80afd90 msgr2=0x7f65b8072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 --2- 172.21.15.22:0/943059906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b80afd90 0x7f65b8072b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009870 tx=0x7f65ac02b860 comp rx=0 tx=0).stop 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 -- 172.21.15.22:0/943059906 shutdown_connections 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 --2- 172.21.15.22:0/943059906 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 --2- 172.21.15.22:0/943059906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b80afd90 0x7f65b8072b10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 -- 172.21.15.22:0/943059906 >> 172.21.15.22:0/943059906 conn(0x7f65b8062440 msgr2=0x7f65b8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 -- 172.21.15.22:0/943059906 shutdown_connections 2024-04-16T16:21:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.554+0000 7f65c0400640 1 -- 172.21.15.22:0/943059906 wait complete. 2024-04-16T16:21:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.556+0000 7f65c0400640 1 Processor -- start 2024-04-16T16:21:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.556+0000 7f65c0400640 1 -- start start 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65c0400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b806dc80 0x7f65b8146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65c0400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65c0400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b80afd90 0x7f65b8142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65c0400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65b80ce8a0 con 0x7f65b806dc80 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65c0400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65b80b0170 con 0x7f65b80afd90 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65c0400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f65b80cea20 con 0x7f65b8073050 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65bda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b806dc80 0x7f65b8146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65bda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b806dc80 0x7f65b8146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49200/0 (socket says 172.21.15.22:49200) 2024-04-16T16:21:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.557+0000 7f65bda00640 1 -- 172.21.15.22:0/739424018 learned_addr learned my addr 172.21.15.22:0/739424018 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:02.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bd000640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bda00640 1 -- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 msgr2=0x7f65b80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65be400640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b80afd90 0x7f65b8142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bda00640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b80b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bda00640 1 -- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b80afd90 msgr2=0x7f65b8142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bda00640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b80afd90 0x7f65b8142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bda00640 1 -- 172.21.15.22:0/739424018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b8153a50 con 0x7f65b806dc80 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bd000640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65bda00640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b806dc80 0x7f65b8146130 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009870 tx=0x7f65ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65b5600640 1 -- 172.21.15.22:0/739424018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac032650 con 0x7f65b806dc80 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65b5600640 1 -- 172.21.15.22:0/739424018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac0327f0 con 0x7f65b806dc80 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65b5600640 1 -- 172.21.15.22:0/739424018 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac032be0 con 0x7f65b806dc80 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.558+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b8153d30 con 0x7f65b806dc80 2024-04-16T16:21:02.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.559+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b81542f0 con 0x7f65b806dc80 2024-04-16T16:21:02.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.560+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b804fd90 con 0x7f65b806dc80 2024-04-16T16:21:02.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.561+0000 7f65b5600640 1 -- 172.21.15.22:0/739424018 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f65ac04c060 con 0x7f65b806dc80 2024-04-16T16:21:02.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.562+0000 7f65b5600640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f659806ce90 0x7f659806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:02.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.562+0000 7f65b5600640 1 -- 172.21.15.22:0/739424018 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f65ac0aded0 con 0x7f65b806dc80 2024-04-16T16:21:02.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.562+0000 7f65bd000640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f659806ce90 0x7f659806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:02.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.563+0000 7f65bd000640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f659806ce90 0x7f659806f350 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f65b8146670 tx=0x7f65a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:02.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.567+0000 7f65b5600640 1 -- 172.21.15.22:0/739424018 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65ac040070 con 0x7f65b806dc80 2024-04-16T16:21:02.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.848+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f65b8158e80 con 0x7f65b806dc80 2024-04-16T16:21:02.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.849+0000 7f65b5600640 1 -- 172.21.15.22:0/739424018 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7f65ac07b9c0 con 0x7f65b806dc80 2024-04-16T16:21:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:02.849 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":280,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1713284194,"num_in_osds":8,"osd_in_since":1713284185,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":262668288,"bytes_avail":772831444992,"bytes_total":773094113280,"write_bytes_sec":2340,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":35,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6267}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-04-16T16:20:35.784274+0000","services":{}},"progress_events":{}} 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f659806ce90 msgr2=0x7f659806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f659806ce90 0x7f659806f350 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f65b8146670 tx=0x7f65a4009040 comp rx=0 tx=0).stop 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b806dc80 msgr2=0x7f65b8146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b806dc80 0x7f65b8146130 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009870 tx=0x7f65ac0046c0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 shutdown_connections 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f659806ce90 0x7f659806f350 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b80afd90 0x7f65b8142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65b8073050 0x7f65b80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 --2- 172.21.15.22:0/739424018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65b806dc80 0x7f65b8146130 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 >> 172.21.15.22:0/739424018 conn(0x7f65b8062440 msgr2=0x7f65b80cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 shutdown_connections 2024-04-16T16:21:02.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:02.852+0000 7f65c0400640 1 -- 172.21.15.22:0/739424018 wait complete. 2024-04-16T16:21:02.872 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-16T16:21:02.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:03.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.086+0000 7f97fb200640 1 Processor -- start 2024-04-16T16:21:03.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.087+0000 7f97fb200640 1 -- start start 2024-04-16T16:21:03.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.088+0000 7f97fb200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97fc0cfd40 0x7f97fc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.088+0000 7f97fb200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc0b9080 con 0x7f97fc15ea50 2024-04-16T16:21:03.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.088+0000 7f97fb200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc0b9360 con 0x7f97fc0d3dd0 2024-04-16T16:21:03.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.088+0000 7f97fb200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc0b9c90 con 0x7f97fc0cfd40 2024-04-16T16:21:03.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.088+0000 7f97f9e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f97fc15ea50 0x7f97fc0ba280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33106/0 (socket says 172.21.15.22:33106) 2024-04-16T16:21:03.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.088+0000 7f97f9e00640 1 -- 172.21.15.22:0/2883254463 learned_addr learned my addr 172.21.15.22:0/2883254463 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97fa800640 1 --2- 172.21.15.22:0/2883254463 >> v2:172.21.15.43:3300/0 conn(0x7f97fc0cfd40 0x7f97fc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11826476 0 0) 0x7f97fc0b9080 con 0x7f97fc15ea50 2024-04-16T16:21:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e0003520 con 0x7f97fc15ea50 2024-04-16T16:21:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2603038179 0 0) 0x7f97e0003520 con 0x7f97fc15ea50 2024-04-16T16:21:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 >> v2:172.21.15.43:3300/0 conn(0x7f97fc0cfd40 msgr2=0x7f97fc0b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 --2- 172.21.15.22:0/2883254463 >> v2:172.21.15.43:3300/0 conn(0x7f97fc0cfd40 0x7f97fc0b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 >> v1:172.21.15.43:6789/0 conn(0x7f97fc0d3dd0 legacy=0x7f97fc0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0b9640 con 0x7f97fc15ea50 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.089+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f97ec0019f0 con 0x7f97fc15ea50 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 >> v1:172.21.15.22:6789/0 conn(0x7f97fc15ea50 legacy=0x7f97fc0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f8a00640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97e00039b0 0x7f97e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f8a00640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97e0004800 0x7f97e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f8a00640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0b9c90 con 0x7f97e00052e0 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97e000c1b0 con 0x7f97e0004800 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f97e000c3b0 con 0x7f97e00039b0 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97fa800640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f9400640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97e0004800 0x7f97e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97fa800640 1 -- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97e00039b0 msgr2=0x7f97e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:03.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97fa800640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97e00039b0 0x7f97e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97fa800640 1 -- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97e0004800 msgr2=0x7f97e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:03.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97fa800640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97e0004800 0x7f97e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97fa800640 1 -- 172.21.15.22:0/2883254463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e0003520 con 0x7f97e00052e0 2024-04-16T16:21:03.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.090+0000 7f97f9400640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97e0004800 0x7f97e0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:03.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.091+0000 7f97fa800640 1 -- 172.21.15.22:0/2883254463 reap_dead start 2024-04-16T16:21:03.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.092+0000 7f97fa800640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97e000b9c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009a90 tx=0x7f97e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96da791767206d93 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:03.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.092+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4009690 con 0x7f97e00052e0 2024-04-16T16:21:03.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.092+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f4004020 con 0x7f97e00052e0 2024-04-16T16:21:03.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.092+0000 7f97f8a00640 1 -- 172.21.15.22:0/2883254463 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4004410 con 0x7f97e00052e0 2024-04-16T16:21:03.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.092+0000 7f97fb200640 1 -- 172.21.15.22:0/2883254463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 msgr2=0x7f97e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:03.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.092+0000 7f97fb200640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97e000b9c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009a90 tx=0x7f97e0005830 comp rx=0 tx=0).stop 2024-04-16T16:21:03.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.093+0000 7f97fb200640 1 -- 172.21.15.22:0/2883254463 shutdown_connections 2024-04-16T16:21:03.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.093+0000 7f97fb200640 1 --2- 172.21.15.22:0/2883254463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97e000b9c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.093+0000 7f97fb200640 1 -- 172.21.15.22:0/2883254463 >> 172.21.15.22:0/2883254463 conn(0x7f97fc072430 msgr2=0x7f97fc072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:03.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.093+0000 7f97fb200640 1 -- 172.21.15.22:0/2883254463 shutdown_connections 2024-04-16T16:21:03.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.093+0000 7f97fb200640 1 -- 172.21.15.22:0/2883254463 wait complete. 2024-04-16T16:21:03.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.094+0000 7f97fb200640 1 Processor -- start 2024-04-16T16:21:03.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.095+0000 7f97fb200640 1 -- start start 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.095+0000 7f97fb200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97fc0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97fb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97fc1f3c30 0x7f97fc1f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97fb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97fc1571f0 0x7f97fc157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97fb200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0cf630 con 0x7f97e00052e0 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97fb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc15ee30 con 0x7f97fc1f3c30 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97fb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc0cf7b0 con 0x7f97fc1571f0 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97fc0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97fc0cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49212/0 (socket says 172.21.15.22:49212) 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 -- 172.21.15.22:0/881575904 learned_addr learned my addr 172.21.15.22:0/881575904 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 -- 172.21.15.22:0/881575904 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97fc1571f0 msgr2=0x7f97fc157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97fc1571f0 0x7f97fc157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 -- 172.21.15.22:0/881575904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97fc1f3c30 msgr2=0x7f97fc1f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97fc1f3c30 0x7f97fc1f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.096+0000 7f97f9e00640 1 -- 172.21.15.22:0/881575904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc157f70 con 0x7f97e00052e0 2024-04-16T16:21:03.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.097+0000 7f97f9e00640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97fc0cbca0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00ca70 tx=0x7f97ec00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:03.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.097+0000 7f97f2000640 1 -- 172.21.15.22:0/881575904 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec018070 con 0x7f97e00052e0 2024-04-16T16:21:03.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.097+0000 7f97f2000640 1 -- 172.21.15.22:0/881575904 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec00a760 con 0x7f97e00052e0 2024-04-16T16:21:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.097+0000 7f97f2000640 1 -- 172.21.15.22:0/881575904 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00ab50 con 0x7f97e00052e0 2024-04-16T16:21:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.097+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc1f4630 con 0x7f97e00052e0 2024-04-16T16:21:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.097+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc0c9010 con 0x7f97e00052e0 2024-04-16T16:21:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.098+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc075f30 con 0x7f97e00052e0 2024-04-16T16:21:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.099+0000 7f97f2000640 1 -- 172.21.15.22:0/881575904 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f97ec01b070 con 0x7f97e00052e0 2024-04-16T16:21:03.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.101+0000 7f97f2000640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f97d806cec0 0x7f97d806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:03.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.101+0000 7f97f2000640 1 -- 172.21.15.22:0/881575904 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f97ec08be10 con 0x7f97e00052e0 2024-04-16T16:21:03.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.101+0000 7f97f9400640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f97d806cec0 0x7f97d806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:03.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.102+0000 7f97f9400640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f97d806cec0 0x7f97d806f380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97e4000f60 tx=0x7f97e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:03.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.105+0000 7f97f2000640 1 -- 172.21.15.22:0/881575904 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f97ec059990 con 0x7f97e00052e0 2024-04-16T16:21:03.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.299+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97fc062d70 con 0x7f97d806cec0 2024-04-16T16:21:03.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.319+0000 7f97f2000640 1 -- 172.21.15.22:0/881575904 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7f97fc062d70 con 0x7f97d806cec0 2024-04-16T16:21:03.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:03.323 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:03.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.323+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f97d806cec0 msgr2=0x7f97d806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:03.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.323+0000 7f97fb200640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f97d806cec0 0x7f97d806f380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97e4000f60 tx=0x7f97e4009040 comp rx=0 tx=0).stop 2024-04-16T16:21:03.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.323+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 msgr2=0x7f97fc0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:03.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.323+0000 7f97fb200640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97fc0cbca0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00ca70 tx=0x7f97ec00cf30 comp rx=0 tx=0).stop 2024-04-16T16:21:03.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 shutdown_connections 2024-04-16T16:21:03.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f97d806cec0 0x7f97d806f380 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97fc1571f0 0x7f97fc157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97fc1f3c30 0x7f97fc1f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 --2- 172.21.15.22:0/881575904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97e00052e0 0x7f97fc0cbca0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:03.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 >> 172.21.15.22:0/881575904 conn(0x7f97fc072430 msgr2=0x7f97fc072810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:03.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 shutdown_connections 2024-04-16T16:21:03.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:03.324+0000 7f97fb200640 1 -- 172.21.15.22:0/881575904 wait complete. 2024-04-16T16:21:03.341 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-04-16T16:21:01.792817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256512,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718208,"statfs":{"total":773094113280,"available":772831444992,"internally_reserved":0,"allocated":7217152,"data_stored":3697420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.124804"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373919+0000","last_change":"2024-04-16T16:20:56.700692+0000","last_active":"2024-04-16T16:20:58.373919+0000","last_peered":"2024-04-16T16:20:58.373919+0000","last_clean":"2024-04-16T16:20:58.373919+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:20:58.373919+0000","last_undegraded":"2024-04-16T16:20:58.373919+0000","last_fullsized":"2024-04-16T16:20:58.373919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:01.405645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375924+0000","last_change":"2024-04-16T16:20:56.704487+0000","last_active":"2024-04-16T16:20:58.375924+0000","last_peered":"2024-04-16T16:20:58.375924+0000","last_clean":"2024-04-16T16:20:58.375924+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:20:58.375924+0000","last_undegraded":"2024-04-16T16:20:58.375924+0000","last_fullsized":"2024-04-16T16:20:58.375924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:18.892594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374985+0000","last_change":"2024-04-16T16:20:56.710584+0000","last_active":"2024-04-16T16:20:58.374985+0000","last_peered":"2024-04-16T16:20:58.374985+0000","last_clean":"2024-04-16T16:20:58.374985+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:20:58.374985+0000","last_undegraded":"2024-04-16T16:20:58.374985+0000","last_fullsized":"2024-04-16T16:20:58.374985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708372+0000","last_change":"2024-04-16T16:20:56.694479+0000","last_active":"2024-04-16T16:20:57.708372+0000","last_peered":"2024-04-16T16:20:57.708372+0000","last_clean":"2024-04-16T16:20:57.708372+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:20:57.708372+0000","last_undegraded":"2024-04-16T16:20:57.708372+0000","last_fullsized":"2024-04-16T16:20:57.708372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373184+0000","last_change":"2024-04-16T16:20:56.687650+0000","last_active":"2024-04-16T16:20:58.373184+0000","last_peered":"2024-04-16T16:20:58.373184+0000","last_clean":"2024-04-16T16:20:58.373184+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:20:58.373184+0000","last_undegraded":"2024-04-16T16:20:58.373184+0000","last_fullsized":"2024-04-16T16:20:58.373184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:24.566878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374109+0000","last_change":"2024-04-16T16:20:56.696467+0000","last_active":"2024-04-16T16:20:58.374109+0000","last_peered":"2024-04-16T16:20:58.374109+0000","last_clean":"2024-04-16T16:20:58.374109+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:20:58.374109+0000","last_undegraded":"2024-04-16T16:20:58.374109+0000","last_fullsized":"2024-04-16T16:20:58.374109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372576+0000","last_change":"2024-04-16T16:20:56.711962+0000","last_active":"2024-04-16T16:20:58.372576+0000","last_peered":"2024-04-16T16:20:58.372576+0000","last_clean":"2024-04-16T16:20:58.372576+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:20:58.372576+0000","last_undegraded":"2024-04-16T16:20:58.372576+0000","last_fullsized":"2024-04-16T16:20:58.372576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:34.290551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.702421+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373554+0000","last_change":"2024-04-16T16:20:56.705792+0000","last_active":"2024-04-16T16:20:58.373554+0000","last_peered":"2024-04-16T16:20:58.373554+0000","last_clean":"2024-04-16T16:20:58.373554+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:20:58.373554+0000","last_undegraded":"2024-04-16T16:20:58.373554+0000","last_fullsized":"2024-04-16T16:20:58.373554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373773+0000","last_change":"2024-04-16T16:20:56.716792+0000","last_active":"2024-04-16T16:20:58.373773+0000","last_peered":"2024-04-16T16:20:58.373773+0000","last_clean":"2024-04-16T16:20:58.373773+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:20:58.373773+0000","last_undegraded":"2024-04-16T16:20:58.373773+0000","last_fullsized":"2024-04-16T16:20:58.373773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375444+0000","last_change":"2024-04-16T16:20:56.709293+0000","last_active":"2024-04-16T16:20:58.375444+0000","last_peered":"2024-04-16T16:20:58.375444+0000","last_clean":"2024-04-16T16:20:58.375444+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:20:58.375444+0000","last_undegraded":"2024-04-16T16:20:58.375444+0000","last_fullsized":"2024-04-16T16:20:58.375444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:47.440922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374963+0000","last_change":"2024-04-16T16:20:56.722078+0000","last_active":"2024-04-16T16:20:58.374963+0000","last_peered":"2024-04-16T16:20:58.374963+0000","last_clean":"2024-04-16T16:20:58.374963+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:20:58.374963+0000","last_undegraded":"2024-04-16T16:20:58.374963+0000","last_fullsized":"2024-04-16T16:20:58.374963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372189+0000","last_change":"2024-04-16T16:20:56.703752+0000","last_active":"2024-04-16T16:20:58.372189+0000","last_peered":"2024-04-16T16:20:58.372189+0000","last_clean":"2024-04-16T16:20:58.372189+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:20:58.372189+0000","last_undegraded":"2024-04-16T16:20:58.372189+0000","last_fullsized":"2024-04-16T16:20:58.372189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:32.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374871+0000","last_change":"2024-04-16T16:20:56.718849+0000","last_active":"2024-04-16T16:20:58.374871+0000","last_peered":"2024-04-16T16:20:58.374871+0000","last_clean":"2024-04-16T16:20:58.374871+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:20:58.374871+0000","last_undegraded":"2024-04-16T16:20:58.374871+0000","last_fullsized":"2024-04-16T16:20:58.374871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.829545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374676+0000","last_change":"2024-04-16T16:20:56.715256+0000","last_active":"2024-04-16T16:20:58.374676+0000","last_peered":"2024-04-16T16:20:58.374676+0000","last_clean":"2024-04-16T16:20:58.374676+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:20:58.374676+0000","last_undegraded":"2024-04-16T16:20:58.374676+0000","last_fullsized":"2024-04-16T16:20:58.374676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374265+0000","last_change":"2024-04-16T16:20:56.703517+0000","last_active":"2024-04-16T16:20:58.374265+0000","last_peered":"2024-04-16T16:20:58.374265+0000","last_clean":"2024-04-16T16:20:58.374265+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:20:58.374265+0000","last_undegraded":"2024-04-16T16:20:58.374265+0000","last_fullsized":"2024-04-16T16:20:58.374265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:28.081709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374176+0000","last_change":"2024-04-16T16:20:56.719987+0000","last_active":"2024-04-16T16:20:58.374176+0000","last_peered":"2024-04-16T16:20:58.374176+0000","last_clean":"2024-04-16T16:20:58.374176+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:20:58.374176+0000","last_undegraded":"2024-04-16T16:20:58.374176+0000","last_fullsized":"2024-04-16T16:20:58.374176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373168+0000","last_change":"2024-04-16T16:20:56.720302+0000","last_active":"2024-04-16T16:20:58.373168+0000","last_peered":"2024-04-16T16:20:58.373168+0000","last_clean":"2024-04-16T16:20:58.373168+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:20:58.373168+0000","last_undegraded":"2024-04-16T16:20:58.373168+0000","last_fullsized":"2024-04-16T16:20:58.373168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374304+0000","last_change":"2024-04-16T16:20:56.711031+0000","last_active":"2024-04-16T16:20:58.374304+0000","last_peered":"2024-04-16T16:20:58.374304+0000","last_clean":"2024-04-16T16:20:58.374304+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:20:58.374304+0000","last_undegraded":"2024-04-16T16:20:58.374304+0000","last_fullsized":"2024-04-16T16:20:58.374304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:24.434925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708201+0000","last_change":"2024-04-16T16:20:56.699535+0000","last_active":"2024-04-16T16:20:57.708201+0000","last_peered":"2024-04-16T16:20:57.708201+0000","last_clean":"2024-04-16T16:20:57.708201+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:20:57.708201+0000","last_undegraded":"2024-04-16T16:20:57.708201+0000","last_fullsized":"2024-04-16T16:20:57.708201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376001+0000","last_change":"2024-04-16T16:20:56.716226+0000","last_active":"2024-04-16T16:20:58.376001+0000","last_peered":"2024-04-16T16:20:58.376001+0000","last_clean":"2024-04-16T16:20:58.376001+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:20:58.376001+0000","last_undegraded":"2024-04-16T16:20:58.376001+0000","last_fullsized":"2024-04-16T16:20:58.376001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373175+0000","last_change":"2024-04-16T16:20:56.690730+0000","last_active":"2024-04-16T16:20:58.373175+0000","last_peered":"2024-04-16T16:20:58.373175+0000","last_clean":"2024-04-16T16:20:58.373175+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:20:58.373175+0000","last_undegraded":"2024-04-16T16:20:58.373175+0000","last_fullsized":"2024-04-16T16:20:58.373175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:22.566150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374342+0000","last_change":"2024-04-16T16:20:56.708786+0000","last_active":"2024-04-16T16:20:58.374342+0000","last_peered":"2024-04-16T16:20:58.374342+0000","last_clean":"2024-04-16T16:20:58.374342+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:20:58.374342+0000","last_undegraded":"2024-04-16T16:20:58.374342+0000","last_fullsized":"2024-04-16T16:20:58.374342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:51.397773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374485+0000","last_change":"2024-04-16T16:20:56.720038+0000","last_active":"2024-04-16T16:20:58.374485+0000","last_peered":"2024-04-16T16:20:58.374485+0000","last_clean":"2024-04-16T16:20:58.374485+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:20:58.374485+0000","last_undegraded":"2024-04-16T16:20:58.374485+0000","last_fullsized":"2024-04-16T16:20:58.374485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.371823+0000","last_change":"2024-04-16T16:20:56.706135+0000","last_active":"2024-04-16T16:20:58.371823+0000","last_peered":"2024-04-16T16:20:58.371823+0000","last_clean":"2024-04-16T16:20:58.371823+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:20:58.371823+0000","last_undegraded":"2024-04-16T16:20:58.371823+0000","last_fullsized":"2024-04-16T16:20:58.371823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:10:18.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374185+0000","last_change":"2024-04-16T16:20:56.707138+0000","last_active":"2024-04-16T16:20:58.374185+0000","last_peered":"2024-04-16T16:20:58.374185+0000","last_clean":"2024-04-16T16:20:58.374185+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:20:58.374185+0000","last_undegraded":"2024-04-16T16:20:58.374185+0000","last_fullsized":"2024-04-16T16:20:58.374185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376195+0000","last_change":"2024-04-16T16:20:56.714674+0000","last_active":"2024-04-16T16:20:58.376195+0000","last_peered":"2024-04-16T16:20:58.376195+0000","last_clean":"2024-04-16T16:20:58.376195+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:20:58.376195+0000","last_undegraded":"2024-04-16T16:20:58.376195+0000","last_fullsized":"2024-04-16T16:20:58.376195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:47.291306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375823+0000","last_change":"2024-04-16T16:20:55.704083+0000","last_active":"2024-04-16T16:20:58.375823+0000","last_peered":"2024-04-16T16:20:58.375823+0000","last_clean":"2024-04-16T16:20:58.375823+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:20:58.375823+0000","last_undegraded":"2024-04-16T16:20:58.375823+0000","last_fullsized":"2024-04-16T16:20:58.375823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:34.565386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375090+0000","last_change":"2024-04-16T16:20:55.700645+0000","last_active":"2024-04-16T16:20:58.375090+0000","last_peered":"2024-04-16T16:20:58.375090+0000","last_clean":"2024-04-16T16:20:58.375090+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:20:58.375090+0000","last_undegraded":"2024-04-16T16:20:58.375090+0000","last_fullsized":"2024-04-16T16:20:58.375090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:56.588790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376827+0000","last_change":"2024-04-16T16:20:56.717040+0000","last_active":"2024-04-16T16:20:58.376827+0000","last_peered":"2024-04-16T16:20:58.376827+0000","last_clean":"2024-04-16T16:20:58.376827+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:20:58.376827+0000","last_undegraded":"2024-04-16T16:20:58.376827+0000","last_fullsized":"2024-04-16T16:20:58.376827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:57.603218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.698501+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:40.710552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376219+0000","last_change":"2024-04-16T16:20:56.708709+0000","last_active":"2024-04-16T16:20:58.376219+0000","last_peered":"2024-04-16T16:20:58.376219+0000","last_clean":"2024-04-16T16:20:58.376219+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:20:58.376219+0000","last_undegraded":"2024-04-16T16:20:58.376219+0000","last_fullsized":"2024-04-16T16:20:58.376219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:35.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707688+0000","last_change":"2024-04-16T16:20:55.703384+0000","last_active":"2024-04-16T16:20:57.707688+0000","last_peered":"2024-04-16T16:20:57.707688+0000","last_clean":"2024-04-16T16:20:57.707688+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:20:57.707688+0000","last_undegraded":"2024-04-16T16:20:57.707688+0000","last_fullsized":"2024-04-16T16:20:57.707688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373769+0000","last_change":"2024-04-16T16:20:56.703273+0000","last_active":"2024-04-16T16:20:58.373769+0000","last_peered":"2024-04-16T16:20:58.373769+0000","last_clean":"2024-04-16T16:20:58.373769+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:20:58.373769+0000","last_undegraded":"2024-04-16T16:20:58.373769+0000","last_fullsized":"2024-04-16T16:20:58.373769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:37.220892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373915+0000","last_change":"2024-04-16T16:20:56.706317+0000","last_active":"2024-04-16T16:20:58.373915+0000","last_peered":"2024-04-16T16:20:58.373915+0000","last_clean":"2024-04-16T16:20:58.373915+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:20:58.373915+0000","last_undegraded":"2024-04-16T16:20:58.373915+0000","last_fullsized":"2024-04-16T16:20:58.373915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:18.555574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374892+0000","last_change":"2024-04-16T16:20:55.703837+0000","last_active":"2024-04-16T16:20:58.374892+0000","last_peered":"2024-04-16T16:20:58.374892+0000","last_clean":"2024-04-16T16:20:58.374892+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:20:58.374892+0000","last_undegraded":"2024-04-16T16:20:58.374892+0000","last_fullsized":"2024-04-16T16:20:58.374892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:13.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372897+0000","last_change":"2024-04-16T16:20:56.716680+0000","last_active":"2024-04-16T16:20:58.372897+0000","last_peered":"2024-04-16T16:20:58.372897+0000","last_clean":"2024-04-16T16:20:58.372897+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:20:58.372897+0000","last_undegraded":"2024-04-16T16:20:58.372897+0000","last_fullsized":"2024-04-16T16:20:58.372897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705691+0000","last_change":"2024-04-16T16:20:55.699938+0000","last_active":"2024-04-16T16:20:57.705691+0000","last_peered":"2024-04-16T16:20:57.705691+0000","last_clean":"2024-04-16T16:20:57.705691+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:20:57.705691+0000","last_undegraded":"2024-04-16T16:20:57.705691+0000","last_fullsized":"2024-04-16T16:20:57.705691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373328+0000","last_change":"2024-04-16T16:20:56.709848+0000","last_active":"2024-04-16T16:20:58.373328+0000","last_peered":"2024-04-16T16:20:58.373328+0000","last_clean":"2024-04-16T16:20:58.373328+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:20:58.373328+0000","last_undegraded":"2024-04-16T16:20:58.373328+0000","last_fullsized":"2024-04-16T16:20:58.373328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:46.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375190+0000","last_change":"2024-04-16T16:20:55.703623+0000","last_active":"2024-04-16T16:20:58.375190+0000","last_peered":"2024-04-16T16:20:58.375190+0000","last_clean":"2024-04-16T16:20:58.375190+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:20:58.375190+0000","last_undegraded":"2024-04-16T16:20:58.375190+0000","last_fullsized":"2024-04-16T16:20:58.375190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374994+0000","last_change":"2024-04-16T16:20:56.723400+0000","last_active":"2024-04-16T16:20:58.374994+0000","last_peered":"2024-04-16T16:20:58.374994+0000","last_clean":"2024-04-16T16:20:58.374994+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:20:58.374994+0000","last_undegraded":"2024-04-16T16:20:58.374994+0000","last_fullsized":"2024-04-16T16:20:58.374994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375368+0000","last_change":"2024-04-16T16:20:55.694413+0000","last_active":"2024-04-16T16:20:58.375368+0000","last_peered":"2024-04-16T16:20:58.375368+0000","last_clean":"2024-04-16T16:20:58.375368+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:20:58.375368+0000","last_undegraded":"2024-04-16T16:20:58.375368+0000","last_fullsized":"2024-04-16T16:20:58.375368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:21.591232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375589+0000","last_change":"2024-04-16T16:20:55.702261+0000","last_active":"2024-04-16T16:20:58.375589+0000","last_peered":"2024-04-16T16:20:58.375589+0000","last_clean":"2024-04-16T16:20:58.375589+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:20:58.375589+0000","last_undegraded":"2024-04-16T16:20:58.375589+0000","last_fullsized":"2024-04-16T16:20:58.375589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375450+0000","last_change":"2024-04-16T16:20:56.712767+0000","last_active":"2024-04-16T16:20:58.375450+0000","last_peered":"2024-04-16T16:20:58.375450+0000","last_clean":"2024-04-16T16:20:58.375450+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:20:58.375450+0000","last_undegraded":"2024-04-16T16:20:58.375450+0000","last_fullsized":"2024-04-16T16:20:58.375450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706177+0000","last_change":"2024-04-16T16:20:56.704028+0000","last_active":"2024-04-16T16:20:57.706177+0000","last_peered":"2024-04-16T16:20:57.706177+0000","last_clean":"2024-04-16T16:20:57.706177+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:20:57.706177+0000","last_undegraded":"2024-04-16T16:20:57.706177+0000","last_fullsized":"2024-04-16T16:20:57.706177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373761+0000","last_change":"2024-04-16T16:20:55.691499+0000","last_active":"2024-04-16T16:20:58.373761+0000","last_peered":"2024-04-16T16:20:58.373761+0000","last_clean":"2024-04-16T16:20:58.373761+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:20:58.373761+0000","last_undegraded":"2024-04-16T16:20:58.373761+0000","last_fullsized":"2024-04-16T16:20:58.373761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:46.276878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374544+0000","last_change":"2024-04-16T16:20:56.718537+0000","last_active":"2024-04-16T16:20:58.374544+0000","last_peered":"2024-04-16T16:20:58.374544+0000","last_clean":"2024-04-16T16:20:58.374544+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:20:58.374544+0000","last_undegraded":"2024-04-16T16:20:58.374544+0000","last_fullsized":"2024-04-16T16:20:58.374544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372802+0000","last_change":"2024-04-16T16:20:55.700778+0000","last_active":"2024-04-16T16:20:58.372802+0000","last_peered":"2024-04-16T16:20:58.372802+0000","last_clean":"2024-04-16T16:20:58.372802+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:20:58.372802+0000","last_undegraded":"2024-04-16T16:20:58.372802+0000","last_fullsized":"2024-04-16T16:20:58.372802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:21.223928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705837+0000","last_change":"2024-04-16T16:20:55.700889+0000","last_active":"2024-04-16T16:20:57.705837+0000","last_peered":"2024-04-16T16:20:57.705837+0000","last_clean":"2024-04-16T16:20:57.705837+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:20:57.705837+0000","last_undegraded":"2024-04-16T16:20:57.705837+0000","last_fullsized":"2024-04-16T16:20:57.705837+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374373+0000","last_change":"2024-04-16T16:20:56.720365+0000","last_active":"2024-04-16T16:20:58.374373+0000","last_peered":"2024-04-16T16:20:58.374373+0000","last_clean":"2024-04-16T16:20:58.374373+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:20:58.374373+0000","last_undegraded":"2024-04-16T16:20:58.374373+0000","last_fullsized":"2024-04-16T16:20:58.374373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373392+0000","last_change":"2024-04-16T16:20:55.705450+0000","last_active":"2024-04-16T16:20:58.373392+0000","last_peered":"2024-04-16T16:20:58.373392+0000","last_clean":"2024-04-16T16:20:58.373392+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:20:58.373392+0000","last_undegraded":"2024-04-16T16:20:58.373392+0000","last_fullsized":"2024-04-16T16:20:58.373392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375228+0000","last_change":"2024-04-16T16:20:56.721758+0000","last_active":"2024-04-16T16:20:58.375228+0000","last_peered":"2024-04-16T16:20:58.375228+0000","last_clean":"2024-04-16T16:20:58.375228+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:20:58.375228+0000","last_undegraded":"2024-04-16T16:20:58.375228+0000","last_fullsized":"2024-04-16T16:20:58.375228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375245+0000","last_change":"2024-04-16T16:20:55.691154+0000","last_active":"2024-04-16T16:20:58.375245+0000","last_peered":"2024-04-16T16:20:58.375245+0000","last_clean":"2024-04-16T16:20:58.375245+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:20:58.375245+0000","last_undegraded":"2024-04-16T16:20:58.375245+0000","last_fullsized":"2024-04-16T16:20:58.375245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:48.698225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708411+0000","last_change":"2024-04-16T16:20:56.708684+0000","last_active":"2024-04-16T16:20:57.708411+0000","last_peered":"2024-04-16T16:20:57.708411+0000","last_clean":"2024-04-16T16:20:57.708411+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:20:57.708411+0000","last_undegraded":"2024-04-16T16:20:57.708411+0000","last_fullsized":"2024-04-16T16:20:57.708411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.699664+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375214+0000","last_change":"2024-04-16T16:20:56.712157+0000","last_active":"2024-04-16T16:20:58.375214+0000","last_peered":"2024-04-16T16:20:58.375214+0000","last_clean":"2024-04-16T16:20:58.375214+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:20:58.375214+0000","last_undegraded":"2024-04-16T16:20:58.375214+0000","last_fullsized":"2024-04-16T16:20:58.375214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707746+0000","last_change":"2024-04-16T16:20:55.702354+0000","last_active":"2024-04-16T16:20:57.707746+0000","last_peered":"2024-04-16T16:20:57.707746+0000","last_clean":"2024-04-16T16:20:57.707746+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:20:57.707746+0000","last_undegraded":"2024-04-16T16:20:57.707746+0000","last_fullsized":"2024-04-16T16:20:57.707746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:50.973007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375511+0000","last_change":"2024-04-16T16:20:56.712536+0000","last_active":"2024-04-16T16:20:58.375511+0000","last_peered":"2024-04-16T16:20:58.375511+0000","last_clean":"2024-04-16T16:20:58.375511+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:20:58.375511+0000","last_undegraded":"2024-04-16T16:20:58.375511+0000","last_fullsized":"2024-04-16T16:20:58.375511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375548+0000","last_change":"2024-04-16T16:20:55.697400+0000","last_active":"2024-04-16T16:20:58.375548+0000","last_peered":"2024-04-16T16:20:58.375548+0000","last_clean":"2024-04-16T16:20:58.375548+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:20:58.375548+0000","last_undegraded":"2024-04-16T16:20:58.375548+0000","last_fullsized":"2024-04-16T16:20:58.375548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:32.224244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706503+0000","last_change":"2024-04-16T16:20:56.705284+0000","last_active":"2024-04-16T16:20:57.706503+0000","last_peered":"2024-04-16T16:20:57.706503+0000","last_clean":"2024-04-16T16:20:57.706503+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:20:57.706503+0000","last_undegraded":"2024-04-16T16:20:57.706503+0000","last_fullsized":"2024-04-16T16:20:57.706503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374874+0000","last_change":"2024-04-16T16:20:55.691520+0000","last_active":"2024-04-16T16:20:58.374874+0000","last_peered":"2024-04-16T16:20:58.374874+0000","last_clean":"2024-04-16T16:20:58.374874+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:20:58.374874+0000","last_undegraded":"2024-04-16T16:20:58.374874+0000","last_fullsized":"2024-04-16T16:20:58.374874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:34.964542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376142+0000","last_change":"2024-04-16T16:20:56.714025+0000","last_active":"2024-04-16T16:20:58.376142+0000","last_peered":"2024-04-16T16:20:58.376142+0000","last_clean":"2024-04-16T16:20:58.376142+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:20:58.376142+0000","last_undegraded":"2024-04-16T16:20:58.376142+0000","last_fullsized":"2024-04-16T16:20:58.376142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374747+0000","last_change":"2024-04-16T16:20:56.715573+0000","last_active":"2024-04-16T16:20:58.374747+0000","last_peered":"2024-04-16T16:20:58.374747+0000","last_clean":"2024-04-16T16:20:58.374747+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:20:58.374747+0000","last_undegraded":"2024-04-16T16:20:58.374747+0000","last_fullsized":"2024-04-16T16:20:58.374747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705507+0000","last_change":"2024-04-16T16:20:55.700653+0000","last_active":"2024-04-16T16:20:57.705507+0000","last_peered":"2024-04-16T16:20:57.705507+0000","last_clean":"2024-04-16T16:20:57.705507+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:20:57.705507+0000","last_undegraded":"2024-04-16T16:20:57.705507+0000","last_fullsized":"2024-04-16T16:20:57.705507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:30.271546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708260+0000","last_change":"2024-04-16T16:20:56.691557+0000","last_active":"2024-04-16T16:20:57.708260+0000","last_peered":"2024-04-16T16:20:57.708260+0000","last_clean":"2024-04-16T16:20:57.708260+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:20:57.708260+0000","last_undegraded":"2024-04-16T16:20:57.708260+0000","last_fullsized":"2024-04-16T16:20:57.708260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708599+0000","last_change":"2024-04-16T16:20:56.714215+0000","last_active":"2024-04-16T16:20:57.708599+0000","last_peered":"2024-04-16T16:20:57.708599+0000","last_clean":"2024-04-16T16:20:57.708599+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:20:57.708599+0000","last_undegraded":"2024-04-16T16:20:57.708599+0000","last_fullsized":"2024-04-16T16:20:57.708599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376396+0000","last_change":"2024-04-16T16:20:55.704363+0000","last_active":"2024-04-16T16:20:58.376396+0000","last_peered":"2024-04-16T16:20:58.376396+0000","last_clean":"2024-04-16T16:20:58.376396+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:20:58.376396+0000","last_undegraded":"2024-04-16T16:20:58.376396+0000","last_fullsized":"2024-04-16T16:20:58.376396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372943+0000","last_change":"2024-04-16T16:20:55.703477+0000","last_active":"2024-04-16T16:20:58.372943+0000","last_peered":"2024-04-16T16:20:58.372943+0000","last_clean":"2024-04-16T16:20:58.372943+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:20:58.372943+0000","last_undegraded":"2024-04-16T16:20:58.372943+0000","last_fullsized":"2024-04-16T16:20:58.372943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:15.228538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376581+0000","last_change":"2024-04-16T16:20:56.707864+0000","last_active":"2024-04-16T16:20:58.376581+0000","last_peered":"2024-04-16T16:20:58.376581+0000","last_clean":"2024-04-16T16:20:58.376581+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:20:58.376581+0000","last_undegraded":"2024-04-16T16:20:58.376581+0000","last_fullsized":"2024-04-16T16:20:58.376581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:21.749618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707985+0000","last_change":"2024-04-16T16:20:55.701244+0000","last_active":"2024-04-16T16:20:57.707985+0000","last_peered":"2024-04-16T16:20:57.707985+0000","last_clean":"2024-04-16T16:20:57.707985+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:20:57.707985+0000","last_undegraded":"2024-04-16T16:20:57.707985+0000","last_fullsized":"2024-04-16T16:20:57.707985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374179+0000","last_change":"2024-04-16T16:20:56.707897+0000","last_active":"2024-04-16T16:20:58.374179+0000","last_peered":"2024-04-16T16:20:58.374179+0000","last_clean":"2024-04-16T16:20:58.374179+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:20:58.374179+0000","last_undegraded":"2024-04-16T16:20:58.374179+0000","last_fullsized":"2024-04-16T16:20:58.374179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:42.907490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374977+0000","last_change":"2024-04-16T16:20:56.720972+0000","last_active":"2024-04-16T16:20:58.374977+0000","last_peered":"2024-04-16T16:20:58.374977+0000","last_clean":"2024-04-16T16:20:58.374977+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:20:58.374977+0000","last_undegraded":"2024-04-16T16:20:58.374977+0000","last_fullsized":"2024-04-16T16:20:58.374977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373562+0000","last_change":"2024-04-16T16:20:56.708340+0000","last_active":"2024-04-16T16:20:58.373562+0000","last_peered":"2024-04-16T16:20:58.373562+0000","last_clean":"2024-04-16T16:20:58.373562+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:20:58.373562+0000","last_undegraded":"2024-04-16T16:20:58.373562+0000","last_fullsized":"2024-04-16T16:20:58.373562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:07.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372721+0000","last_change":"2024-04-16T16:20:55.692470+0000","last_active":"2024-04-16T16:20:58.372721+0000","last_peered":"2024-04-16T16:20:58.372721+0000","last_clean":"2024-04-16T16:20:58.372721+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:20:58.372721+0000","last_undegraded":"2024-04-16T16:20:58.372721+0000","last_fullsized":"2024-04-16T16:20:58.372721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:20.735190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372709+0000","last_change":"2024-04-16T16:20:56.720232+0000","last_active":"2024-04-16T16:20:58.372709+0000","last_peered":"2024-04-16T16:20:58.372709+0000","last_clean":"2024-04-16T16:20:58.372709+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:20:58.372709+0000","last_undegraded":"2024-04-16T16:20:58.372709+0000","last_fullsized":"2024-04-16T16:20:58.372709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:34.266414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372516+0000","last_change":"2024-04-16T16:20:55.702982+0000","last_active":"2024-04-16T16:20:58.372516+0000","last_peered":"2024-04-16T16:20:58.372516+0000","last_clean":"2024-04-16T16:20:58.372516+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:20:58.372516+0000","last_undegraded":"2024-04-16T16:20:58.372516+0000","last_fullsized":"2024-04-16T16:20:58.372516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:05.020022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373594+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:58.373594+0000","last_peered":"2024-04-16T16:20:58.373594+0000","last_clean":"2024-04-16T16:20:58.373594+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:58.373594+0000","last_undegraded":"2024-04-16T16:20:58.373594+0000","last_fullsized":"2024-04-16T16:20:58.373594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":904511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":313983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":753664,"data_stored":314635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":906545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:04.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-16T16:21:06.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.578+0000 7f7a78e00640 1 Processor -- start 2024-04-16T16:21:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.578+0000 7f7a78e00640 1 -- start start 2024-04-16T16:21:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.580+0000 7f7a78e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a740d0bb0 0x7f7a740cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.580+0000 7f7a78e00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a740ceb90 con 0x7f7a740ce4d0 2024-04-16T16:21:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.580+0000 7f7a78e00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a740cee70 con 0x7f7a7415c860 2024-04-16T16:21:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.580+0000 7f7a78e00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7a740ce960 con 0x7f7a740d0bb0 2024-04-16T16:21:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.580+0000 7f7a6aa00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7a740ce4d0 0x7f7a740d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33118/0 (socket says 172.21.15.22:33118) 2024-04-16T16:21:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.580+0000 7f7a6aa00640 1 -- 172.21.15.22:0/3625938952 learned_addr learned my addr 172.21.15.22:0/3625938952 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.580+0000 7f7a73e00640 1 --2- 172.21.15.22:0/3625938952 >> v2:172.21.15.22:3300/0 conn(0x7f7a740d0bb0 0x7f7a740cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.581+0000 7f7a73e00640 1 -- 172.21.15.22:0/3625938952 >> v1:172.21.15.43:6789/0 conn(0x7f7a7415c860 legacy=0x7f7a740b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.581+0000 7f7a72a00640 1 -- 172.21.15.22:0/3625938952 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393722909 0 0) 0x7f7a740ceb90 con 0x7f7a740ce4d0 2024-04-16T16:21:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.581+0000 7f7a73e00640 1 -- 172.21.15.22:0/3625938952 >> v1:172.21.15.22:6789/0 conn(0x7f7a740ce4d0 legacy=0x7f7a740d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.581+0000 7f7a73e00640 1 -- 172.21.15.22:0/3625938952 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a740cf150 con 0x7f7a740d0bb0 2024-04-16T16:21:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.582+0000 7f7a73e00640 1 --2- 172.21.15.22:0/3625938952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a740cfc30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0097a0 tx=0x7f7a6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d395e081db38d51a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.582+0000 7f7a72a00640 1 -- 172.21.15.22:0/3625938952 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c035020 con 0x7f7a740d0bb0 2024-04-16T16:21:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.582+0000 7f7a72a00640 1 -- 172.21.15.22:0/3625938952 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c031830 con 0x7f7a740d0bb0 2024-04-16T16:21:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.582+0000 7f7a72a00640 1 -- 172.21.15.22:0/3625938952 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c031c00 con 0x7f7a740d0bb0 2024-04-16T16:21:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.583+0000 7f7a78e00640 1 -- 172.21.15.22:0/3625938952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 msgr2=0x7f7a740cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.583+0000 7f7a78e00640 1 --2- 172.21.15.22:0/3625938952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a740cfc30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0097a0 tx=0x7f7a6c02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.583+0000 7f7a78e00640 1 -- 172.21.15.22:0/3625938952 shutdown_connections 2024-04-16T16:21:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.583+0000 7f7a78e00640 1 --2- 172.21.15.22:0/3625938952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a740cfc30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.583+0000 7f7a78e00640 1 -- 172.21.15.22:0/3625938952 >> 172.21.15.22:0/3625938952 conn(0x7f7a74062440 msgr2=0x7f7a74062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.583+0000 7f7a78e00640 1 -- 172.21.15.22:0/3625938952 shutdown_connections 2024-04-16T16:21:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.583+0000 7f7a78e00640 1 -- 172.21.15.22:0/3625938952 wait complete. 2024-04-16T16:21:06.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.585+0000 7f7a78e00640 1 Processor -- start 2024-04-16T16:21:06.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.585+0000 7f7a78e00640 1 -- start start 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a78e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a740ce4d0 0x7f7a74157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a78e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a74145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a78e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a7415c860 0x7f7a74145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a78e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7415cc40 con 0x7f7a740d0bb0 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a78e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7a740cf710 con 0x7f7a740ce4d0 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a78e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7406cf40 con 0x7f7a7415c860 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a6aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a74145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a6aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a74145a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49230/0 (socket says 172.21.15.22:49230) 2024-04-16T16:21:06.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.586+0000 7f7a6aa00640 1 -- 172.21.15.22:0/1613621986 learned_addr learned my addr 172.21.15.22:0/1613621986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:06.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a73400640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a740ce4d0 0x7f7a74157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:06.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a73e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a7415c860 0x7f7a74145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:06.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a6aa00640 1 -- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a7415c860 msgr2=0x7f7a74145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:06.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a6aa00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a7415c860 0x7f7a74145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a6aa00640 1 -- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a740ce4d0 msgr2=0x7f7a74157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:06.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a6aa00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a740ce4d0 0x7f7a74157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a6aa00640 1 -- 172.21.15.22:0/1613621986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a74151d40 con 0x7f7a740d0bb0 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a73e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a7415c860 0x7f7a74145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.587+0000 7f7a6aa00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a74145a60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c500 tx=0x7f7a5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.588+0000 7f7a6be00640 1 -- 172.21.15.22:0/1613621986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c007480 con 0x7f7a740d0bb0 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.588+0000 7f7a6be00640 1 -- 172.21.15.22:0/1613621986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c0057a0 con 0x7f7a740d0bb0 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.588+0000 7f7a6be00640 1 -- 172.21.15.22:0/1613621986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c007620 con 0x7f7a740d0bb0 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.588+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a74152020 con 0x7f7a740d0bb0 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.588+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a741525e0 con 0x7f7a740d0bb0 2024-04-16T16:21:06.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.589+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a74075f30 con 0x7f7a740d0bb0 2024-04-16T16:21:06.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.590+0000 7f7a6be00640 1 -- 172.21.15.22:0/1613621986 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f7a5c005b50 con 0x7f7a740d0bb0 2024-04-16T16:21:06.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.591+0000 7f7a6be00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7a5006ce90 0x7f7a5006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:06.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.591+0000 7f7a6be00640 1 -- 172.21.15.22:0/1613621986 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f7a5c08c2d0 con 0x7f7a740d0bb0 2024-04-16T16:21:06.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.592+0000 7f7a73400640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7a5006ce90 0x7f7a5006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:06.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.592+0000 7f7a73400640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7a5006ce90 0x7f7a5006f350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009f20 tx=0x7f7a640094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:06.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.596+0000 7f7a6be00640 1 -- 172.21.15.22:0/1613621986 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a5c0182b0 con 0x7f7a740d0bb0 2024-04-16T16:21:06.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.797+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a740b4b50 con 0x7f7a5006ce90 2024-04-16T16:21:06.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.815+0000 7f7a6be00640 1 -- 172.21.15.22:0/1613621986 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251842 (secure 0 0 0) 0x7f7a740b4b50 con 0x7f7a5006ce90 2024-04-16T16:21:06.819 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:06.820 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7a5006ce90 msgr2=0x7f7a5006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7a5006ce90 0x7f7a5006f350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009f20 tx=0x7f7a640094d0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 msgr2=0x7f7a74145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a74145a60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c500 tx=0x7f7a5c00c9c0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 shutdown_connections 2024-04-16T16:21:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f7a5006ce90 0x7f7a5006f350 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a7415c860 0x7f7a74145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a740d0bb0 0x7f7a74145a60 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 --2- 172.21.15.22:0/1613621986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a740ce4d0 0x7f7a74157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 >> 172.21.15.22:0/1613621986 conn(0x7f7a74062440 msgr2=0x7f7a74072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 shutdown_connections 2024-04-16T16:21:06.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:06.821+0000 7f7a78e00640 1 -- 172.21.15.22:0/1613621986 wait complete. 2024-04-16T16:21:06.840 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-16T16:21:05.794400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256512,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718208,"statfs":{"total":773094113280,"available":772831444992,"internally_reserved":0,"allocated":7217152,"data_stored":3697420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.121294"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373919+0000","last_change":"2024-04-16T16:20:56.700692+0000","last_active":"2024-04-16T16:20:58.373919+0000","last_peered":"2024-04-16T16:20:58.373919+0000","last_clean":"2024-04-16T16:20:58.373919+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:20:58.373919+0000","last_undegraded":"2024-04-16T16:20:58.373919+0000","last_fullsized":"2024-04-16T16:20:58.373919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:01.405645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375924+0000","last_change":"2024-04-16T16:20:56.704487+0000","last_active":"2024-04-16T16:20:58.375924+0000","last_peered":"2024-04-16T16:20:58.375924+0000","last_clean":"2024-04-16T16:20:58.375924+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:20:58.375924+0000","last_undegraded":"2024-04-16T16:20:58.375924+0000","last_fullsized":"2024-04-16T16:20:58.375924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:18.892594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374985+0000","last_change":"2024-04-16T16:20:56.710584+0000","last_active":"2024-04-16T16:20:58.374985+0000","last_peered":"2024-04-16T16:20:58.374985+0000","last_clean":"2024-04-16T16:20:58.374985+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:20:58.374985+0000","last_undegraded":"2024-04-16T16:20:58.374985+0000","last_fullsized":"2024-04-16T16:20:58.374985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708372+0000","last_change":"2024-04-16T16:20:56.694479+0000","last_active":"2024-04-16T16:20:57.708372+0000","last_peered":"2024-04-16T16:20:57.708372+0000","last_clean":"2024-04-16T16:20:57.708372+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:20:57.708372+0000","last_undegraded":"2024-04-16T16:20:57.708372+0000","last_fullsized":"2024-04-16T16:20:57.708372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373184+0000","last_change":"2024-04-16T16:20:56.687650+0000","last_active":"2024-04-16T16:20:58.373184+0000","last_peered":"2024-04-16T16:20:58.373184+0000","last_clean":"2024-04-16T16:20:58.373184+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:20:58.373184+0000","last_undegraded":"2024-04-16T16:20:58.373184+0000","last_fullsized":"2024-04-16T16:20:58.373184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:24.566878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374109+0000","last_change":"2024-04-16T16:20:56.696467+0000","last_active":"2024-04-16T16:20:58.374109+0000","last_peered":"2024-04-16T16:20:58.374109+0000","last_clean":"2024-04-16T16:20:58.374109+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:20:58.374109+0000","last_undegraded":"2024-04-16T16:20:58.374109+0000","last_fullsized":"2024-04-16T16:20:58.374109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372576+0000","last_change":"2024-04-16T16:20:56.711962+0000","last_active":"2024-04-16T16:20:58.372576+0000","last_peered":"2024-04-16T16:20:58.372576+0000","last_clean":"2024-04-16T16:20:58.372576+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:20:58.372576+0000","last_undegraded":"2024-04-16T16:20:58.372576+0000","last_fullsized":"2024-04-16T16:20:58.372576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:34.290551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.702421+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373554+0000","last_change":"2024-04-16T16:20:56.705792+0000","last_active":"2024-04-16T16:20:58.373554+0000","last_peered":"2024-04-16T16:20:58.373554+0000","last_clean":"2024-04-16T16:20:58.373554+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:20:58.373554+0000","last_undegraded":"2024-04-16T16:20:58.373554+0000","last_fullsized":"2024-04-16T16:20:58.373554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373773+0000","last_change":"2024-04-16T16:20:56.716792+0000","last_active":"2024-04-16T16:20:58.373773+0000","last_peered":"2024-04-16T16:20:58.373773+0000","last_clean":"2024-04-16T16:20:58.373773+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:20:58.373773+0000","last_undegraded":"2024-04-16T16:20:58.373773+0000","last_fullsized":"2024-04-16T16:20:58.373773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375444+0000","last_change":"2024-04-16T16:20:56.709293+0000","last_active":"2024-04-16T16:20:58.375444+0000","last_peered":"2024-04-16T16:20:58.375444+0000","last_clean":"2024-04-16T16:20:58.375444+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:20:58.375444+0000","last_undegraded":"2024-04-16T16:20:58.375444+0000","last_fullsized":"2024-04-16T16:20:58.375444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:47.440922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374963+0000","last_change":"2024-04-16T16:20:56.722078+0000","last_active":"2024-04-16T16:20:58.374963+0000","last_peered":"2024-04-16T16:20:58.374963+0000","last_clean":"2024-04-16T16:20:58.374963+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:20:58.374963+0000","last_undegraded":"2024-04-16T16:20:58.374963+0000","last_fullsized":"2024-04-16T16:20:58.374963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372189+0000","last_change":"2024-04-16T16:20:56.703752+0000","last_active":"2024-04-16T16:20:58.372189+0000","last_peered":"2024-04-16T16:20:58.372189+0000","last_clean":"2024-04-16T16:20:58.372189+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:20:58.372189+0000","last_undegraded":"2024-04-16T16:20:58.372189+0000","last_fullsized":"2024-04-16T16:20:58.372189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:32.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374871+0000","last_change":"2024-04-16T16:20:56.718849+0000","last_active":"2024-04-16T16:20:58.374871+0000","last_peered":"2024-04-16T16:20:58.374871+0000","last_clean":"2024-04-16T16:20:58.374871+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:20:58.374871+0000","last_undegraded":"2024-04-16T16:20:58.374871+0000","last_fullsized":"2024-04-16T16:20:58.374871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.829545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374676+0000","last_change":"2024-04-16T16:20:56.715256+0000","last_active":"2024-04-16T16:20:58.374676+0000","last_peered":"2024-04-16T16:20:58.374676+0000","last_clean":"2024-04-16T16:20:58.374676+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:20:58.374676+0000","last_undegraded":"2024-04-16T16:20:58.374676+0000","last_fullsized":"2024-04-16T16:20:58.374676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374265+0000","last_change":"2024-04-16T16:20:56.703517+0000","last_active":"2024-04-16T16:20:58.374265+0000","last_peered":"2024-04-16T16:20:58.374265+0000","last_clean":"2024-04-16T16:20:58.374265+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:20:58.374265+0000","last_undegraded":"2024-04-16T16:20:58.374265+0000","last_fullsized":"2024-04-16T16:20:58.374265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:28.081709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374176+0000","last_change":"2024-04-16T16:20:56.719987+0000","last_active":"2024-04-16T16:20:58.374176+0000","last_peered":"2024-04-16T16:20:58.374176+0000","last_clean":"2024-04-16T16:20:58.374176+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:20:58.374176+0000","last_undegraded":"2024-04-16T16:20:58.374176+0000","last_fullsized":"2024-04-16T16:20:58.374176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373168+0000","last_change":"2024-04-16T16:20:56.720302+0000","last_active":"2024-04-16T16:20:58.373168+0000","last_peered":"2024-04-16T16:20:58.373168+0000","last_clean":"2024-04-16T16:20:58.373168+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:20:58.373168+0000","last_undegraded":"2024-04-16T16:20:58.373168+0000","last_fullsized":"2024-04-16T16:20:58.373168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374304+0000","last_change":"2024-04-16T16:20:56.711031+0000","last_active":"2024-04-16T16:20:58.374304+0000","last_peered":"2024-04-16T16:20:58.374304+0000","last_clean":"2024-04-16T16:20:58.374304+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:20:58.374304+0000","last_undegraded":"2024-04-16T16:20:58.374304+0000","last_fullsized":"2024-04-16T16:20:58.374304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:24.434925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708201+0000","last_change":"2024-04-16T16:20:56.699535+0000","last_active":"2024-04-16T16:20:57.708201+0000","last_peered":"2024-04-16T16:20:57.708201+0000","last_clean":"2024-04-16T16:20:57.708201+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:20:57.708201+0000","last_undegraded":"2024-04-16T16:20:57.708201+0000","last_fullsized":"2024-04-16T16:20:57.708201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376001+0000","last_change":"2024-04-16T16:20:56.716226+0000","last_active":"2024-04-16T16:20:58.376001+0000","last_peered":"2024-04-16T16:20:58.376001+0000","last_clean":"2024-04-16T16:20:58.376001+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:20:58.376001+0000","last_undegraded":"2024-04-16T16:20:58.376001+0000","last_fullsized":"2024-04-16T16:20:58.376001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373175+0000","last_change":"2024-04-16T16:20:56.690730+0000","last_active":"2024-04-16T16:20:58.373175+0000","last_peered":"2024-04-16T16:20:58.373175+0000","last_clean":"2024-04-16T16:20:58.373175+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:20:58.373175+0000","last_undegraded":"2024-04-16T16:20:58.373175+0000","last_fullsized":"2024-04-16T16:20:58.373175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:22.566150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374342+0000","last_change":"2024-04-16T16:20:56.708786+0000","last_active":"2024-04-16T16:20:58.374342+0000","last_peered":"2024-04-16T16:20:58.374342+0000","last_clean":"2024-04-16T16:20:58.374342+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:20:58.374342+0000","last_undegraded":"2024-04-16T16:20:58.374342+0000","last_fullsized":"2024-04-16T16:20:58.374342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:51.397773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374485+0000","last_change":"2024-04-16T16:20:56.720038+0000","last_active":"2024-04-16T16:20:58.374485+0000","last_peered":"2024-04-16T16:20:58.374485+0000","last_clean":"2024-04-16T16:20:58.374485+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:20:58.374485+0000","last_undegraded":"2024-04-16T16:20:58.374485+0000","last_fullsized":"2024-04-16T16:20:58.374485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.371823+0000","last_change":"2024-04-16T16:20:56.706135+0000","last_active":"2024-04-16T16:20:58.371823+0000","last_peered":"2024-04-16T16:20:58.371823+0000","last_clean":"2024-04-16T16:20:58.371823+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:20:58.371823+0000","last_undegraded":"2024-04-16T16:20:58.371823+0000","last_fullsized":"2024-04-16T16:20:58.371823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:10:18.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374185+0000","last_change":"2024-04-16T16:20:56.707138+0000","last_active":"2024-04-16T16:20:58.374185+0000","last_peered":"2024-04-16T16:20:58.374185+0000","last_clean":"2024-04-16T16:20:58.374185+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:20:58.374185+0000","last_undegraded":"2024-04-16T16:20:58.374185+0000","last_fullsized":"2024-04-16T16:20:58.374185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376195+0000","last_change":"2024-04-16T16:20:56.714674+0000","last_active":"2024-04-16T16:20:58.376195+0000","last_peered":"2024-04-16T16:20:58.376195+0000","last_clean":"2024-04-16T16:20:58.376195+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:20:58.376195+0000","last_undegraded":"2024-04-16T16:20:58.376195+0000","last_fullsized":"2024-04-16T16:20:58.376195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:47.291306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375823+0000","last_change":"2024-04-16T16:20:55.704083+0000","last_active":"2024-04-16T16:20:58.375823+0000","last_peered":"2024-04-16T16:20:58.375823+0000","last_clean":"2024-04-16T16:20:58.375823+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:20:58.375823+0000","last_undegraded":"2024-04-16T16:20:58.375823+0000","last_fullsized":"2024-04-16T16:20:58.375823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:34.565386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375090+0000","last_change":"2024-04-16T16:20:55.700645+0000","last_active":"2024-04-16T16:20:58.375090+0000","last_peered":"2024-04-16T16:20:58.375090+0000","last_clean":"2024-04-16T16:20:58.375090+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:20:58.375090+0000","last_undegraded":"2024-04-16T16:20:58.375090+0000","last_fullsized":"2024-04-16T16:20:58.375090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:56.588790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376827+0000","last_change":"2024-04-16T16:20:56.717040+0000","last_active":"2024-04-16T16:20:58.376827+0000","last_peered":"2024-04-16T16:20:58.376827+0000","last_clean":"2024-04-16T16:20:58.376827+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:20:58.376827+0000","last_undegraded":"2024-04-16T16:20:58.376827+0000","last_fullsized":"2024-04-16T16:20:58.376827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:57.603218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.698501+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:40.710552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376219+0000","last_change":"2024-04-16T16:20:56.708709+0000","last_active":"2024-04-16T16:20:58.376219+0000","last_peered":"2024-04-16T16:20:58.376219+0000","last_clean":"2024-04-16T16:20:58.376219+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:20:58.376219+0000","last_undegraded":"2024-04-16T16:20:58.376219+0000","last_fullsized":"2024-04-16T16:20:58.376219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:35.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707688+0000","last_change":"2024-04-16T16:20:55.703384+0000","last_active":"2024-04-16T16:20:57.707688+0000","last_peered":"2024-04-16T16:20:57.707688+0000","last_clean":"2024-04-16T16:20:57.707688+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:20:57.707688+0000","last_undegraded":"2024-04-16T16:20:57.707688+0000","last_fullsized":"2024-04-16T16:20:57.707688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373769+0000","last_change":"2024-04-16T16:20:56.703273+0000","last_active":"2024-04-16T16:20:58.373769+0000","last_peered":"2024-04-16T16:20:58.373769+0000","last_clean":"2024-04-16T16:20:58.373769+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:20:58.373769+0000","last_undegraded":"2024-04-16T16:20:58.373769+0000","last_fullsized":"2024-04-16T16:20:58.373769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:37.220892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373915+0000","last_change":"2024-04-16T16:20:56.706317+0000","last_active":"2024-04-16T16:20:58.373915+0000","last_peered":"2024-04-16T16:20:58.373915+0000","last_clean":"2024-04-16T16:20:58.373915+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:20:58.373915+0000","last_undegraded":"2024-04-16T16:20:58.373915+0000","last_fullsized":"2024-04-16T16:20:58.373915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:18.555574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374892+0000","last_change":"2024-04-16T16:20:55.703837+0000","last_active":"2024-04-16T16:20:58.374892+0000","last_peered":"2024-04-16T16:20:58.374892+0000","last_clean":"2024-04-16T16:20:58.374892+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:20:58.374892+0000","last_undegraded":"2024-04-16T16:20:58.374892+0000","last_fullsized":"2024-04-16T16:20:58.374892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:13.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372897+0000","last_change":"2024-04-16T16:20:56.716680+0000","last_active":"2024-04-16T16:20:58.372897+0000","last_peered":"2024-04-16T16:20:58.372897+0000","last_clean":"2024-04-16T16:20:58.372897+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:20:58.372897+0000","last_undegraded":"2024-04-16T16:20:58.372897+0000","last_fullsized":"2024-04-16T16:20:58.372897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705691+0000","last_change":"2024-04-16T16:20:55.699938+0000","last_active":"2024-04-16T16:20:57.705691+0000","last_peered":"2024-04-16T16:20:57.705691+0000","last_clean":"2024-04-16T16:20:57.705691+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:20:57.705691+0000","last_undegraded":"2024-04-16T16:20:57.705691+0000","last_fullsized":"2024-04-16T16:20:57.705691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373328+0000","last_change":"2024-04-16T16:20:56.709848+0000","last_active":"2024-04-16T16:20:58.373328+0000","last_peered":"2024-04-16T16:20:58.373328+0000","last_clean":"2024-04-16T16:20:58.373328+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:20:58.373328+0000","last_undegraded":"2024-04-16T16:20:58.373328+0000","last_fullsized":"2024-04-16T16:20:58.373328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:46.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375190+0000","last_change":"2024-04-16T16:20:55.703623+0000","last_active":"2024-04-16T16:20:58.375190+0000","last_peered":"2024-04-16T16:20:58.375190+0000","last_clean":"2024-04-16T16:20:58.375190+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:20:58.375190+0000","last_undegraded":"2024-04-16T16:20:58.375190+0000","last_fullsized":"2024-04-16T16:20:58.375190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374994+0000","last_change":"2024-04-16T16:20:56.723400+0000","last_active":"2024-04-16T16:20:58.374994+0000","last_peered":"2024-04-16T16:20:58.374994+0000","last_clean":"2024-04-16T16:20:58.374994+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:20:58.374994+0000","last_undegraded":"2024-04-16T16:20:58.374994+0000","last_fullsized":"2024-04-16T16:20:58.374994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375368+0000","last_change":"2024-04-16T16:20:55.694413+0000","last_active":"2024-04-16T16:20:58.375368+0000","last_peered":"2024-04-16T16:20:58.375368+0000","last_clean":"2024-04-16T16:20:58.375368+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:20:58.375368+0000","last_undegraded":"2024-04-16T16:20:58.375368+0000","last_fullsized":"2024-04-16T16:20:58.375368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:21.591232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375589+0000","last_change":"2024-04-16T16:20:55.702261+0000","last_active":"2024-04-16T16:20:58.375589+0000","last_peered":"2024-04-16T16:20:58.375589+0000","last_clean":"2024-04-16T16:20:58.375589+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:20:58.375589+0000","last_undegraded":"2024-04-16T16:20:58.375589+0000","last_fullsized":"2024-04-16T16:20:58.375589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375450+0000","last_change":"2024-04-16T16:20:56.712767+0000","last_active":"2024-04-16T16:20:58.375450+0000","last_peered":"2024-04-16T16:20:58.375450+0000","last_clean":"2024-04-16T16:20:58.375450+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:20:58.375450+0000","last_undegraded":"2024-04-16T16:20:58.375450+0000","last_fullsized":"2024-04-16T16:20:58.375450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706177+0000","last_change":"2024-04-16T16:20:56.704028+0000","last_active":"2024-04-16T16:20:57.706177+0000","last_peered":"2024-04-16T16:20:57.706177+0000","last_clean":"2024-04-16T16:20:57.706177+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:20:57.706177+0000","last_undegraded":"2024-04-16T16:20:57.706177+0000","last_fullsized":"2024-04-16T16:20:57.706177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373761+0000","last_change":"2024-04-16T16:20:55.691499+0000","last_active":"2024-04-16T16:20:58.373761+0000","last_peered":"2024-04-16T16:20:58.373761+0000","last_clean":"2024-04-16T16:20:58.373761+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:20:58.373761+0000","last_undegraded":"2024-04-16T16:20:58.373761+0000","last_fullsized":"2024-04-16T16:20:58.373761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:46.276878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374544+0000","last_change":"2024-04-16T16:20:56.718537+0000","last_active":"2024-04-16T16:20:58.374544+0000","last_peered":"2024-04-16T16:20:58.374544+0000","last_clean":"2024-04-16T16:20:58.374544+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:20:58.374544+0000","last_undegraded":"2024-04-16T16:20:58.374544+0000","last_fullsized":"2024-04-16T16:20:58.374544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372802+0000","last_change":"2024-04-16T16:20:55.700778+0000","last_active":"2024-04-16T16:20:58.372802+0000","last_peered":"2024-04-16T16:20:58.372802+0000","last_clean":"2024-04-16T16:20:58.372802+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:20:58.372802+0000","last_undegraded":"2024-04-16T16:20:58.372802+0000","last_fullsized":"2024-04-16T16:20:58.372802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:21.223928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705837+0000","last_change":"2024-04-16T16:20:55.700889+0000","last_active":"2024-04-16T16:20:57.705837+0000","last_peered":"2024-04-16T16:20:57.705837+0000","last_clean":"2024-04-16T16:20:57.705837+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:20:57.705837+0000","last_undegraded":"2024-04-16T16:20:57.705837+0000","last_fullsized":"2024-04-16T16:20:57.705837+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374373+0000","last_change":"2024-04-16T16:20:56.720365+0000","last_active":"2024-04-16T16:20:58.374373+0000","last_peered":"2024-04-16T16:20:58.374373+0000","last_clean":"2024-04-16T16:20:58.374373+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:20:58.374373+0000","last_undegraded":"2024-04-16T16:20:58.374373+0000","last_fullsized":"2024-04-16T16:20:58.374373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373392+0000","last_change":"2024-04-16T16:20:55.705450+0000","last_active":"2024-04-16T16:20:58.373392+0000","last_peered":"2024-04-16T16:20:58.373392+0000","last_clean":"2024-04-16T16:20:58.373392+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:20:58.373392+0000","last_undegraded":"2024-04-16T16:20:58.373392+0000","last_fullsized":"2024-04-16T16:20:58.373392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375228+0000","last_change":"2024-04-16T16:20:56.721758+0000","last_active":"2024-04-16T16:20:58.375228+0000","last_peered":"2024-04-16T16:20:58.375228+0000","last_clean":"2024-04-16T16:20:58.375228+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:20:58.375228+0000","last_undegraded":"2024-04-16T16:20:58.375228+0000","last_fullsized":"2024-04-16T16:20:58.375228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375245+0000","last_change":"2024-04-16T16:20:55.691154+0000","last_active":"2024-04-16T16:20:58.375245+0000","last_peered":"2024-04-16T16:20:58.375245+0000","last_clean":"2024-04-16T16:20:58.375245+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:20:58.375245+0000","last_undegraded":"2024-04-16T16:20:58.375245+0000","last_fullsized":"2024-04-16T16:20:58.375245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:48.698225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708411+0000","last_change":"2024-04-16T16:20:56.708684+0000","last_active":"2024-04-16T16:20:57.708411+0000","last_peered":"2024-04-16T16:20:57.708411+0000","last_clean":"2024-04-16T16:20:57.708411+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:20:57.708411+0000","last_undegraded":"2024-04-16T16:20:57.708411+0000","last_fullsized":"2024-04-16T16:20:57.708411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.699664+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375214+0000","last_change":"2024-04-16T16:20:56.712157+0000","last_active":"2024-04-16T16:20:58.375214+0000","last_peered":"2024-04-16T16:20:58.375214+0000","last_clean":"2024-04-16T16:20:58.375214+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:20:58.375214+0000","last_undegraded":"2024-04-16T16:20:58.375214+0000","last_fullsized":"2024-04-16T16:20:58.375214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707746+0000","last_change":"2024-04-16T16:20:55.702354+0000","last_active":"2024-04-16T16:20:57.707746+0000","last_peered":"2024-04-16T16:20:57.707746+0000","last_clean":"2024-04-16T16:20:57.707746+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:20:57.707746+0000","last_undegraded":"2024-04-16T16:20:57.707746+0000","last_fullsized":"2024-04-16T16:20:57.707746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:50.973007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375511+0000","last_change":"2024-04-16T16:20:56.712536+0000","last_active":"2024-04-16T16:20:58.375511+0000","last_peered":"2024-04-16T16:20:58.375511+0000","last_clean":"2024-04-16T16:20:58.375511+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:20:58.375511+0000","last_undegraded":"2024-04-16T16:20:58.375511+0000","last_fullsized":"2024-04-16T16:20:58.375511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375548+0000","last_change":"2024-04-16T16:20:55.697400+0000","last_active":"2024-04-16T16:20:58.375548+0000","last_peered":"2024-04-16T16:20:58.375548+0000","last_clean":"2024-04-16T16:20:58.375548+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:20:58.375548+0000","last_undegraded":"2024-04-16T16:20:58.375548+0000","last_fullsized":"2024-04-16T16:20:58.375548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:32.224244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706503+0000","last_change":"2024-04-16T16:20:56.705284+0000","last_active":"2024-04-16T16:20:57.706503+0000","last_peered":"2024-04-16T16:20:57.706503+0000","last_clean":"2024-04-16T16:20:57.706503+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:20:57.706503+0000","last_undegraded":"2024-04-16T16:20:57.706503+0000","last_fullsized":"2024-04-16T16:20:57.706503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374874+0000","last_change":"2024-04-16T16:20:55.691520+0000","last_active":"2024-04-16T16:20:58.374874+0000","last_peered":"2024-04-16T16:20:58.374874+0000","last_clean":"2024-04-16T16:20:58.374874+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:20:58.374874+0000","last_undegraded":"2024-04-16T16:20:58.374874+0000","last_fullsized":"2024-04-16T16:20:58.374874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:34.964542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376142+0000","last_change":"2024-04-16T16:20:56.714025+0000","last_active":"2024-04-16T16:20:58.376142+0000","last_peered":"2024-04-16T16:20:58.376142+0000","last_clean":"2024-04-16T16:20:58.376142+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:20:58.376142+0000","last_undegraded":"2024-04-16T16:20:58.376142+0000","last_fullsized":"2024-04-16T16:20:58.376142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374747+0000","last_change":"2024-04-16T16:20:56.715573+0000","last_active":"2024-04-16T16:20:58.374747+0000","last_peered":"2024-04-16T16:20:58.374747+0000","last_clean":"2024-04-16T16:20:58.374747+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:20:58.374747+0000","last_undegraded":"2024-04-16T16:20:58.374747+0000","last_fullsized":"2024-04-16T16:20:58.374747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705507+0000","last_change":"2024-04-16T16:20:55.700653+0000","last_active":"2024-04-16T16:20:57.705507+0000","last_peered":"2024-04-16T16:20:57.705507+0000","last_clean":"2024-04-16T16:20:57.705507+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:20:57.705507+0000","last_undegraded":"2024-04-16T16:20:57.705507+0000","last_fullsized":"2024-04-16T16:20:57.705507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:30.271546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708260+0000","last_change":"2024-04-16T16:20:56.691557+0000","last_active":"2024-04-16T16:20:57.708260+0000","last_peered":"2024-04-16T16:20:57.708260+0000","last_clean":"2024-04-16T16:20:57.708260+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:20:57.708260+0000","last_undegraded":"2024-04-16T16:20:57.708260+0000","last_fullsized":"2024-04-16T16:20:57.708260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708599+0000","last_change":"2024-04-16T16:20:56.714215+0000","last_active":"2024-04-16T16:20:57.708599+0000","last_peered":"2024-04-16T16:20:57.708599+0000","last_clean":"2024-04-16T16:20:57.708599+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:20:57.708599+0000","last_undegraded":"2024-04-16T16:20:57.708599+0000","last_fullsized":"2024-04-16T16:20:57.708599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376396+0000","last_change":"2024-04-16T16:20:55.704363+0000","last_active":"2024-04-16T16:20:58.376396+0000","last_peered":"2024-04-16T16:20:58.376396+0000","last_clean":"2024-04-16T16:20:58.376396+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:20:58.376396+0000","last_undegraded":"2024-04-16T16:20:58.376396+0000","last_fullsized":"2024-04-16T16:20:58.376396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372943+0000","last_change":"2024-04-16T16:20:55.703477+0000","last_active":"2024-04-16T16:20:58.372943+0000","last_peered":"2024-04-16T16:20:58.372943+0000","last_clean":"2024-04-16T16:20:58.372943+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:20:58.372943+0000","last_undegraded":"2024-04-16T16:20:58.372943+0000","last_fullsized":"2024-04-16T16:20:58.372943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:15.228538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376581+0000","last_change":"2024-04-16T16:20:56.707864+0000","last_active":"2024-04-16T16:20:58.376581+0000","last_peered":"2024-04-16T16:20:58.376581+0000","last_clean":"2024-04-16T16:20:58.376581+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:20:58.376581+0000","last_undegraded":"2024-04-16T16:20:58.376581+0000","last_fullsized":"2024-04-16T16:20:58.376581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:21.749618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707985+0000","last_change":"2024-04-16T16:20:55.701244+0000","last_active":"2024-04-16T16:20:57.707985+0000","last_peered":"2024-04-16T16:20:57.707985+0000","last_clean":"2024-04-16T16:20:57.707985+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:20:57.707985+0000","last_undegraded":"2024-04-16T16:20:57.707985+0000","last_fullsized":"2024-04-16T16:20:57.707985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374179+0000","last_change":"2024-04-16T16:20:56.707897+0000","last_active":"2024-04-16T16:20:58.374179+0000","last_peered":"2024-04-16T16:20:58.374179+0000","last_clean":"2024-04-16T16:20:58.374179+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:20:58.374179+0000","last_undegraded":"2024-04-16T16:20:58.374179+0000","last_fullsized":"2024-04-16T16:20:58.374179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:42.907490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374977+0000","last_change":"2024-04-16T16:20:56.720972+0000","last_active":"2024-04-16T16:20:58.374977+0000","last_peered":"2024-04-16T16:20:58.374977+0000","last_clean":"2024-04-16T16:20:58.374977+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:20:58.374977+0000","last_undegraded":"2024-04-16T16:20:58.374977+0000","last_fullsized":"2024-04-16T16:20:58.374977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373562+0000","last_change":"2024-04-16T16:20:56.708340+0000","last_active":"2024-04-16T16:20:58.373562+0000","last_peered":"2024-04-16T16:20:58.373562+0000","last_clean":"2024-04-16T16:20:58.373562+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:20:58.373562+0000","last_undegraded":"2024-04-16T16:20:58.373562+0000","last_fullsized":"2024-04-16T16:20:58.373562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:07.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372721+0000","last_change":"2024-04-16T16:20:55.692470+0000","last_active":"2024-04-16T16:20:58.372721+0000","last_peered":"2024-04-16T16:20:58.372721+0000","last_clean":"2024-04-16T16:20:58.372721+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:20:58.372721+0000","last_undegraded":"2024-04-16T16:20:58.372721+0000","last_fullsized":"2024-04-16T16:20:58.372721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:20.735190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372709+0000","last_change":"2024-04-16T16:20:56.720232+0000","last_active":"2024-04-16T16:20:58.372709+0000","last_peered":"2024-04-16T16:20:58.372709+0000","last_clean":"2024-04-16T16:20:58.372709+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:20:58.372709+0000","last_undegraded":"2024-04-16T16:20:58.372709+0000","last_fullsized":"2024-04-16T16:20:58.372709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:34.266414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372516+0000","last_change":"2024-04-16T16:20:55.702982+0000","last_active":"2024-04-16T16:20:58.372516+0000","last_peered":"2024-04-16T16:20:58.372516+0000","last_clean":"2024-04-16T16:20:58.372516+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:20:58.372516+0000","last_undegraded":"2024-04-16T16:20:58.372516+0000","last_fullsized":"2024-04-16T16:20:58.372516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:05.020022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373594+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:58.373594+0000","last_peered":"2024-04-16T16:20:58.373594+0000","last_clean":"2024-04-16T16:20:58.373594+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:58.373594+0000","last_undegraded":"2024-04-16T16:20:58.373594+0000","last_fullsized":"2024-04-16T16:20:58.373594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":904511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":313983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":753664,"data_stored":314635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":906545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:06.843 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T16:21:06.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T16:21:07.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.118+0000 7f15db200640 1 Processor -- start 2024-04-16T16:21:07.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.118+0000 7f15db200640 1 -- start start 2024-04-16T16:21:07.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.119+0000 7f15db200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15dc0b3b80 0x7f15dc0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.119+0000 7f15db200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 0x7f15dc0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.119+0000 7f15db200640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15dc0d4640 con 0x7f15dc0b6640 2024-04-16T16:21:07.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.119+0000 7f15db200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f15dc0d3d20 con 0x7f15dc0b3b80 2024-04-16T16:21:07.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.119+0000 7f15db200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc0cfee0 con 0x7f15dc0d41b0 2024-04-16T16:21:07.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.119+0000 7f15d9e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f15dc0b6640 0x7f15dc0b6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33134/0 (socket says 172.21.15.22:33134) 2024-04-16T16:21:07.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.119+0000 7f15d9e00640 1 -- 172.21.15.22:0/1464945922 learned_addr learned my addr 172.21.15.22:0/1464945922 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d9400640 1 --2- 172.21.15.22:0/1464945922 >> v2:172.21.15.43:3300/0 conn(0x7f15dc0b3b80 0x7f15dc0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058682057 0 0) 0x7f15dc0d4640 con 0x7f15dc0b6640 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15da800640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 0x7f15dc0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c0003520 con 0x7f15dc0b6640 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4293110325 0 0) 0x7f15c0003520 con 0x7f15dc0b6640 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 msgr2=0x7f15dc0b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 0x7f15dc0b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 >> v2:172.21.15.43:3300/0 conn(0x7f15dc0b3b80 msgr2=0x7f15dc0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 --2- 172.21.15.22:0/1464945922 >> v2:172.21.15.43:3300/0 conn(0x7f15dc0b3b80 0x7f15dc0cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc0cfc00 con 0x7f15dc0b6640 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f15cc001670 con 0x7f15dc0b6640 2024-04-16T16:21:07.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 >> v1:172.21.15.22:6789/0 conn(0x7f15dc0b6640 legacy=0x7f15dc0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c00039b0 0x7f15c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c0004800 0x7f15c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 0x7f15c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0d3d20 con 0x7f15c00039b0 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0cfee0 con 0x7f15c0004800 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.120+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15c000b9c0 con 0x7f15dc0d41b0 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c00039b0 0x7f15c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15d9e00640 1 -- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 msgr2=0x7f15c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15da800640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 0x7f15c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15d9400640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c0004800 0x7f15c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0d41b0 0x7f15c00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15d9e00640 1 -- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c0004800 msgr2=0x7f15c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:07.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c0004800 0x7f15c0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.121+0000 7f15d9e00640 1 -- 172.21.15.22:0/1464945922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c0003520 con 0x7f15c00039b0 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.122+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c00039b0 0x7f15c0003dd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c210 tx=0x7f15c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15acb46c243fc31a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc007d50 con 0x7f15c00039b0 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15cc030070 con 0x7f15c00039b0 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15d8a00640 1 -- 172.21.15.22:0/1464945922 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc02cd80 con 0x7f15c00039b0 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15db200640 1 -- 172.21.15.22:0/1464945922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c00039b0 msgr2=0x7f15c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15db200640 1 --2- 172.21.15.22:0/1464945922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c00039b0 0x7f15c0003dd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c210 tx=0x7f15c0005830 comp rx=0 tx=0).stop 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15da800640 1 -- 172.21.15.22:0/1464945922 reap_dead start 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15db200640 1 -- 172.21.15.22:0/1464945922 shutdown_connections 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15db200640 1 -- 172.21.15.22:0/1464945922 >> 172.21.15.22:0/1464945922 conn(0x7f15dc062620 msgr2=0x7f15dc062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15db200640 1 -- 172.21.15.22:0/1464945922 shutdown_connections 2024-04-16T16:21:07.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.123+0000 7f15db200640 1 -- 172.21.15.22:0/1464945922 wait complete. 2024-04-16T16:21:07.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.125+0000 7f15db200640 1 Processor -- start 2024-04-16T16:21:07.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.125+0000 7f15db200640 1 -- start start 2024-04-16T16:21:07.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.126+0000 7f15db200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00039b0 0x7f15dc0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.126+0000 7f15db200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15dc0c8d20 0x7f15dc158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.126+0000 7f15db200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0cb900 0x7f15dc0cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.126+0000 7f15db200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0cf890 con 0x7f15dc0c8d20 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.126+0000 7f15db200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0d39b0 con 0x7f15c00039b0 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.126+0000 7f15db200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc0b79f0 con 0x7f15dc0cb900 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.126+0000 7f15d9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15dc0c8d20 0x7f15dc158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15dc0c8d20 0x7f15dc158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49260/0 (socket says 172.21.15.22:49260) 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 -- 172.21.15.22:0/1220287885 learned_addr learned my addr 172.21.15.22:0/1220287885 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00039b0 0x7f15dc0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 -- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0cb900 msgr2=0x7f15dc0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0cb900 0x7f15dc0cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 -- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00039b0 msgr2=0x7f15dc0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00039b0 0x7f15dc0cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 -- 172.21.15.22:0/1220287885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc0c9590 con 0x7f15dc0c8d20 2024-04-16T16:21:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00039b0 0x7f15dc0cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:07.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.127+0000 7f15d9400640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15dc0c8d20 0x7f15dc158650 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f15c40108c0 tx=0x7f15c4010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:07.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.128+0000 7f15d2000640 1 -- 172.21.15.22:0/1220287885 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c400f040 con 0x7f15dc0c8d20 2024-04-16T16:21:07.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.128+0000 7f15d2000640 1 -- 172.21.15.22:0/1220287885 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c400eae0 con 0x7f15dc0c8d20 2024-04-16T16:21:07.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.128+0000 7f15d2000640 1 -- 172.21.15.22:0/1220287885 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c401c400 con 0x7f15dc0c8d20 2024-04-16T16:21:07.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.128+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc0c9870 con 0x7f15dc0c8d20 2024-04-16T16:21:07.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.128+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc0c9e30 con 0x7f15dc0c8d20 2024-04-16T16:21:07.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.129+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc075f30 con 0x7f15dc0c8d20 2024-04-16T16:21:07.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.130+0000 7f15d2000640 1 -- 172.21.15.22:0/1220287885 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f15c401c5a0 con 0x7f15dc0c8d20 2024-04-16T16:21:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.131+0000 7f15d2000640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15b806ce90 0x7f15b806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.131+0000 7f15d2000640 1 -- 172.21.15.22:0/1220287885 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f15c408cb50 con 0x7f15dc0c8d20 2024-04-16T16:21:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.131+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15b806ce90 0x7f15b806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.132+0000 7f15d9e00640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15b806ce90 0x7f15b806f350 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15cc034000 tx=0x7f15cc007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.136+0000 7f15d2000640 1 -- 172.21.15.22:0/1220287885 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15c408ee20 con 0x7f15dc0c8d20 2024-04-16T16:21:07.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.413+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f15dc0d34b0 con 0x7f15dc0c8d20 2024-04-16T16:21:07.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.418+0000 7f15d2000640 1 -- 172.21.15.22:0/1220287885 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f15c4018030 con 0x7f15dc0c8d20 2024-04-16T16:21:07.418 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-04-16T16:21:07.418 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAtpB5m26TqDxAAag/7gXDlXug7eeh7Kw4XPw== 2024-04-16T16:21:07.418 INFO:teuthology.orchestra.run.smithi022.stdout: caps mds = "allow" 2024-04-16T16:21:07.418 INFO:teuthology.orchestra.run.smithi022.stdout: caps mon = "allow r" 2024-04-16T16:21:07.418 INFO:teuthology.orchestra.run.smithi022.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T16:21:07.418 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2024-04-16T16:21:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15b806ce90 msgr2=0x7f15b806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15b806ce90 0x7f15b806f350 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15cc034000 tx=0x7f15cc007000 comp rx=0 tx=0).stop 2024-04-16T16:21:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15dc0c8d20 msgr2=0x7f15dc158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15dc0c8d20 0x7f15dc158650 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f15c40108c0 tx=0x7f15c4010d80 comp rx=0 tx=0).stop 2024-04-16T16:21:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 shutdown_connections 2024-04-16T16:21:07.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15b806ce90 0x7f15b806f350 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15dc0cb900 0x7f15dc0cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15dc0c8d20 0x7f15dc158650 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 --2- 172.21.15.22:0/1220287885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00039b0 0x7f15dc0cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.420+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 >> 172.21.15.22:0/1220287885 conn(0x7f15dc062620 msgr2=0x7f15dc0b9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.421+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 shutdown_connections 2024-04-16T16:21:07.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.421+0000 7f15db200640 1 -- 172.21.15.22:0/1220287885 wait complete. 2024-04-16T16:21:07.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:21:07.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:07.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.640+0000 7fb7eca00640 1 Processor -- start 2024-04-16T16:21:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.640+0000 7fb7eca00640 1 -- start start 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7eca00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb7e806eaa0 0x7fb7e80b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7eca00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb7e80cc810 0x7fb7e806df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7eca00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e806d160 con 0x7fb7e806ee80 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7eca00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e806cf10 con 0x7fb7e80cc810 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7eca00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e806d440 con 0x7fb7e806eaa0 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7e5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb7e80cc810 0x7fb7e806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7e5e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb7e80cc810 0x7fb7e806df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49272/0 (socket says 172.21.15.22:49272) 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7e5e00640 1 -- 172.21.15.22:0/3854319333 learned_addr learned my addr 172.21.15.22:0/3854319333 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.642+0000 7fb7e6800640 1 --2- 172.21.15.22:0/3854319333 >> v2:172.21.15.43:3300/0 conn(0x7fb7e806eaa0 0x7fb7e80b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.643+0000 7fb7e5e00640 1 -- 172.21.15.22:0/3854319333 >> v2:172.21.15.43:3300/0 conn(0x7fb7e806eaa0 msgr2=0x7fb7e80b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:07.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.643+0000 7fb7e5e00640 1 --2- 172.21.15.22:0/3854319333 >> v2:172.21.15.43:3300/0 conn(0x7fb7e806eaa0 0x7fb7e80b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.643+0000 7fb7e5e00640 1 -- 172.21.15.22:0/3854319333 >> v1:172.21.15.43:6789/0 conn(0x7fb7e806ee80 legacy=0x7fb7e815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:07.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.643+0000 7fb7e5e00640 1 -- 172.21.15.22:0/3854319333 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e806d720 con 0x7fb7e80cc810 2024-04-16T16:21:07.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.644+0000 7fb7e5e00640 1 --2- 172.21.15.22:0/3854319333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e806df00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009870 tx=0x7fb7d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f33dd55af4dbe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:07.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7e5400640 1 -- 172.21.15.22:0/3854319333 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4035020 con 0x7fb7e80cc810 2024-04-16T16:21:07.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7e5400640 1 -- 172.21.15.22:0/3854319333 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d4031870 con 0x7fb7e80cc810 2024-04-16T16:21:07.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7e5400640 1 -- 172.21.15.22:0/3854319333 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4031c40 con 0x7fb7e80cc810 2024-04-16T16:21:07.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7eca00640 1 -- 172.21.15.22:0/3854319333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 msgr2=0x7fb7e806df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7eca00640 1 --2- 172.21.15.22:0/3854319333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e806df00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009870 tx=0x7fb7d402b910 comp rx=0 tx=0).stop 2024-04-16T16:21:07.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7eca00640 1 -- 172.21.15.22:0/3854319333 shutdown_connections 2024-04-16T16:21:07.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7eca00640 1 --2- 172.21.15.22:0/3854319333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e806df00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7eca00640 1 --2- 172.21.15.22:0/3854319333 >> v2:172.21.15.43:3300/0 conn(0x7fb7e806eaa0 0x7fb7e80b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.645+0000 7fb7eca00640 1 -- 172.21.15.22:0/3854319333 >> 172.21.15.22:0/3854319333 conn(0x7fb7e8062440 msgr2=0x7fb7e8062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:07.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.646+0000 7fb7eca00640 1 -- 172.21.15.22:0/3854319333 shutdown_connections 2024-04-16T16:21:07.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.646+0000 7fb7eca00640 1 -- 172.21.15.22:0/3854319333 wait complete. 2024-04-16T16:21:07.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.647+0000 7fb7eca00640 1 Processor -- start 2024-04-16T16:21:07.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.647+0000 7fb7eca00640 1 -- start start 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.648+0000 7fb7eca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7e806eaa0 0x7fb7e8148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.648+0000 7fb7eca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7e806ee80 0x7fb7e80b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.648+0000 7fb7eca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e80ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.648+0000 7fb7eca00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e806e440 con 0x7fb7e80cc810 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.648+0000 7fb7eca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80b4360 con 0x7fb7e806ee80 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.648+0000 7fb7eca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e815c910 con 0x7fb7e806eaa0 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e80ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e80ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49276/0 (socket says 172.21.15.22:49276) 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 -- 172.21.15.22:0/1618167308 learned_addr learned my addr 172.21.15.22:0/1618167308 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e5e00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7e806ee80 0x7fb7e80b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e6800640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7e806eaa0 0x7fb7e8148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 -- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7e806eaa0 msgr2=0x7fb7e8148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7e806eaa0 0x7fb7e8148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 -- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7e806ee80 msgr2=0x7fb7e80b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7e806ee80 0x7fb7e80b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.649+0000 7fb7e7200640 1 -- 172.21.15.22:0/1618167308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e80712c0 con 0x7fb7e80cc810 2024-04-16T16:21:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.650+0000 7fb7e7200640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e80ae860 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c7b0 tx=0x7fb7e000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.650+0000 7fb7dea00640 1 -- 172.21.15.22:0/1618167308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0004b60 con 0x7fb7e80cc810 2024-04-16T16:21:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.650+0000 7fb7dea00640 1 -- 172.21.15.22:0/1618167308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0004d00 con 0x7fb7e80cc810 2024-04-16T16:21:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.650+0000 7fb7dea00640 1 -- 172.21.15.22:0/1618167308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000aa90 con 0x7fb7e80cc810 2024-04-16T16:21:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.650+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e80715a0 con 0x7fb7e80cc810 2024-04-16T16:21:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.650+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e8071b60 con 0x7fb7e80cc810 2024-04-16T16:21:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.651+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e806e260 con 0x7fb7e80cc810 2024-04-16T16:21:07.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.652+0000 7fb7dea00640 1 -- 172.21.15.22:0/1618167308 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fb7e000ac30 con 0x7fb7e80cc810 2024-04-16T16:21:07.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.653+0000 7fb7dea00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb7c806ce90 0x7fb7c806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:07.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.653+0000 7fb7dea00640 1 -- 172.21.15.22:0/1618167308 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fb7e008c980 con 0x7fb7e80cc810 2024-04-16T16:21:07.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.653+0000 7fb7e6800640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb7c806ce90 0x7fb7c806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:07.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.654+0000 7fb7e6800640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb7c806ce90 0x7fb7c806f350 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8006fd0 tx=0x7fb7d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:07.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.658+0000 7fb7dea00640 1 -- 172.21.15.22:0/1618167308 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7e806e260 con 0x7fb7e80cc810 2024-04-16T16:21:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.911+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7e8075f30 con 0x7fb7e80cc810 2024-04-16T16:21:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.912+0000 7fb7dea00640 1 -- 172.21.15.22:0/1618167308 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5178 (secure 0 0 0) 0x7fb7e0020070 con 0x7fb7e80cc810 2024-04-16T16:21:07.912 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:07.912 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4005390609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4005390609},{"type":"v1","addr":"172.21.15.43:6835","nonce":4005390609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5350,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3406985834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3406985834},{"type":"v1","addr":"172.21.15.43:6833","nonce":3406985834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6836/1482042737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1482042737},{"type":"v1","addr":"172.21.15.22:6836","nonce":1482042737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:20:56.164231+0000","modified":"2024-04-16T16:20:59.221283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6837/540536764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6835","nonce":540536764},{"type":"v1","addr":"172.21.15.22:6837","nonce":540536764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6267,"qdb_cluster":[6267]},"id":4}]} 2024-04-16T16:21:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 35 2024-04-16T16:21:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.914+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb7c806ce90 msgr2=0x7fb7c806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.914+0000 7fb7eca00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb7c806ce90 0x7fb7c806f350 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8006fd0 tx=0x7fb7d8008040 comp rx=0 tx=0).stop 2024-04-16T16:21:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.914+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 msgr2=0x7fb7e80ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.914+0000 7fb7eca00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e80ae860 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c7b0 tx=0x7fb7e000cc70 comp rx=0 tx=0).stop 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 shutdown_connections 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb7c806ce90 0x7fb7c806f350 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7e80cc810 0x7fb7e80ae860 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7e806ee80 0x7fb7e80b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 --2- 172.21.15.22:0/1618167308 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7e806eaa0 0x7fb7e8148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 >> 172.21.15.22:0/1618167308 conn(0x7fb7e8062440 msgr2=0x7fb7e80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 shutdown_connections 2024-04-16T16:21:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:07.915+0000 7fb7eca00640 1 -- 172.21.15.22:0/1618167308 wait complete. 2024-04-16T16:21:08.038 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during pending state and validate the reason ... ERROR 2024-04-16T16:21:08.038 INFO:tasks.cephfs_test_runner: 2024-04-16T16:21:08.038 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T16:21:08.038 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-16T16:21:08.038 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during pending state and validate the reason 2024-04-16T16:21:08.038 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/test_volumes.py", line 401, in setUp 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).setUp() 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-04-16T16:21:08.039 INFO:tasks.cephfs_test_runner: 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:Ran 3 tests in 223.586s 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner: 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner: 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during pending state and validate the reason 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/test_volumes.py", line 401, in setUp 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).setUp() 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T16:21:08.040 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-04-16T16:21:08.041 INFO:tasks.cephfs_test_runner: 2024-04-16T16:21:08.041 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-16T16:21:08.270 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=72ab6c9cf717440488bb41d1ceb9ef43 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-16T16:21:08.271 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-16T16:21:08.281 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-16T16:21:08.300 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-16T16:21:08.300 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:21:08.301 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:21:08.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:21:08.363 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-16T16:21:08.363 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:21:08.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T16:21:08.416 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:21:08.416 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:21:08.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:21:08.477 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-16T16:21:08.477 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T16:21:08.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053546,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T16:21:08.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:08.533 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:21:08.594 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T16:21:08.595 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-16T16:21:08.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:08.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T16:21:08.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:08.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T16:21:08.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:08.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-04-16T16:21:08.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:08.907 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-04-16T16:21:08.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:08.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-04-16T16:21:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2024-04-16T16:21:09.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:21:09.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:09.096 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:21:09.157 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T16:21:09.157 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-16T16:21:09.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:09.158 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T16:21:09.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:09.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T16:21:09.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:09.346 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-16T16:21:09.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:09.516 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-16T16:21:09.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T16:21:09.558 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-16T16:21:09.696 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-04-16T16:21:09.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:21:09.701 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T16:21:09.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T16:21:09.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:09.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.952+0000 7fde5f200640 1 Processor -- start 2024-04-16T16:21:09.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.952+0000 7fde5f200640 1 -- start start 2024-04-16T16:21:09.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.953+0000 7fde5f200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde580afd90 0x7fde58072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:09.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.953+0000 7fde5f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde5806dc80 0x7fde580d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:09.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.953+0000 7fde5f200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde58073050 0x7fde580d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:09.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.953+0000 7fde5f200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fde58160480 con 0x7fde580afd90 2024-04-16T16:21:09.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.953+0000 7fde5f200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fde581606d0 con 0x7fde58073050 2024-04-16T16:21:09.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.953+0000 7fde5f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde581609b0 con 0x7fde5806dc80 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde580afd90 0x7fde58072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde580afd90 0x7fde58072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37788/0 (socket says 172.21.15.22:37788) 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 -- 172.21.15.22:0/1761468190 learned_addr learned my addr 172.21.15.22:0/1761468190 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57400640 1 --2- 172.21.15.22:0/1761468190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde5806dc80 0x7fde580d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde5d200640 1 --2- 172.21.15.22:0/1761468190 >> v2:172.21.15.43:3300/0 conn(0x7fde58073050 0x7fde580d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 -- 172.21.15.22:0/1761468190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde5806dc80 msgr2=0x7fde580d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 --2- 172.21.15.22:0/1761468190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde5806dc80 0x7fde580d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:09.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 -- 172.21.15.22:0/1761468190 >> v2:172.21.15.43:3300/0 conn(0x7fde58073050 msgr2=0x7fde580d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:09.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 --2- 172.21.15.22:0/1761468190 >> v2:172.21.15.43:3300/0 conn(0x7fde58073050 0x7fde580d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:09.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.954+0000 7fde57e00640 1 -- 172.21.15.22:0/1761468190 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde58160c90 con 0x7fde580afd90 2024-04-16T16:21:09.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.956+0000 7fde57e00640 1 --2- 172.21.15.22:0/1761468190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58072b10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fde5806e6d0 tx=0x7fde4802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda7da2a372ca61c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:09.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.956+0000 7fde56a00640 1 -- 172.21.15.22:0/1761468190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde480317d0 con 0x7fde580afd90 2024-04-16T16:21:09.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.956+0000 7fde56a00640 1 -- 172.21.15.22:0/1761468190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde48037070 con 0x7fde580afd90 2024-04-16T16:21:09.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.956+0000 7fde56a00640 1 -- 172.21.15.22:0/1761468190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48031b90 con 0x7fde580afd90 2024-04-16T16:21:09.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 -- 172.21.15.22:0/1761468190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 msgr2=0x7fde58072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:09.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 --2- 172.21.15.22:0/1761468190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58072b10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fde5806e6d0 tx=0x7fde4802b870 comp rx=0 tx=0).stop 2024-04-16T16:21:09.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 -- 172.21.15.22:0/1761468190 shutdown_connections 2024-04-16T16:21:09.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 --2- 172.21.15.22:0/1761468190 >> v2:172.21.15.43:3300/0 conn(0x7fde58073050 0x7fde580d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:09.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 --2- 172.21.15.22:0/1761468190 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde5806dc80 0x7fde580d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:09.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 --2- 172.21.15.22:0/1761468190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58072b10 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:09.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 -- 172.21.15.22:0/1761468190 >> 172.21.15.22:0/1761468190 conn(0x7fde58062440 msgr2=0x7fde58062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:09.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 -- 172.21.15.22:0/1761468190 shutdown_connections 2024-04-16T16:21:09.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.957+0000 7fde5f200640 1 -- 172.21.15.22:0/1761468190 wait complete. 2024-04-16T16:21:09.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.959+0000 7fde5f200640 1 Processor -- start 2024-04-16T16:21:09.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.959+0000 7fde5f200640 1 -- start start 2024-04-16T16:21:09.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde5806dc80 0x7fde58155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:09.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde58073050 0x7fde581559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:09.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:09.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fde580ce8a0 con 0x7fde580afd90 2024-04-16T16:21:09.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde580b0170 con 0x7fde5806dc80 2024-04-16T16:21:09.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde580cea20 con 0x7fde58073050 2024-04-16T16:21:09.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5d200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:09.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5d200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37798/0 (socket says 172.21.15.22:37798) 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.960+0000 7fde5d200640 1 -- 172.21.15.22:0/2044436114 learned_addr learned my addr 172.21.15.22:0/2044436114 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde57e00640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde5806dc80 0x7fde58155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde57400640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde58073050 0x7fde581559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde5d200640 1 -- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde58073050 msgr2=0x7fde581559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde5d200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde58073050 0x7fde581559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde5d200640 1 -- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde5806dc80 msgr2=0x7fde58155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde5d200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde5806dc80 0x7fde58155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde5d200640 1 -- 172.21.15.22:0/2044436114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5814a4b0 con 0x7fde580afd90 2024-04-16T16:21:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde5d200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58150f70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fde5000cd70 tx=0x7fde5000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.961+0000 7fde4fe00640 1 -- 172.21.15.22:0/2044436114 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50003b90 con 0x7fde580afd90 2024-04-16T16:21:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.962+0000 7fde4fe00640 1 -- 172.21.15.22:0/2044436114 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde50003d30 con 0x7fde580afd90 2024-04-16T16:21:09.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.962+0000 7fde4fe00640 1 -- 172.21.15.22:0/2044436114 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50004240 con 0x7fde580afd90 2024-04-16T16:21:09.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.962+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde58153af0 con 0x7fde580afd90 2024-04-16T16:21:09.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.962+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde581540b0 con 0x7fde580afd90 2024-04-16T16:21:09.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.963+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde580694b0 con 0x7fde580afd90 2024-04-16T16:21:09.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.964+0000 7fde4fe00640 1 -- 172.21.15.22:0/2044436114 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fde500043e0 con 0x7fde580afd90 2024-04-16T16:21:09.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.965+0000 7fde4fe00640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde3806ce90 0x7fde3806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:09.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.965+0000 7fde4fe00640 1 -- 172.21.15.22:0/2044436114 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fde5008d130 con 0x7fde580afd90 2024-04-16T16:21:09.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.965+0000 7fde57e00640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde3806ce90 0x7fde3806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:09.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.966+0000 7fde57e00640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde3806ce90 0x7fde3806f350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fde48036000 tx=0x7fde4803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:09.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:09.970+0000 7fde4fe00640 1 -- 172.21.15.22:0/2044436114 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde580694b0 con 0x7fde580afd90 2024-04-16T16:21:10.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.175+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde5804fd90 con 0x7fde3806ce90 2024-04-16T16:21:10.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.186+0000 7fde4fe00640 1 -- 172.21.15.22:0/2044436114 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251843 (secure 0 0 0) 0x7fde5804fd90 con 0x7fde3806ce90 2024-04-16T16:21:10.189 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:10.190 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.190+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde3806ce90 msgr2=0x7fde3806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.190+0000 7fde5f200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde3806ce90 0x7fde3806f350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fde48036000 tx=0x7fde4803d040 comp rx=0 tx=0).stop 2024-04-16T16:21:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 msgr2=0x7fde58150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58150f70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fde5000cd70 tx=0x7fde5000a660 comp rx=0 tx=0).stop 2024-04-16T16:21:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 shutdown_connections 2024-04-16T16:21:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fde3806ce90 0x7fde3806f350 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde580afd90 0x7fde58150f70 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde58073050 0x7fde581559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 --2- 172.21.15.22:0/2044436114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde5806dc80 0x7fde58155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 >> 172.21.15.22:0/2044436114 conn(0x7fde58062440 msgr2=0x7fde581595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 shutdown_connections 2024-04-16T16:21:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.191+0000 7fde5f200640 1 -- 172.21.15.22:0/2044436114 wait complete. 2024-04-16T16:21:10.212 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-16T16:21:09.795946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256512,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718208,"statfs":{"total":773094113280,"available":772831444992,"internally_reserved":0,"allocated":7217152,"data_stored":3697420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004579"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373919+0000","last_change":"2024-04-16T16:20:56.700692+0000","last_active":"2024-04-16T16:20:58.373919+0000","last_peered":"2024-04-16T16:20:58.373919+0000","last_clean":"2024-04-16T16:20:58.373919+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:20:58.373919+0000","last_undegraded":"2024-04-16T16:20:58.373919+0000","last_fullsized":"2024-04-16T16:20:58.373919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:01.405645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375924+0000","last_change":"2024-04-16T16:20:56.704487+0000","last_active":"2024-04-16T16:20:58.375924+0000","last_peered":"2024-04-16T16:20:58.375924+0000","last_clean":"2024-04-16T16:20:58.375924+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:20:58.375924+0000","last_undegraded":"2024-04-16T16:20:58.375924+0000","last_fullsized":"2024-04-16T16:20:58.375924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:18.892594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374985+0000","last_change":"2024-04-16T16:20:56.710584+0000","last_active":"2024-04-16T16:20:58.374985+0000","last_peered":"2024-04-16T16:20:58.374985+0000","last_clean":"2024-04-16T16:20:58.374985+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:20:58.374985+0000","last_undegraded":"2024-04-16T16:20:58.374985+0000","last_fullsized":"2024-04-16T16:20:58.374985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708372+0000","last_change":"2024-04-16T16:20:56.694479+0000","last_active":"2024-04-16T16:20:57.708372+0000","last_peered":"2024-04-16T16:20:57.708372+0000","last_clean":"2024-04-16T16:20:57.708372+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:20:57.708372+0000","last_undegraded":"2024-04-16T16:20:57.708372+0000","last_fullsized":"2024-04-16T16:20:57.708372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373184+0000","last_change":"2024-04-16T16:20:56.687650+0000","last_active":"2024-04-16T16:20:58.373184+0000","last_peered":"2024-04-16T16:20:58.373184+0000","last_clean":"2024-04-16T16:20:58.373184+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:20:58.373184+0000","last_undegraded":"2024-04-16T16:20:58.373184+0000","last_fullsized":"2024-04-16T16:20:58.373184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:24.566878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374109+0000","last_change":"2024-04-16T16:20:56.696467+0000","last_active":"2024-04-16T16:20:58.374109+0000","last_peered":"2024-04-16T16:20:58.374109+0000","last_clean":"2024-04-16T16:20:58.374109+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:20:58.374109+0000","last_undegraded":"2024-04-16T16:20:58.374109+0000","last_fullsized":"2024-04-16T16:20:58.374109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372576+0000","last_change":"2024-04-16T16:20:56.711962+0000","last_active":"2024-04-16T16:20:58.372576+0000","last_peered":"2024-04-16T16:20:58.372576+0000","last_clean":"2024-04-16T16:20:58.372576+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:20:58.372576+0000","last_undegraded":"2024-04-16T16:20:58.372576+0000","last_fullsized":"2024-04-16T16:20:58.372576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:34.290551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.702421+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373554+0000","last_change":"2024-04-16T16:20:56.705792+0000","last_active":"2024-04-16T16:20:58.373554+0000","last_peered":"2024-04-16T16:20:58.373554+0000","last_clean":"2024-04-16T16:20:58.373554+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:20:58.373554+0000","last_undegraded":"2024-04-16T16:20:58.373554+0000","last_fullsized":"2024-04-16T16:20:58.373554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373773+0000","last_change":"2024-04-16T16:20:56.716792+0000","last_active":"2024-04-16T16:20:58.373773+0000","last_peered":"2024-04-16T16:20:58.373773+0000","last_clean":"2024-04-16T16:20:58.373773+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:20:58.373773+0000","last_undegraded":"2024-04-16T16:20:58.373773+0000","last_fullsized":"2024-04-16T16:20:58.373773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375444+0000","last_change":"2024-04-16T16:20:56.709293+0000","last_active":"2024-04-16T16:20:58.375444+0000","last_peered":"2024-04-16T16:20:58.375444+0000","last_clean":"2024-04-16T16:20:58.375444+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:20:58.375444+0000","last_undegraded":"2024-04-16T16:20:58.375444+0000","last_fullsized":"2024-04-16T16:20:58.375444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:47.440922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374963+0000","last_change":"2024-04-16T16:20:56.722078+0000","last_active":"2024-04-16T16:20:58.374963+0000","last_peered":"2024-04-16T16:20:58.374963+0000","last_clean":"2024-04-16T16:20:58.374963+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:20:58.374963+0000","last_undegraded":"2024-04-16T16:20:58.374963+0000","last_fullsized":"2024-04-16T16:20:58.374963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372189+0000","last_change":"2024-04-16T16:20:56.703752+0000","last_active":"2024-04-16T16:20:58.372189+0000","last_peered":"2024-04-16T16:20:58.372189+0000","last_clean":"2024-04-16T16:20:58.372189+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:20:58.372189+0000","last_undegraded":"2024-04-16T16:20:58.372189+0000","last_fullsized":"2024-04-16T16:20:58.372189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:32.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374871+0000","last_change":"2024-04-16T16:20:56.718849+0000","last_active":"2024-04-16T16:20:58.374871+0000","last_peered":"2024-04-16T16:20:58.374871+0000","last_clean":"2024-04-16T16:20:58.374871+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:20:58.374871+0000","last_undegraded":"2024-04-16T16:20:58.374871+0000","last_fullsized":"2024-04-16T16:20:58.374871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.829545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374676+0000","last_change":"2024-04-16T16:20:56.715256+0000","last_active":"2024-04-16T16:20:58.374676+0000","last_peered":"2024-04-16T16:20:58.374676+0000","last_clean":"2024-04-16T16:20:58.374676+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:20:58.374676+0000","last_undegraded":"2024-04-16T16:20:58.374676+0000","last_fullsized":"2024-04-16T16:20:58.374676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374265+0000","last_change":"2024-04-16T16:20:56.703517+0000","last_active":"2024-04-16T16:20:58.374265+0000","last_peered":"2024-04-16T16:20:58.374265+0000","last_clean":"2024-04-16T16:20:58.374265+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:20:58.374265+0000","last_undegraded":"2024-04-16T16:20:58.374265+0000","last_fullsized":"2024-04-16T16:20:58.374265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:28.081709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374176+0000","last_change":"2024-04-16T16:20:56.719987+0000","last_active":"2024-04-16T16:20:58.374176+0000","last_peered":"2024-04-16T16:20:58.374176+0000","last_clean":"2024-04-16T16:20:58.374176+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:20:58.374176+0000","last_undegraded":"2024-04-16T16:20:58.374176+0000","last_fullsized":"2024-04-16T16:20:58.374176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373168+0000","last_change":"2024-04-16T16:20:56.720302+0000","last_active":"2024-04-16T16:20:58.373168+0000","last_peered":"2024-04-16T16:20:58.373168+0000","last_clean":"2024-04-16T16:20:58.373168+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:20:58.373168+0000","last_undegraded":"2024-04-16T16:20:58.373168+0000","last_fullsized":"2024-04-16T16:20:58.373168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374304+0000","last_change":"2024-04-16T16:20:56.711031+0000","last_active":"2024-04-16T16:20:58.374304+0000","last_peered":"2024-04-16T16:20:58.374304+0000","last_clean":"2024-04-16T16:20:58.374304+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:20:58.374304+0000","last_undegraded":"2024-04-16T16:20:58.374304+0000","last_fullsized":"2024-04-16T16:20:58.374304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:24.434925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708201+0000","last_change":"2024-04-16T16:20:56.699535+0000","last_active":"2024-04-16T16:20:57.708201+0000","last_peered":"2024-04-16T16:20:57.708201+0000","last_clean":"2024-04-16T16:20:57.708201+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:20:57.708201+0000","last_undegraded":"2024-04-16T16:20:57.708201+0000","last_fullsized":"2024-04-16T16:20:57.708201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376001+0000","last_change":"2024-04-16T16:20:56.716226+0000","last_active":"2024-04-16T16:20:58.376001+0000","last_peered":"2024-04-16T16:20:58.376001+0000","last_clean":"2024-04-16T16:20:58.376001+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:20:58.376001+0000","last_undegraded":"2024-04-16T16:20:58.376001+0000","last_fullsized":"2024-04-16T16:20:58.376001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373175+0000","last_change":"2024-04-16T16:20:56.690730+0000","last_active":"2024-04-16T16:20:58.373175+0000","last_peered":"2024-04-16T16:20:58.373175+0000","last_clean":"2024-04-16T16:20:58.373175+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:20:58.373175+0000","last_undegraded":"2024-04-16T16:20:58.373175+0000","last_fullsized":"2024-04-16T16:20:58.373175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:22.566150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374342+0000","last_change":"2024-04-16T16:20:56.708786+0000","last_active":"2024-04-16T16:20:58.374342+0000","last_peered":"2024-04-16T16:20:58.374342+0000","last_clean":"2024-04-16T16:20:58.374342+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:20:58.374342+0000","last_undegraded":"2024-04-16T16:20:58.374342+0000","last_fullsized":"2024-04-16T16:20:58.374342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:51.397773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374485+0000","last_change":"2024-04-16T16:20:56.720038+0000","last_active":"2024-04-16T16:20:58.374485+0000","last_peered":"2024-04-16T16:20:58.374485+0000","last_clean":"2024-04-16T16:20:58.374485+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:20:58.374485+0000","last_undegraded":"2024-04-16T16:20:58.374485+0000","last_fullsized":"2024-04-16T16:20:58.374485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.371823+0000","last_change":"2024-04-16T16:20:56.706135+0000","last_active":"2024-04-16T16:20:58.371823+0000","last_peered":"2024-04-16T16:20:58.371823+0000","last_clean":"2024-04-16T16:20:58.371823+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:20:58.371823+0000","last_undegraded":"2024-04-16T16:20:58.371823+0000","last_fullsized":"2024-04-16T16:20:58.371823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:10:18.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374185+0000","last_change":"2024-04-16T16:20:56.707138+0000","last_active":"2024-04-16T16:20:58.374185+0000","last_peered":"2024-04-16T16:20:58.374185+0000","last_clean":"2024-04-16T16:20:58.374185+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:20:58.374185+0000","last_undegraded":"2024-04-16T16:20:58.374185+0000","last_fullsized":"2024-04-16T16:20:58.374185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376195+0000","last_change":"2024-04-16T16:20:56.714674+0000","last_active":"2024-04-16T16:20:58.376195+0000","last_peered":"2024-04-16T16:20:58.376195+0000","last_clean":"2024-04-16T16:20:58.376195+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:20:58.376195+0000","last_undegraded":"2024-04-16T16:20:58.376195+0000","last_fullsized":"2024-04-16T16:20:58.376195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:47.291306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375823+0000","last_change":"2024-04-16T16:20:55.704083+0000","last_active":"2024-04-16T16:20:58.375823+0000","last_peered":"2024-04-16T16:20:58.375823+0000","last_clean":"2024-04-16T16:20:58.375823+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:20:58.375823+0000","last_undegraded":"2024-04-16T16:20:58.375823+0000","last_fullsized":"2024-04-16T16:20:58.375823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:34.565386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375090+0000","last_change":"2024-04-16T16:20:55.700645+0000","last_active":"2024-04-16T16:20:58.375090+0000","last_peered":"2024-04-16T16:20:58.375090+0000","last_clean":"2024-04-16T16:20:58.375090+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:20:58.375090+0000","last_undegraded":"2024-04-16T16:20:58.375090+0000","last_fullsized":"2024-04-16T16:20:58.375090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:56.588790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376827+0000","last_change":"2024-04-16T16:20:56.717040+0000","last_active":"2024-04-16T16:20:58.376827+0000","last_peered":"2024-04-16T16:20:58.376827+0000","last_clean":"2024-04-16T16:20:58.376827+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:20:58.376827+0000","last_undegraded":"2024-04-16T16:20:58.376827+0000","last_fullsized":"2024-04-16T16:20:58.376827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:57.603218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.698501+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:40.710552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376219+0000","last_change":"2024-04-16T16:20:56.708709+0000","last_active":"2024-04-16T16:20:58.376219+0000","last_peered":"2024-04-16T16:20:58.376219+0000","last_clean":"2024-04-16T16:20:58.376219+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:20:58.376219+0000","last_undegraded":"2024-04-16T16:20:58.376219+0000","last_fullsized":"2024-04-16T16:20:58.376219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:35.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707688+0000","last_change":"2024-04-16T16:20:55.703384+0000","last_active":"2024-04-16T16:20:57.707688+0000","last_peered":"2024-04-16T16:20:57.707688+0000","last_clean":"2024-04-16T16:20:57.707688+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:20:57.707688+0000","last_undegraded":"2024-04-16T16:20:57.707688+0000","last_fullsized":"2024-04-16T16:20:57.707688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373769+0000","last_change":"2024-04-16T16:20:56.703273+0000","last_active":"2024-04-16T16:20:58.373769+0000","last_peered":"2024-04-16T16:20:58.373769+0000","last_clean":"2024-04-16T16:20:58.373769+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:20:58.373769+0000","last_undegraded":"2024-04-16T16:20:58.373769+0000","last_fullsized":"2024-04-16T16:20:58.373769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:37.220892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373915+0000","last_change":"2024-04-16T16:20:56.706317+0000","last_active":"2024-04-16T16:20:58.373915+0000","last_peered":"2024-04-16T16:20:58.373915+0000","last_clean":"2024-04-16T16:20:58.373915+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:20:58.373915+0000","last_undegraded":"2024-04-16T16:20:58.373915+0000","last_fullsized":"2024-04-16T16:20:58.373915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:18.555574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374892+0000","last_change":"2024-04-16T16:20:55.703837+0000","last_active":"2024-04-16T16:20:58.374892+0000","last_peered":"2024-04-16T16:20:58.374892+0000","last_clean":"2024-04-16T16:20:58.374892+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:20:58.374892+0000","last_undegraded":"2024-04-16T16:20:58.374892+0000","last_fullsized":"2024-04-16T16:20:58.374892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:13.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372897+0000","last_change":"2024-04-16T16:20:56.716680+0000","last_active":"2024-04-16T16:20:58.372897+0000","last_peered":"2024-04-16T16:20:58.372897+0000","last_clean":"2024-04-16T16:20:58.372897+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:20:58.372897+0000","last_undegraded":"2024-04-16T16:20:58.372897+0000","last_fullsized":"2024-04-16T16:20:58.372897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705691+0000","last_change":"2024-04-16T16:20:55.699938+0000","last_active":"2024-04-16T16:20:57.705691+0000","last_peered":"2024-04-16T16:20:57.705691+0000","last_clean":"2024-04-16T16:20:57.705691+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:20:57.705691+0000","last_undegraded":"2024-04-16T16:20:57.705691+0000","last_fullsized":"2024-04-16T16:20:57.705691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373328+0000","last_change":"2024-04-16T16:20:56.709848+0000","last_active":"2024-04-16T16:20:58.373328+0000","last_peered":"2024-04-16T16:20:58.373328+0000","last_clean":"2024-04-16T16:20:58.373328+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:20:58.373328+0000","last_undegraded":"2024-04-16T16:20:58.373328+0000","last_fullsized":"2024-04-16T16:20:58.373328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:46.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375190+0000","last_change":"2024-04-16T16:20:55.703623+0000","last_active":"2024-04-16T16:20:58.375190+0000","last_peered":"2024-04-16T16:20:58.375190+0000","last_clean":"2024-04-16T16:20:58.375190+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:20:58.375190+0000","last_undegraded":"2024-04-16T16:20:58.375190+0000","last_fullsized":"2024-04-16T16:20:58.375190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374994+0000","last_change":"2024-04-16T16:20:56.723400+0000","last_active":"2024-04-16T16:20:58.374994+0000","last_peered":"2024-04-16T16:20:58.374994+0000","last_clean":"2024-04-16T16:20:58.374994+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:20:58.374994+0000","last_undegraded":"2024-04-16T16:20:58.374994+0000","last_fullsized":"2024-04-16T16:20:58.374994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375368+0000","last_change":"2024-04-16T16:20:55.694413+0000","last_active":"2024-04-16T16:20:58.375368+0000","last_peered":"2024-04-16T16:20:58.375368+0000","last_clean":"2024-04-16T16:20:58.375368+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:20:58.375368+0000","last_undegraded":"2024-04-16T16:20:58.375368+0000","last_fullsized":"2024-04-16T16:20:58.375368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:21.591232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375589+0000","last_change":"2024-04-16T16:20:55.702261+0000","last_active":"2024-04-16T16:20:58.375589+0000","last_peered":"2024-04-16T16:20:58.375589+0000","last_clean":"2024-04-16T16:20:58.375589+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:20:58.375589+0000","last_undegraded":"2024-04-16T16:20:58.375589+0000","last_fullsized":"2024-04-16T16:20:58.375589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375450+0000","last_change":"2024-04-16T16:20:56.712767+0000","last_active":"2024-04-16T16:20:58.375450+0000","last_peered":"2024-04-16T16:20:58.375450+0000","last_clean":"2024-04-16T16:20:58.375450+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:20:58.375450+0000","last_undegraded":"2024-04-16T16:20:58.375450+0000","last_fullsized":"2024-04-16T16:20:58.375450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706177+0000","last_change":"2024-04-16T16:20:56.704028+0000","last_active":"2024-04-16T16:20:57.706177+0000","last_peered":"2024-04-16T16:20:57.706177+0000","last_clean":"2024-04-16T16:20:57.706177+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:20:57.706177+0000","last_undegraded":"2024-04-16T16:20:57.706177+0000","last_fullsized":"2024-04-16T16:20:57.706177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373761+0000","last_change":"2024-04-16T16:20:55.691499+0000","last_active":"2024-04-16T16:20:58.373761+0000","last_peered":"2024-04-16T16:20:58.373761+0000","last_clean":"2024-04-16T16:20:58.373761+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:20:58.373761+0000","last_undegraded":"2024-04-16T16:20:58.373761+0000","last_fullsized":"2024-04-16T16:20:58.373761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:46.276878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374544+0000","last_change":"2024-04-16T16:20:56.718537+0000","last_active":"2024-04-16T16:20:58.374544+0000","last_peered":"2024-04-16T16:20:58.374544+0000","last_clean":"2024-04-16T16:20:58.374544+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:20:58.374544+0000","last_undegraded":"2024-04-16T16:20:58.374544+0000","last_fullsized":"2024-04-16T16:20:58.374544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372802+0000","last_change":"2024-04-16T16:20:55.700778+0000","last_active":"2024-04-16T16:20:58.372802+0000","last_peered":"2024-04-16T16:20:58.372802+0000","last_clean":"2024-04-16T16:20:58.372802+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:20:58.372802+0000","last_undegraded":"2024-04-16T16:20:58.372802+0000","last_fullsized":"2024-04-16T16:20:58.372802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:21.223928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705837+0000","last_change":"2024-04-16T16:20:55.700889+0000","last_active":"2024-04-16T16:20:57.705837+0000","last_peered":"2024-04-16T16:20:57.705837+0000","last_clean":"2024-04-16T16:20:57.705837+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:20:57.705837+0000","last_undegraded":"2024-04-16T16:20:57.705837+0000","last_fullsized":"2024-04-16T16:20:57.705837+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374373+0000","last_change":"2024-04-16T16:20:56.720365+0000","last_active":"2024-04-16T16:20:58.374373+0000","last_peered":"2024-04-16T16:20:58.374373+0000","last_clean":"2024-04-16T16:20:58.374373+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:20:58.374373+0000","last_undegraded":"2024-04-16T16:20:58.374373+0000","last_fullsized":"2024-04-16T16:20:58.374373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373392+0000","last_change":"2024-04-16T16:20:55.705450+0000","last_active":"2024-04-16T16:20:58.373392+0000","last_peered":"2024-04-16T16:20:58.373392+0000","last_clean":"2024-04-16T16:20:58.373392+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:20:58.373392+0000","last_undegraded":"2024-04-16T16:20:58.373392+0000","last_fullsized":"2024-04-16T16:20:58.373392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375228+0000","last_change":"2024-04-16T16:20:56.721758+0000","last_active":"2024-04-16T16:20:58.375228+0000","last_peered":"2024-04-16T16:20:58.375228+0000","last_clean":"2024-04-16T16:20:58.375228+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:20:58.375228+0000","last_undegraded":"2024-04-16T16:20:58.375228+0000","last_fullsized":"2024-04-16T16:20:58.375228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375245+0000","last_change":"2024-04-16T16:20:55.691154+0000","last_active":"2024-04-16T16:20:58.375245+0000","last_peered":"2024-04-16T16:20:58.375245+0000","last_clean":"2024-04-16T16:20:58.375245+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:20:58.375245+0000","last_undegraded":"2024-04-16T16:20:58.375245+0000","last_fullsized":"2024-04-16T16:20:58.375245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:48.698225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708411+0000","last_change":"2024-04-16T16:20:56.708684+0000","last_active":"2024-04-16T16:20:57.708411+0000","last_peered":"2024-04-16T16:20:57.708411+0000","last_clean":"2024-04-16T16:20:57.708411+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:20:57.708411+0000","last_undegraded":"2024-04-16T16:20:57.708411+0000","last_fullsized":"2024-04-16T16:20:57.708411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.699664+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375214+0000","last_change":"2024-04-16T16:20:56.712157+0000","last_active":"2024-04-16T16:20:58.375214+0000","last_peered":"2024-04-16T16:20:58.375214+0000","last_clean":"2024-04-16T16:20:58.375214+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:20:58.375214+0000","last_undegraded":"2024-04-16T16:20:58.375214+0000","last_fullsized":"2024-04-16T16:20:58.375214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707746+0000","last_change":"2024-04-16T16:20:55.702354+0000","last_active":"2024-04-16T16:20:57.707746+0000","last_peered":"2024-04-16T16:20:57.707746+0000","last_clean":"2024-04-16T16:20:57.707746+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:20:57.707746+0000","last_undegraded":"2024-04-16T16:20:57.707746+0000","last_fullsized":"2024-04-16T16:20:57.707746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:50.973007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375511+0000","last_change":"2024-04-16T16:20:56.712536+0000","last_active":"2024-04-16T16:20:58.375511+0000","last_peered":"2024-04-16T16:20:58.375511+0000","last_clean":"2024-04-16T16:20:58.375511+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:20:58.375511+0000","last_undegraded":"2024-04-16T16:20:58.375511+0000","last_fullsized":"2024-04-16T16:20:58.375511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375548+0000","last_change":"2024-04-16T16:20:55.697400+0000","last_active":"2024-04-16T16:20:58.375548+0000","last_peered":"2024-04-16T16:20:58.375548+0000","last_clean":"2024-04-16T16:20:58.375548+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:20:58.375548+0000","last_undegraded":"2024-04-16T16:20:58.375548+0000","last_fullsized":"2024-04-16T16:20:58.375548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:32.224244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706503+0000","last_change":"2024-04-16T16:20:56.705284+0000","last_active":"2024-04-16T16:20:57.706503+0000","last_peered":"2024-04-16T16:20:57.706503+0000","last_clean":"2024-04-16T16:20:57.706503+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:20:57.706503+0000","last_undegraded":"2024-04-16T16:20:57.706503+0000","last_fullsized":"2024-04-16T16:20:57.706503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374874+0000","last_change":"2024-04-16T16:20:55.691520+0000","last_active":"2024-04-16T16:20:58.374874+0000","last_peered":"2024-04-16T16:20:58.374874+0000","last_clean":"2024-04-16T16:20:58.374874+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:20:58.374874+0000","last_undegraded":"2024-04-16T16:20:58.374874+0000","last_fullsized":"2024-04-16T16:20:58.374874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:34.964542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376142+0000","last_change":"2024-04-16T16:20:56.714025+0000","last_active":"2024-04-16T16:20:58.376142+0000","last_peered":"2024-04-16T16:20:58.376142+0000","last_clean":"2024-04-16T16:20:58.376142+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:20:58.376142+0000","last_undegraded":"2024-04-16T16:20:58.376142+0000","last_fullsized":"2024-04-16T16:20:58.376142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374747+0000","last_change":"2024-04-16T16:20:56.715573+0000","last_active":"2024-04-16T16:20:58.374747+0000","last_peered":"2024-04-16T16:20:58.374747+0000","last_clean":"2024-04-16T16:20:58.374747+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:20:58.374747+0000","last_undegraded":"2024-04-16T16:20:58.374747+0000","last_fullsized":"2024-04-16T16:20:58.374747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705507+0000","last_change":"2024-04-16T16:20:55.700653+0000","last_active":"2024-04-16T16:20:57.705507+0000","last_peered":"2024-04-16T16:20:57.705507+0000","last_clean":"2024-04-16T16:20:57.705507+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:20:57.705507+0000","last_undegraded":"2024-04-16T16:20:57.705507+0000","last_fullsized":"2024-04-16T16:20:57.705507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:30.271546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708260+0000","last_change":"2024-04-16T16:20:56.691557+0000","last_active":"2024-04-16T16:20:57.708260+0000","last_peered":"2024-04-16T16:20:57.708260+0000","last_clean":"2024-04-16T16:20:57.708260+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:20:57.708260+0000","last_undegraded":"2024-04-16T16:20:57.708260+0000","last_fullsized":"2024-04-16T16:20:57.708260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708599+0000","last_change":"2024-04-16T16:20:56.714215+0000","last_active":"2024-04-16T16:20:57.708599+0000","last_peered":"2024-04-16T16:20:57.708599+0000","last_clean":"2024-04-16T16:20:57.708599+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:20:57.708599+0000","last_undegraded":"2024-04-16T16:20:57.708599+0000","last_fullsized":"2024-04-16T16:20:57.708599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376396+0000","last_change":"2024-04-16T16:20:55.704363+0000","last_active":"2024-04-16T16:20:58.376396+0000","last_peered":"2024-04-16T16:20:58.376396+0000","last_clean":"2024-04-16T16:20:58.376396+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:20:58.376396+0000","last_undegraded":"2024-04-16T16:20:58.376396+0000","last_fullsized":"2024-04-16T16:20:58.376396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372943+0000","last_change":"2024-04-16T16:20:55.703477+0000","last_active":"2024-04-16T16:20:58.372943+0000","last_peered":"2024-04-16T16:20:58.372943+0000","last_clean":"2024-04-16T16:20:58.372943+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:20:58.372943+0000","last_undegraded":"2024-04-16T16:20:58.372943+0000","last_fullsized":"2024-04-16T16:20:58.372943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:15.228538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376581+0000","last_change":"2024-04-16T16:20:56.707864+0000","last_active":"2024-04-16T16:20:58.376581+0000","last_peered":"2024-04-16T16:20:58.376581+0000","last_clean":"2024-04-16T16:20:58.376581+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:20:58.376581+0000","last_undegraded":"2024-04-16T16:20:58.376581+0000","last_fullsized":"2024-04-16T16:20:58.376581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:21.749618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707985+0000","last_change":"2024-04-16T16:20:55.701244+0000","last_active":"2024-04-16T16:20:57.707985+0000","last_peered":"2024-04-16T16:20:57.707985+0000","last_clean":"2024-04-16T16:20:57.707985+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:20:57.707985+0000","last_undegraded":"2024-04-16T16:20:57.707985+0000","last_fullsized":"2024-04-16T16:20:57.707985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374179+0000","last_change":"2024-04-16T16:20:56.707897+0000","last_active":"2024-04-16T16:20:58.374179+0000","last_peered":"2024-04-16T16:20:58.374179+0000","last_clean":"2024-04-16T16:20:58.374179+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:20:58.374179+0000","last_undegraded":"2024-04-16T16:20:58.374179+0000","last_fullsized":"2024-04-16T16:20:58.374179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:42.907490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374977+0000","last_change":"2024-04-16T16:20:56.720972+0000","last_active":"2024-04-16T16:20:58.374977+0000","last_peered":"2024-04-16T16:20:58.374977+0000","last_clean":"2024-04-16T16:20:58.374977+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:20:58.374977+0000","last_undegraded":"2024-04-16T16:20:58.374977+0000","last_fullsized":"2024-04-16T16:20:58.374977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373562+0000","last_change":"2024-04-16T16:20:56.708340+0000","last_active":"2024-04-16T16:20:58.373562+0000","last_peered":"2024-04-16T16:20:58.373562+0000","last_clean":"2024-04-16T16:20:58.373562+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:20:58.373562+0000","last_undegraded":"2024-04-16T16:20:58.373562+0000","last_fullsized":"2024-04-16T16:20:58.373562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:07.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372721+0000","last_change":"2024-04-16T16:20:55.692470+0000","last_active":"2024-04-16T16:20:58.372721+0000","last_peered":"2024-04-16T16:20:58.372721+0000","last_clean":"2024-04-16T16:20:58.372721+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:20:58.372721+0000","last_undegraded":"2024-04-16T16:20:58.372721+0000","last_fullsized":"2024-04-16T16:20:58.372721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:20.735190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372709+0000","last_change":"2024-04-16T16:20:56.720232+0000","last_active":"2024-04-16T16:20:58.372709+0000","last_peered":"2024-04-16T16:20:58.372709+0000","last_clean":"2024-04-16T16:20:58.372709+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:20:58.372709+0000","last_undegraded":"2024-04-16T16:20:58.372709+0000","last_fullsized":"2024-04-16T16:20:58.372709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:34.266414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372516+0000","last_change":"2024-04-16T16:20:55.702982+0000","last_active":"2024-04-16T16:20:58.372516+0000","last_peered":"2024-04-16T16:20:58.372516+0000","last_clean":"2024-04-16T16:20:58.372516+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:20:58.372516+0000","last_undegraded":"2024-04-16T16:20:58.372516+0000","last_fullsized":"2024-04-16T16:20:58.372516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:05.020022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373594+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:58.373594+0000","last_peered":"2024-04-16T16:20:58.373594+0000","last_clean":"2024-04-16T16:20:58.373594+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:58.373594+0000","last_undegraded":"2024-04-16T16:20:58.373594+0000","last_fullsized":"2024-04-16T16:20:58.373594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":904511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":313983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":753664,"data_stored":314635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":906545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:10.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:10.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.478+0000 7fe942400640 1 Processor -- start 2024-04-16T16:21:10.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.478+0000 7fe942400640 1 -- start start 2024-04-16T16:21:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.480+0000 7fe942400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe93c0b0be0 0x7fe93c072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.480+0000 7fe942400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c062440 0x7fe93c0628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.480+0000 7fe942400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c0af140 con 0x7fe93c15ebf0 2024-04-16T16:21:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.480+0000 7fe942400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe93c062df0 con 0x7fe93c0b0be0 2024-04-16T16:21:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.480+0000 7fe942400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe93c0af420 con 0x7fe93c062440 2024-04-16T16:21:10.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.481+0000 7fe93b400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe93c15ebf0 0x7fe93c0ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39332/0 (socket says 172.21.15.22:39332) 2024-04-16T16:21:10.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.481+0000 7fe93b400640 1 -- 172.21.15.22:0/361983137 learned_addr learned my addr 172.21.15.22:0/361983137 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:10.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.481+0000 7fe93aa00640 1 --2- 172.21.15.22:0/361983137 >> v2:172.21.15.43:3300/0 conn(0x7fe93c0b0be0 0x7fe93c072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.481+0000 7fe93be00640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c062440 0x7fe93c0628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.481+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087345538 0 0) 0x7fe93c0af140 con 0x7fe93c15ebf0 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.481+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe920003520 con 0x7fe93c15ebf0 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2912434562 0 0) 0x7fe920003520 con 0x7fe93c15ebf0 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c062440 msgr2=0x7fe93c0628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c062440 0x7fe93c0628b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 >> v2:172.21.15.43:3300/0 conn(0x7fe93c0b0be0 msgr2=0x7fe93c072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:10.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 --2- 172.21.15.22:0/361983137 >> v2:172.21.15.43:3300/0 conn(0x7fe93c0b0be0 0x7fe93c072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c0721f0 con 0x7fe93c15ebf0 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fe92c001670 con 0x7fe93c15ebf0 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 >> v1:172.21.15.22:6789/0 conn(0x7fe93c15ebf0 legacy=0x7fe93c0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c062440 0x7fe9200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe920003f80 0x7fe920004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe9200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c062df0 con 0x7fe920004d40 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c0af420 con 0x7fe920003f80 2024-04-16T16:21:10.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe92000b9c0 con 0x7fe93c062440 2024-04-16T16:21:10.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93be00640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe9200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93be00640 1 -- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c062440 msgr2=0x7fe9200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:10.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93be00640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c062440 0x7fe9200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93be00640 1 -- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe920003f80 msgr2=0x7fe920004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:10.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93be00640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe920003f80 0x7fe920004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.482+0000 7fe93be00640 1 -- 172.21.15.22:0/361983137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe920003520 con 0x7fe920004d40 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe93be00640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe9200051c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe93400e170 tx=0x7fe920005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366487eb2a9d87ab server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934039070 con 0x7fe920004d40 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe93402cc20 con 0x7fe920004d40 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe93a000640 1 -- 172.21.15.22:0/361983137 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934009c10 con 0x7fe920004d40 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe942400640 1 -- 172.21.15.22:0/361983137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 msgr2=0x7fe9200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe942400640 1 --2- 172.21.15.22:0/361983137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe9200051c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe93400e170 tx=0x7fe920005830 comp rx=0 tx=0).stop 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe93be00640 1 -- 172.21.15.22:0/361983137 reap_dead start 2024-04-16T16:21:10.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe942400640 1 -- 172.21.15.22:0/361983137 shutdown_connections 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.484+0000 7fe942400640 1 -- 172.21.15.22:0/361983137 >> 172.21.15.22:0/361983137 conn(0x7fe93c0d1820 msgr2=0x7fe93c0d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.485+0000 7fe942400640 1 -- 172.21.15.22:0/361983137 shutdown_connections 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.485+0000 7fe942400640 1 -- 172.21.15.22:0/361983137 wait complete. 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.486+0000 7fe942400640 1 Processor -- start 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.486+0000 7fe942400640 1 -- start start 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.487+0000 7fe942400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe93c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.487+0000 7fe942400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe93c15c820 0x7fe93c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.487+0000 7fe942400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c0d04a0 0x7fe93c0d0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.487+0000 7fe942400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c15efd0 con 0x7fe920004d40 2024-04-16T16:21:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.487+0000 7fe942400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c0727b0 con 0x7fe93c15c820 2024-04-16T16:21:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.487+0000 7fe942400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe93c15f150 con 0x7fe93c0d04a0 2024-04-16T16:21:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe93c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe93c14a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37820/0 (socket says 172.21.15.22:37820) 2024-04-16T16:21:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 -- 172.21.15.22:0/2804615003 learned_addr learned my addr 172.21.15.22:0/2804615003 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93be00640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c0d04a0 0x7fe93c0d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93aa00640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe93c15c820 0x7fe93c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 -- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c0d04a0 msgr2=0x7fe93c0d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c0d04a0 0x7fe93c0d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 -- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe93c15c820 msgr2=0x7fe93c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe93c15c820 0x7fe93c15cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.488+0000 7fe93b400640 1 -- 172.21.15.22:0/2804615003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c0cf400 con 0x7fe920004d40 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.489+0000 7fe93b400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe93c14a240 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c800 tx=0x7fe92c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.489+0000 7fe933400640 1 -- 172.21.15.22:0/2804615003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c018070 con 0x7fe920004d40 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.489+0000 7fe933400640 1 -- 172.21.15.22:0/2804615003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92c0074e0 con 0x7fe920004d40 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.489+0000 7fe933400640 1 -- 172.21.15.22:0/2804615003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c004a00 con 0x7fe920004d40 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.489+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe93c0cf6e0 con 0x7fe920004d40 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.489+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93c0cfca0 con 0x7fe920004d40 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.490+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93c04fd90 con 0x7fe920004d40 2024-04-16T16:21:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.491+0000 7fe933400640 1 -- 172.21.15.22:0/2804615003 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fe92c01b070 con 0x7fe920004d40 2024-04-16T16:21:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.492+0000 7fe933400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe91c06ce90 0x7fe91c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.493+0000 7fe933400640 1 -- 172.21.15.22:0/2804615003 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fe92c08bc60 con 0x7fe920004d40 2024-04-16T16:21:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.493+0000 7fe93aa00640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe91c06ce90 0x7fe91c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.494+0000 7fe93aa00640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe91c06ce90 0x7fe91c06f350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe928004770 tx=0x7fe928008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:10.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.497+0000 7fe933400640 1 -- 172.21.15.22:0/2804615003 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe92c0597e0 con 0x7fe920004d40 2024-04-16T16:21:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.690+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe93c070460 con 0x7fe91c06ce90 2024-04-16T16:21:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.707+0000 7fe933400640 1 -- 172.21.15.22:0/2804615003 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251843 (secure 0 0 0) 0x7fe93c070460 con 0x7fe91c06ce90 2024-04-16T16:21:10.710 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:10.712 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:10.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe91c06ce90 msgr2=0x7fe91c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe91c06ce90 0x7fe91c06f350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe928004770 tx=0x7fe928008040 comp rx=0 tx=0).stop 2024-04-16T16:21:10.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 msgr2=0x7fe93c14a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:10.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe93c14a240 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c800 tx=0x7fe92c00ccc0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 shutdown_connections 2024-04-16T16:21:10.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe91c06ce90 0x7fe91c06f350 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe93c0d04a0 0x7fe93c0d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe93c15c820 0x7fe93c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 --2- 172.21.15.22:0/2804615003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe920004d40 0x7fe93c14a240 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.713+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 >> 172.21.15.22:0/2804615003 conn(0x7fe93c0d1820 msgr2=0x7fe93c0b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.714+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 shutdown_connections 2024-04-16T16:21:10.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.714+0000 7fe942400640 1 -- 172.21.15.22:0/2804615003 wait complete. 2024-04-16T16:21:10.733 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-16T16:21:09.795946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256512,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718208,"statfs":{"total":773094113280,"available":772831444992,"internally_reserved":0,"allocated":7217152,"data_stored":3697420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004579"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373919+0000","last_change":"2024-04-16T16:20:56.700692+0000","last_active":"2024-04-16T16:20:58.373919+0000","last_peered":"2024-04-16T16:20:58.373919+0000","last_clean":"2024-04-16T16:20:58.373919+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:20:58.373919+0000","last_undegraded":"2024-04-16T16:20:58.373919+0000","last_fullsized":"2024-04-16T16:20:58.373919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:01.405645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375924+0000","last_change":"2024-04-16T16:20:56.704487+0000","last_active":"2024-04-16T16:20:58.375924+0000","last_peered":"2024-04-16T16:20:58.375924+0000","last_clean":"2024-04-16T16:20:58.375924+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:20:58.375924+0000","last_undegraded":"2024-04-16T16:20:58.375924+0000","last_fullsized":"2024-04-16T16:20:58.375924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:18.892594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374985+0000","last_change":"2024-04-16T16:20:56.710584+0000","last_active":"2024-04-16T16:20:58.374985+0000","last_peered":"2024-04-16T16:20:58.374985+0000","last_clean":"2024-04-16T16:20:58.374985+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:20:58.374985+0000","last_undegraded":"2024-04-16T16:20:58.374985+0000","last_fullsized":"2024-04-16T16:20:58.374985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708372+0000","last_change":"2024-04-16T16:20:56.694479+0000","last_active":"2024-04-16T16:20:57.708372+0000","last_peered":"2024-04-16T16:20:57.708372+0000","last_clean":"2024-04-16T16:20:57.708372+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:20:57.708372+0000","last_undegraded":"2024-04-16T16:20:57.708372+0000","last_fullsized":"2024-04-16T16:20:57.708372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373184+0000","last_change":"2024-04-16T16:20:56.687650+0000","last_active":"2024-04-16T16:20:58.373184+0000","last_peered":"2024-04-16T16:20:58.373184+0000","last_clean":"2024-04-16T16:20:58.373184+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:20:58.373184+0000","last_undegraded":"2024-04-16T16:20:58.373184+0000","last_fullsized":"2024-04-16T16:20:58.373184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:24.566878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374109+0000","last_change":"2024-04-16T16:20:56.696467+0000","last_active":"2024-04-16T16:20:58.374109+0000","last_peered":"2024-04-16T16:20:58.374109+0000","last_clean":"2024-04-16T16:20:58.374109+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:20:58.374109+0000","last_undegraded":"2024-04-16T16:20:58.374109+0000","last_fullsized":"2024-04-16T16:20:58.374109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372576+0000","last_change":"2024-04-16T16:20:56.711962+0000","last_active":"2024-04-16T16:20:58.372576+0000","last_peered":"2024-04-16T16:20:58.372576+0000","last_clean":"2024-04-16T16:20:58.372576+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:20:58.372576+0000","last_undegraded":"2024-04-16T16:20:58.372576+0000","last_fullsized":"2024-04-16T16:20:58.372576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:34.290551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.702421+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373554+0000","last_change":"2024-04-16T16:20:56.705792+0000","last_active":"2024-04-16T16:20:58.373554+0000","last_peered":"2024-04-16T16:20:58.373554+0000","last_clean":"2024-04-16T16:20:58.373554+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:20:58.373554+0000","last_undegraded":"2024-04-16T16:20:58.373554+0000","last_fullsized":"2024-04-16T16:20:58.373554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373773+0000","last_change":"2024-04-16T16:20:56.716792+0000","last_active":"2024-04-16T16:20:58.373773+0000","last_peered":"2024-04-16T16:20:58.373773+0000","last_clean":"2024-04-16T16:20:58.373773+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:20:58.373773+0000","last_undegraded":"2024-04-16T16:20:58.373773+0000","last_fullsized":"2024-04-16T16:20:58.373773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375444+0000","last_change":"2024-04-16T16:20:56.709293+0000","last_active":"2024-04-16T16:20:58.375444+0000","last_peered":"2024-04-16T16:20:58.375444+0000","last_clean":"2024-04-16T16:20:58.375444+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:20:58.375444+0000","last_undegraded":"2024-04-16T16:20:58.375444+0000","last_fullsized":"2024-04-16T16:20:58.375444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:47.440922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374963+0000","last_change":"2024-04-16T16:20:56.722078+0000","last_active":"2024-04-16T16:20:58.374963+0000","last_peered":"2024-04-16T16:20:58.374963+0000","last_clean":"2024-04-16T16:20:58.374963+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:20:58.374963+0000","last_undegraded":"2024-04-16T16:20:58.374963+0000","last_fullsized":"2024-04-16T16:20:58.374963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372189+0000","last_change":"2024-04-16T16:20:56.703752+0000","last_active":"2024-04-16T16:20:58.372189+0000","last_peered":"2024-04-16T16:20:58.372189+0000","last_clean":"2024-04-16T16:20:58.372189+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:20:58.372189+0000","last_undegraded":"2024-04-16T16:20:58.372189+0000","last_fullsized":"2024-04-16T16:20:58.372189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:32.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374871+0000","last_change":"2024-04-16T16:20:56.718849+0000","last_active":"2024-04-16T16:20:58.374871+0000","last_peered":"2024-04-16T16:20:58.374871+0000","last_clean":"2024-04-16T16:20:58.374871+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:20:58.374871+0000","last_undegraded":"2024-04-16T16:20:58.374871+0000","last_fullsized":"2024-04-16T16:20:58.374871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.829545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374676+0000","last_change":"2024-04-16T16:20:56.715256+0000","last_active":"2024-04-16T16:20:58.374676+0000","last_peered":"2024-04-16T16:20:58.374676+0000","last_clean":"2024-04-16T16:20:58.374676+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:20:58.374676+0000","last_undegraded":"2024-04-16T16:20:58.374676+0000","last_fullsized":"2024-04-16T16:20:58.374676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374265+0000","last_change":"2024-04-16T16:20:56.703517+0000","last_active":"2024-04-16T16:20:58.374265+0000","last_peered":"2024-04-16T16:20:58.374265+0000","last_clean":"2024-04-16T16:20:58.374265+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:20:58.374265+0000","last_undegraded":"2024-04-16T16:20:58.374265+0000","last_fullsized":"2024-04-16T16:20:58.374265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:28.081709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374176+0000","last_change":"2024-04-16T16:20:56.719987+0000","last_active":"2024-04-16T16:20:58.374176+0000","last_peered":"2024-04-16T16:20:58.374176+0000","last_clean":"2024-04-16T16:20:58.374176+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:20:58.374176+0000","last_undegraded":"2024-04-16T16:20:58.374176+0000","last_fullsized":"2024-04-16T16:20:58.374176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373168+0000","last_change":"2024-04-16T16:20:56.720302+0000","last_active":"2024-04-16T16:20:58.373168+0000","last_peered":"2024-04-16T16:20:58.373168+0000","last_clean":"2024-04-16T16:20:58.373168+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:20:58.373168+0000","last_undegraded":"2024-04-16T16:20:58.373168+0000","last_fullsized":"2024-04-16T16:20:58.373168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374304+0000","last_change":"2024-04-16T16:20:56.711031+0000","last_active":"2024-04-16T16:20:58.374304+0000","last_peered":"2024-04-16T16:20:58.374304+0000","last_clean":"2024-04-16T16:20:58.374304+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:20:58.374304+0000","last_undegraded":"2024-04-16T16:20:58.374304+0000","last_fullsized":"2024-04-16T16:20:58.374304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:24.434925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708201+0000","last_change":"2024-04-16T16:20:56.699535+0000","last_active":"2024-04-16T16:20:57.708201+0000","last_peered":"2024-04-16T16:20:57.708201+0000","last_clean":"2024-04-16T16:20:57.708201+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:20:57.708201+0000","last_undegraded":"2024-04-16T16:20:57.708201+0000","last_fullsized":"2024-04-16T16:20:57.708201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376001+0000","last_change":"2024-04-16T16:20:56.716226+0000","last_active":"2024-04-16T16:20:58.376001+0000","last_peered":"2024-04-16T16:20:58.376001+0000","last_clean":"2024-04-16T16:20:58.376001+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:20:58.376001+0000","last_undegraded":"2024-04-16T16:20:58.376001+0000","last_fullsized":"2024-04-16T16:20:58.376001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373175+0000","last_change":"2024-04-16T16:20:56.690730+0000","last_active":"2024-04-16T16:20:58.373175+0000","last_peered":"2024-04-16T16:20:58.373175+0000","last_clean":"2024-04-16T16:20:58.373175+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:20:58.373175+0000","last_undegraded":"2024-04-16T16:20:58.373175+0000","last_fullsized":"2024-04-16T16:20:58.373175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:22.566150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374342+0000","last_change":"2024-04-16T16:20:56.708786+0000","last_active":"2024-04-16T16:20:58.374342+0000","last_peered":"2024-04-16T16:20:58.374342+0000","last_clean":"2024-04-16T16:20:58.374342+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:20:58.374342+0000","last_undegraded":"2024-04-16T16:20:58.374342+0000","last_fullsized":"2024-04-16T16:20:58.374342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:51.397773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374485+0000","last_change":"2024-04-16T16:20:56.720038+0000","last_active":"2024-04-16T16:20:58.374485+0000","last_peered":"2024-04-16T16:20:58.374485+0000","last_clean":"2024-04-16T16:20:58.374485+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:20:58.374485+0000","last_undegraded":"2024-04-16T16:20:58.374485+0000","last_fullsized":"2024-04-16T16:20:58.374485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.371823+0000","last_change":"2024-04-16T16:20:56.706135+0000","last_active":"2024-04-16T16:20:58.371823+0000","last_peered":"2024-04-16T16:20:58.371823+0000","last_clean":"2024-04-16T16:20:58.371823+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:20:58.371823+0000","last_undegraded":"2024-04-16T16:20:58.371823+0000","last_fullsized":"2024-04-16T16:20:58.371823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:10:18.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374185+0000","last_change":"2024-04-16T16:20:56.707138+0000","last_active":"2024-04-16T16:20:58.374185+0000","last_peered":"2024-04-16T16:20:58.374185+0000","last_clean":"2024-04-16T16:20:58.374185+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:20:58.374185+0000","last_undegraded":"2024-04-16T16:20:58.374185+0000","last_fullsized":"2024-04-16T16:20:58.374185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376195+0000","last_change":"2024-04-16T16:20:56.714674+0000","last_active":"2024-04-16T16:20:58.376195+0000","last_peered":"2024-04-16T16:20:58.376195+0000","last_clean":"2024-04-16T16:20:58.376195+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:20:58.376195+0000","last_undegraded":"2024-04-16T16:20:58.376195+0000","last_fullsized":"2024-04-16T16:20:58.376195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:47.291306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375823+0000","last_change":"2024-04-16T16:20:55.704083+0000","last_active":"2024-04-16T16:20:58.375823+0000","last_peered":"2024-04-16T16:20:58.375823+0000","last_clean":"2024-04-16T16:20:58.375823+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:20:58.375823+0000","last_undegraded":"2024-04-16T16:20:58.375823+0000","last_fullsized":"2024-04-16T16:20:58.375823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:34.565386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375090+0000","last_change":"2024-04-16T16:20:55.700645+0000","last_active":"2024-04-16T16:20:58.375090+0000","last_peered":"2024-04-16T16:20:58.375090+0000","last_clean":"2024-04-16T16:20:58.375090+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:20:58.375090+0000","last_undegraded":"2024-04-16T16:20:58.375090+0000","last_fullsized":"2024-04-16T16:20:58.375090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:56.588790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376827+0000","last_change":"2024-04-16T16:20:56.717040+0000","last_active":"2024-04-16T16:20:58.376827+0000","last_peered":"2024-04-16T16:20:58.376827+0000","last_clean":"2024-04-16T16:20:58.376827+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:20:58.376827+0000","last_undegraded":"2024-04-16T16:20:58.376827+0000","last_fullsized":"2024-04-16T16:20:58.376827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:57.603218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.698501+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:40.710552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376219+0000","last_change":"2024-04-16T16:20:56.708709+0000","last_active":"2024-04-16T16:20:58.376219+0000","last_peered":"2024-04-16T16:20:58.376219+0000","last_clean":"2024-04-16T16:20:58.376219+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:20:58.376219+0000","last_undegraded":"2024-04-16T16:20:58.376219+0000","last_fullsized":"2024-04-16T16:20:58.376219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:35.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707688+0000","last_change":"2024-04-16T16:20:55.703384+0000","last_active":"2024-04-16T16:20:57.707688+0000","last_peered":"2024-04-16T16:20:57.707688+0000","last_clean":"2024-04-16T16:20:57.707688+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:20:57.707688+0000","last_undegraded":"2024-04-16T16:20:57.707688+0000","last_fullsized":"2024-04-16T16:20:57.707688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373769+0000","last_change":"2024-04-16T16:20:56.703273+0000","last_active":"2024-04-16T16:20:58.373769+0000","last_peered":"2024-04-16T16:20:58.373769+0000","last_clean":"2024-04-16T16:20:58.373769+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:20:58.373769+0000","last_undegraded":"2024-04-16T16:20:58.373769+0000","last_fullsized":"2024-04-16T16:20:58.373769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:37.220892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373915+0000","last_change":"2024-04-16T16:20:56.706317+0000","last_active":"2024-04-16T16:20:58.373915+0000","last_peered":"2024-04-16T16:20:58.373915+0000","last_clean":"2024-04-16T16:20:58.373915+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:20:58.373915+0000","last_undegraded":"2024-04-16T16:20:58.373915+0000","last_fullsized":"2024-04-16T16:20:58.373915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:18.555574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374892+0000","last_change":"2024-04-16T16:20:55.703837+0000","last_active":"2024-04-16T16:20:58.374892+0000","last_peered":"2024-04-16T16:20:58.374892+0000","last_clean":"2024-04-16T16:20:58.374892+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:20:58.374892+0000","last_undegraded":"2024-04-16T16:20:58.374892+0000","last_fullsized":"2024-04-16T16:20:58.374892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:13.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372897+0000","last_change":"2024-04-16T16:20:56.716680+0000","last_active":"2024-04-16T16:20:58.372897+0000","last_peered":"2024-04-16T16:20:58.372897+0000","last_clean":"2024-04-16T16:20:58.372897+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:20:58.372897+0000","last_undegraded":"2024-04-16T16:20:58.372897+0000","last_fullsized":"2024-04-16T16:20:58.372897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705691+0000","last_change":"2024-04-16T16:20:55.699938+0000","last_active":"2024-04-16T16:20:57.705691+0000","last_peered":"2024-04-16T16:20:57.705691+0000","last_clean":"2024-04-16T16:20:57.705691+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:20:57.705691+0000","last_undegraded":"2024-04-16T16:20:57.705691+0000","last_fullsized":"2024-04-16T16:20:57.705691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373328+0000","last_change":"2024-04-16T16:20:56.709848+0000","last_active":"2024-04-16T16:20:58.373328+0000","last_peered":"2024-04-16T16:20:58.373328+0000","last_clean":"2024-04-16T16:20:58.373328+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:20:58.373328+0000","last_undegraded":"2024-04-16T16:20:58.373328+0000","last_fullsized":"2024-04-16T16:20:58.373328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:46.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375190+0000","last_change":"2024-04-16T16:20:55.703623+0000","last_active":"2024-04-16T16:20:58.375190+0000","last_peered":"2024-04-16T16:20:58.375190+0000","last_clean":"2024-04-16T16:20:58.375190+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:20:58.375190+0000","last_undegraded":"2024-04-16T16:20:58.375190+0000","last_fullsized":"2024-04-16T16:20:58.375190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374994+0000","last_change":"2024-04-16T16:20:56.723400+0000","last_active":"2024-04-16T16:20:58.374994+0000","last_peered":"2024-04-16T16:20:58.374994+0000","last_clean":"2024-04-16T16:20:58.374994+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:20:58.374994+0000","last_undegraded":"2024-04-16T16:20:58.374994+0000","last_fullsized":"2024-04-16T16:20:58.374994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375368+0000","last_change":"2024-04-16T16:20:55.694413+0000","last_active":"2024-04-16T16:20:58.375368+0000","last_peered":"2024-04-16T16:20:58.375368+0000","last_clean":"2024-04-16T16:20:58.375368+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:20:58.375368+0000","last_undegraded":"2024-04-16T16:20:58.375368+0000","last_fullsized":"2024-04-16T16:20:58.375368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:21.591232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375589+0000","last_change":"2024-04-16T16:20:55.702261+0000","last_active":"2024-04-16T16:20:58.375589+0000","last_peered":"2024-04-16T16:20:58.375589+0000","last_clean":"2024-04-16T16:20:58.375589+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:20:58.375589+0000","last_undegraded":"2024-04-16T16:20:58.375589+0000","last_fullsized":"2024-04-16T16:20:58.375589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375450+0000","last_change":"2024-04-16T16:20:56.712767+0000","last_active":"2024-04-16T16:20:58.375450+0000","last_peered":"2024-04-16T16:20:58.375450+0000","last_clean":"2024-04-16T16:20:58.375450+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:20:58.375450+0000","last_undegraded":"2024-04-16T16:20:58.375450+0000","last_fullsized":"2024-04-16T16:20:58.375450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706177+0000","last_change":"2024-04-16T16:20:56.704028+0000","last_active":"2024-04-16T16:20:57.706177+0000","last_peered":"2024-04-16T16:20:57.706177+0000","last_clean":"2024-04-16T16:20:57.706177+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:20:57.706177+0000","last_undegraded":"2024-04-16T16:20:57.706177+0000","last_fullsized":"2024-04-16T16:20:57.706177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373761+0000","last_change":"2024-04-16T16:20:55.691499+0000","last_active":"2024-04-16T16:20:58.373761+0000","last_peered":"2024-04-16T16:20:58.373761+0000","last_clean":"2024-04-16T16:20:58.373761+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:20:58.373761+0000","last_undegraded":"2024-04-16T16:20:58.373761+0000","last_fullsized":"2024-04-16T16:20:58.373761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:46.276878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374544+0000","last_change":"2024-04-16T16:20:56.718537+0000","last_active":"2024-04-16T16:20:58.374544+0000","last_peered":"2024-04-16T16:20:58.374544+0000","last_clean":"2024-04-16T16:20:58.374544+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:20:58.374544+0000","last_undegraded":"2024-04-16T16:20:58.374544+0000","last_fullsized":"2024-04-16T16:20:58.374544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372802+0000","last_change":"2024-04-16T16:20:55.700778+0000","last_active":"2024-04-16T16:20:58.372802+0000","last_peered":"2024-04-16T16:20:58.372802+0000","last_clean":"2024-04-16T16:20:58.372802+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:20:58.372802+0000","last_undegraded":"2024-04-16T16:20:58.372802+0000","last_fullsized":"2024-04-16T16:20:58.372802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:21.223928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705837+0000","last_change":"2024-04-16T16:20:55.700889+0000","last_active":"2024-04-16T16:20:57.705837+0000","last_peered":"2024-04-16T16:20:57.705837+0000","last_clean":"2024-04-16T16:20:57.705837+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:20:57.705837+0000","last_undegraded":"2024-04-16T16:20:57.705837+0000","last_fullsized":"2024-04-16T16:20:57.705837+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374373+0000","last_change":"2024-04-16T16:20:56.720365+0000","last_active":"2024-04-16T16:20:58.374373+0000","last_peered":"2024-04-16T16:20:58.374373+0000","last_clean":"2024-04-16T16:20:58.374373+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:20:58.374373+0000","last_undegraded":"2024-04-16T16:20:58.374373+0000","last_fullsized":"2024-04-16T16:20:58.374373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373392+0000","last_change":"2024-04-16T16:20:55.705450+0000","last_active":"2024-04-16T16:20:58.373392+0000","last_peered":"2024-04-16T16:20:58.373392+0000","last_clean":"2024-04-16T16:20:58.373392+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:20:58.373392+0000","last_undegraded":"2024-04-16T16:20:58.373392+0000","last_fullsized":"2024-04-16T16:20:58.373392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375228+0000","last_change":"2024-04-16T16:20:56.721758+0000","last_active":"2024-04-16T16:20:58.375228+0000","last_peered":"2024-04-16T16:20:58.375228+0000","last_clean":"2024-04-16T16:20:58.375228+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:20:58.375228+0000","last_undegraded":"2024-04-16T16:20:58.375228+0000","last_fullsized":"2024-04-16T16:20:58.375228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375245+0000","last_change":"2024-04-16T16:20:55.691154+0000","last_active":"2024-04-16T16:20:58.375245+0000","last_peered":"2024-04-16T16:20:58.375245+0000","last_clean":"2024-04-16T16:20:58.375245+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:20:58.375245+0000","last_undegraded":"2024-04-16T16:20:58.375245+0000","last_fullsized":"2024-04-16T16:20:58.375245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:48.698225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708411+0000","last_change":"2024-04-16T16:20:56.708684+0000","last_active":"2024-04-16T16:20:57.708411+0000","last_peered":"2024-04-16T16:20:57.708411+0000","last_clean":"2024-04-16T16:20:57.708411+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:20:57.708411+0000","last_undegraded":"2024-04-16T16:20:57.708411+0000","last_fullsized":"2024-04-16T16:20:57.708411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.699664+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375214+0000","last_change":"2024-04-16T16:20:56.712157+0000","last_active":"2024-04-16T16:20:58.375214+0000","last_peered":"2024-04-16T16:20:58.375214+0000","last_clean":"2024-04-16T16:20:58.375214+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:20:58.375214+0000","last_undegraded":"2024-04-16T16:20:58.375214+0000","last_fullsized":"2024-04-16T16:20:58.375214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707746+0000","last_change":"2024-04-16T16:20:55.702354+0000","last_active":"2024-04-16T16:20:57.707746+0000","last_peered":"2024-04-16T16:20:57.707746+0000","last_clean":"2024-04-16T16:20:57.707746+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:20:57.707746+0000","last_undegraded":"2024-04-16T16:20:57.707746+0000","last_fullsized":"2024-04-16T16:20:57.707746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:50.973007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375511+0000","last_change":"2024-04-16T16:20:56.712536+0000","last_active":"2024-04-16T16:20:58.375511+0000","last_peered":"2024-04-16T16:20:58.375511+0000","last_clean":"2024-04-16T16:20:58.375511+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:20:58.375511+0000","last_undegraded":"2024-04-16T16:20:58.375511+0000","last_fullsized":"2024-04-16T16:20:58.375511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375548+0000","last_change":"2024-04-16T16:20:55.697400+0000","last_active":"2024-04-16T16:20:58.375548+0000","last_peered":"2024-04-16T16:20:58.375548+0000","last_clean":"2024-04-16T16:20:58.375548+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:20:58.375548+0000","last_undegraded":"2024-04-16T16:20:58.375548+0000","last_fullsized":"2024-04-16T16:20:58.375548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:32.224244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706503+0000","last_change":"2024-04-16T16:20:56.705284+0000","last_active":"2024-04-16T16:20:57.706503+0000","last_peered":"2024-04-16T16:20:57.706503+0000","last_clean":"2024-04-16T16:20:57.706503+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:20:57.706503+0000","last_undegraded":"2024-04-16T16:20:57.706503+0000","last_fullsized":"2024-04-16T16:20:57.706503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374874+0000","last_change":"2024-04-16T16:20:55.691520+0000","last_active":"2024-04-16T16:20:58.374874+0000","last_peered":"2024-04-16T16:20:58.374874+0000","last_clean":"2024-04-16T16:20:58.374874+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:20:58.374874+0000","last_undegraded":"2024-04-16T16:20:58.374874+0000","last_fullsized":"2024-04-16T16:20:58.374874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:34.964542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376142+0000","last_change":"2024-04-16T16:20:56.714025+0000","last_active":"2024-04-16T16:20:58.376142+0000","last_peered":"2024-04-16T16:20:58.376142+0000","last_clean":"2024-04-16T16:20:58.376142+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:20:58.376142+0000","last_undegraded":"2024-04-16T16:20:58.376142+0000","last_fullsized":"2024-04-16T16:20:58.376142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374747+0000","last_change":"2024-04-16T16:20:56.715573+0000","last_active":"2024-04-16T16:20:58.374747+0000","last_peered":"2024-04-16T16:20:58.374747+0000","last_clean":"2024-04-16T16:20:58.374747+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:20:58.374747+0000","last_undegraded":"2024-04-16T16:20:58.374747+0000","last_fullsized":"2024-04-16T16:20:58.374747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705507+0000","last_change":"2024-04-16T16:20:55.700653+0000","last_active":"2024-04-16T16:20:57.705507+0000","last_peered":"2024-04-16T16:20:57.705507+0000","last_clean":"2024-04-16T16:20:57.705507+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:20:57.705507+0000","last_undegraded":"2024-04-16T16:20:57.705507+0000","last_fullsized":"2024-04-16T16:20:57.705507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:30.271546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708260+0000","last_change":"2024-04-16T16:20:56.691557+0000","last_active":"2024-04-16T16:20:57.708260+0000","last_peered":"2024-04-16T16:20:57.708260+0000","last_clean":"2024-04-16T16:20:57.708260+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:20:57.708260+0000","last_undegraded":"2024-04-16T16:20:57.708260+0000","last_fullsized":"2024-04-16T16:20:57.708260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708599+0000","last_change":"2024-04-16T16:20:56.714215+0000","last_active":"2024-04-16T16:20:57.708599+0000","last_peered":"2024-04-16T16:20:57.708599+0000","last_clean":"2024-04-16T16:20:57.708599+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:20:57.708599+0000","last_undegraded":"2024-04-16T16:20:57.708599+0000","last_fullsized":"2024-04-16T16:20:57.708599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376396+0000","last_change":"2024-04-16T16:20:55.704363+0000","last_active":"2024-04-16T16:20:58.376396+0000","last_peered":"2024-04-16T16:20:58.376396+0000","last_clean":"2024-04-16T16:20:58.376396+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:20:58.376396+0000","last_undegraded":"2024-04-16T16:20:58.376396+0000","last_fullsized":"2024-04-16T16:20:58.376396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372943+0000","last_change":"2024-04-16T16:20:55.703477+0000","last_active":"2024-04-16T16:20:58.372943+0000","last_peered":"2024-04-16T16:20:58.372943+0000","last_clean":"2024-04-16T16:20:58.372943+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:20:58.372943+0000","last_undegraded":"2024-04-16T16:20:58.372943+0000","last_fullsized":"2024-04-16T16:20:58.372943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:15.228538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376581+0000","last_change":"2024-04-16T16:20:56.707864+0000","last_active":"2024-04-16T16:20:58.376581+0000","last_peered":"2024-04-16T16:20:58.376581+0000","last_clean":"2024-04-16T16:20:58.376581+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:20:58.376581+0000","last_undegraded":"2024-04-16T16:20:58.376581+0000","last_fullsized":"2024-04-16T16:20:58.376581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:21.749618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707985+0000","last_change":"2024-04-16T16:20:55.701244+0000","last_active":"2024-04-16T16:20:57.707985+0000","last_peered":"2024-04-16T16:20:57.707985+0000","last_clean":"2024-04-16T16:20:57.707985+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:20:57.707985+0000","last_undegraded":"2024-04-16T16:20:57.707985+0000","last_fullsized":"2024-04-16T16:20:57.707985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374179+0000","last_change":"2024-04-16T16:20:56.707897+0000","last_active":"2024-04-16T16:20:58.374179+0000","last_peered":"2024-04-16T16:20:58.374179+0000","last_clean":"2024-04-16T16:20:58.374179+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:20:58.374179+0000","last_undegraded":"2024-04-16T16:20:58.374179+0000","last_fullsized":"2024-04-16T16:20:58.374179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:42.907490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374977+0000","last_change":"2024-04-16T16:20:56.720972+0000","last_active":"2024-04-16T16:20:58.374977+0000","last_peered":"2024-04-16T16:20:58.374977+0000","last_clean":"2024-04-16T16:20:58.374977+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:20:58.374977+0000","last_undegraded":"2024-04-16T16:20:58.374977+0000","last_fullsized":"2024-04-16T16:20:58.374977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373562+0000","last_change":"2024-04-16T16:20:56.708340+0000","last_active":"2024-04-16T16:20:58.373562+0000","last_peered":"2024-04-16T16:20:58.373562+0000","last_clean":"2024-04-16T16:20:58.373562+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:20:58.373562+0000","last_undegraded":"2024-04-16T16:20:58.373562+0000","last_fullsized":"2024-04-16T16:20:58.373562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:07.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372721+0000","last_change":"2024-04-16T16:20:55.692470+0000","last_active":"2024-04-16T16:20:58.372721+0000","last_peered":"2024-04-16T16:20:58.372721+0000","last_clean":"2024-04-16T16:20:58.372721+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:20:58.372721+0000","last_undegraded":"2024-04-16T16:20:58.372721+0000","last_fullsized":"2024-04-16T16:20:58.372721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:20.735190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372709+0000","last_change":"2024-04-16T16:20:56.720232+0000","last_active":"2024-04-16T16:20:58.372709+0000","last_peered":"2024-04-16T16:20:58.372709+0000","last_clean":"2024-04-16T16:20:58.372709+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:20:58.372709+0000","last_undegraded":"2024-04-16T16:20:58.372709+0000","last_fullsized":"2024-04-16T16:20:58.372709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:34.266414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372516+0000","last_change":"2024-04-16T16:20:55.702982+0000","last_active":"2024-04-16T16:20:58.372516+0000","last_peered":"2024-04-16T16:20:58.372516+0000","last_clean":"2024-04-16T16:20:58.372516+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:20:58.372516+0000","last_undegraded":"2024-04-16T16:20:58.372516+0000","last_fullsized":"2024-04-16T16:20:58.372516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:05.020022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373594+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:58.373594+0000","last_peered":"2024-04-16T16:20:58.373594+0000","last_clean":"2024-04-16T16:20:58.373594+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:58.373594+0000","last_undegraded":"2024-04-16T16:20:58.373594+0000","last_fullsized":"2024-04-16T16:20:58.373594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":904511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":313983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":753664,"data_stored":314635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":906545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:10.737 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T16:21:10.737 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:10.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2024-04-16T16:21:10.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.996+0000 7f6a4be00640 1 Processor -- start 2024-04-16T16:21:10.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.996+0000 7f6a4be00640 1 -- start start 2024-04-16T16:21:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.997+0000 7f6a4be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a4c0d0b80 0x7f6a4c15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.997+0000 7f6a4be00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6a4c0728c0 0x7f6a4c06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.997+0000 7f6a4be00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a4c071b00 con 0x7f6a4c15b790 2024-04-16T16:21:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.997+0000 7f6a4be00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f6a4c072430 con 0x7f6a4c0d0b80 2024-04-16T16:21:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.997+0000 7f6a4be00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6a4c071de0 con 0x7f6a4c0728c0 2024-04-16T16:21:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a43e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a4c0d0b80 0x7f6a4c15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a43e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a4c0d0b80 0x7f6a4c15fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37826/0 (socket says 172.21.15.22:37826) 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a43e00640 1 -- 172.21.15.22:0/4254045996 learned_addr learned my addr 172.21.15.22:0/4254045996 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a4b400640 1 --2- 172.21.15.22:0/4254045996 >> v2:172.21.15.43:3300/0 conn(0x7f6a4c0728c0 0x7f6a4c06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a43e00640 1 -- 172.21.15.22:0/4254045996 >> v2:172.21.15.43:3300/0 conn(0x7f6a4c0728c0 msgr2=0x7f6a4c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a43e00640 1 --2- 172.21.15.22:0/4254045996 >> v2:172.21.15.43:3300/0 conn(0x7f6a4c0728c0 0x7f6a4c06cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a43e00640 1 -- 172.21.15.22:0/4254045996 >> v1:172.21.15.43:6789/0 conn(0x7f6a4c15b790 legacy=0x7f6a4c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a43e00640 1 -- 172.21.15.22:0/4254045996 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c0720c0 con 0x7f6a4c0d0b80 2024-04-16T16:21:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.998+0000 7f6a4b400640 1 --2- 172.21.15.22:0/4254045996 >> v2:172.21.15.43:3300/0 conn(0x7f6a4c0728c0 0x7f6a4c06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:10.999+0000 7f6a43e00640 1 --2- 172.21.15.22:0/4254045996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0d0b80 0x7f6a4c15fd50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0633d0 tx=0x7f6a3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da95f2c8ea9879ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.000+0000 7f6a4a000640 1 -- 172.21.15.22:0/4254045996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34035020 con 0x7f6a4c0d0b80 2024-04-16T16:21:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.000+0000 7f6a4a000640 1 -- 172.21.15.22:0/4254045996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a34031870 con 0x7f6a4c0d0b80 2024-04-16T16:21:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.000+0000 7f6a4a000640 1 -- 172.21.15.22:0/4254045996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34031c40 con 0x7f6a4c0d0b80 2024-04-16T16:21:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.000+0000 7f6a4be00640 1 -- 172.21.15.22:0/4254045996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0d0b80 msgr2=0x7f6a4c15fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.000+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4254045996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0d0b80 0x7f6a4c15fd50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0633d0 tx=0x7f6a3402b910 comp rx=0 tx=0).stop 2024-04-16T16:21:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.001+0000 7f6a4be00640 1 -- 172.21.15.22:0/4254045996 shutdown_connections 2024-04-16T16:21:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.001+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4254045996 >> v2:172.21.15.43:3300/0 conn(0x7f6a4c0728c0 0x7f6a4c06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.001+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4254045996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0d0b80 0x7f6a4c15fd50 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.001+0000 7f6a4be00640 1 -- 172.21.15.22:0/4254045996 >> 172.21.15.22:0/4254045996 conn(0x7f6a4c062440 msgr2=0x7f6a4c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.001+0000 7f6a4be00640 1 -- 172.21.15.22:0/4254045996 shutdown_connections 2024-04-16T16:21:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.001+0000 7f6a4be00640 1 -- 172.21.15.22:0/4254045996 wait complete. 2024-04-16T16:21:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.002+0000 7f6a4be00640 1 Processor -- start 2024-04-16T16:21:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.002+0000 7f6a4be00640 1 -- start start 2024-04-16T16:21:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.003+0000 7f6a4be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0728c0 0x7f6a4c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.003+0000 7f6a4be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a4c0d0b80 0x7f6a4c1f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.003+0000 7f6a4be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a4c15b790 0x7f6a4c0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.003+0000 7f6a4be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0cc7c0 con 0x7f6a4c0728c0 2024-04-16T16:21:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.003+0000 7f6a4be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0afde0 con 0x7f6a4c0d0b80 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.003+0000 7f6a4be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c0cc940 con 0x7f6a4c15b790 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0728c0 0x7f6a4c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0728c0 0x7f6a4c0b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37840/0 (socket says 172.21.15.22:37840) 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 -- 172.21.15.22:0/4003413007 learned_addr learned my addr 172.21.15.22:0/4003413007 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a43e00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a4c0d0b80 0x7f6a4c1f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4b400640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a4c15b790 0x7f6a4c0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 -- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a4c15b790 msgr2=0x7f6a4c0aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a4c15b790 0x7f6a4c0aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 -- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a4c0d0b80 msgr2=0x7f6a4c1f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a4c0d0b80 0x7f6a4c1f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.004+0000 7f6a4aa00640 1 -- 172.21.15.22:0/4003413007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c1f52b0 con 0x7f6a4c0728c0 2024-04-16T16:21:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.005+0000 7f6a4aa00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0728c0 0x7f6a4c0b10b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00b3e0 tx=0x7f6a3c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.005+0000 7f6a42a00640 1 -- 172.21.15.22:0/4003413007 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c015020 con 0x7f6a4c0728c0 2024-04-16T16:21:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.005+0000 7f6a42a00640 1 -- 172.21.15.22:0/4003413007 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c011850 con 0x7f6a4c0728c0 2024-04-16T16:21:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.005+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4c1f5820 con 0x7f6a4c0728c0 2024-04-16T16:21:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.005+0000 7f6a42a00640 1 -- 172.21.15.22:0/4003413007 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c011c40 con 0x7f6a4c0728c0 2024-04-16T16:21:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.005+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4c1531a0 con 0x7f6a4c0728c0 2024-04-16T16:21:11.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.006+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4c075f30 con 0x7f6a4c0728c0 2024-04-16T16:21:11.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.008+0000 7f6a42a00640 1 -- 172.21.15.22:0/4003413007 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f6a3c018020 con 0x7f6a4c0728c0 2024-04-16T16:21:11.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.009+0000 7f6a42a00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a2806ce90 0x7f6a2806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.009+0000 7f6a42a00640 1 -- 172.21.15.22:0/4003413007 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f6a3c08c550 con 0x7f6a4c0728c0 2024-04-16T16:21:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.009+0000 7f6a43e00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a2806ce90 0x7f6a2806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.010+0000 7f6a43e00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a2806ce90 0x7f6a2806f350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a34036000 tx=0x7f6a3403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:11.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.013+0000 7f6a42a00640 1 -- 172.21.15.22:0/4003413007 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a3c01f020 con 0x7f6a4c0728c0 2024-04-16T16:21:11.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.213+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a4c15fb30 con 0x7f6a2806ce90 2024-04-16T16:21:11.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.224+0000 7f6a42a00640 1 -- 172.21.15.22:0/4003413007 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251843 (secure 0 0 0) 0x7f6a4c15fb30 con 0x7f6a2806ce90 2024-04-16T16:21:11.226 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:11.232 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a2806ce90 msgr2=0x7f6a2806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a2806ce90 0x7f6a2806f350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a34036000 tx=0x7f6a3403c040 comp rx=0 tx=0).stop 2024-04-16T16:21:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0728c0 msgr2=0x7f6a4c0b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0728c0 0x7f6a4c0b10b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00b3e0 tx=0x7f6a3c00b8a0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 shutdown_connections 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f6a2806ce90 0x7f6a2806f350 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a4c15b790 0x7f6a4c0aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a4c0d0b80 0x7f6a4c1f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 --2- 172.21.15.22:0/4003413007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4c0728c0 0x7f6a4c0b10b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 >> 172.21.15.22:0/4003413007 conn(0x7f6a4c062440 msgr2=0x7f6a4c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 shutdown_connections 2024-04-16T16:21:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.232+0000 7f6a4be00640 1 -- 172.21.15.22:0/4003413007 wait complete. 2024-04-16T16:21:11.250 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-16T16:21:09.795946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256512,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718208,"statfs":{"total":773094113280,"available":772831444992,"internally_reserved":0,"allocated":7217152,"data_stored":3697420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004579"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373919+0000","last_change":"2024-04-16T16:20:56.700692+0000","last_active":"2024-04-16T16:20:58.373919+0000","last_peered":"2024-04-16T16:20:58.373919+0000","last_clean":"2024-04-16T16:20:58.373919+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:20:58.373919+0000","last_undegraded":"2024-04-16T16:20:58.373919+0000","last_fullsized":"2024-04-16T16:20:58.373919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:01.405645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375924+0000","last_change":"2024-04-16T16:20:56.704487+0000","last_active":"2024-04-16T16:20:58.375924+0000","last_peered":"2024-04-16T16:20:58.375924+0000","last_clean":"2024-04-16T16:20:58.375924+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:20:58.375924+0000","last_undegraded":"2024-04-16T16:20:58.375924+0000","last_fullsized":"2024-04-16T16:20:58.375924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:18.892594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374985+0000","last_change":"2024-04-16T16:20:56.710584+0000","last_active":"2024-04-16T16:20:58.374985+0000","last_peered":"2024-04-16T16:20:58.374985+0000","last_clean":"2024-04-16T16:20:58.374985+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:20:58.374985+0000","last_undegraded":"2024-04-16T16:20:58.374985+0000","last_fullsized":"2024-04-16T16:20:58.374985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708372+0000","last_change":"2024-04-16T16:20:56.694479+0000","last_active":"2024-04-16T16:20:57.708372+0000","last_peered":"2024-04-16T16:20:57.708372+0000","last_clean":"2024-04-16T16:20:57.708372+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:20:57.708372+0000","last_undegraded":"2024-04-16T16:20:57.708372+0000","last_fullsized":"2024-04-16T16:20:57.708372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373184+0000","last_change":"2024-04-16T16:20:56.687650+0000","last_active":"2024-04-16T16:20:58.373184+0000","last_peered":"2024-04-16T16:20:58.373184+0000","last_clean":"2024-04-16T16:20:58.373184+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:20:58.373184+0000","last_undegraded":"2024-04-16T16:20:58.373184+0000","last_fullsized":"2024-04-16T16:20:58.373184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:24.566878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374109+0000","last_change":"2024-04-16T16:20:56.696467+0000","last_active":"2024-04-16T16:20:58.374109+0000","last_peered":"2024-04-16T16:20:58.374109+0000","last_clean":"2024-04-16T16:20:58.374109+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:20:58.374109+0000","last_undegraded":"2024-04-16T16:20:58.374109+0000","last_fullsized":"2024-04-16T16:20:58.374109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705352+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:20:57.705352+0000","last_peered":"2024-04-16T16:20:57.705352+0000","last_clean":"2024-04-16T16:20:57.705352+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:20:57.705352+0000","last_undegraded":"2024-04-16T16:20:57.705352+0000","last_fullsized":"2024-04-16T16:20:57.705352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372576+0000","last_change":"2024-04-16T16:20:56.711962+0000","last_active":"2024-04-16T16:20:58.372576+0000","last_peered":"2024-04-16T16:20:58.372576+0000","last_clean":"2024-04-16T16:20:58.372576+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:20:58.372576+0000","last_undegraded":"2024-04-16T16:20:58.372576+0000","last_fullsized":"2024-04-16T16:20:58.372576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:34.290551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702770+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:20:57.702770+0000","last_peered":"2024-04-16T16:20:57.702770+0000","last_clean":"2024-04-16T16:20:57.702770+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:20:57.702770+0000","last_undegraded":"2024-04-16T16:20:57.702770+0000","last_fullsized":"2024-04-16T16:20:57.702770+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702118+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:20:57.702118+0000","last_peered":"2024-04-16T16:20:57.702118+0000","last_clean":"2024-04-16T16:20:57.702118+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:20:57.702118+0000","last_undegraded":"2024-04-16T16:20:57.702118+0000","last_fullsized":"2024-04-16T16:20:57.702118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707538+0000","last_change":"2024-04-16T16:20:56.702421+0000","last_active":"2024-04-16T16:20:57.707538+0000","last_peered":"2024-04-16T16:20:57.707538+0000","last_clean":"2024-04-16T16:20:57.707538+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:20:57.707538+0000","last_undegraded":"2024-04-16T16:20:57.707538+0000","last_fullsized":"2024-04-16T16:20:57.707538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373554+0000","last_change":"2024-04-16T16:20:56.705792+0000","last_active":"2024-04-16T16:20:58.373554+0000","last_peered":"2024-04-16T16:20:58.373554+0000","last_clean":"2024-04-16T16:20:58.373554+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:20:58.373554+0000","last_undegraded":"2024-04-16T16:20:58.373554+0000","last_fullsized":"2024-04-16T16:20:58.373554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706489+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:20:57.706489+0000","last_peered":"2024-04-16T16:20:57.706489+0000","last_clean":"2024-04-16T16:20:57.706489+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:20:57.706489+0000","last_undegraded":"2024-04-16T16:20:57.706489+0000","last_fullsized":"2024-04-16T16:20:57.706489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706344+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:20:57.706344+0000","last_peered":"2024-04-16T16:20:57.706344+0000","last_clean":"2024-04-16T16:20:57.706344+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:20:57.706344+0000","last_undegraded":"2024-04-16T16:20:57.706344+0000","last_fullsized":"2024-04-16T16:20:57.706344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373773+0000","last_change":"2024-04-16T16:20:56.716792+0000","last_active":"2024-04-16T16:20:58.373773+0000","last_peered":"2024-04-16T16:20:58.373773+0000","last_clean":"2024-04-16T16:20:58.373773+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:20:58.373773+0000","last_undegraded":"2024-04-16T16:20:58.373773+0000","last_fullsized":"2024-04-16T16:20:58.373773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375444+0000","last_change":"2024-04-16T16:20:56.709293+0000","last_active":"2024-04-16T16:20:58.375444+0000","last_peered":"2024-04-16T16:20:58.375444+0000","last_clean":"2024-04-16T16:20:58.375444+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:20:58.375444+0000","last_undegraded":"2024-04-16T16:20:58.375444+0000","last_fullsized":"2024-04-16T16:20:58.375444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:47.440922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374963+0000","last_change":"2024-04-16T16:20:56.722078+0000","last_active":"2024-04-16T16:20:58.374963+0000","last_peered":"2024-04-16T16:20:58.374963+0000","last_clean":"2024-04-16T16:20:58.374963+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:20:58.374963+0000","last_undegraded":"2024-04-16T16:20:58.374963+0000","last_fullsized":"2024-04-16T16:20:58.374963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372189+0000","last_change":"2024-04-16T16:20:56.703752+0000","last_active":"2024-04-16T16:20:58.372189+0000","last_peered":"2024-04-16T16:20:58.372189+0000","last_clean":"2024-04-16T16:20:58.372189+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:20:58.372189+0000","last_undegraded":"2024-04-16T16:20:58.372189+0000","last_fullsized":"2024-04-16T16:20:58.372189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:32.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374871+0000","last_change":"2024-04-16T16:20:56.718849+0000","last_active":"2024-04-16T16:20:58.374871+0000","last_peered":"2024-04-16T16:20:58.374871+0000","last_clean":"2024-04-16T16:20:58.374871+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:20:58.374871+0000","last_undegraded":"2024-04-16T16:20:58.374871+0000","last_fullsized":"2024-04-16T16:20:58.374871+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.829545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374676+0000","last_change":"2024-04-16T16:20:56.715256+0000","last_active":"2024-04-16T16:20:58.374676+0000","last_peered":"2024-04-16T16:20:58.374676+0000","last_clean":"2024-04-16T16:20:58.374676+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:20:58.374676+0000","last_undegraded":"2024-04-16T16:20:58.374676+0000","last_fullsized":"2024-04-16T16:20:58.374676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374265+0000","last_change":"2024-04-16T16:20:56.703517+0000","last_active":"2024-04-16T16:20:58.374265+0000","last_peered":"2024-04-16T16:20:58.374265+0000","last_clean":"2024-04-16T16:20:58.374265+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:20:58.374265+0000","last_undegraded":"2024-04-16T16:20:58.374265+0000","last_fullsized":"2024-04-16T16:20:58.374265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:28.081709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374176+0000","last_change":"2024-04-16T16:20:56.719987+0000","last_active":"2024-04-16T16:20:58.374176+0000","last_peered":"2024-04-16T16:20:58.374176+0000","last_clean":"2024-04-16T16:20:58.374176+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:20:58.374176+0000","last_undegraded":"2024-04-16T16:20:58.374176+0000","last_fullsized":"2024-04-16T16:20:58.374176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373168+0000","last_change":"2024-04-16T16:20:56.720302+0000","last_active":"2024-04-16T16:20:58.373168+0000","last_peered":"2024-04-16T16:20:58.373168+0000","last_clean":"2024-04-16T16:20:58.373168+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:20:58.373168+0000","last_undegraded":"2024-04-16T16:20:58.373168+0000","last_fullsized":"2024-04-16T16:20:58.373168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374304+0000","last_change":"2024-04-16T16:20:56.711031+0000","last_active":"2024-04-16T16:20:58.374304+0000","last_peered":"2024-04-16T16:20:58.374304+0000","last_clean":"2024-04-16T16:20:58.374304+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:20:58.374304+0000","last_undegraded":"2024-04-16T16:20:58.374304+0000","last_fullsized":"2024-04-16T16:20:58.374304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:24.434925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708201+0000","last_change":"2024-04-16T16:20:56.699535+0000","last_active":"2024-04-16T16:20:57.708201+0000","last_peered":"2024-04-16T16:20:57.708201+0000","last_clean":"2024-04-16T16:20:57.708201+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:20:57.708201+0000","last_undegraded":"2024-04-16T16:20:57.708201+0000","last_fullsized":"2024-04-16T16:20:57.708201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376001+0000","last_change":"2024-04-16T16:20:56.716226+0000","last_active":"2024-04-16T16:20:58.376001+0000","last_peered":"2024-04-16T16:20:58.376001+0000","last_clean":"2024-04-16T16:20:58.376001+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:20:58.376001+0000","last_undegraded":"2024-04-16T16:20:58.376001+0000","last_fullsized":"2024-04-16T16:20:58.376001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373175+0000","last_change":"2024-04-16T16:20:56.690730+0000","last_active":"2024-04-16T16:20:58.373175+0000","last_peered":"2024-04-16T16:20:58.373175+0000","last_clean":"2024-04-16T16:20:58.373175+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:20:58.373175+0000","last_undegraded":"2024-04-16T16:20:58.373175+0000","last_fullsized":"2024-04-16T16:20:58.373175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:22.566150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374342+0000","last_change":"2024-04-16T16:20:56.708786+0000","last_active":"2024-04-16T16:20:58.374342+0000","last_peered":"2024-04-16T16:20:58.374342+0000","last_clean":"2024-04-16T16:20:58.374342+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:20:58.374342+0000","last_undegraded":"2024-04-16T16:20:58.374342+0000","last_fullsized":"2024-04-16T16:20:58.374342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:51.397773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374485+0000","last_change":"2024-04-16T16:20:56.720038+0000","last_active":"2024-04-16T16:20:58.374485+0000","last_peered":"2024-04-16T16:20:58.374485+0000","last_clean":"2024-04-16T16:20:58.374485+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:20:58.374485+0000","last_undegraded":"2024-04-16T16:20:58.374485+0000","last_fullsized":"2024-04-16T16:20:58.374485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.371823+0000","last_change":"2024-04-16T16:20:56.706135+0000","last_active":"2024-04-16T16:20:58.371823+0000","last_peered":"2024-04-16T16:20:58.371823+0000","last_clean":"2024-04-16T16:20:58.371823+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:20:58.371823+0000","last_undegraded":"2024-04-16T16:20:58.371823+0000","last_fullsized":"2024-04-16T16:20:58.371823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:10:18.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374185+0000","last_change":"2024-04-16T16:20:56.707138+0000","last_active":"2024-04-16T16:20:58.374185+0000","last_peered":"2024-04-16T16:20:58.374185+0000","last_clean":"2024-04-16T16:20:58.374185+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:20:58.374185+0000","last_undegraded":"2024-04-16T16:20:58.374185+0000","last_fullsized":"2024-04-16T16:20:58.374185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376195+0000","last_change":"2024-04-16T16:20:56.714674+0000","last_active":"2024-04-16T16:20:58.376195+0000","last_peered":"2024-04-16T16:20:58.376195+0000","last_clean":"2024-04-16T16:20:58.376195+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:20:58.376195+0000","last_undegraded":"2024-04-16T16:20:58.376195+0000","last_fullsized":"2024-04-16T16:20:58.376195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:47.291306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375823+0000","last_change":"2024-04-16T16:20:55.704083+0000","last_active":"2024-04-16T16:20:58.375823+0000","last_peered":"2024-04-16T16:20:58.375823+0000","last_clean":"2024-04-16T16:20:58.375823+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:20:58.375823+0000","last_undegraded":"2024-04-16T16:20:58.375823+0000","last_fullsized":"2024-04-16T16:20:58.375823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:34.565386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703318+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:20:57.703318+0000","last_peered":"2024-04-16T16:20:57.703318+0000","last_clean":"2024-04-16T16:20:57.703318+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:20:57.703318+0000","last_undegraded":"2024-04-16T16:20:57.703318+0000","last_fullsized":"2024-04-16T16:20:57.703318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375090+0000","last_change":"2024-04-16T16:20:55.700645+0000","last_active":"2024-04-16T16:20:58.375090+0000","last_peered":"2024-04-16T16:20:58.375090+0000","last_clean":"2024-04-16T16:20:58.375090+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:20:58.375090+0000","last_undegraded":"2024-04-16T16:20:58.375090+0000","last_fullsized":"2024-04-16T16:20:58.375090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:56.588790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376827+0000","last_change":"2024-04-16T16:20:56.717040+0000","last_active":"2024-04-16T16:20:58.376827+0000","last_peered":"2024-04-16T16:20:58.376827+0000","last_clean":"2024-04-16T16:20:58.376827+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:20:58.376827+0000","last_undegraded":"2024-04-16T16:20:58.376827+0000","last_fullsized":"2024-04-16T16:20:58.376827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:57.603218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.698501+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:40.710552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376219+0000","last_change":"2024-04-16T16:20:56.708709+0000","last_active":"2024-04-16T16:20:58.376219+0000","last_peered":"2024-04-16T16:20:58.376219+0000","last_clean":"2024-04-16T16:20:58.376219+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:20:58.376219+0000","last_undegraded":"2024-04-16T16:20:58.376219+0000","last_fullsized":"2024-04-16T16:20:58.376219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:35.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707688+0000","last_change":"2024-04-16T16:20:55.703384+0000","last_active":"2024-04-16T16:20:57.707688+0000","last_peered":"2024-04-16T16:20:57.707688+0000","last_clean":"2024-04-16T16:20:57.707688+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:20:57.707688+0000","last_undegraded":"2024-04-16T16:20:57.707688+0000","last_fullsized":"2024-04-16T16:20:57.707688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373769+0000","last_change":"2024-04-16T16:20:56.703273+0000","last_active":"2024-04-16T16:20:58.373769+0000","last_peered":"2024-04-16T16:20:58.373769+0000","last_clean":"2024-04-16T16:20:58.373769+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:20:58.373769+0000","last_undegraded":"2024-04-16T16:20:58.373769+0000","last_fullsized":"2024-04-16T16:20:58.373769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:37.220892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706508+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:20:57.706508+0000","last_peered":"2024-04-16T16:20:57.706508+0000","last_clean":"2024-04-16T16:20:57.706508+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:20:57.706508+0000","last_undegraded":"2024-04-16T16:20:57.706508+0000","last_fullsized":"2024-04-16T16:20:57.706508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373915+0000","last_change":"2024-04-16T16:20:56.706317+0000","last_active":"2024-04-16T16:20:58.373915+0000","last_peered":"2024-04-16T16:20:58.373915+0000","last_clean":"2024-04-16T16:20:58.373915+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:20:58.373915+0000","last_undegraded":"2024-04-16T16:20:58.373915+0000","last_fullsized":"2024-04-16T16:20:58.373915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:18.555574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374892+0000","last_change":"2024-04-16T16:20:55.703837+0000","last_active":"2024-04-16T16:20:58.374892+0000","last_peered":"2024-04-16T16:20:58.374892+0000","last_clean":"2024-04-16T16:20:58.374892+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:20:58.374892+0000","last_undegraded":"2024-04-16T16:20:58.374892+0000","last_fullsized":"2024-04-16T16:20:58.374892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:13.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372897+0000","last_change":"2024-04-16T16:20:56.716680+0000","last_active":"2024-04-16T16:20:58.372897+0000","last_peered":"2024-04-16T16:20:58.372897+0000","last_clean":"2024-04-16T16:20:58.372897+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:20:58.372897+0000","last_undegraded":"2024-04-16T16:20:58.372897+0000","last_fullsized":"2024-04-16T16:20:58.372897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705691+0000","last_change":"2024-04-16T16:20:55.699938+0000","last_active":"2024-04-16T16:20:57.705691+0000","last_peered":"2024-04-16T16:20:57.705691+0000","last_clean":"2024-04-16T16:20:57.705691+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:20:57.705691+0000","last_undegraded":"2024-04-16T16:20:57.705691+0000","last_fullsized":"2024-04-16T16:20:57.705691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373328+0000","last_change":"2024-04-16T16:20:56.709848+0000","last_active":"2024-04-16T16:20:58.373328+0000","last_peered":"2024-04-16T16:20:58.373328+0000","last_clean":"2024-04-16T16:20:58.373328+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:20:58.373328+0000","last_undegraded":"2024-04-16T16:20:58.373328+0000","last_fullsized":"2024-04-16T16:20:58.373328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:46.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705149+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:20:57.705149+0000","last_peered":"2024-04-16T16:20:57.705149+0000","last_clean":"2024-04-16T16:20:57.705149+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:20:57.705149+0000","last_undegraded":"2024-04-16T16:20:57.705149+0000","last_fullsized":"2024-04-16T16:20:57.705149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707948+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:20:57.707948+0000","last_peered":"2024-04-16T16:20:57.707948+0000","last_clean":"2024-04-16T16:20:57.707948+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:20:57.707948+0000","last_undegraded":"2024-04-16T16:20:57.707948+0000","last_fullsized":"2024-04-16T16:20:57.707948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375190+0000","last_change":"2024-04-16T16:20:55.703623+0000","last_active":"2024-04-16T16:20:58.375190+0000","last_peered":"2024-04-16T16:20:58.375190+0000","last_clean":"2024-04-16T16:20:58.375190+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:20:58.375190+0000","last_undegraded":"2024-04-16T16:20:58.375190+0000","last_fullsized":"2024-04-16T16:20:58.375190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374994+0000","last_change":"2024-04-16T16:20:56.723400+0000","last_active":"2024-04-16T16:20:58.374994+0000","last_peered":"2024-04-16T16:20:58.374994+0000","last_clean":"2024-04-16T16:20:58.374994+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:20:58.374994+0000","last_undegraded":"2024-04-16T16:20:58.374994+0000","last_fullsized":"2024-04-16T16:20:58.374994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375368+0000","last_change":"2024-04-16T16:20:55.694413+0000","last_active":"2024-04-16T16:20:58.375368+0000","last_peered":"2024-04-16T16:20:58.375368+0000","last_clean":"2024-04-16T16:20:58.375368+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:20:58.375368+0000","last_undegraded":"2024-04-16T16:20:58.375368+0000","last_fullsized":"2024-04-16T16:20:58.375368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:21.591232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701658+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:20:57.701658+0000","last_peered":"2024-04-16T16:20:57.701658+0000","last_clean":"2024-04-16T16:20:57.701658+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:20:57.701658+0000","last_undegraded":"2024-04-16T16:20:57.701658+0000","last_fullsized":"2024-04-16T16:20:57.701658+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375589+0000","last_change":"2024-04-16T16:20:55.702261+0000","last_active":"2024-04-16T16:20:58.375589+0000","last_peered":"2024-04-16T16:20:58.375589+0000","last_clean":"2024-04-16T16:20:58.375589+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:20:58.375589+0000","last_undegraded":"2024-04-16T16:20:58.375589+0000","last_fullsized":"2024-04-16T16:20:58.375589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375450+0000","last_change":"2024-04-16T16:20:56.712767+0000","last_active":"2024-04-16T16:20:58.375450+0000","last_peered":"2024-04-16T16:20:58.375450+0000","last_clean":"2024-04-16T16:20:58.375450+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:20:58.375450+0000","last_undegraded":"2024-04-16T16:20:58.375450+0000","last_fullsized":"2024-04-16T16:20:58.375450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707063+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:20:57.707063+0000","last_peered":"2024-04-16T16:20:57.707063+0000","last_clean":"2024-04-16T16:20:57.707063+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:20:57.707063+0000","last_undegraded":"2024-04-16T16:20:57.707063+0000","last_fullsized":"2024-04-16T16:20:57.707063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706177+0000","last_change":"2024-04-16T16:20:56.704028+0000","last_active":"2024-04-16T16:20:57.706177+0000","last_peered":"2024-04-16T16:20:57.706177+0000","last_clean":"2024-04-16T16:20:57.706177+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:20:57.706177+0000","last_undegraded":"2024-04-16T16:20:57.706177+0000","last_fullsized":"2024-04-16T16:20:57.706177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373761+0000","last_change":"2024-04-16T16:20:55.691499+0000","last_active":"2024-04-16T16:20:58.373761+0000","last_peered":"2024-04-16T16:20:58.373761+0000","last_clean":"2024-04-16T16:20:58.373761+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:20:58.373761+0000","last_undegraded":"2024-04-16T16:20:58.373761+0000","last_fullsized":"2024-04-16T16:20:58.373761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:46.276878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374544+0000","last_change":"2024-04-16T16:20:56.718537+0000","last_active":"2024-04-16T16:20:58.374544+0000","last_peered":"2024-04-16T16:20:58.374544+0000","last_clean":"2024-04-16T16:20:58.374544+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:20:58.374544+0000","last_undegraded":"2024-04-16T16:20:58.374544+0000","last_fullsized":"2024-04-16T16:20:58.374544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372802+0000","last_change":"2024-04-16T16:20:55.700778+0000","last_active":"2024-04-16T16:20:58.372802+0000","last_peered":"2024-04-16T16:20:58.372802+0000","last_clean":"2024-04-16T16:20:58.372802+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:20:58.372802+0000","last_undegraded":"2024-04-16T16:20:58.372802+0000","last_fullsized":"2024-04-16T16:20:58.372802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:21.223928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705286+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:20:57.705286+0000","last_peered":"2024-04-16T16:20:57.705286+0000","last_clean":"2024-04-16T16:20:57.705286+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:20:57.705286+0000","last_undegraded":"2024-04-16T16:20:57.705286+0000","last_fullsized":"2024-04-16T16:20:57.705286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705837+0000","last_change":"2024-04-16T16:20:55.700889+0000","last_active":"2024-04-16T16:20:57.705837+0000","last_peered":"2024-04-16T16:20:57.705837+0000","last_clean":"2024-04-16T16:20:57.705837+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:20:57.705837+0000","last_undegraded":"2024-04-16T16:20:57.705837+0000","last_fullsized":"2024-04-16T16:20:57.705837+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374373+0000","last_change":"2024-04-16T16:20:56.720365+0000","last_active":"2024-04-16T16:20:58.374373+0000","last_peered":"2024-04-16T16:20:58.374373+0000","last_clean":"2024-04-16T16:20:58.374373+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:20:58.374373+0000","last_undegraded":"2024-04-16T16:20:58.374373+0000","last_fullsized":"2024-04-16T16:20:58.374373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373392+0000","last_change":"2024-04-16T16:20:55.705450+0000","last_active":"2024-04-16T16:20:58.373392+0000","last_peered":"2024-04-16T16:20:58.373392+0000","last_clean":"2024-04-16T16:20:58.373392+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:20:58.373392+0000","last_undegraded":"2024-04-16T16:20:58.373392+0000","last_fullsized":"2024-04-16T16:20:58.373392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375228+0000","last_change":"2024-04-16T16:20:56.721758+0000","last_active":"2024-04-16T16:20:58.375228+0000","last_peered":"2024-04-16T16:20:58.375228+0000","last_clean":"2024-04-16T16:20:58.375228+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:20:58.375228+0000","last_undegraded":"2024-04-16T16:20:58.375228+0000","last_fullsized":"2024-04-16T16:20:58.375228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375245+0000","last_change":"2024-04-16T16:20:55.691154+0000","last_active":"2024-04-16T16:20:58.375245+0000","last_peered":"2024-04-16T16:20:58.375245+0000","last_clean":"2024-04-16T16:20:58.375245+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:20:58.375245+0000","last_undegraded":"2024-04-16T16:20:58.375245+0000","last_fullsized":"2024-04-16T16:20:58.375245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:48.698225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708411+0000","last_change":"2024-04-16T16:20:56.708684+0000","last_active":"2024-04-16T16:20:57.708411+0000","last_peered":"2024-04-16T16:20:57.708411+0000","last_clean":"2024-04-16T16:20:57.708411+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:20:57.708411+0000","last_undegraded":"2024-04-16T16:20:57.708411+0000","last_fullsized":"2024-04-16T16:20:57.708411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376352+0000","last_change":"2024-04-16T16:20:55.699664+0000","last_active":"2024-04-16T16:20:58.376352+0000","last_peered":"2024-04-16T16:20:58.376352+0000","last_clean":"2024-04-16T16:20:58.376352+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:20:58.376352+0000","last_undegraded":"2024-04-16T16:20:58.376352+0000","last_fullsized":"2024-04-16T16:20:58.376352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375214+0000","last_change":"2024-04-16T16:20:56.712157+0000","last_active":"2024-04-16T16:20:58.375214+0000","last_peered":"2024-04-16T16:20:58.375214+0000","last_clean":"2024-04-16T16:20:58.375214+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:20:58.375214+0000","last_undegraded":"2024-04-16T16:20:58.375214+0000","last_fullsized":"2024-04-16T16:20:58.375214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707746+0000","last_change":"2024-04-16T16:20:55.702354+0000","last_active":"2024-04-16T16:20:57.707746+0000","last_peered":"2024-04-16T16:20:57.707746+0000","last_clean":"2024-04-16T16:20:57.707746+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:20:57.707746+0000","last_undegraded":"2024-04-16T16:20:57.707746+0000","last_fullsized":"2024-04-16T16:20:57.707746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:50.973007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375511+0000","last_change":"2024-04-16T16:20:56.712536+0000","last_active":"2024-04-16T16:20:58.375511+0000","last_peered":"2024-04-16T16:20:58.375511+0000","last_clean":"2024-04-16T16:20:58.375511+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:20:58.375511+0000","last_undegraded":"2024-04-16T16:20:58.375511+0000","last_fullsized":"2024-04-16T16:20:58.375511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.375548+0000","last_change":"2024-04-16T16:20:55.697400+0000","last_active":"2024-04-16T16:20:58.375548+0000","last_peered":"2024-04-16T16:20:58.375548+0000","last_clean":"2024-04-16T16:20:58.375548+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:20:58.375548+0000","last_undegraded":"2024-04-16T16:20:58.375548+0000","last_fullsized":"2024-04-16T16:20:58.375548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:32.224244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706503+0000","last_change":"2024-04-16T16:20:56.705284+0000","last_active":"2024-04-16T16:20:57.706503+0000","last_peered":"2024-04-16T16:20:57.706503+0000","last_clean":"2024-04-16T16:20:57.706503+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:20:57.706503+0000","last_undegraded":"2024-04-16T16:20:57.706503+0000","last_fullsized":"2024-04-16T16:20:57.706503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374874+0000","last_change":"2024-04-16T16:20:55.691520+0000","last_active":"2024-04-16T16:20:58.374874+0000","last_peered":"2024-04-16T16:20:58.374874+0000","last_clean":"2024-04-16T16:20:58.374874+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:20:58.374874+0000","last_undegraded":"2024-04-16T16:20:58.374874+0000","last_fullsized":"2024-04-16T16:20:58.374874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:34.964542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376142+0000","last_change":"2024-04-16T16:20:56.714025+0000","last_active":"2024-04-16T16:20:58.376142+0000","last_peered":"2024-04-16T16:20:58.376142+0000","last_clean":"2024-04-16T16:20:58.376142+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:20:58.376142+0000","last_undegraded":"2024-04-16T16:20:58.376142+0000","last_fullsized":"2024-04-16T16:20:58.376142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.702218+0000","last_change":"2024-04-16T16:20:55.694598+0000","last_active":"2024-04-16T16:20:57.702218+0000","last_peered":"2024-04-16T16:20:57.702218+0000","last_clean":"2024-04-16T16:20:57.702218+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:20:57.702218+0000","last_undegraded":"2024-04-16T16:20:57.702218+0000","last_fullsized":"2024-04-16T16:20:57.702218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:01.927903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374747+0000","last_change":"2024-04-16T16:20:56.715573+0000","last_active":"2024-04-16T16:20:58.374747+0000","last_peered":"2024-04-16T16:20:58.374747+0000","last_clean":"2024-04-16T16:20:58.374747+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:20:58.374747+0000","last_undegraded":"2024-04-16T16:20:58.374747+0000","last_fullsized":"2024-04-16T16:20:58.374747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.705507+0000","last_change":"2024-04-16T16:20:55.700653+0000","last_active":"2024-04-16T16:20:57.705507+0000","last_peered":"2024-04-16T16:20:57.705507+0000","last_clean":"2024-04-16T16:20:57.705507+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:20:57.705507+0000","last_undegraded":"2024-04-16T16:20:57.705507+0000","last_fullsized":"2024-04-16T16:20:57.705507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:30.271546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708260+0000","last_change":"2024-04-16T16:20:56.691557+0000","last_active":"2024-04-16T16:20:57.708260+0000","last_peered":"2024-04-16T16:20:57.708260+0000","last_clean":"2024-04-16T16:20:57.708260+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:20:57.708260+0000","last_undegraded":"2024-04-16T16:20:57.708260+0000","last_fullsized":"2024-04-16T16:20:57.708260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.703392+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:20:57.703392+0000","last_peered":"2024-04-16T16:20:57.703392+0000","last_clean":"2024-04-16T16:20:57.703392+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:20:57.703392+0000","last_undegraded":"2024-04-16T16:20:57.703392+0000","last_fullsized":"2024-04-16T16:20:57.703392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:33:40.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.708599+0000","last_change":"2024-04-16T16:20:56.714215+0000","last_active":"2024-04-16T16:20:57.708599+0000","last_peered":"2024-04-16T16:20:57.708599+0000","last_clean":"2024-04-16T16:20:57.708599+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:20:57.708599+0000","last_undegraded":"2024-04-16T16:20:57.708599+0000","last_fullsized":"2024-04-16T16:20:57.708599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376396+0000","last_change":"2024-04-16T16:20:55.704363+0000","last_active":"2024-04-16T16:20:58.376396+0000","last_peered":"2024-04-16T16:20:58.376396+0000","last_clean":"2024-04-16T16:20:58.376396+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:20:58.376396+0000","last_undegraded":"2024-04-16T16:20:58.376396+0000","last_fullsized":"2024-04-16T16:20:58.376396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701593+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:20:57.701593+0000","last_peered":"2024-04-16T16:20:57.701593+0000","last_clean":"2024-04-16T16:20:57.701593+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:20:57.701593+0000","last_undegraded":"2024-04-16T16:20:57.701593+0000","last_fullsized":"2024-04-16T16:20:57.701593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:56.800553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372943+0000","last_change":"2024-04-16T16:20:55.703477+0000","last_active":"2024-04-16T16:20:58.372943+0000","last_peered":"2024-04-16T16:20:58.372943+0000","last_clean":"2024-04-16T16:20:58.372943+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:20:58.372943+0000","last_undegraded":"2024-04-16T16:20:58.372943+0000","last_fullsized":"2024-04-16T16:20:58.372943+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:15.228538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.376581+0000","last_change":"2024-04-16T16:20:56.707864+0000","last_active":"2024-04-16T16:20:58.376581+0000","last_peered":"2024-04-16T16:20:58.376581+0000","last_clean":"2024-04-16T16:20:58.376581+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:20:58.376581+0000","last_undegraded":"2024-04-16T16:20:58.376581+0000","last_fullsized":"2024-04-16T16:20:58.376581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:21.749618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.707985+0000","last_change":"2024-04-16T16:20:55.701244+0000","last_active":"2024-04-16T16:20:57.707985+0000","last_peered":"2024-04-16T16:20:57.707985+0000","last_clean":"2024-04-16T16:20:57.707985+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:20:57.707985+0000","last_undegraded":"2024-04-16T16:20:57.707985+0000","last_fullsized":"2024-04-16T16:20:57.707985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374179+0000","last_change":"2024-04-16T16:20:56.707897+0000","last_active":"2024-04-16T16:20:58.374179+0000","last_peered":"2024-04-16T16:20:58.374179+0000","last_clean":"2024-04-16T16:20:58.374179+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:20:58.374179+0000","last_undegraded":"2024-04-16T16:20:58.374179+0000","last_fullsized":"2024-04-16T16:20:58.374179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:42.907490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701598+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:20:57.701598+0000","last_peered":"2024-04-16T16:20:57.701598+0000","last_clean":"2024-04-16T16:20:57.701598+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:20:57.701598+0000","last_undegraded":"2024-04-16T16:20:57.701598+0000","last_fullsized":"2024-04-16T16:20:57.701598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:23.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.374977+0000","last_change":"2024-04-16T16:20:56.720972+0000","last_active":"2024-04-16T16:20:58.374977+0000","last_peered":"2024-04-16T16:20:58.374977+0000","last_clean":"2024-04-16T16:20:58.374977+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:20:58.374977+0000","last_undegraded":"2024-04-16T16:20:58.374977+0000","last_fullsized":"2024-04-16T16:20:58.374977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.706431+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:20:57.706431+0000","last_peered":"2024-04-16T16:20:57.706431+0000","last_clean":"2024-04-16T16:20:57.706431+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:20:57.706431+0000","last_undegraded":"2024-04-16T16:20:57.706431+0000","last_fullsized":"2024-04-16T16:20:57.706431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701303+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:20:57.701303+0000","last_peered":"2024-04-16T16:20:57.701303+0000","last_clean":"2024-04-16T16:20:57.701303+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:20:57.701303+0000","last_undegraded":"2024-04-16T16:20:57.701303+0000","last_fullsized":"2024-04-16T16:20:57.701303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:43.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:57.701319+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:20:57.701319+0000","last_peered":"2024-04-16T16:20:57.701319+0000","last_clean":"2024-04-16T16:20:57.701319+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:20:57.701319+0000","last_undegraded":"2024-04-16T16:20:57.701319+0000","last_fullsized":"2024-04-16T16:20:57.701319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:00.391217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373562+0000","last_change":"2024-04-16T16:20:56.708340+0000","last_active":"2024-04-16T16:20:58.373562+0000","last_peered":"2024-04-16T16:20:58.373562+0000","last_clean":"2024-04-16T16:20:58.373562+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:20:58.373562+0000","last_undegraded":"2024-04-16T16:20:58.373562+0000","last_fullsized":"2024-04-16T16:20:58.373562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:07.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372721+0000","last_change":"2024-04-16T16:20:55.692470+0000","last_active":"2024-04-16T16:20:58.372721+0000","last_peered":"2024-04-16T16:20:58.372721+0000","last_clean":"2024-04-16T16:20:58.372721+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:20:58.372721+0000","last_undegraded":"2024-04-16T16:20:58.372721+0000","last_fullsized":"2024-04-16T16:20:58.372721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:20.735190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372709+0000","last_change":"2024-04-16T16:20:56.720232+0000","last_active":"2024-04-16T16:20:58.372709+0000","last_peered":"2024-04-16T16:20:58.372709+0000","last_clean":"2024-04-16T16:20:58.372709+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:20:58.372709+0000","last_undegraded":"2024-04-16T16:20:58.372709+0000","last_fullsized":"2024-04-16T16:20:58.372709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:34.266414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.372516+0000","last_change":"2024-04-16T16:20:55.702982+0000","last_active":"2024-04-16T16:20:58.372516+0000","last_peered":"2024-04-16T16:20:58.372516+0000","last_clean":"2024-04-16T16:20:58.372516+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:20:58.372516+0000","last_undegraded":"2024-04-16T16:20:58.372516+0000","last_fullsized":"2024-04-16T16:20:58.372516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:05.020022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-16T16:20:58.373594+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:20:58.373594+0000","last_peered":"2024-04-16T16:20:58.373594+0000","last_clean":"2024-04-16T16:20:58.373594+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:20:58.373594+0000","last_undegraded":"2024-04-16T16:20:58.373594+0000","last_fullsized":"2024-04-16T16:20:58.373594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":904511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":313983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":753664,"data_stored":314635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":315595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":753664,"data_stored":314039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":314073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":906545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:11.254 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T16:21:11.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.518+0000 7fb15fe00640 1 Processor -- start 2024-04-16T16:21:11.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.518+0000 7fb15fe00640 1 -- start start 2024-04-16T16:21:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600d3dd0 0x7fb1600cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15fe00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1600cfb70 0x7fb1600b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15fe00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1600b9080 con 0x7fb16015ea50 2024-04-16T16:21:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15fe00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb1600b9c90 con 0x7fb1600cfb70 2024-04-16T16:21:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb1600b9360 con 0x7fb1600d3dd0 2024-04-16T16:21:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1600cfb70 0x7fb1600b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15f400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1600cfb70 0x7fb1600b7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37846/0 (socket says 172.21.15.22:37846) 2024-04-16T16:21:11.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15f400640 1 -- 172.21.15.22:0/2660424057 learned_addr learned my addr 172.21.15.22:0/2660424057 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:11.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.520+0000 7fb15e000640 1 --2- 172.21.15.22:0/2660424057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600d3dd0 0x7fb1600cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.521+0000 7fb15f400640 1 -- 172.21.15.22:0/2660424057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600d3dd0 msgr2=0x7fb1600cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.521+0000 7fb15f400640 1 --2- 172.21.15.22:0/2660424057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600d3dd0 0x7fb1600cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.521+0000 7fb15f400640 1 -- 172.21.15.22:0/2660424057 >> v1:172.21.15.43:6789/0 conn(0x7fb16015ea50 legacy=0x7fb1600ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.521+0000 7fb15f400640 1 -- 172.21.15.22:0/2660424057 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1600b9640 con 0x7fb1600cfb70 2024-04-16T16:21:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.522+0000 7fb15f400640 1 --2- 172.21.15.22:0/2660424057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600cfb70 0x7fb1600b7a90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb158009e80 tx=0x7fb15802bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d3fd55abedc66e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.522+0000 7fb15d600640 1 -- 172.21.15.22:0/2660424057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15802c930 con 0x7fb1600cfb70 2024-04-16T16:21:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.522+0000 7fb15d600640 1 -- 172.21.15.22:0/2660424057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15802cad0 con 0x7fb1600cfb70 2024-04-16T16:21:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.522+0000 7fb15d600640 1 -- 172.21.15.22:0/2660424057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1580343f0 con 0x7fb1600cfb70 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 -- 172.21.15.22:0/2660424057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600cfb70 msgr2=0x7fb1600b7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 --2- 172.21.15.22:0/2660424057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600cfb70 0x7fb1600b7a90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb158009e80 tx=0x7fb15802bd90 comp rx=0 tx=0).stop 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 -- 172.21.15.22:0/2660424057 shutdown_connections 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 --2- 172.21.15.22:0/2660424057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600cfb70 0x7fb1600b7a90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 --2- 172.21.15.22:0/2660424057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600d3dd0 0x7fb1600cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 -- 172.21.15.22:0/2660424057 >> 172.21.15.22:0/2660424057 conn(0x7fb160072430 msgr2=0x7fb160072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 -- 172.21.15.22:0/2660424057 shutdown_connections 2024-04-16T16:21:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.523+0000 7fb15fe00640 1 -- 172.21.15.22:0/2660424057 wait complete. 2024-04-16T16:21:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.525+0000 7fb15fe00640 1 Processor -- start 2024-04-16T16:21:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.525+0000 7fb15fe00640 1 -- start start 2024-04-16T16:21:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.526+0000 7fb15fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600cfb70 0x7fb1600c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.526+0000 7fb15fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600d3dd0 0x7fb160148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.526+0000 7fb15fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb16015ea50 0x7fb1600d4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.526+0000 7fb15fe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb1600b7fd0 con 0x7fb1600d3dd0 2024-04-16T16:21:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.526+0000 7fb15fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb16015ee30 con 0x7fb16015ea50 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.526+0000 7fb15fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb1600b8150 con 0x7fb1600cfb70 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600d3dd0 0x7fb160148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600d3dd0 0x7fb160148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37860/0 (socket says 172.21.15.22:37860) 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 -- 172.21.15.22:0/1021483224 learned_addr learned my addr 172.21.15.22:0/1021483224 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15ea00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600cfb70 0x7fb1600c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15f400640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb16015ea50 0x7fb1600d4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 -- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600cfb70 msgr2=0x7fb1600c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600cfb70 0x7fb1600c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 -- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb16015ea50 msgr2=0x7fb1600d4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb16015ea50 0x7fb1600d4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 -- 172.21.15.22:0/1021483224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb160156c50 con 0x7fb1600d3dd0 2024-04-16T16:21:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15f400640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb16015ea50 0x7fb1600d4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.527+0000 7fb15e000640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600d3dd0 0x7fb160148b20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00d800 tx=0x7fb14c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.528+0000 7fb156a00640 1 -- 172.21.15.22:0/1021483224 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00b6c0 con 0x7fb1600d3dd0 2024-04-16T16:21:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.528+0000 7fb156a00640 1 -- 172.21.15.22:0/1021483224 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c019070 con 0x7fb1600d3dd0 2024-04-16T16:21:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.528+0000 7fb156a00640 1 -- 172.21.15.22:0/1021483224 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00ba80 con 0x7fb1600d3dd0 2024-04-16T16:21:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.528+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1600c8970 con 0x7fb1600d3dd0 2024-04-16T16:21:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.528+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1600c8f20 con 0x7fb1600d3dd0 2024-04-16T16:21:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.529+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb160075f30 con 0x7fb1600d3dd0 2024-04-16T16:21:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.531+0000 7fb156a00640 1 -- 172.21.15.22:0/1021483224 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fb14c00bc20 con 0x7fb1600d3dd0 2024-04-16T16:21:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.531+0000 7fb156a00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb14006ce90 0x7fb14006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.532+0000 7fb156a00640 1 -- 172.21.15.22:0/1021483224 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fb14c08cac0 con 0x7fb1600d3dd0 2024-04-16T16:21:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.532+0000 7fb15ea00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb14006ce90 0x7fb14006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.532+0000 7fb15ea00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb14006ce90 0x7fb14006f350 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb150006fd0 tx=0x7fb150008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.536+0000 7fb156a00640 1 -- 172.21.15.22:0/1021483224 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb14c05a680 con 0x7fb1600d3dd0 2024-04-16T16:21:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.740+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1600b8910 con 0x7fb1600d3dd0 2024-04-16T16:21:11.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.743+0000 7fb156a00640 1 -- 172.21.15.22:0/1021483224 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16545 (secure 0 0 0) 0x7fb14c059f80 con 0x7fb1600d3dd0 2024-04-16T16:21:11.743 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:11.744 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":62,"fsid":"96f4a5d6-2098-4ed6-be29-6c8dfddfcbaf","created":"2024-04-16T16:16:22.478474+0000","modified":"2024-04-16T16:20:57.686813+0000","last_up_change":"2024-04-16T16:16:34.418784+0000","last_in_change":"2024-04-16T16:16:25.943255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T16:16:35.741414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-16T16:20:54.072603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-16T16:20:55.142667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64c1255c-1abe-4e0a-aca0-8e6fcd1d3b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6817","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6819","nonce":62943544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6823","nonce":62943544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6831","nonce":62943544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":62943544},{"type":"v1","addr":"172.21.15.22:6827","nonce":62943544}]},"public_addr":"172.21.15.22:6819/62943544","cluster_addr":"172.21.15.22:6823/62943544","heartbeat_back_addr":"172.21.15.22:6831/62943544","heartbeat_front_addr":"172.21.15.22:6827/62943544","state":["exists","up"]},{"osd":1,"uuid":"e089ea0f-e418-4308-b2b4-895e33dfd0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6809","nonce":454707647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6811","nonce":454707647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6815","nonce":454707647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":454707647},{"type":"v1","addr":"172.21.15.22:6813","nonce":454707647}]},"public_addr":"172.21.15.22:6809/454707647","cluster_addr":"172.21.15.22:6811/454707647","heartbeat_back_addr":"172.21.15.22:6815/454707647","heartbeat_front_addr":"172.21.15.22:6813/454707647","state":["exists","up"]},{"osd":2,"uuid":"9742e41f-89fa-446a-813d-f3670dfdf6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6801","nonce":154267311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6803","nonce":154267311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6807","nonce":154267311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":154267311},{"type":"v1","addr":"172.21.15.22:6805","nonce":154267311}]},"public_addr":"172.21.15.22:6801/154267311","cluster_addr":"172.21.15.22:6803/154267311","heartbeat_back_addr":"172.21.15.22:6807/154267311","heartbeat_front_addr":"172.21.15.22:6805/154267311","state":["exists","up"]},{"osd":3,"uuid":"6b93b718-b634-453a-88bc-c7f5f4661eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6818","nonce":552031347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6822","nonce":552031347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6830","nonce":552031347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":552031347},{"type":"v1","addr":"172.21.15.22:6826","nonce":552031347}]},"public_addr":"172.21.15.22:6818/552031347","cluster_addr":"172.21.15.22:6822/552031347","heartbeat_back_addr":"172.21.15.22:6830/552031347","heartbeat_front_addr":"172.21.15.22:6826/552031347","state":["exists","up"]},{"osd":4,"uuid":"c2b47158-c1b8-4efb-b3c6-2ce29849d207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6809","nonce":2374877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6811","nonce":2374877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6815","nonce":2374877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2374877108},{"type":"v1","addr":"172.21.15.43:6813","nonce":2374877108}]},"public_addr":"172.21.15.43:6809/2374877108","cluster_addr":"172.21.15.43:6811/2374877108","heartbeat_back_addr":"172.21.15.43:6815/2374877108","heartbeat_front_addr":"172.21.15.43:6813/2374877108","state":["exists","up"]},{"osd":5,"uuid":"5aedead8-fa25-48b9-a7a4-45253da9f6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6801","nonce":3649609022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6803","nonce":3649609022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6807","nonce":3649609022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3649609022},{"type":"v1","addr":"172.21.15.43:6805","nonce":3649609022}]},"public_addr":"172.21.15.43:6801/3649609022","cluster_addr":"172.21.15.43:6803/3649609022","heartbeat_back_addr":"172.21.15.43:6807/3649609022","heartbeat_front_addr":"172.21.15.43:6805/3649609022","state":["exists","up"]},{"osd":6,"uuid":"515ff6c1-422b-4756-8a85-9d2670478df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6817","nonce":748765916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6819","nonce":748765916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6826","nonce":748765916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":748765916},{"type":"v1","addr":"172.21.15.43:6822","nonce":748765916}]},"public_addr":"172.21.15.43:6817/748765916","cluster_addr":"172.21.15.43:6819/748765916","heartbeat_back_addr":"172.21.15.43:6826/748765916","heartbeat_front_addr":"172.21.15.43:6822/748765916","state":["exists","up"]},{"osd":7,"uuid":"6a25f11e-2222-4e6d-8a6e-da1ddf1c6271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6823","nonce":355389441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6827","nonce":355389441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6831","nonce":355389441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":355389441},{"type":"v1","addr":"172.21.15.43:6829","nonce":355389441}]},"public_addr":"172.21.15.43:6823/355389441","cluster_addr":"172.21.15.43:6827/355389441","heartbeat_back_addr":"172.21.15.43:6831/355389441","heartbeat_front_addr":"172.21.15.43:6829/355389441","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.349070+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.301723+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.270044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.369022+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.553879+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.111549+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.408942+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T16:16:31.648270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T16:21:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb14006ce90 msgr2=0x7fb14006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb14006ce90 0x7fb14006f350 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb150006fd0 tx=0x7fb150008040 comp rx=0 tx=0).stop 2024-04-16T16:21:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600d3dd0 msgr2=0x7fb160148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600d3dd0 0x7fb160148b20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00d800 tx=0x7fb14c00dcc0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 shutdown_connections 2024-04-16T16:21:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fb14006ce90 0x7fb14006f350 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb16015ea50 0x7fb1600d4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1600d3dd0 0x7fb160148b20 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 --2- 172.21.15.22:0/1021483224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1600cfb70 0x7fb1600c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 >> 172.21.15.22:0/1021483224 conn(0x7fb160072430 msgr2=0x7fb16015cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 shutdown_connections 2024-04-16T16:21:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:11.746+0000 7fb15fe00640 1 -- 172.21.15.22:0/1021483224 wait complete. 2024-04-16T16:21:12.534 INFO:tasks.ceph.mds.a.smithi022.stderr:2024-04-16T16:21:12.534+0000 7f766aa00640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-16T16:21:12.765 INFO:tasks.ceph:Scrubbing osd.0 2024-04-16T16:21:12.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:12.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.995+0000 7fe74be00640 1 Processor -- start 2024-04-16T16:21:12.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.995+0000 7fe74be00640 1 -- start start 2024-04-16T16:21:12.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.997+0000 7fe74be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe74c15c6e0 0x7fe74c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:12.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.997+0000 7fe74be00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74c06cf80 con 0x7fe74c0af930 2024-04-16T16:21:12.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.997+0000 7fe74be00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74c06d260 con 0x7fe74c072e30 2024-04-16T16:21:12.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.997+0000 7fe74be00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe74c06d540 con 0x7fe74c15c6e0 2024-04-16T16:21:12.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.997+0000 7fe74aa00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe74c15c6e0 0x7fe74c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:12.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.997+0000 7fe743e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe74c0af930 0x7fe74c072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39346/0 (socket says 172.21.15.22:39346) 2024-04-16T16:21:12.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.997+0000 7fe743e00640 1 -- 172.21.15.22:0/2281298092 learned_addr learned my addr 172.21.15.22:0/2281298092 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:12.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.998+0000 7fe74aa00640 1 -- 172.21.15.22:0/2281298092 >> v1:172.21.15.43:6789/0 conn(0x7fe74c072e30 legacy=0x7fe74c0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:12.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.998+0000 7fe74aa00640 1 -- 172.21.15.22:0/2281298092 >> v1:172.21.15.22:6789/0 conn(0x7fe74c0af930 legacy=0x7fe74c072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:12.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.998+0000 7fe74a000640 1 -- 172.21.15.22:0/2281298092 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824000210 0 0) 0x7fe74c06cf80 con 0x7fe74c0af930 2024-04-16T16:21:12.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.998+0000 7fe74aa00640 1 -- 172.21.15.22:0/2281298092 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c06d820 con 0x7fe74c15c6e0 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.999+0000 7fe74aa00640 1 --2- 172.21.15.22:0/2281298092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c15c6e0 0x7fe74c06e940 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097a0 tx=0x7fe73c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43754bc285e1c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.999+0000 7fe74a000640 1 -- 172.21.15.22:0/2281298092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c035020 con 0x7fe74c15c6e0 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.999+0000 7fe74a000640 1 -- 172.21.15.22:0/2281298092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73c031830 con 0x7fe74c15c6e0 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:12.999+0000 7fe74a000640 1 -- 172.21.15.22:0/2281298092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c031c00 con 0x7fe74c15c6e0 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.000+0000 7fe74be00640 1 -- 172.21.15.22:0/2281298092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c15c6e0 msgr2=0x7fe74c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.000+0000 7fe74be00640 1 --2- 172.21.15.22:0/2281298092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c15c6e0 0x7fe74c06e940 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097a0 tx=0x7fe73c02b8d0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.000+0000 7fe74be00640 1 -- 172.21.15.22:0/2281298092 shutdown_connections 2024-04-16T16:21:13.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.000+0000 7fe74be00640 1 --2- 172.21.15.22:0/2281298092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c15c6e0 0x7fe74c06e940 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.000+0000 7fe74be00640 1 -- 172.21.15.22:0/2281298092 >> 172.21.15.22:0/2281298092 conn(0x7fe74c062440 msgr2=0x7fe74c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:13.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.000+0000 7fe74be00640 1 -- 172.21.15.22:0/2281298092 shutdown_connections 2024-04-16T16:21:13.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.000+0000 7fe74be00640 1 -- 172.21.15.22:0/2281298092 wait complete. 2024-04-16T16:21:13.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.002+0000 7fe74be00640 1 Processor -- start 2024-04-16T16:21:13.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.002+0000 7fe74be00640 1 -- start start 2024-04-16T16:21:13.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe74be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe74c072e30 0x7fe74c152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe74be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c0af930 0x7fe74c1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe74be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe74c15c6e0 0x7fe74c1e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe74be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c15cc40 con 0x7fe74c0af930 2024-04-16T16:21:13.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe74be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c15cac0 con 0x7fe74c15c6e0 2024-04-16T16:21:13.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe74be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe74c0cec40 con 0x7fe74c072e30 2024-04-16T16:21:13.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe743e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c0af930 0x7fe74c1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe743e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c0af930 0x7fe74c1521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37878/0 (socket says 172.21.15.22:37878) 2024-04-16T16:21:13.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.003+0000 7fe743e00640 1 -- 172.21.15.22:0/537085765 learned_addr learned my addr 172.21.15.22:0/537085765 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:13.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe74b400640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe74c15c6e0 0x7fe74c1e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe74aa00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe74c072e30 0x7fe74c152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe743e00640 1 -- 172.21.15.22:0/537085765 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe74c072e30 msgr2=0x7fe74c152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe743e00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe74c072e30 0x7fe74c152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe743e00640 1 -- 172.21.15.22:0/537085765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe74c15c6e0 msgr2=0x7fe74c1e76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe743e00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe74c15c6e0 0x7fe74c1e76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe743e00640 1 -- 172.21.15.22:0/537085765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c1e6630 con 0x7fe74c0af930 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe743e00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c0af930 0x7fe74c1521f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c4d0 tx=0x7fe73400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734018070 con 0x7fe74c0af930 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe734007500 con 0x7fe74c0af930 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734004a20 con 0x7fe74c0af930 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.004+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74c1e6910 con 0x7fe74c0af930 2024-04-16T16:21:13.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.005+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74c1e6ed0 con 0x7fe74c0af930 2024-04-16T16:21:13.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.006+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe74c152730 con 0x7fe74c0af930 2024-04-16T16:21:13.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.007+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fe734004bc0 con 0x7fe74c0af930 2024-04-16T16:21:13.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.008+0000 7fe742a00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe72806ce90 0x7fe72806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.008+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fe73408b890 con 0x7fe74c0af930 2024-04-16T16:21:13.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.008+0000 7fe74aa00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe72806ce90 0x7fe72806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.008+0000 7fe742a00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7fe728075140 0x7fe728077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.008+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 --> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe728077c10 con 0x7fe728075140 2024-04-16T16:21:13.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.008+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fe734092050 con 0x7fe74c0af930 2024-04-16T16:21:13.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.008+0000 7fe74b400640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7fe728075140 0x7fe728077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.009+0000 7fe74aa00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe72806ce90 0x7fe72806f350 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe73c036000 tx=0x7fe73c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.009+0000 7fe74b400640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7fe728075140 0x7fe728077560 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.010+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== osd.0 v2:172.21.15.22:6817/62943544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe728077c10 con 0x7fe728075140 2024-04-16T16:21:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.024+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 --> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe74c075f30 con 0x7fe728075140 2024-04-16T16:21:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.025+0000 7fe742a00640 1 -- 172.21.15.22:0/537085765 <== osd.0 v2:172.21.15.22:6817/62943544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe74c075f30 con 0x7fe728075140 2024-04-16T16:21:13.025 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:13.025 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:13.025 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:13.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.025+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7fe728075140 msgr2=0x7fe728077560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.025+0000 7fe74be00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6817/62943544,v1:172.21.15.22:6819/62943544] conn(0x7fe728075140 0x7fe728077560 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe72806ce90 msgr2=0x7fe72806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fe72806ce90 0x7fe72806f350 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe73c036000 tx=0x7fe73c008030 comp rx=0 tx=0).stop 2024-04-16T16:21:13.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c0af930 msgr2=0x7fe74c1521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 --2- 172.21.15.22:0/537085765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe74c0af930 0x7fe74c1521f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c4d0 tx=0x7fe73400c990 comp rx=0 tx=0).stop 2024-04-16T16:21:13.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74b400640 1 -- 172.21.15.22:0/537085765 reap_dead start 2024-04-16T16:21:13.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 shutdown_connections 2024-04-16T16:21:13.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 >> 172.21.15.22:0/537085765 conn(0x7fe74c062440 msgr2=0x7fe74c0ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:13.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 shutdown_connections 2024-04-16T16:21:13.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.026+0000 7fe74be00640 1 -- 172.21.15.22:0/537085765 wait complete. 2024-04-16T16:21:13.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-16T16:21:13.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.258+0000 7f92df200640 1 Processor -- start 2024-04-16T16:21:13.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.259+0000 7f92df200640 1 -- start start 2024-04-16T16:21:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.260+0000 7f92df200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92e015e8b0 0x7f92e0162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.260+0000 7f92df200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f92e00d07c0 0x7f92e00b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92df200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e0163400 con 0x7f92e00b56b0 2024-04-16T16:21:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92df200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f92e006dc70 con 0x7f92e015e8b0 2024-04-16T16:21:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92df200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f92e006e100 con 0x7f92e00d07c0 2024-04-16T16:21:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92dde00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92e015e8b0 0x7f92e0162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92dde00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92e015e8b0 0x7f92e0162ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37880/0 (socket says 172.21.15.22:37880) 2024-04-16T16:21:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92dde00640 1 -- 172.21.15.22:0/3226756287 learned_addr learned my addr 172.21.15.22:0/3226756287 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:13.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92de800640 1 --2- 172.21.15.22:0/3226756287 >> v2:172.21.15.43:3300/0 conn(0x7f92e00d07c0 0x7f92e00b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92dde00640 1 -- 172.21.15.22:0/3226756287 >> v2:172.21.15.43:3300/0 conn(0x7f92e00d07c0 msgr2=0x7f92e00b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92dde00640 1 --2- 172.21.15.22:0/3226756287 >> v2:172.21.15.43:3300/0 conn(0x7f92e00d07c0 0x7f92e00b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92dde00640 1 -- 172.21.15.22:0/3226756287 >> v1:172.21.15.43:6789/0 conn(0x7f92e00b56b0 legacy=0x7f92e00d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.261+0000 7f92dde00640 1 -- 172.21.15.22:0/3226756287 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e006d060 con 0x7f92e015e8b0 2024-04-16T16:21:13.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.262+0000 7f92dde00640 1 --2- 172.21.15.22:0/3226756287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e015e8b0 0x7f92e0162ec0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f92e00732b0 tx=0x7f92d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162822df7172cb7c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.263+0000 7f92dd400640 1 -- 172.21.15.22:0/3226756287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0035020 con 0x7f92e015e8b0 2024-04-16T16:21:13.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.263+0000 7f92dd400640 1 -- 172.21.15.22:0/3226756287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d0031870 con 0x7f92e015e8b0 2024-04-16T16:21:13.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.263+0000 7f92dd400640 1 -- 172.21.15.22:0/3226756287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0031c40 con 0x7f92e015e8b0 2024-04-16T16:21:13.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.263+0000 7f92df200640 1 -- 172.21.15.22:0/3226756287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e015e8b0 msgr2=0x7f92e0162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.263+0000 7f92df200640 1 --2- 172.21.15.22:0/3226756287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e015e8b0 0x7f92e0162ec0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f92e00732b0 tx=0x7f92d002b910 comp rx=0 tx=0).stop 2024-04-16T16:21:13.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.264+0000 7f92df200640 1 -- 172.21.15.22:0/3226756287 shutdown_connections 2024-04-16T16:21:13.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.264+0000 7f92df200640 1 --2- 172.21.15.22:0/3226756287 >> v2:172.21.15.43:3300/0 conn(0x7f92e00d07c0 0x7f92e00b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.264+0000 7f92df200640 1 --2- 172.21.15.22:0/3226756287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e015e8b0 0x7f92e0162ec0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.264+0000 7f92df200640 1 -- 172.21.15.22:0/3226756287 >> 172.21.15.22:0/3226756287 conn(0x7f92e0075070 msgr2=0x7f92e0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:13.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.264+0000 7f92df200640 1 -- 172.21.15.22:0/3226756287 shutdown_connections 2024-04-16T16:21:13.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.264+0000 7f92df200640 1 -- 172.21.15.22:0/3226756287 wait complete. 2024-04-16T16:21:13.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.265+0000 7f92df200640 1 Processor -- start 2024-04-16T16:21:13.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.266+0000 7f92df200640 1 -- start start 2024-04-16T16:21:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.266+0000 7f92df200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e00b56b0 0x7f92e01427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.266+0000 7f92df200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92e00d07c0 0x7f92e0161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.266+0000 7f92df200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92e015e8b0 0x7f92e0142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.266+0000 7f92df200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92e006d900 con 0x7f92e00b56b0 2024-04-16T16:21:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.266+0000 7f92df200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92e006d620 con 0x7f92e00d07c0 2024-04-16T16:21:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.266+0000 7f92df200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f92e015ec90 con 0x7f92e015e8b0 2024-04-16T16:21:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e00b56b0 0x7f92e01427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e00b56b0 0x7f92e01427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37890/0 (socket says 172.21.15.22:37890) 2024-04-16T16:21:13.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 -- 172.21.15.22:0/1704670279 learned_addr learned my addr 172.21.15.22:0/1704670279 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:13.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 -- 172.21.15.22:0/1704670279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92e015e8b0 msgr2=0x7f92e0142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92e015e8b0 0x7f92e0142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 -- 172.21.15.22:0/1704670279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92e00d07c0 msgr2=0x7f92e0161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92e00d07c0 0x7f92e0161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 -- 172.21.15.22:0/1704670279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e015fff0 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.267+0000 7f92dde00640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e00b56b0 0x7f92e01427a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f92d0000c00 tx=0x7f92d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.268+0000 7f92d6000640 1 -- 172.21.15.22:0/1704670279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0040070 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.268+0000 7f92d6000640 1 -- 172.21.15.22:0/1704670279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d003a420 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.268+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e01602d0 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.268+0000 7f92d6000640 1 -- 172.21.15.22:0/1704670279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0035040 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.268+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e0160890 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.269+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e0075f30 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.270+0000 7f92d6000640 1 -- 172.21.15.22:0/1704670279 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f92d004b060 con 0x7f92e00b56b0 2024-04-16T16:21:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.271+0000 7f92d6000640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92bc06cec0 0x7f92bc06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.271+0000 7f92d6000640 1 -- 172.21.15.22:0/1704670279 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7f92d00ae5b0 con 0x7f92e00b56b0 2024-04-16T16:21:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.271+0000 7f92d7e00640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92bc06cec0 0x7f92bc06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.272+0000 7f92d7e00640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92bc06cec0 0x7f92bc06f380 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f92e0156cd0 tx=0x7f92c8007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.276+0000 7f92d6000640 1 -- 172.21.15.22:0/1704670279 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92d002f320 con 0x7f92e00b56b0 2024-04-16T16:21:13.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.482+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f92e0071160 con 0x7f92bc06cec0 2024-04-16T16:21:13.483 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 0 to deep-scrub 2024-04-16T16:21:13.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.483+0000 7f92d6000640 1 -- 172.21.15.22:0/1704670279 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f92e0071160 con 0x7f92bc06cec0 2024-04-16T16:21:13.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92bc06cec0 msgr2=0x7f92bc06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92bc06cec0 0x7f92bc06f380 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f92e0156cd0 tx=0x7f92c8007990 comp rx=0 tx=0).stop 2024-04-16T16:21:13.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e00b56b0 msgr2=0x7f92e01427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e00b56b0 0x7f92e01427a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f92d0000c00 tx=0x7f92d00046c0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 shutdown_connections 2024-04-16T16:21:13.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f92bc06cec0 0x7f92bc06f380 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92e015e8b0 0x7f92e0142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92e00d07c0 0x7f92e0161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 --2- 172.21.15.22:0/1704670279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e00b56b0 0x7f92e01427a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 >> 172.21.15.22:0/1704670279 conn(0x7f92e0075070 msgr2=0x7f92e00b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:13.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 shutdown_connections 2024-04-16T16:21:13.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.486+0000 7f92df200640 1 -- 172.21.15.22:0/1704670279 wait complete. 2024-04-16T16:21:13.504 INFO:tasks.ceph:Scrubbing osd.1 2024-04-16T16:21:13.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:13.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.725+0000 7ff830c00640 1 Processor -- start 2024-04-16T16:21:13.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.726+0000 7ff830c00640 1 -- start start 2024-04-16T16:21:13.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff830c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c15c6e0 0x7ff82c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff830c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff82c0af930 0x7ff82c072720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff830c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff82c06cf80 con 0x7ff82c072c60 2024-04-16T16:21:13.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff830c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff82c06d260 con 0x7ff82c0af930 2024-04-16T16:21:13.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff830c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff82c06d540 con 0x7ff82c15c6e0 2024-04-16T16:21:13.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff823e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff82c0af930 0x7ff82c072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff823e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff82c0af930 0x7ff82c072720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37900/0 (socket says 172.21.15.22:37900) 2024-04-16T16:21:13.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.727+0000 7ff823e00640 1 -- 172.21.15.22:0/3571867245 learned_addr learned my addr 172.21.15.22:0/3571867245 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:13.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.728+0000 7ff823e00640 1 -- 172.21.15.22:0/3571867245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c15c6e0 msgr2=0x7ff82c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.728+0000 7ff82b400640 1 --2- 172.21.15.22:0/3571867245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c15c6e0 0x7ff82c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.728+0000 7ff823e00640 1 --2- 172.21.15.22:0/3571867245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c15c6e0 0x7ff82c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.728+0000 7ff823e00640 1 -- 172.21.15.22:0/3571867245 >> v1:172.21.15.43:6789/0 conn(0x7ff82c072c60 legacy=0x7ff82c160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.728+0000 7ff823e00640 1 -- 172.21.15.22:0/3571867245 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c06d820 con 0x7ff82c0af930 2024-04-16T16:21:13.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.729+0000 7ff823e00640 1 --2- 172.21.15.22:0/3571867245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c0af930 0x7ff82c072720 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff814009870 tx=0x7ff81402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef65f2d05ee3a41 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.729+0000 7ff82aa00640 1 -- 172.21.15.22:0/3571867245 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814035020 con 0x7ff82c0af930 2024-04-16T16:21:13.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.729+0000 7ff82aa00640 1 -- 172.21.15.22:0/3571867245 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff814031640 con 0x7ff82c0af930 2024-04-16T16:21:13.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.729+0000 7ff82aa00640 1 -- 172.21.15.22:0/3571867245 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81402d040 con 0x7ff82c0af930 2024-04-16T16:21:13.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 -- 172.21.15.22:0/3571867245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c0af930 msgr2=0x7ff82c072720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 --2- 172.21.15.22:0/3571867245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c0af930 0x7ff82c072720 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff814009870 tx=0x7ff81402b8f0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 -- 172.21.15.22:0/3571867245 shutdown_connections 2024-04-16T16:21:13.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 --2- 172.21.15.22:0/3571867245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c0af930 0x7ff82c072720 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 --2- 172.21.15.22:0/3571867245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c15c6e0 0x7ff82c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 -- 172.21.15.22:0/3571867245 >> 172.21.15.22:0/3571867245 conn(0x7ff82c062440 msgr2=0x7ff82c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:13.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 -- 172.21.15.22:0/3571867245 shutdown_connections 2024-04-16T16:21:13.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.730+0000 7ff830c00640 1 -- 172.21.15.22:0/3571867245 wait complete. 2024-04-16T16:21:13.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.732+0000 7ff830c00640 1 Processor -- start 2024-04-16T16:21:13.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.732+0000 7ff830c00640 1 -- start start 2024-04-16T16:21:13.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.733+0000 7ff830c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c072c60 0x7ff82c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.733+0000 7ff830c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c0af930 0x7ff82c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.733+0000 7ff830c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff82c15c6e0 0x7ff82c15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.733+0000 7ff830c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c15cc40 con 0x7ff82c072c60 2024-04-16T16:21:13.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.733+0000 7ff830c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c15cac0 con 0x7ff82c15c6e0 2024-04-16T16:21:13.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.733+0000 7ff830c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff82c0cf540 con 0x7ff82c0af930 2024-04-16T16:21:13.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.733+0000 7ff82b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c072c60 0x7ff82c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c072c60 0x7ff82c0b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37904/0 (socket says 172.21.15.22:37904) 2024-04-16T16:21:13.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 -- 172.21.15.22:0/492406665 learned_addr learned my addr 172.21.15.22:0/492406665 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:13.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82be00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff82c15c6e0 0x7ff82c15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 -- 172.21.15.22:0/492406665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c0af930 msgr2=0x7ff82c0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff82c0af930 0x7ff82c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 -- 172.21.15.22:0/492406665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff82c15c6e0 msgr2=0x7ff82c15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff82c15c6e0 0x7ff82c15f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 -- 172.21.15.22:0/492406665 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c15ff80 con 0x7ff82c072c60 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.734+0000 7ff82b400640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c072c60 0x7ff82c0b47c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c820 tx=0x7ff81c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.735+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c015070 con 0x7ff82c072c60 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.735+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c004020 con 0x7ff82c072c60 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.735+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0043f0 con 0x7ff82c072c60 2024-04-16T16:21:13.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.735+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82c0b3ce0 con 0x7ff82c072c60 2024-04-16T16:21:13.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.735+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82c14c790 con 0x7ff82c072c60 2024-04-16T16:21:13.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.736+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff82c075f30 con 0x7ff82c072c60 2024-04-16T16:21:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.737+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7ff81c007830 con 0x7ff82c072c60 2024-04-16T16:21:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.738+0000 7ff823400640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff80806ce90 0x7ff80806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.738+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7ff81c08c560 con 0x7ff82c072c60 2024-04-16T16:21:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.738+0000 7ff823e00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff80806ce90 0x7ff80806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.738+0000 7ff823400640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7ff808075140 0x7ff808077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.738+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 --> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff808077c10 con 0x7ff808075140 2024-04-16T16:21:13.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.738+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7ff81c093050 con 0x7ff82c072c60 2024-04-16T16:21:13.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.739+0000 7ff82be00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7ff808075140 0x7ff808077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.739+0000 7ff823e00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff80806ce90 0x7ff80806f350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff814036000 tx=0x7ff814030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.739+0000 7ff82be00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7ff808075140 0x7ff808077560 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.740+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== osd.1 v2:172.21.15.22:6808/454707647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff808077c10 con 0x7ff808075140 2024-04-16T16:21:13.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.755+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 --> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff82c063230 con 0x7ff808075140 2024-04-16T16:21:13.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.755+0000 7ff823400640 1 -- 172.21.15.22:0/492406665 <== osd.1 v2:172.21.15.22:6808/454707647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff82c063230 con 0x7ff808075140 2024-04-16T16:21:13.755 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:13.756 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:13.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7ff808075140 msgr2=0x7ff808077560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6808/454707647,v1:172.21.15.22:6809/454707647] conn(0x7ff808075140 0x7ff808077560 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff80806ce90 msgr2=0x7ff80806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff80806ce90 0x7ff80806f350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff814036000 tx=0x7ff814030000 comp rx=0 tx=0).stop 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c072c60 msgr2=0x7ff82c0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 --2- 172.21.15.22:0/492406665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff82c072c60 0x7ff82c0b47c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c820 tx=0x7ff81c00cce0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff82be00640 1 -- 172.21.15.22:0/492406665 reap_dead start 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 shutdown_connections 2024-04-16T16:21:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 >> 172.21.15.22:0/492406665 conn(0x7ff82c062440 msgr2=0x7ff82c0ce360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:13.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 shutdown_connections 2024-04-16T16:21:13.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.756+0000 7ff830c00640 1 -- 172.21.15.22:0/492406665 wait complete. 2024-04-16T16:21:13.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-16T16:21:13.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.980+0000 7ff9ad400640 1 Processor -- start 2024-04-16T16:21:13.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.980+0000 7ff9ad400640 1 -- start start 2024-04-16T16:21:13.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.982+0000 7ff9ad400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9a815a240 0x7ff9a80d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.982+0000 7ff9ad400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 0x7ff9a80d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.982+0000 7ff9ad400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a815d300 con 0x7ff9a8160380 2024-04-16T16:21:13.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.982+0000 7ff9ad400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a815d5e0 con 0x7ff9a815a240 2024-04-16T16:21:13.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.982+0000 7ff9ad400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a815d8c0 con 0x7ff9a815cd90 2024-04-16T16:21:13.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.982+0000 7ff9aca00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff9a8160380 0x7ff9a8070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39358/0 (socket says 172.21.15.22:39358) 2024-04-16T16:21:13.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.982+0000 7ff9aca00640 1 -- 172.21.15.22:0/536928663 learned_addr learned my addr 172.21.15.22:0/536928663 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:13.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a7e00640 1 --2- 172.21.15.22:0/536928663 >> v2:172.21.15.43:3300/0 conn(0x7ff9a815a240 0x7ff9a80d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a7400640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 0x7ff9a80d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3068298416 0 0) 0x7ff9a815d300 con 0x7ff9a8160380 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff98c003520 con 0x7ff9a8160380 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3362608983 0 0) 0x7ff98c003520 con 0x7ff9a8160380 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 msgr2=0x7ff9a80d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 0x7ff9a80d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 >> v2:172.21.15.43:3300/0 conn(0x7ff9a815a240 msgr2=0x7ff9a80d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 --2- 172.21.15.22:0/536928663 >> v2:172.21.15.43:3300/0 conn(0x7ff9a815a240 0x7ff9a80d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a815dba0 con 0x7ff9a8160380 2024-04-16T16:21:13.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7ff9a00019f0 con 0x7ff9a8160380 2024-04-16T16:21:13.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 >> v1:172.21.15.22:6789/0 conn(0x7ff9a8160380 legacy=0x7ff9a8070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff98c003a20 0x7ff98c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 0x7ff98c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff98c004d40 0x7ff98c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.983+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a815d5e0 con 0x7ff98c004d40 2024-04-16T16:21:13.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a815d8c0 con 0x7ff98c003a20 2024-04-16T16:21:13.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff98c00b9c0 con 0x7ff9a815cd90 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9aca00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff98c004d40 0x7ff98c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9a7400640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 0x7ff98c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9a7e00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff98c003a20 0x7ff98c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9aca00640 1 -- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 msgr2=0x7ff98c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9aca00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9a815cd90 0x7ff98c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9aca00640 1 -- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff98c003a20 msgr2=0x7ff98c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9aca00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff98c003a20 0x7ff98c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.984+0000 7ff9aca00640 1 -- 172.21.15.22:0/536928663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c003520 con 0x7ff98c004d40 2024-04-16T16:21:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.985+0000 7ff9aca00640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff98c004d40 0x7ff98c0051c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000a870 tx=0x7ff98c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5674e1b7cd4bc678 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000a4c0 con 0x7ff98c004d40 2024-04-16T16:21:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a0034630 con 0x7ff98c004d40 2024-04-16T16:21:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9a6a00640 1 -- 172.21.15.22:0/536928663 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0034a20 con 0x7ff98c004d40 2024-04-16T16:21:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9ad400640 1 -- 172.21.15.22:0/536928663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff98c004d40 msgr2=0x7ff98c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9ad400640 1 --2- 172.21.15.22:0/536928663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff98c004d40 0x7ff98c0051c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000a870 tx=0x7ff98c005830 comp rx=0 tx=0).stop 2024-04-16T16:21:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9aca00640 1 -- 172.21.15.22:0/536928663 reap_dead start 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9ad400640 1 -- 172.21.15.22:0/536928663 shutdown_connections 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9ad400640 1 -- 172.21.15.22:0/536928663 >> 172.21.15.22:0/536928663 conn(0x7ff9a8075070 msgr2=0x7ff9a8062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.986+0000 7ff9ad400640 1 -- 172.21.15.22:0/536928663 shutdown_connections 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.987+0000 7ff9ad400640 1 -- 172.21.15.22:0/536928663 wait complete. 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.988+0000 7ff9ad400640 1 Processor -- start 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.988+0000 7ff9ad400640 1 -- start start 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.989+0000 7ff9ad400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff98c004d40 0x7ff9a8148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.989+0000 7ff9ad400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9a81f5950 0x7ff9a81445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.989+0000 7ff9ad400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a8144b00 0x7ff9a8153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.989+0000 7ff9ad400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8073120 con 0x7ff9a81f5950 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.989+0000 7ff9ad400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8072fa0 con 0x7ff9a8144b00 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.989+0000 7ff9ad400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a815a620 con 0x7ff98c004d40 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9a81f5950 0x7ff9a81445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9a81f5950 0x7ff9a81445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37910/0 (socket says 172.21.15.22:37910) 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 -- 172.21.15.22:0/4060145925 learned_addr learned my addr 172.21.15.22:0/4060145925 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9aca00640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a8144b00 0x7ff9a8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7e00640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff98c004d40 0x7ff9a8148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 -- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff98c004d40 msgr2=0x7ff9a8148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff98c004d40 0x7ff9a8148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 -- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a8144b00 msgr2=0x7ff9a8153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a8144b00 0x7ff9a8153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9a7400640 1 -- 172.21.15.22:0/4060145925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a81f4ed0 con 0x7ff9a81f5950 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.990+0000 7ff9aca00640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a8144b00 0x7ff9a8153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.991+0000 7ff9a7400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9a81f5950 0x7ff9a81445c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff994011630 tx=0x7ff994011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.991+0000 7ff99fe00640 1 -- 172.21.15.22:0/4060145925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99400f920 con 0x7ff9a81f5950 2024-04-16T16:21:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.991+0000 7ff99fe00640 1 -- 172.21.15.22:0/4060145925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99400fac0 con 0x7ff9a81f5950 2024-04-16T16:21:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.991+0000 7ff99fe00640 1 -- 172.21.15.22:0/4060145925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99400fe70 con 0x7ff9a81f5950 2024-04-16T16:21:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.991+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a8145080 con 0x7ff9a81f5950 2024-04-16T16:21:13.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.991+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a81f5150 con 0x7ff9a81f5950 2024-04-16T16:21:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.992+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a8075f30 con 0x7ff9a81f5950 2024-04-16T16:21:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.993+0000 7ff99fe00640 1 -- 172.21.15.22:0/4060145925 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7ff994015460 con 0x7ff9a81f5950 2024-04-16T16:21:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.995+0000 7ff99fe00640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff98806cec0 0x7ff98806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.995+0000 7ff99fe00640 1 -- 172.21.15.22:0/4060145925 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7ff99408d040 con 0x7ff9a81f5950 2024-04-16T16:21:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.995+0000 7ff9a7e00640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff98806cec0 0x7ff98806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:13.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.996+0000 7ff9a7e00640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff98806cec0 0x7ff98806f380 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff998009950 tx=0x7ff998008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:13.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:13.999+0000 7ff99fe00640 1 -- 172.21.15.22:0/4060145925 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9a81f4ed0 con 0x7ff9a81f5950 2024-04-16T16:21:14.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.204+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff9a8155640 con 0x7ff98806cec0 2024-04-16T16:21:14.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.204+0000 7ff99fe00640 1 -- 172.21.15.22:0/4060145925 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff9a8155640 con 0x7ff98806cec0 2024-04-16T16:21:14.204 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 1 to deep-scrub 2024-04-16T16:21:14.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.207+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff98806cec0 msgr2=0x7ff98806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.207+0000 7ff9ad400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff98806cec0 0x7ff98806f380 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff998009950 tx=0x7ff998008040 comp rx=0 tx=0).stop 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.207+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9a81f5950 msgr2=0x7ff9a81445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.207+0000 7ff9ad400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9a81f5950 0x7ff9a81445c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff994011630 tx=0x7ff994011af0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 shutdown_connections 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff98806cec0 0x7ff98806f380 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a8144b00 0x7ff9a8153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9a81f5950 0x7ff9a81445c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 --2- 172.21.15.22:0/4060145925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff98c004d40 0x7ff9a8148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 >> 172.21.15.22:0/4060145925 conn(0x7ff9a8075070 msgr2=0x7ff9a815a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:14.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 shutdown_connections 2024-04-16T16:21:14.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.208+0000 7ff9ad400640 1 -- 172.21.15.22:0/4060145925 wait complete. 2024-04-16T16:21:14.226 INFO:tasks.ceph:Scrubbing osd.2 2024-04-16T16:21:14.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:14.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.449+0000 7fbcb6400640 1 Processor -- start 2024-04-16T16:21:14.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.449+0000 7fbcb6400640 1 -- start start 2024-04-16T16:21:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcb6400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbcb015c6e0 0x7fbcb006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcb6400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0072e30 0x7fbcb00ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcb6400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb006cf80 con 0x7fbcb00af930 2024-04-16T16:21:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcb6400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb006d260 con 0x7fbcb015c6e0 2024-04-16T16:21:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcb6400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb006d540 con 0x7fbcb0072e30 2024-04-16T16:21:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcafe00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbcb00af930 0x7fbcb0072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39374/0 (socket says 172.21.15.22:39374) 2024-04-16T16:21:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcafe00640 1 -- 172.21.15.22:0/2682744260 learned_addr learned my addr 172.21.15.22:0/2682744260 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:14.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.451+0000 7fbcb5000640 1 --2- 172.21.15.22:0/2682744260 >> v2:172.21.15.43:3300/0 conn(0x7fbcb015c6e0 0x7fbcb006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcb5a00640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0072e30 0x7fbcb00ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501495900 0 0) 0x7fbcb006cf80 con 0x7fbcb00af930 2024-04-16T16:21:14.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc98003520 con 0x7fbcb00af930 2024-04-16T16:21:14.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3798684852 0 0) 0x7fbc98003520 con 0x7fbcb00af930 2024-04-16T16:21:14.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0072e30 msgr2=0x7fbcb00ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:14.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0072e30 0x7fbcb00ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 >> v2:172.21.15.43:3300/0 conn(0x7fbcb015c6e0 msgr2=0x7fbcb006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:14.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 --2- 172.21.15.22:0/2682744260 >> v2:172.21.15.43:3300/0 conn(0x7fbcb015c6e0 0x7fbcb006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb006d820 con 0x7fbcb00af930 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7fbc9c001670 con 0x7fbcb00af930 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 >> v1:172.21.15.22:6789/0 conn(0x7fbcb00af930 legacy=0x7fbcb0072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc980039b0 0x7fbc98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc98004800 0x7fbc98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0072e30 0x7fbc980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb006d260 con 0x7fbc980039b0 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb006d540 con 0x7fbc98004800 2024-04-16T16:21:14.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.452+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9800b9c0 con 0x7fbcb0072e30 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcb5000640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc980039b0 0x7fbc98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcafe00640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc98004800 0x7fbc98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcb5000640 1 -- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0072e30 msgr2=0x7fbc980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcb5000640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0072e30 0x7fbc980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcb5000640 1 -- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc98004800 msgr2=0x7fbc98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcb5000640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc98004800 0x7fbc98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcb5000640 1 -- 172.21.15.22:0/2682744260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc98003520 con 0x7fbc980039b0 2024-04-16T16:21:14.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.453+0000 7fbcafe00640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc98004800 0x7fbc98004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:14.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.454+0000 7fbcb5000640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc980039b0 0x7fbc98003dd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009ac0 tx=0x7fbc98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9211806d2dc947e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:14.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4039070 con 0x7fbc980039b0 2024-04-16T16:21:14.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca402c710 con 0x7fbc980039b0 2024-04-16T16:21:14.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcaf400640 1 -- 172.21.15.22:0/2682744260 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4009690 con 0x7fbc980039b0 2024-04-16T16:21:14.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcb6400640 1 -- 172.21.15.22:0/2682744260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc980039b0 msgr2=0x7fbc98003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcb6400640 1 --2- 172.21.15.22:0/2682744260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc980039b0 0x7fbc98003dd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009ac0 tx=0x7fbc98005830 comp rx=0 tx=0).stop 2024-04-16T16:21:14.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcb5a00640 1 -- 172.21.15.22:0/2682744260 reap_dead start 2024-04-16T16:21:14.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcb6400640 1 -- 172.21.15.22:0/2682744260 shutdown_connections 2024-04-16T16:21:14.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcb6400640 1 -- 172.21.15.22:0/2682744260 >> 172.21.15.22:0/2682744260 conn(0x7fbcb0062440 msgr2=0x7fbcb0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcb6400640 1 -- 172.21.15.22:0/2682744260 shutdown_connections 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.455+0000 7fbcb6400640 1 -- 172.21.15.22:0/2682744260 wait complete. 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.457+0000 7fbcb6400640 1 Processor -- start 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.457+0000 7fbcb6400640 1 -- start start 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.458+0000 7fbcb6400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc980039b0 0x7fbcb014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.458+0000 7fbcb6400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0156180 0x7fbcb0156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.458+0000 7fbcb6400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcb015d3c0 0x7fbcb015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.458+0000 7fbcb6400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb015cc40 con 0x7fbcb015d3c0 2024-04-16T16:21:14.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.458+0000 7fbcb6400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb015cac0 con 0x7fbc980039b0 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.458+0000 7fbcb6400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb00ce530 con 0x7fbcb0156180 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcb015d3c0 0x7fbcb015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcb015d3c0 0x7fbcb015d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37926/0 (socket says 172.21.15.22:37926) 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 -- 172.21.15.22:0/3457655179 learned_addr learned my addr 172.21.15.22:0/3457655179 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5000640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc980039b0 0x7fbcb014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 -- 172.21.15.22:0/3457655179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0156180 msgr2=0x7fbcb0156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcb0156180 0x7fbcb0156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 -- 172.21.15.22:0/3457655179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc980039b0 msgr2=0x7fbcb014b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc980039b0 0x7fbcb014b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 -- 172.21.15.22:0/3457655179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb01f4d20 con 0x7fbcb015d3c0 2024-04-16T16:21:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.459+0000 7fbcb5a00640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcb015d3c0 0x7fbcb015d840 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0161420 tx=0x7fbca800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.460+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca800bae0 con 0x7fbcb015d3c0 2024-04-16T16:21:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.460+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca801a070 con 0x7fbcb015d3c0 2024-04-16T16:21:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.460+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8014400 con 0x7fbcb015d3c0 2024-04-16T16:21:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.460+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb015e170 con 0x7fbcb015d3c0 2024-04-16T16:21:14.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.460+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb015e730 con 0x7fbcb015d3c0 2024-04-16T16:21:14.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.461+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcb0075f30 con 0x7fbcb015d3c0 2024-04-16T16:21:14.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.462+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fbca8005d10 con 0x7fbcb015d3c0 2024-04-16T16:21:14.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.463+0000 7fbcacc00640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbc9006ce90 0x7fbc9006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.463+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fbca808c6c0 con 0x7fbcb015d3c0 2024-04-16T16:21:14.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.463+0000 7fbcb5000640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbc9006ce90 0x7fbc9006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.463+0000 7fbcacc00640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7fbc90075140 0x7fbc90077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.464+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 --> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbca800ce90 con 0x7fbc90075140 2024-04-16T16:21:14.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.464+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fbca8093050 con 0x7fbcb015d3c0 2024-04-16T16:21:14.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.464+0000 7fbcafe00640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7fbc90075140 0x7fbc90077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.464+0000 7fbcb5000640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbc9006ce90 0x7fbc9006f350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbca4036000 tx=0x7fbca4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:14.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.465+0000 7fbcafe00640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7fbc90075140 0x7fbc90077560 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:14.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.465+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== osd.2 v2:172.21.15.22:6800/154267311 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbca800ce90 con 0x7fbc90075140 2024-04-16T16:21:14.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.480+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 --> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbcb0063230 con 0x7fbc90075140 2024-04-16T16:21:14.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.480+0000 7fbcacc00640 1 -- 172.21.15.22:0/3457655179 <== osd.2 v2:172.21.15.22:6800/154267311 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbcb0063230 con 0x7fbc90075140 2024-04-16T16:21:14.480 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:14.480 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:14.480 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:14.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7fbc90075140 msgr2=0x7fbc90077560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6800/154267311,v1:172.21.15.22:6801/154267311] conn(0x7fbc90075140 0x7fbc90077560 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbc9006ce90 msgr2=0x7fbc9006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbc9006ce90 0x7fbc9006f350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbca4036000 tx=0x7fbca4030000 comp rx=0 tx=0).stop 2024-04-16T16:21:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcb015d3c0 msgr2=0x7fbcb015d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 --2- 172.21.15.22:0/3457655179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcb015d3c0 0x7fbcb015d840 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0161420 tx=0x7fbca800b480 comp rx=0 tx=0).stop 2024-04-16T16:21:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb5a00640 1 -- 172.21.15.22:0/3457655179 reap_dead start 2024-04-16T16:21:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 shutdown_connections 2024-04-16T16:21:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 >> 172.21.15.22:0/3457655179 conn(0x7fbcb0062440 msgr2=0x7fbcb00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 shutdown_connections 2024-04-16T16:21:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.481+0000 7fbcb6400640 1 -- 172.21.15.22:0/3457655179 wait complete. 2024-04-16T16:21:14.500 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-16T16:21:14.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.721+0000 7f8a52000640 1 Processor -- start 2024-04-16T16:21:14.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.721+0000 7f8a52000640 1 -- start start 2024-04-16T16:21:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.723+0000 7f8a52000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c15eb30 0x7f8a4c0d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.723+0000 7f8a52000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c0d4650 con 0x7f8a4c0d1770 2024-04-16T16:21:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.723+0000 7f8a52000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c15ef10 con 0x7f8a4c0d2fb0 2024-04-16T16:21:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.723+0000 7f8a52000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d1bb0 con 0x7f8a4c15eb30 2024-04-16T16:21:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.723+0000 7f8a4be00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8a4c0d1770 0x7f8a4c0d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39378/0 (socket says 172.21.15.22:39378) 2024-04-16T16:21:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.723+0000 7f8a4be00640 1 -- 172.21.15.22:0/4095141015 learned_addr learned my addr 172.21.15.22:0/4095141015 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:14.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a50c00640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c15eb30 0x7f8a4c0d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 269688922 0 0) 0x7f8a4c0d4650 con 0x7f8a4c0d1770 2024-04-16T16:21:14.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a34003520 con 0x7f8a4c0d1770 2024-04-16T16:21:14.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1439108161 0 0) 0x7f8a34003520 con 0x7f8a4c0d1770 2024-04-16T16:21:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c15eb30 msgr2=0x7f8a4c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c15eb30 0x7f8a4c0d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 >> v1:172.21.15.43:6789/0 conn(0x7f8a4c0d2fb0 legacy=0x7f8a4c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0d35b0 con 0x7f8a4c0d1770 2024-04-16T16:21:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4243008258 0 0) 0x7f8a38001670 con 0x7f8a4c0d1770 2024-04-16T16:21:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 >> v1:172.21.15.22:6789/0 conn(0x7f8a4c0d1770 legacy=0x7f8a4c0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a34003a50 0x7f8a34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c15eb30 0x7f8a34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34004d40 0x7f8a340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d1bb0 con 0x7f8a34003a50 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3400bad0 con 0x7f8a34004d40 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.724+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3400bcd0 con 0x7f8a4c15eb30 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.725+0000 7f8a50c00640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a34003a50 0x7f8a34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.725+0000 7f8a50c00640 1 -- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c15eb30 msgr2=0x7f8a34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.725+0000 7f8a50c00640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c15eb30 0x7f8a34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.725+0000 7f8a50c00640 1 -- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34004d40 msgr2=0x7f8a340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.725+0000 7f8a50c00640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34004d40 0x7f8a340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.725+0000 7f8a50c00640 1 -- 172.21.15.22:0/4095141015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a34003520 con 0x7f8a34003a50 2024-04-16T16:21:14.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.726+0000 7f8a50c00640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a34003a50 0x7f8a34003e70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009a90 tx=0x7f8a34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820497cfef056163 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40039070 con 0x7f8a34003a50 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4002c600 con 0x7f8a34003a50 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a4b400640 1 -- 172.21.15.22:0/4095141015 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40009690 con 0x7f8a34003a50 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a52000640 1 -- 172.21.15.22:0/4095141015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a34003a50 msgr2=0x7f8a34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a52000640 1 --2- 172.21.15.22:0/4095141015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a34003a50 0x7f8a34003e70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009a90 tx=0x7f8a34005830 comp rx=0 tx=0).stop 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a51600640 1 -- 172.21.15.22:0/4095141015 reap_dead start 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a52000640 1 -- 172.21.15.22:0/4095141015 shutdown_connections 2024-04-16T16:21:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a52000640 1 -- 172.21.15.22:0/4095141015 >> 172.21.15.22:0/4095141015 conn(0x7f8a4c072670 msgr2=0x7f8a4c062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a52000640 1 -- 172.21.15.22:0/4095141015 shutdown_connections 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.727+0000 7f8a52000640 1 -- 172.21.15.22:0/4095141015 wait complete. 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.729+0000 7f8a52000640 1 Processor -- start 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.729+0000 7f8a52000640 1 -- start start 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.730+0000 7f8a52000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34003a50 0x7f8a4c14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.730+0000 7f8a52000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c0b5e20 0x7f8a4c0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.730+0000 7f8a52000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a4c0cb8f0 0x7f8a4c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.730+0000 7f8a52000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d3e50 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.730+0000 7f8a52000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d3b70 con 0x7f8a34003a50 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.730+0000 7f8a52000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d4130 con 0x7f8a4c0b5e20 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.730+0000 7f8a51600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a4c0cb8f0 0x7f8a4c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a4c0cb8f0 0x7f8a4c0cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37944/0 (socket says 172.21.15.22:37944) 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 -- 172.21.15.22:0/1683483606 learned_addr learned my addr 172.21.15.22:0/1683483606 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a50c00640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34003a50 0x7f8a4c14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a4be00640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c0b5e20 0x7f8a4c0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 -- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c0b5e20 msgr2=0x7f8a4c0b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c0b5e20 0x7f8a4c0b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 -- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34003a50 msgr2=0x7f8a4c14ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34003a50 0x7f8a4c14ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 -- 172.21.15.22:0/1683483606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0cc8e0 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.731+0000 7f8a51600640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a4c0cb8f0 0x7f8a4c0cbd70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0d1200 tx=0x7f8a4400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.732+0000 7f8a48c00640 1 -- 172.21.15.22:0/1683483606 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44017070 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.732+0000 7f8a48c00640 1 -- 172.21.15.22:0/1683483606 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44005d60 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.732+0000 7f8a48c00640 1 -- 172.21.15.22:0/1683483606 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400a850 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.732+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c0cc600 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.732+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c0cd5a0 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.733+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c075f30 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.734+0000 7f8a48c00640 1 -- 172.21.15.22:0/1683483606 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f8a4401a070 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.735+0000 7f8a48c00640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8a2c06cec0 0x7f8a2c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:14.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.735+0000 7f8a48c00640 1 -- 172.21.15.22:0/1683483606 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7f8a4408b8f0 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.736+0000 7f8a50c00640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8a2c06cec0 0x7f8a2c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:14.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.737+0000 7f8a50c00640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8a2c06cec0 0x7f8a2c06f380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a40036000 tx=0x7f8a40030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:14.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.740+0000 7f8a48c00640 1 -- 172.21.15.22:0/1683483606 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a440594a0 con 0x7f8a4c0cb8f0 2024-04-16T16:21:14.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.949+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f8a4c0b7ef0 con 0x7f8a2c06cec0 2024-04-16T16:21:14.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.949+0000 7f8a48c00640 1 -- 172.21.15.22:0/1683483606 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8a4c0b7ef0 con 0x7f8a2c06cec0 2024-04-16T16:21:14.949 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 2 to deep-scrub 2024-04-16T16:21:14.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.952+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8a2c06cec0 msgr2=0x7f8a2c06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.952+0000 7f8a52000640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8a2c06cec0 0x7f8a2c06f380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a40036000 tx=0x7f8a40030000 comp rx=0 tx=0).stop 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.952+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a4c0cb8f0 msgr2=0x7f8a4c0cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.952+0000 7f8a52000640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a4c0cb8f0 0x7f8a4c0cbd70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0d1200 tx=0x7f8a4400cb90 comp rx=0 tx=0).stop 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 shutdown_connections 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f8a2c06cec0 0x7f8a2c06f380 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a4c0cb8f0 0x7f8a4c0cbd70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8a4c0b5e20 0x7f8a4c0b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 --2- 172.21.15.22:0/1683483606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a34003a50 0x7f8a4c14ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:14.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 >> 172.21.15.22:0/1683483606 conn(0x7f8a4c072670 msgr2=0x7f8a4c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:14.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 shutdown_connections 2024-04-16T16:21:14.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:14.953+0000 7f8a52000640 1 -- 172.21.15.22:0/1683483606 wait complete. 2024-04-16T16:21:14.972 INFO:tasks.ceph:Scrubbing osd.3 2024-04-16T16:21:14.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:15.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.190+0000 7fcbbae00640 1 Processor -- start 2024-04-16T16:21:15.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.190+0000 7fcbbae00640 1 -- start start 2024-04-16T16:21:15.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbbae00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcbb4156cd0 0x7fcbb406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbbae00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbb40cd4e0 0x7fcbb4072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbbae00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb415ccc0 con 0x7fcbb406e930 2024-04-16T16:21:15.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbbae00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb415cf80 con 0x7fcbb4156cd0 2024-04-16T16:21:15.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbbae00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb415d260 con 0x7fcbb40cd4e0 2024-04-16T16:21:15.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbb9a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcbb4156cd0 0x7fcbb406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbb9a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcbb4156cd0 0x7fcbb406e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37950/0 (socket says 172.21.15.22:37950) 2024-04-16T16:21:15.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbb9a00640 1 -- 172.21.15.22:0/2940767541 learned_addr learned my addr 172.21.15.22:0/2940767541 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:15.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.192+0000 7fcbba400640 1 --2- 172.21.15.22:0/2940767541 >> v2:172.21.15.43:3300/0 conn(0x7fcbb40cd4e0 0x7fcbb4072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.193+0000 7fcbb9a00640 1 -- 172.21.15.22:0/2940767541 >> v2:172.21.15.43:3300/0 conn(0x7fcbb40cd4e0 msgr2=0x7fcbb4072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:15.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.193+0000 7fcbb9a00640 1 --2- 172.21.15.22:0/2940767541 >> v2:172.21.15.43:3300/0 conn(0x7fcbb40cd4e0 0x7fcbb4072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.193+0000 7fcbb9a00640 1 -- 172.21.15.22:0/2940767541 >> v1:172.21.15.43:6789/0 conn(0x7fcbb406e930 legacy=0x7fcbb40ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:15.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.193+0000 7fcbb9a00640 1 -- 172.21.15.22:0/2940767541 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb415d540 con 0x7fcbb4156cd0 2024-04-16T16:21:15.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.194+0000 7fcbb9a00640 1 --2- 172.21.15.22:0/2940767541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb4156cd0 0x7fcbb406e3f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcbb415a890 tx=0x7fcba802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ad10821f7b9e30 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.194+0000 7fcbb3e00640 1 -- 172.21.15.22:0/2940767541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8035020 con 0x7fcbb4156cd0 2024-04-16T16:21:15.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.194+0000 7fcbb3e00640 1 -- 172.21.15.22:0/2940767541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba8031890 con 0x7fcbb4156cd0 2024-04-16T16:21:15.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.194+0000 7fcbb3e00640 1 -- 172.21.15.22:0/2940767541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8031c60 con 0x7fcbb4156cd0 2024-04-16T16:21:15.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 -- 172.21.15.22:0/2940767541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb4156cd0 msgr2=0x7fcbb406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 --2- 172.21.15.22:0/2940767541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb4156cd0 0x7fcbb406e3f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcbb415a890 tx=0x7fcba802b930 comp rx=0 tx=0).stop 2024-04-16T16:21:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 -- 172.21.15.22:0/2940767541 shutdown_connections 2024-04-16T16:21:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 --2- 172.21.15.22:0/2940767541 >> v2:172.21.15.43:3300/0 conn(0x7fcbb40cd4e0 0x7fcbb4072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 --2- 172.21.15.22:0/2940767541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb4156cd0 0x7fcbb406e3f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 -- 172.21.15.22:0/2940767541 >> 172.21.15.22:0/2940767541 conn(0x7fcbb40b2110 msgr2=0x7fcbb40b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 -- 172.21.15.22:0/2940767541 shutdown_connections 2024-04-16T16:21:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.195+0000 7fcbbae00640 1 -- 172.21.15.22:0/2940767541 wait complete. 2024-04-16T16:21:15.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.197+0000 7fcbbae00640 1 Processor -- start 2024-04-16T16:21:15.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.197+0000 7fcbbae00640 1 -- start start 2024-04-16T16:21:15.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbbae00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb406e930 0x7fcbb4143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbbae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbb40cd4e0 0x7fcbb415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbbae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4156cd0 0x7fcbb415f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbbae00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb406dbd0 con 0x7fcbb406e930 2024-04-16T16:21:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbbae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb41570b0 con 0x7fcbb4156cd0 2024-04-16T16:21:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbbae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb406dd50 con 0x7fcbb40cd4e0 2024-04-16T16:21:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbb9a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb406e930 0x7fcbb4143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbb9a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb406e930 0x7fcbb4143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37966/0 (socket says 172.21.15.22:37966) 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.198+0000 7fcbb9a00640 1 -- 172.21.15.22:0/1732568211 learned_addr learned my addr 172.21.15.22:0/1732568211 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbba400640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4156cd0 0x7fcbb415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb9a00640 1 -- 172.21.15.22:0/1732568211 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbb40cd4e0 msgr2=0x7fcbb415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb9a00640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbb40cd4e0 0x7fcbb415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb9a00640 1 -- 172.21.15.22:0/1732568211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4156cd0 msgr2=0x7fcbb415f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb9a00640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4156cd0 0x7fcbb415f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb9a00640 1 -- 172.21.15.22:0/1732568211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb4151150 con 0x7fcbb406e930 2024-04-16T16:21:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb9a00640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb406e930 0x7fcbb4143ff0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcba8000c00 tx=0x7fcba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba803ad60 con 0x7fcbb406e930 2024-04-16T16:21:15.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba80443f0 con 0x7fcbb406e930 2024-04-16T16:21:15.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba80447c0 con 0x7fcbb406e930 2024-04-16T16:21:15.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.199+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb4151430 con 0x7fcbb406e930 2024-04-16T16:21:15.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.200+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb41519f0 con 0x7fcbb406e930 2024-04-16T16:21:15.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.201+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcbb4075f30 con 0x7fcbb406e930 2024-04-16T16:21:15.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.202+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fcba804b060 con 0x7fcbb406e930 2024-04-16T16:21:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.203+0000 7fcbb1600640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcb9406ce90 0x7fcb9406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.203+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fcba80ae8c0 con 0x7fcbb406e930 2024-04-16T16:21:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.203+0000 7fcbb1600640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7fcb94075140 0x7fcb94077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.203+0000 7fcbb9000640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcb9406ce90 0x7fcb9406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.203+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 --> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcba8033e90 con 0x7fcb94075140 2024-04-16T16:21:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.203+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fcba80b5050 con 0x7fcbb406e930 2024-04-16T16:21:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.203+0000 7fcbba400640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7fcb94075140 0x7fcb94077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.204+0000 7fcbb9000640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcb9406ce90 0x7fcb9406f350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcbb415bfc0 tx=0x7fcba00079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.204+0000 7fcbba400640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7fcb94075140 0x7fcb94077560 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.205+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== osd.3 v2:172.21.15.22:6816/552031347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcba8033e90 con 0x7fcb94075140 2024-04-16T16:21:15.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.220+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 --> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcbb406e600 con 0x7fcb94075140 2024-04-16T16:21:15.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.220+0000 7fcbb1600640 1 -- 172.21.15.22:0/1732568211 <== osd.3 v2:172.21.15.22:6816/552031347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcbb406e600 con 0x7fcb94075140 2024-04-16T16:21:15.220 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:15.220 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:15.220 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:15.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7fcb94075140 msgr2=0x7fcb94077560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6816/552031347,v1:172.21.15.22:6818/552031347] conn(0x7fcb94075140 0x7fcb94077560 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcb9406ce90 msgr2=0x7fcb9406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fcb9406ce90 0x7fcb9406f350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcbb415bfc0 tx=0x7fcba00079b0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb406e930 msgr2=0x7fcbb4143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 --2- 172.21.15.22:0/1732568211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbb406e930 0x7fcbb4143ff0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcba8000c00 tx=0x7fcba80046c0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbba400640 1 -- 172.21.15.22:0/1732568211 reap_dead start 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 shutdown_connections 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 >> 172.21.15.22:0/1732568211 conn(0x7fcbb40b2110 msgr2=0x7fcbb40b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 shutdown_connections 2024-04-16T16:21:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.221+0000 7fcbbae00640 1 -- 172.21.15.22:0/1732568211 wait complete. 2024-04-16T16:21:15.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-16T16:21:15.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.454+0000 7f15ca200640 1 Processor -- start 2024-04-16T16:21:15.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.454+0000 7f15ca200640 1 -- start start 2024-04-16T16:21:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15ca200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15c4072640 0x7f15c406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15ca200640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15c406d9e0 0x7f15c415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15ca200640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c40b36d0 con 0x7f15c415b5f0 2024-04-16T16:21:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15ca200640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f15c40b42e0 con 0x7f15c406d9e0 2024-04-16T16:21:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15ca200640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f15c40b39b0 con 0x7f15c4072640 2024-04-16T16:21:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15c9800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15c406d9e0 0x7f15c415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15c9800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15c406d9e0 0x7f15c415b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37980/0 (socket says 172.21.15.22:37980) 2024-04-16T16:21:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.455+0000 7f15c9800640 1 -- 172.21.15.22:0/2560227649 learned_addr learned my addr 172.21.15.22:0/2560227649 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.456+0000 7f15c3e00640 1 --2- 172.21.15.22:0/2560227649 >> v2:172.21.15.43:3300/0 conn(0x7f15c4072640 0x7f15c406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.456+0000 7f15c9800640 1 -- 172.21.15.22:0/2560227649 >> v2:172.21.15.43:3300/0 conn(0x7f15c4072640 msgr2=0x7f15c406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.456+0000 7f15c9800640 1 --2- 172.21.15.22:0/2560227649 >> v2:172.21.15.43:3300/0 conn(0x7f15c4072640 0x7f15c406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.456+0000 7f15c9800640 1 -- 172.21.15.22:0/2560227649 >> v1:172.21.15.43:6789/0 conn(0x7f15c415b5f0 legacy=0x7f15c4071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.456+0000 7f15c9800640 1 -- 172.21.15.22:0/2560227649 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c40b3c90 con 0x7f15c406d9e0 2024-04-16T16:21:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.457+0000 7f15c9800640 1 --2- 172.21.15.22:0/2560227649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c415b9d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f15c40633a0 tx=0x7f15bc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984f6fab2d1d71da server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.457+0000 7f15c3400640 1 -- 172.21.15.22:0/2560227649 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc02c9f0 con 0x7f15c406d9e0 2024-04-16T16:21:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.457+0000 7f15c3400640 1 -- 172.21.15.22:0/2560227649 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc02cb90 con 0x7f15c406d9e0 2024-04-16T16:21:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.457+0000 7f15c3400640 1 -- 172.21.15.22:0/2560227649 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0343f0 con 0x7f15c406d9e0 2024-04-16T16:21:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 -- 172.21.15.22:0/2560227649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 msgr2=0x7f15c415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 --2- 172.21.15.22:0/2560227649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c415b9d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f15c40633a0 tx=0x7f15bc02be50 comp rx=0 tx=0).stop 2024-04-16T16:21:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 -- 172.21.15.22:0/2560227649 shutdown_connections 2024-04-16T16:21:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 --2- 172.21.15.22:0/2560227649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c415b9d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 --2- 172.21.15.22:0/2560227649 >> v2:172.21.15.43:3300/0 conn(0x7f15c4072640 0x7f15c406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 -- 172.21.15.22:0/2560227649 >> 172.21.15.22:0/2560227649 conn(0x7f15c4075070 msgr2=0x7f15c4062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 -- 172.21.15.22:0/2560227649 shutdown_connections 2024-04-16T16:21:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.458+0000 7f15ca200640 1 -- 172.21.15.22:0/2560227649 wait complete. 2024-04-16T16:21:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.460+0000 7f15ca200640 1 Processor -- start 2024-04-16T16:21:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.460+0000 7f15ca200640 1 -- start start 2024-04-16T16:21:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.461+0000 7f15ca200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c414a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.461+0000 7f15ca200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4072640 0x7f15c415a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.461+0000 7f15ca200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c415b5f0 0x7f15c414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.461+0000 7f15ca200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15c40b4770 con 0x7f15c406d9e0 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.461+0000 7f15ca200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15c40b33a0 con 0x7f15c4072640 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.461+0000 7f15ca200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15c414ad00 con 0x7f15c415b5f0 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.461+0000 7f15c8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c414a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37988/0 (socket says 172.21.15.22:37988) 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 -- 172.21.15.22:0/127183050 learned_addr learned my addr 172.21.15.22:0/127183050 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c3e00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4072640 0x7f15c415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c9800640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c415b5f0 0x7f15c414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 -- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c415b5f0 msgr2=0x7f15c414fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c415b5f0 0x7f15c414fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 -- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4072640 msgr2=0x7f15c415a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4072640 0x7f15c415a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 -- 172.21.15.22:0/127183050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c414afe0 con 0x7f15c406d9e0 2024-04-16T16:21:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c3e00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4072640 0x7f15c415a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c9800640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c415b5f0 0x7f15c414fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:15.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.462+0000 7f15c8e00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c414a670 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f15b800b3e0 tx=0x7f15b800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.463+0000 7f15c0c00640 1 -- 172.21.15.22:0/127183050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8015020 con 0x7f15c406d9e0 2024-04-16T16:21:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.463+0000 7f15c0c00640 1 -- 172.21.15.22:0/127183050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b8011850 con 0x7f15c406d9e0 2024-04-16T16:21:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.463+0000 7f15c0c00640 1 -- 172.21.15.22:0/127183050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8011c40 con 0x7f15c406d9e0 2024-04-16T16:21:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.463+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c414b2c0 con 0x7f15c406d9e0 2024-04-16T16:21:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.463+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c414b880 con 0x7f15c406d9e0 2024-04-16T16:21:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.464+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c414ba80 con 0x7f15c406d9e0 2024-04-16T16:21:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.465+0000 7f15c0c00640 1 -- 172.21.15.22:0/127183050 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f15b8018020 con 0x7f15c406d9e0 2024-04-16T16:21:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.466+0000 7f15c0c00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15a406ce90 0x7f15a406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.466+0000 7f15c0c00640 1 -- 172.21.15.22:0/127183050 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7f15b808c6a0 con 0x7f15c406d9e0 2024-04-16T16:21:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.466+0000 7f15c3e00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15a406ce90 0x7f15a406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.467+0000 7f15c3e00640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15a406ce90 0x7f15a406f350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f15c41f7a50 tx=0x7f15b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.471+0000 7f15c0c00640 1 -- 172.21.15.22:0/127183050 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15c414ba80 con 0x7f15c406d9e0 2024-04-16T16:21:15.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.681+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f15c4075f30 con 0x7f15a406ce90 2024-04-16T16:21:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.682+0000 7f15c0c00640 1 -- 172.21.15.22:0/127183050 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f15c4075f30 con 0x7f15a406ce90 2024-04-16T16:21:15.681 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 3 to deep-scrub 2024-04-16T16:21:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.684+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15a406ce90 msgr2=0x7f15a406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.684+0000 7f15ca200640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15a406ce90 0x7f15a406f350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f15c41f7a50 tx=0x7f15b0008040 comp rx=0 tx=0).stop 2024-04-16T16:21:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.684+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 msgr2=0x7f15c414a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.684+0000 7f15ca200640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c414a670 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f15b800b3e0 tx=0x7f15b800b8a0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 shutdown_connections 2024-04-16T16:21:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f15a406ce90 0x7f15a406f350 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c415b5f0 0x7f15c414fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4072640 0x7f15c415a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 --2- 172.21.15.22:0/127183050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15c406d9e0 0x7f15c414a670 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 >> 172.21.15.22:0/127183050 conn(0x7f15c4075070 msgr2=0x7f15c415da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 shutdown_connections 2024-04-16T16:21:15.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.685+0000 7f15ca200640 1 -- 172.21.15.22:0/127183050 wait complete. 2024-04-16T16:21:15.705 INFO:tasks.ceph:Scrubbing osd.4 2024-04-16T16:21:15.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:15.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.932+0000 7fbda2400640 1 Processor -- start 2024-04-16T16:21:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.932+0000 7fbda2400640 1 -- start start 2024-04-16T16:21:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.934+0000 7fbda2400640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbd9c0d0dd0 0x7fbd9c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.934+0000 7fbda2400640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbd9c06c620 0x7fbd9c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.934+0000 7fbda2400640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c06fb70 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.934+0000 7fbda2400640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9c15ccf0 con 0x7fbd9c0d0dd0 2024-04-16T16:21:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.934+0000 7fbda2400640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9c1605b0 con 0x7fbd9c06c620 2024-04-16T16:21:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.935+0000 7fbd9be00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbd9c06f6f0 0x7fbd9c062440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39386/0 (socket says 172.21.15.22:39386) 2024-04-16T16:21:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.935+0000 7fbd9be00640 1 -- 172.21.15.22:0/500354353 learned_addr learned my addr 172.21.15.22:0/500354353 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.935+0000 7fbda1000640 1 --2- 172.21.15.22:0/500354353 >> v2:172.21.15.22:3300/0 conn(0x7fbd9c0d0dd0 0x7fbd9c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.935+0000 7fbda1a00640 1 --2- 172.21.15.22:0/500354353 >> v2:172.21.15.43:3300/0 conn(0x7fbd9c06c620 0x7fbd9c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.935+0000 7fbd9b400640 1 -- 172.21.15.22:0/500354353 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275640792 0 0) 0x7fbd9c06fb70 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.935+0000 7fbd9b400640 1 -- 172.21.15.22:0/500354353 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd84003520 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.936+0000 7fbda1000640 1 -- 172.21.15.22:0/500354353 >> v2:172.21.15.43:3300/0 conn(0x7fbd9c06c620 msgr2=0x7fbd9c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.936+0000 7fbda1000640 1 --2- 172.21.15.22:0/500354353 >> v2:172.21.15.43:3300/0 conn(0x7fbd9c06c620 0x7fbd9c0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.936+0000 7fbda1000640 1 -- 172.21.15.22:0/500354353 >> v1:172.21.15.22:6789/0 conn(0x7fbd9c06f6f0 legacy=0x7fbd9c062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.936+0000 7fbda1000640 1 -- 172.21.15.22:0/500354353 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c160890 con 0x7fbd9c0d0dd0 2024-04-16T16:21:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.937+0000 7fbda1000640 1 --2- 172.21.15.22:0/500354353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c0d0dd0 0x7fbd9c06f1b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0ce5f0 tx=0x7fbd9002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930b92f76d8f846b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.937+0000 7fbd9b400640 1 -- 172.21.15.22:0/500354353 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90038070 con 0x7fbd9c0d0dd0 2024-04-16T16:21:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.937+0000 7fbd9b400640 1 -- 172.21.15.22:0/500354353 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd90031520 con 0x7fbd9c0d0dd0 2024-04-16T16:21:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.937+0000 7fbd9b400640 1 -- 172.21.15.22:0/500354353 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd900318d0 con 0x7fbd9c0d0dd0 2024-04-16T16:21:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 -- 172.21.15.22:0/500354353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c0d0dd0 msgr2=0x7fbd9c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 --2- 172.21.15.22:0/500354353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c0d0dd0 0x7fbd9c06f1b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0ce5f0 tx=0x7fbd9002b7c0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 -- 172.21.15.22:0/500354353 shutdown_connections 2024-04-16T16:21:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 --2- 172.21.15.22:0/500354353 >> v2:172.21.15.43:3300/0 conn(0x7fbd9c06c620 0x7fbd9c0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 --2- 172.21.15.22:0/500354353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c0d0dd0 0x7fbd9c06f1b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 -- 172.21.15.22:0/500354353 >> 172.21.15.22:0/500354353 conn(0x7fbd9c0b3290 msgr2=0x7fbd9c0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 -- 172.21.15.22:0/500354353 shutdown_connections 2024-04-16T16:21:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.938+0000 7fbda2400640 1 -- 172.21.15.22:0/500354353 wait complete. 2024-04-16T16:21:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.941+0000 7fbda2400640 1 Processor -- start 2024-04-16T16:21:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.941+0000 7fbda2400640 1 -- start start 2024-04-16T16:21:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.942+0000 7fbda2400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd9c06c620 0x7fbd9c142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.942+0000 7fbda2400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c06f6f0 0x7fbd9c1f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbda2400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd9c0d0dd0 0x7fbd9c155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbda2400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c0d11b0 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbda2400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c062d60 con 0x7fbd9c06c620 2024-04-16T16:21:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbda2400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c0d1330 con 0x7fbd9c0d0dd0 2024-04-16T16:21:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c06f6f0 0x7fbd9c1f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c06f6f0 0x7fbd9c1f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38004/0 (socket says 172.21.15.22:38004) 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 -- 172.21.15.22:0/3289467962 learned_addr learned my addr 172.21.15.22:0/3289467962 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbda1000640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd9c06c620 0x7fbd9c142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbda1a00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd9c0d0dd0 0x7fbd9c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 -- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd9c0d0dd0 msgr2=0x7fbd9c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd9c0d0dd0 0x7fbd9c155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 -- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd9c06c620 msgr2=0x7fbd9c142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd9c06c620 0x7fbd9c142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.943+0000 7fbd9be00640 1 -- 172.21.15.22:0/3289467962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c1576b0 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.944+0000 7fbd9be00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c06f6f0 0x7fbd9c1f8550 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800c430 tx=0x7fbd8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.944+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88017070 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.944+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd88005ce0 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.944+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c157990 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.944+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd880072f0 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.944+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c157f50 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.945+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd9c075f30 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.946+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fbd8801a070 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.947+0000 7fbd98c00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd7c06ce90 0x7fbd7c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.948+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fbd8808bb70 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.948+0000 7fbda1000640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd7c06ce90 0x7fbd7c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.948+0000 7fbd98c00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7fbd7c075140 0x7fbd7c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.948+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 --> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd88015e70 con 0x7fbd7c075140 2024-04-16T16:21:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.948+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fbd880902a0 con 0x7fbd9c06f6f0 2024-04-16T16:21:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.949+0000 7fbda1000640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd7c06ce90 0x7fbd7c06f350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd90035000 tx=0x7fbd90030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.949+0000 7fbda1a00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7fbd7c075140 0x7fbd7c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.950+0000 7fbda1a00640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7fbd7c075140 0x7fbd7c077560 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:15.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.952+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== osd.4 v2:172.21.15.43:6808/2374877108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd88015e70 con 0x7fbd7c075140 2024-04-16T16:21:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.967+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 --> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd9c0720e0 con 0x7fbd7c075140 2024-04-16T16:21:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.968+0000 7fbd98c00640 1 -- 172.21.15.22:0/3289467962 <== osd.4 v2:172.21.15.43:6808/2374877108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd9c0720e0 con 0x7fbd7c075140 2024-04-16T16:21:15.967 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:15.968 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.968+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7fbd7c075140 msgr2=0x7fbd7c077560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.968+0000 7fbda2400640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.43:6808/2374877108,v1:172.21.15.43:6809/2374877108] conn(0x7fbd7c075140 0x7fbd7c077560 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.968+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd7c06ce90 msgr2=0x7fbd7c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.968+0000 7fbda2400640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fbd7c06ce90 0x7fbd7c06f350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd90035000 tx=0x7fbd90030000 comp rx=0 tx=0).stop 2024-04-16T16:21:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.968+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c06f6f0 msgr2=0x7fbd9c1f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.968+0000 7fbda2400640 1 --2- 172.21.15.22:0/3289467962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd9c06f6f0 0x7fbd9c1f8550 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800c430 tx=0x7fbd8800c8f0 comp rx=0 tx=0).stop 2024-04-16T16:21:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.969+0000 7fbda1a00640 1 -- 172.21.15.22:0/3289467962 reap_dead start 2024-04-16T16:21:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.969+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 shutdown_connections 2024-04-16T16:21:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.969+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 >> 172.21.15.22:0/3289467962 conn(0x7fbd9c0b3290 msgr2=0x7fbd9c15ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.969+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 shutdown_connections 2024-04-16T16:21:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:15.969+0000 7fbda2400640 1 -- 172.21.15.22:0/3289467962 wait complete. 2024-04-16T16:21:15.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-16T16:21:16.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.201+0000 7fc5d9a00640 1 Processor -- start 2024-04-16T16:21:16.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.201+0000 7fc5d9a00640 1 -- start start 2024-04-16T16:21:16.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d9a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5d40b56b0 0x7fc5d40d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d9a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5d40d05f0 0x7fc5d40b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d9a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5d406d060 con 0x7fc5d415e8b0 2024-04-16T16:21:16.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d9a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc5d406dc70 con 0x7fc5d40d05f0 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d9a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc5d406e100 con 0x7fc5d40b56b0 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d3e00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc5d415e8b0 0x7fc5d4162ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39388/0 (socket says 172.21.15.22:39388) 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d3e00640 1 -- 172.21.15.22:0/2547038463 learned_addr learned my addr 172.21.15.22:0/2547038463 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5d9000640 1 --2- 172.21.15.22:0/2547038463 >> v2:172.21.15.22:3300/0 conn(0x7fc5d40d05f0 0x7fc5d40b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.203+0000 7fc5cb400640 1 --2- 172.21.15.22:0/2547038463 >> v2:172.21.15.43:3300/0 conn(0x7fc5d40b56b0 0x7fc5d40d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.204+0000 7fc5d9000640 1 -- 172.21.15.22:0/2547038463 >> v2:172.21.15.43:3300/0 conn(0x7fc5d40b56b0 msgr2=0x7fc5d40d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.204+0000 7fc5d9000640 1 --2- 172.21.15.22:0/2547038463 >> v2:172.21.15.43:3300/0 conn(0x7fc5d40b56b0 0x7fc5d40d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.204+0000 7fc5d9000640 1 -- 172.21.15.22:0/2547038463 >> v1:172.21.15.22:6789/0 conn(0x7fc5d415e8b0 legacy=0x7fc5d4162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.204+0000 7fc5d9000640 1 -- 172.21.15.22:0/2547038463 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d406d340 con 0x7fc5d40d05f0 2024-04-16T16:21:16.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.204+0000 7fc5cb400640 1 --2- 172.21.15.22:0/2547038463 >> v2:172.21.15.43:3300/0 conn(0x7fc5d40b56b0 0x7fc5d40d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.205+0000 7fc5d9000640 1 --2- 172.21.15.22:0/2547038463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40d05f0 0x7fc5d40b3680 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc5d406efd0 tx=0x7fc5cc02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77710f9f61ea63d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.205+0000 7fc5d3400640 1 -- 172.21.15.22:0/2547038463 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc039070 con 0x7fc5d40d05f0 2024-04-16T16:21:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.205+0000 7fc5d3400640 1 -- 172.21.15.22:0/2547038463 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5cc02cc70 con 0x7fc5d40d05f0 2024-04-16T16:21:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.205+0000 7fc5d3400640 1 -- 172.21.15.22:0/2547038463 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc034660 con 0x7fc5d40d05f0 2024-04-16T16:21:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 -- 172.21.15.22:0/2547038463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40d05f0 msgr2=0x7fc5d40b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/2547038463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40d05f0 0x7fc5d40b3680 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc5d406efd0 tx=0x7fc5cc02bec0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 -- 172.21.15.22:0/2547038463 shutdown_connections 2024-04-16T16:21:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/2547038463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40d05f0 0x7fc5d40b3680 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/2547038463 >> v2:172.21.15.43:3300/0 conn(0x7fc5d40b56b0 0x7fc5d40d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 -- 172.21.15.22:0/2547038463 >> 172.21.15.22:0/2547038463 conn(0x7fc5d4075070 msgr2=0x7fc5d4062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 -- 172.21.15.22:0/2547038463 shutdown_connections 2024-04-16T16:21:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.206+0000 7fc5d9a00640 1 -- 172.21.15.22:0/2547038463 wait complete. 2024-04-16T16:21:16.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.208+0000 7fc5d9a00640 1 Processor -- start 2024-04-16T16:21:16.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.208+0000 7fc5d9a00640 1 -- start start 2024-04-16T16:21:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d9a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40b56b0 0x7fc5d4147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d9a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5d40d05f0 0x7fc5d415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5d415e8b0 0x7fc5d4156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d9a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d406d900 con 0x7fc5d40b56b0 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d9a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d40d0a20 con 0x7fc5d415e8b0 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d9a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d415ec90 con 0x7fc5d40d05f0 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40b56b0 0x7fc5d4147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40b56b0 0x7fc5d4147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38026/0 (socket says 172.21.15.22:38026) 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d3e00640 1 -- 172.21.15.22:0/4224200356 learned_addr learned my addr 172.21.15.22:0/4224200356 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5cb400640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5d40d05f0 0x7fc5d415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d3e00640 1 -- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5d40d05f0 msgr2=0x7fc5d415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d9000640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5d415e8b0 0x7fc5d4156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d3e00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5d40d05f0 0x7fc5d415b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d3e00640 1 -- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5d415e8b0 msgr2=0x7fc5d4156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.209+0000 7fc5d3e00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5d415e8b0 0x7fc5d4156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.210+0000 7fc5d3e00640 1 -- 172.21.15.22:0/4224200356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d40ccae0 con 0x7fc5d40b56b0 2024-04-16T16:21:16.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.210+0000 7fc5d3e00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40b56b0 0x7fc5d4147fa0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400c3f0 tx=0x7fc5c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.210+0000 7fc5d0c00640 1 -- 172.21.15.22:0/4224200356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4017070 con 0x7fc5d40b56b0 2024-04-16T16:21:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.210+0000 7fc5d0c00640 1 -- 172.21.15.22:0/4224200356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c4005ce0 con 0x7fc5d40b56b0 2024-04-16T16:21:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.210+0000 7fc5d0c00640 1 -- 172.21.15.22:0/4224200356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40072f0 con 0x7fc5d40b56b0 2024-04-16T16:21:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.210+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d40ccdc0 con 0x7fc5d40b56b0 2024-04-16T16:21:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.210+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d40cd380 con 0x7fc5d40b56b0 2024-04-16T16:21:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.211+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d4075f30 con 0x7fc5d40b56b0 2024-04-16T16:21:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.213+0000 7fc5d0c00640 1 -- 172.21.15.22:0/4224200356 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fc5c401a070 con 0x7fc5d40b56b0 2024-04-16T16:21:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.213+0000 7fc5d0c00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5b006ce90 0x7fc5b006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.214+0000 7fc5d0c00640 1 -- 172.21.15.22:0/4224200356 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fc5c408b9b0 con 0x7fc5d40b56b0 2024-04-16T16:21:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.214+0000 7fc5cb400640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5b006ce90 0x7fc5b006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.215+0000 7fc5cb400640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5b006ce90 0x7fc5b006f350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4072d00 tx=0x7fc5bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.218+0000 7fc5d0c00640 1 -- 172.21.15.22:0/4224200356 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5c4059510 con 0x7fc5d40b56b0 2024-04-16T16:21:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.425+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc5d40cc890 con 0x7fc5b006ce90 2024-04-16T16:21:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.426+0000 7fc5d0c00640 1 -- 172.21.15.22:0/4224200356 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc5d40cc890 con 0x7fc5b006ce90 2024-04-16T16:21:16.426 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 4 to deep-scrub 2024-04-16T16:21:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.428+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5b006ce90 msgr2=0x7fc5b006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.428+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5b006ce90 0x7fc5b006f350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4072d00 tx=0x7fc5bc008040 comp rx=0 tx=0).stop 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.428+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40b56b0 msgr2=0x7fc5d4147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.428+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40b56b0 0x7fc5d4147fa0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400c3f0 tx=0x7fc5c400c8b0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 shutdown_connections 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5b006ce90 0x7fc5b006f350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5d415e8b0 0x7fc5d4156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5d40d05f0 0x7fc5d415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 --2- 172.21.15.22:0/4224200356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d40b56b0 0x7fc5d4147fa0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 >> 172.21.15.22:0/4224200356 conn(0x7fc5d4075070 msgr2=0x7fc5d41613a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:16.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 shutdown_connections 2024-04-16T16:21:16.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.429+0000 7fc5d9a00640 1 -- 172.21.15.22:0/4224200356 wait complete. 2024-04-16T16:21:16.450 INFO:tasks.ceph:Scrubbing osd.5 2024-04-16T16:21:16.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:16.625 INFO:tasks.ceph.mds.a.smithi022.stderr:2024-04-16T16:21:16.625+0000 7f766fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T16:21:16.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.675+0000 7fec34a00640 1 Processor -- start 2024-04-16T16:21:16.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.675+0000 7fec34a00640 1 -- start start 2024-04-16T16:21:16.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec34a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec3015ea50 0x7fec3006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec34a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fec30072790 0x7fec300b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec34a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec30162750 con 0x7fec30072e70 2024-04-16T16:21:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec34a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fec300b44e0 con 0x7fec3015ea50 2024-04-16T16:21:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec34a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fec30162470 con 0x7fec30072790 2024-04-16T16:21:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec2e800640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec3015ea50 0x7fec3006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec2f200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fec30072e70 0x7fec30070f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39400/0 (socket says 172.21.15.22:39400) 2024-04-16T16:21:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.677+0000 7fec2f200640 1 -- 172.21.15.22:0/2040820653 learned_addr learned my addr 172.21.15.22:0/2040820653 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.678+0000 7fec2de00640 1 --2- 172.21.15.22:0/2040820653 >> v2:172.21.15.43:3300/0 conn(0x7fec30072790 0x7fec300b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.678+0000 7fec2e800640 1 -- 172.21.15.22:0/2040820653 >> v2:172.21.15.43:3300/0 conn(0x7fec30072790 msgr2=0x7fec300b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.678+0000 7fec2e800640 1 --2- 172.21.15.22:0/2040820653 >> v2:172.21.15.43:3300/0 conn(0x7fec30072790 0x7fec300b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.678+0000 7fec2e800640 1 -- 172.21.15.22:0/2040820653 >> v1:172.21.15.22:6789/0 conn(0x7fec30072e70 legacy=0x7fec30070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.678+0000 7fec2e800640 1 -- 172.21.15.22:0/2040820653 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3006d3e0 con 0x7fec3015ea50 2024-04-16T16:21:16.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.678+0000 7fec2d400640 1 -- 172.21.15.22:0/2040820653 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369031740 0 0) 0x7fec30162750 con 0x7fec30072e70 2024-04-16T16:21:16.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.679+0000 7fec2e800640 1 --2- 172.21.15.22:0/2040820653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec3006e1a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fec3006f070 tx=0x7fec2002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0aa5b6e9e0aab6f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.679+0000 7fec2d400640 1 -- 172.21.15.22:0/2040820653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20034070 con 0x7fec3015ea50 2024-04-16T16:21:16.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.679+0000 7fec2d400640 1 -- 172.21.15.22:0/2040820653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec20030610 con 0x7fec3015ea50 2024-04-16T16:21:16.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.679+0000 7fec2d400640 1 -- 172.21.15.22:0/2040820653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec200309e0 con 0x7fec3015ea50 2024-04-16T16:21:16.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 -- 172.21.15.22:0/2040820653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 msgr2=0x7fec3006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 --2- 172.21.15.22:0/2040820653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec3006e1a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fec3006f070 tx=0x7fec2002b960 comp rx=0 tx=0).stop 2024-04-16T16:21:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 -- 172.21.15.22:0/2040820653 shutdown_connections 2024-04-16T16:21:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 --2- 172.21.15.22:0/2040820653 >> v2:172.21.15.43:3300/0 conn(0x7fec30072790 0x7fec300b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 --2- 172.21.15.22:0/2040820653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec3006e1a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 -- 172.21.15.22:0/2040820653 >> 172.21.15.22:0/2040820653 conn(0x7fec30062440 msgr2=0x7fec30062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 -- 172.21.15.22:0/2040820653 shutdown_connections 2024-04-16T16:21:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.680+0000 7fec34a00640 1 -- 172.21.15.22:0/2040820653 wait complete. 2024-04-16T16:21:16.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.682+0000 7fec34a00640 1 Processor -- start 2024-04-16T16:21:16.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.682+0000 7fec34a00640 1 -- start start 2024-04-16T16:21:16.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec34a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec30072790 0x7fec300b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec34a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec30072e70 0x7fec30154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec34a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec30148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec34a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fec3006dc80 con 0x7fec3015ea50 2024-04-16T16:21:16.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec34a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fec3006d9a0 con 0x7fec30072e70 2024-04-16T16:21:16.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec34a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fec300b3c60 con 0x7fec30072790 2024-04-16T16:21:16.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec2f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec30148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec2f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec30148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38042/0 (socket says 172.21.15.22:38042) 2024-04-16T16:21:16.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.683+0000 7fec2f200640 1 -- 172.21.15.22:0/3165108704 learned_addr learned my addr 172.21.15.22:0/3165108704 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:16.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2f200640 1 -- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec30072790 msgr2=0x7fec300b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2e800640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec30072790 0x7fec300b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2f200640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec30072790 0x7fec300b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2de00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec30072e70 0x7fec30154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2f200640 1 -- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec30072e70 msgr2=0x7fec30154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2f200640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec30072e70 0x7fec30154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2f200640 1 -- 172.21.15.22:0/3165108704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec30149510 con 0x7fec3015ea50 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec2f200640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec30148fd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fec2800c7a0 tx=0x7fec2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28018070 con 0x7fec3015ea50 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2800a640 con 0x7fec3015ea50 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2800aab0 con 0x7fec3015ea50 2024-04-16T16:21:16.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.684+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec300b0f20 con 0x7fec3015ea50 2024-04-16T16:21:16.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.685+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec300b14e0 con 0x7fec3015ea50 2024-04-16T16:21:16.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.685+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec300b1ba0 con 0x7fec3015ea50 2024-04-16T16:21:16.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.687+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fec2801b070 con 0x7fec3015ea50 2024-04-16T16:21:16.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.688+0000 7fec26a00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fec1006cee0 0x7fec1006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.688+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fec2808bcb0 con 0x7fec3015ea50 2024-04-16T16:21:16.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.688+0000 7fec2e800640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fec1006cee0 0x7fec1006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.688+0000 7fec26a00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fec10075210 0x7fec10077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.688+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 --> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec10077ce0 con 0x7fec10075210 2024-04-16T16:21:16.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.688+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fec28090220 con 0x7fec3015ea50 2024-04-16T16:21:16.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.689+0000 7fec2de00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fec10075210 0x7fec10077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.689+0000 7fec2e800640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fec1006cee0 0x7fec1006f3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec20036000 tx=0x7fec20008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.690+0000 7fec2de00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fec10075210 0x7fec10077630 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.692+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== osd.5 v2:172.21.15.43:6800/3649609022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec10077ce0 con 0x7fec10075210 2024-04-16T16:21:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.707+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 --> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec30075f30 con 0x7fec10075210 2024-04-16T16:21:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.708+0000 7fec26a00640 1 -- 172.21.15.22:0/3165108704 <== osd.5 v2:172.21.15.43:6800/3649609022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec30075f30 con 0x7fec10075210 2024-04-16T16:21:16.708 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:16.708 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:16.708 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.708+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fec10075210 msgr2=0x7fec10077630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.708+0000 7fec34a00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.43:6800/3649609022,v1:172.21.15.43:6801/3649609022] conn(0x7fec10075210 0x7fec10077630 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fec1006cee0 msgr2=0x7fec1006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fec1006cee0 0x7fec1006f3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec20036000 tx=0x7fec20008030 comp rx=0 tx=0).stop 2024-04-16T16:21:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 msgr2=0x7fec30148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 --2- 172.21.15.22:0/3165108704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec3015ea50 0x7fec30148fd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fec2800c7a0 tx=0x7fec2800cc60 comp rx=0 tx=0).stop 2024-04-16T16:21:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec2f200640 1 -- 172.21.15.22:0/3165108704 reap_dead start 2024-04-16T16:21:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 shutdown_connections 2024-04-16T16:21:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 >> 172.21.15.22:0/3165108704 conn(0x7fec30062440 msgr2=0x7fec301614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 shutdown_connections 2024-04-16T16:21:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.709+0000 7fec34a00640 1 -- 172.21.15.22:0/3165108704 wait complete. 2024-04-16T16:21:16.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-16T16:21:16.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.944+0000 7fc9eb600640 1 Processor -- start 2024-04-16T16:21:16.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.944+0000 7fc9eb600640 1 -- start start 2024-04-16T16:21:16.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.945+0000 7fc9eb600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9e415fdc0 0x7fc9e40b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.946+0000 7fc9eb600640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e40af0b0 con 0x7fc9e40b5430 2024-04-16T16:21:16.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.946+0000 7fc9eb600640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e40af390 con 0x7fc9e40b5810 2024-04-16T16:21:16.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.946+0000 7fc9eb600640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e406d150 con 0x7fc9e415fdc0 2024-04-16T16:21:16.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.946+0000 7fc9e3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9e415fdc0 0x7fc9e40b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.946+0000 7fc9e3e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9e415fdc0 0x7fc9e40b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38054/0 (socket says 172.21.15.22:38054) 2024-04-16T16:21:16.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.946+0000 7fc9e3e00640 1 -- 172.21.15.22:0/185517609 learned_addr learned my addr 172.21.15.22:0/185517609 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:16.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.947+0000 7fc9e3e00640 1 -- 172.21.15.22:0/185517609 >> v1:172.21.15.43:6789/0 conn(0x7fc9e40b5810 legacy=0x7fc9e4158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:16.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.947+0000 7fc9e3e00640 1 -- 172.21.15.22:0/185517609 >> v1:172.21.15.22:6789/0 conn(0x7fc9e40b5430 legacy=0x7fc9e40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.947+0000 7fc9e3400640 1 -- 172.21.15.22:0/185517609 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922820130 0 0) 0x7fc9e40af0b0 con 0x7fc9e40b5430 2024-04-16T16:21:16.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.947+0000 7fc9e3e00640 1 -- 172.21.15.22:0/185517609 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e40af670 con 0x7fc9e415fdc0 2024-04-16T16:21:16.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.948+0000 7fc9e3e00640 1 --2- 172.21.15.22:0/185517609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b39e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc9e406d2d0 tx=0x7fc9d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f0c5d6d4d6a1d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9e3400640 1 -- 172.21.15.22:0/185517609 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4034070 con 0x7fc9e415fdc0 2024-04-16T16:21:16.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9e3400640 1 -- 172.21.15.22:0/185517609 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d4030840 con 0x7fc9e415fdc0 2024-04-16T16:21:16.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9e3400640 1 -- 172.21.15.22:0/185517609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4030c10 con 0x7fc9e415fdc0 2024-04-16T16:21:16.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9eb600640 1 -- 172.21.15.22:0/185517609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 msgr2=0x7fc9e40b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9eb600640 1 --2- 172.21.15.22:0/185517609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b39e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc9e406d2d0 tx=0x7fc9d402b980 comp rx=0 tx=0).stop 2024-04-16T16:21:16.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9eb600640 1 -- 172.21.15.22:0/185517609 shutdown_connections 2024-04-16T16:21:16.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9eb600640 1 --2- 172.21.15.22:0/185517609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b39e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9eb600640 1 -- 172.21.15.22:0/185517609 >> 172.21.15.22:0/185517609 conn(0x7fc9e4062440 msgr2=0x7fc9e4062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:16.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.949+0000 7fc9eb600640 1 -- 172.21.15.22:0/185517609 shutdown_connections 2024-04-16T16:21:16.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.950+0000 7fc9eb600640 1 -- 172.21.15.22:0/185517609 wait complete. 2024-04-16T16:21:16.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.951+0000 7fc9eb600640 1 Processor -- start 2024-04-16T16:21:16.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.951+0000 7fc9eb600640 1 -- start start 2024-04-16T16:21:16.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.952+0000 7fc9eb600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e40b5430 0x7fc9e41f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.952+0000 7fc9eb600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9e40b5810 0x7fc9e41f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.952+0000 7fc9eb600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.952+0000 7fc9eb600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4159360 con 0x7fc9e415fdc0 2024-04-16T16:21:16.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.952+0000 7fc9eb600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e406d430 con 0x7fc9e40b5430 2024-04-16T16:21:16.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.952+0000 7fc9eb600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e41594e0 con 0x7fc9e40b5810 2024-04-16T16:21:16.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.952+0000 7fc9e9600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38058/0 (socket says 172.21.15.22:38058) 2024-04-16T16:21:16.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 -- 172.21.15.22:0/2598641095 learned_addr learned my addr 172.21.15.22:0/2598641095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:16.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e8c00640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e40b5430 0x7fc9e41f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e3e00640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9e40b5810 0x7fc9e41f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 -- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9e40b5810 msgr2=0x7fc9e41f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9e40b5810 0x7fc9e41f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 -- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e40b5430 msgr2=0x7fc9e41f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e40b5430 0x7fc9e41f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 -- 172.21.15.22:0/2598641095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e41ea5b0 con 0x7fc9e415fdc0 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.953+0000 7fc9e9600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b22a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00b970 tx=0x7fc9dc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.954+0000 7fc9e0c00640 1 -- 172.21.15.22:0/2598641095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc019070 con 0x7fc9e415fdc0 2024-04-16T16:21:16.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.954+0000 7fc9e0c00640 1 -- 172.21.15.22:0/2598641095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9dc00cb40 con 0x7fc9e415fdc0 2024-04-16T16:21:16.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.954+0000 7fc9e0c00640 1 -- 172.21.15.22:0/2598641095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc014440 con 0x7fc9e415fdc0 2024-04-16T16:21:16.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.954+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e40cc830 con 0x7fc9e415fdc0 2024-04-16T16:21:16.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.954+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e40ccdf0 con 0x7fc9e415fdc0 2024-04-16T16:21:16.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.955+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e404fd90 con 0x7fc9e415fdc0 2024-04-16T16:21:16.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.956+0000 7fc9e0c00640 1 -- 172.21.15.22:0/2598641095 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fc9dc01c070 con 0x7fc9e415fdc0 2024-04-16T16:21:16.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.957+0000 7fc9e0c00640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc9c806cec0 0x7fc9c806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:16.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.957+0000 7fc9e0c00640 1 -- 172.21.15.22:0/2598641095 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fc9dc08c2a0 con 0x7fc9e415fdc0 2024-04-16T16:21:16.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.957+0000 7fc9e8c00640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc9c806cec0 0x7fc9c806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:16.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.958+0000 7fc9e8c00640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc9c806cec0 0x7fc9c806f380 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f60 tx=0x7fc9d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:16.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:16.962+0000 7fc9e0c00640 1 -- 172.21.15.22:0/2598641095 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9dc059dc0 con 0x7fc9e415fdc0 2024-04-16T16:21:17.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.165+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc9e40d0f40 con 0x7fc9c806cec0 2024-04-16T16:21:17.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.166+0000 7fc9e0c00640 1 -- 172.21.15.22:0/2598641095 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc9e40d0f40 con 0x7fc9c806cec0 2024-04-16T16:21:17.166 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 5 to deep-scrub 2024-04-16T16:21:17.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc9c806cec0 msgr2=0x7fc9c806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc9c806cec0 0x7fc9c806f380 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f60 tx=0x7fc9d8009040 comp rx=0 tx=0).stop 2024-04-16T16:21:17.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 msgr2=0x7fc9e40b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b22a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00b970 tx=0x7fc9dc00be30 comp rx=0 tx=0).stop 2024-04-16T16:21:17.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 shutdown_connections 2024-04-16T16:21:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc9c806cec0 0x7fc9c806f380 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9e415fdc0 0x7fc9e40b22a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9e40b5810 0x7fc9e41f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 --2- 172.21.15.22:0/2598641095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e40b5430 0x7fc9e41f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 >> 172.21.15.22:0/2598641095 conn(0x7fc9e4062440 msgr2=0x7fc9e4160360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 shutdown_connections 2024-04-16T16:21:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.169+0000 7fc9eb600640 1 -- 172.21.15.22:0/2598641095 wait complete. 2024-04-16T16:21:17.190 INFO:tasks.ceph:Scrubbing osd.6 2024-04-16T16:21:17.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.421+0000 7fd913000640 1 Processor -- start 2024-04-16T16:21:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.422+0000 7fd913000640 1 -- start start 2024-04-16T16:21:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.423+0000 7fd913000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd90c0cf090 0x7fd90c0d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.423+0000 7fd913000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90c0cfee0 con 0x7fd90c0b3b80 2024-04-16T16:21:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.423+0000 7fd913000640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90c0cfc00 con 0x7fd90c0b6640 2024-04-16T16:21:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.423+0000 7fd913000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c0d3d20 con 0x7fd90c0cf090 2024-04-16T16:21:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd912600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd90c0cf090 0x7fd90c0d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd911200640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd90c0b3b80 0x7fd90c0b79f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39420/0 (socket says 172.21.15.22:39420) 2024-04-16T16:21:17.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd912600640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd90c0cf090 0x7fd90c0d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38066/0 (socket says 172.21.15.22:38066) 2024-04-16T16:21:17.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd911200640 1 -- 172.21.15.22:0/4094343445 learned_addr learned my addr 172.21.15.22:0/4094343445 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:17.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd912600640 1 -- 172.21.15.22:0/4094343445 >> v1:172.21.15.43:6789/0 conn(0x7fd90c0b6640 legacy=0x7fd90c0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd912600640 1 -- 172.21.15.22:0/4094343445 >> v1:172.21.15.22:6789/0 conn(0x7fd90c0b3b80 legacy=0x7fd90c0b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd912600640 1 -- 172.21.15.22:0/4094343445 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c0d36d0 con 0x7fd90c0cf090 2024-04-16T16:21:17.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.424+0000 7fd90be00640 1 -- 172.21.15.22:0/4094343445 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232147692 0 0) 0x7fd90c0cfee0 con 0x7fd90c0b3b80 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.426+0000 7fd912600640 1 --2- 172.21.15.22:0/4094343445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0cf090 0x7fd90c0d41b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd904009d90 tx=0x7fd90402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f999e5e9e7481a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.426+0000 7fd90be00640 1 -- 172.21.15.22:0/4094343445 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904039070 con 0x7fd90c0cf090 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.426+0000 7fd90be00640 1 -- 172.21.15.22:0/4094343445 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90402cd00 con 0x7fd90c0cf090 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.426+0000 7fd90be00640 1 -- 172.21.15.22:0/4094343445 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904034660 con 0x7fd90c0cf090 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.427+0000 7fd913000640 1 -- 172.21.15.22:0/4094343445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0cf090 msgr2=0x7fd90c0d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.427+0000 7fd913000640 1 --2- 172.21.15.22:0/4094343445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0cf090 0x7fd90c0d41b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd904009d90 tx=0x7fd90402bf50 comp rx=0 tx=0).stop 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.427+0000 7fd913000640 1 -- 172.21.15.22:0/4094343445 shutdown_connections 2024-04-16T16:21:17.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.427+0000 7fd913000640 1 --2- 172.21.15.22:0/4094343445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0cf090 0x7fd90c0d41b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.427+0000 7fd913000640 1 -- 172.21.15.22:0/4094343445 >> 172.21.15.22:0/4094343445 conn(0x7fd90c062620 msgr2=0x7fd90c062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:17.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.427+0000 7fd913000640 1 -- 172.21.15.22:0/4094343445 shutdown_connections 2024-04-16T16:21:17.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.427+0000 7fd913000640 1 -- 172.21.15.22:0/4094343445 wait complete. 2024-04-16T16:21:17.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.429+0000 7fd913000640 1 Processor -- start 2024-04-16T16:21:17.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.429+0000 7fd913000640 1 -- start start 2024-04-16T16:21:17.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd913000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd90c0b3b80 0x7fd90c161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd913000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0b6640 0x7fd90c15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd913000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd90c0cf090 0x7fd90c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd913000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0b8100 con 0x7fd90c0b6640 2024-04-16T16:21:17.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd913000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0cf890 con 0x7fd90c0cf090 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd913000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c0b8280 con 0x7fd90c0b3b80 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd911200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0b6640 0x7fd90c15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd911200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0b6640 0x7fd90c15ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38068/0 (socket says 172.21.15.22:38068) 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.430+0000 7fd911200640 1 -- 172.21.15.22:0/4061975478 learned_addr learned my addr 172.21.15.22:0/4061975478 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd911200640 1 -- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd90c0b3b80 msgr2=0x7fd90c161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd911200640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd90c0b3b80 0x7fd90c161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd911200640 1 -- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd90c0cf090 msgr2=0x7fd90c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd912600640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd90c0cf090 0x7fd90c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd911200640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd90c0cf090 0x7fd90c15b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd911200640 1 -- 172.21.15.22:0/4061975478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c15f0a0 con 0x7fd90c0b6640 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd911200640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0b6640 0x7fd90c15ad70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c3f0 tx=0x7fd8f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80074e0 con 0x7fd90c0b6640 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f80047e0 con 0x7fd90c0b6640 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c15f340 con 0x7fd90c0b6640 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8004c10 con 0x7fd90c0b6640 2024-04-16T16:21:17.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.431+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c0ceca0 con 0x7fd90c0b6640 2024-04-16T16:21:17.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.432+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd90c075f30 con 0x7fd90c0b6640 2024-04-16T16:21:17.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.434+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fd8f8011070 con 0x7fd90c0b6640 2024-04-16T16:21:17.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.435+0000 7fd909600640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8ec06ce90 0x7fd8ec06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.435+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fd8f808c260 con 0x7fd90c0b6640 2024-04-16T16:21:17.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.435+0000 7fd911c00640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8ec06ce90 0x7fd8ec06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.435+0000 7fd909600640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7fd8ec075130 0x7fd8ec077550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.435+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 --> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8f801ee50 con 0x7fd8ec075130 2024-04-16T16:21:17.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.435+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fd8f8093050 con 0x7fd90c0b6640 2024-04-16T16:21:17.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.436+0000 7fd911c00640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8ec06ce90 0x7fd8ec06f350 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc000f60 tx=0x7fd8fc0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:17.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.436+0000 7fd912600640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7fd8ec075130 0x7fd8ec077550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.437+0000 7fd912600640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7fd8ec075130 0x7fd8ec077550 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:17.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.439+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== osd.6 v2:172.21.15.43:6816/748765916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8f801ee50 con 0x7fd8ec075130 2024-04-16T16:21:17.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.455+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 --> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd90c15e580 con 0x7fd8ec075130 2024-04-16T16:21:17.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.456+0000 7fd909600640 1 -- 172.21.15.22:0/4061975478 <== osd.6 v2:172.21.15.43:6816/748765916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd90c15e580 con 0x7fd8ec075130 2024-04-16T16:21:17.455 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:17.456 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:17.456 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.456+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7fd8ec075130 msgr2=0x7fd8ec077550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.456+0000 7fd913000640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.43:6816/748765916,v1:172.21.15.43:6817/748765916] conn(0x7fd8ec075130 0x7fd8ec077550 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8ec06ce90 msgr2=0x7fd8ec06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fd8ec06ce90 0x7fd8ec06f350 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc000f60 tx=0x7fd8fc0079b0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0b6640 msgr2=0x7fd90c15ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 --2- 172.21.15.22:0/4061975478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd90c0b6640 0x7fd90c15ad70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c3f0 tx=0x7fd8f800c8b0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd912600640 1 -- 172.21.15.22:0/4061975478 reap_dead start 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 shutdown_connections 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 >> 172.21.15.22:0/4061975478 conn(0x7fd90c062620 msgr2=0x7fd90c0b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 shutdown_connections 2024-04-16T16:21:17.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.457+0000 7fd913000640 1 -- 172.21.15.22:0/4061975478 wait complete. 2024-04-16T16:21:17.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2024-04-16T16:21:17.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-16T16:21:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.698+0000 7ff323c00640 1 Processor -- start 2024-04-16T16:21:17.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.699+0000 7ff323c00640 1 -- start start 2024-04-16T16:21:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.700+0000 7ff323c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff31c0d1a80 0x7ff31c0ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.700+0000 7ff323c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff31c0d4410 0x7ff31c0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.700+0000 7ff323c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31c15f2b0 con 0x7ff31c15eed0 2024-04-16T16:21:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.700+0000 7ff323c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff31c0d4820 con 0x7ff31c0d1a80 2024-04-16T16:21:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.700+0000 7ff323c00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff31c0d3110 con 0x7ff31c0d4410 2024-04-16T16:21:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.700+0000 7ff31be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff31c0d1a80 0x7ff31c0ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.701+0000 7ff31be00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff31c0d1a80 0x7ff31c0ba5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38084/0 (socket says 172.21.15.22:38084) 2024-04-16T16:21:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.701+0000 7ff31be00640 1 -- 172.21.15.22:0/3863848287 learned_addr learned my addr 172.21.15.22:0/3863848287 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.701+0000 7ff321c00640 1 --2- 172.21.15.22:0/3863848287 >> v2:172.21.15.43:3300/0 conn(0x7ff31c0d4410 0x7ff31c0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.701+0000 7ff31be00640 1 -- 172.21.15.22:0/3863848287 >> v2:172.21.15.43:3300/0 conn(0x7ff31c0d4410 msgr2=0x7ff31c0d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.701+0000 7ff31be00640 1 --2- 172.21.15.22:0/3863848287 >> v2:172.21.15.43:3300/0 conn(0x7ff31c0d4410 0x7ff31c0d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.701+0000 7ff31be00640 1 -- 172.21.15.22:0/3863848287 >> v1:172.21.15.43:6789/0 conn(0x7ff31c15eed0 legacy=0x7ff31c0d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.701+0000 7ff31be00640 1 -- 172.21.15.22:0/3863848287 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c0d3370 con 0x7ff31c0d1a80 2024-04-16T16:21:17.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.702+0000 7ff31be00640 1 --2- 172.21.15.22:0/3863848287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d1a80 0x7ff31c0ba5c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0d2160 tx=0x7ff30402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a814306f6aa1c854 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:17.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.702+0000 7ff31b400640 1 -- 172.21.15.22:0/3863848287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30402ca80 con 0x7ff31c0d1a80 2024-04-16T16:21:17.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.702+0000 7ff31b400640 1 -- 172.21.15.22:0/3863848287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff30402cc20 con 0x7ff31c0d1a80 2024-04-16T16:21:17.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.702+0000 7ff31b400640 1 -- 172.21.15.22:0/3863848287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3040343f0 con 0x7ff31c0d1a80 2024-04-16T16:21:17.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 -- 172.21.15.22:0/3863848287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d1a80 msgr2=0x7ff31c0ba5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 --2- 172.21.15.22:0/3863848287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d1a80 0x7ff31c0ba5c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0d2160 tx=0x7ff30402bee0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 -- 172.21.15.22:0/3863848287 shutdown_connections 2024-04-16T16:21:17.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 --2- 172.21.15.22:0/3863848287 >> v2:172.21.15.43:3300/0 conn(0x7ff31c0d4410 0x7ff31c0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 --2- 172.21.15.22:0/3863848287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d1a80 0x7ff31c0ba5c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 -- 172.21.15.22:0/3863848287 >> 172.21.15.22:0/3863848287 conn(0x7ff31c062440 msgr2=0x7ff31c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:17.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 -- 172.21.15.22:0/3863848287 shutdown_connections 2024-04-16T16:21:17.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.703+0000 7ff323c00640 1 -- 172.21.15.22:0/3863848287 wait complete. 2024-04-16T16:21:17.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.705+0000 7ff323c00640 1 Processor -- start 2024-04-16T16:21:17.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.705+0000 7ff323c00640 1 -- start start 2024-04-16T16:21:17.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.706+0000 7ff323c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d4410 0x7ff31c0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.706+0000 7ff323c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff31c15eed0 0x7ff31c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.706+0000 7ff323c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff31c0c9c40 0x7ff31c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.706+0000 7ff323c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c0d3c10 con 0x7ff31c0d4410 2024-04-16T16:21:17.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.706+0000 7ff323c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c0d3930 con 0x7ff31c15eed0 2024-04-16T16:21:17.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.706+0000 7ff323c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c0d3ef0 con 0x7ff31c0c9c40 2024-04-16T16:21:17.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d4410 0x7ff31c0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d4410 0x7ff31c0c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38100/0 (socket says 172.21.15.22:38100) 2024-04-16T16:21:17.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 -- 172.21.15.22:0/2647606194 learned_addr learned my addr 172.21.15.22:0/2647606194 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:17.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff31be00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff31c15eed0 0x7ff31c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 -- 172.21.15.22:0/2647606194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff31c0c9c40 msgr2=0x7ff31c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff31c0c9c40 0x7ff31c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 -- 172.21.15.22:0/2647606194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff31c15eed0 msgr2=0x7ff31c1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff31c15eed0 0x7ff31c1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 -- 172.21.15.22:0/2647606194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c0c8ba0 con 0x7ff31c0d4410 2024-04-16T16:21:17.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.707+0000 7ff321200640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d4410 0x7ff31c0c85c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00b3f0 tx=0x7ff30c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:17.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.708+0000 7ff318c00640 1 -- 172.21.15.22:0/2647606194 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c015020 con 0x7ff31c0d4410 2024-04-16T16:21:17.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.708+0000 7ff318c00640 1 -- 172.21.15.22:0/2647606194 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff30c011830 con 0x7ff31c0d4410 2024-04-16T16:21:17.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.708+0000 7ff318c00640 1 -- 172.21.15.22:0/2647606194 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c011c20 con 0x7ff31c0d4410 2024-04-16T16:21:17.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.708+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31c0c8e80 con 0x7ff31c0d4410 2024-04-16T16:21:17.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.708+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31c0c9440 con 0x7ff31c0d4410 2024-04-16T16:21:17.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.709+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31c04fd90 con 0x7ff31c0d4410 2024-04-16T16:21:17.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.710+0000 7ff318c00640 1 -- 172.21.15.22:0/2647606194 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7ff30c018020 con 0x7ff31c0d4410 2024-04-16T16:21:17.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.711+0000 7ff318c00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2f806ce90 0x7ff2f806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:17.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.711+0000 7ff318c00640 1 -- 172.21.15.22:0/2647606194 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7ff30c08c230 con 0x7ff31c0d4410 2024-04-16T16:21:17.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.711+0000 7ff31be00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2f806ce90 0x7ff2f806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:17.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.712+0000 7ff31be00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2f806ce90 0x7ff2f806f350 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff304035000 tx=0x7ff304030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:17.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.716+0000 7ff318c00640 1 -- 172.21.15.22:0/2647606194 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff30c01f030 con 0x7ff31c0d4410 2024-04-16T16:21:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.924+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7ff31c069b60 con 0x7ff2f806ce90 2024-04-16T16:21:17.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.925+0000 7ff318c00640 1 -- 172.21.15.22:0/2647606194 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff31c069b60 con 0x7ff2f806ce90 2024-04-16T16:21:17.924 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 6 to deep-scrub 2024-04-16T16:21:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2f806ce90 msgr2=0x7ff2f806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2f806ce90 0x7ff2f806f350 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff304035000 tx=0x7ff304030000 comp rx=0 tx=0).stop 2024-04-16T16:21:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d4410 msgr2=0x7ff31c0c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d4410 0x7ff31c0c85c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00b3f0 tx=0x7ff30c00b8b0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 shutdown_connections 2024-04-16T16:21:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7ff2f806ce90 0x7ff2f806f350 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff31c0c9c40 0x7ff31c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff31c15eed0 0x7ff31c1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 --2- 172.21.15.22:0/2647606194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff31c0d4410 0x7ff31c0c85c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 >> 172.21.15.22:0/2647606194 conn(0x7ff31c062440 msgr2=0x7ff31c0b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 shutdown_connections 2024-04-16T16:21:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:17.927+0000 7ff323c00640 1 -- 172.21.15.22:0/2647606194 wait complete. 2024-04-16T16:21:17.945 INFO:tasks.ceph:Scrubbing osd.7 2024-04-16T16:21:17.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-16T16:21:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.171+0000 7f0272000640 1 Processor -- start 2024-04-16T16:21:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.172+0000 7f0272000640 1 -- start start 2024-04-16T16:21:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f0272000640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f026c15ea10 0x7f026c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f0272000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f026c073110 0x7f026c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f0272000640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f026c0aebb0 con 0x7f026c162710 2024-04-16T16:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f0272000640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f026c0af7c0 con 0x7f026c073110 2024-04-16T16:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f0272000640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f026c0aee90 con 0x7f026c15ea10 2024-04-16T16:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f0262a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f026c073110 0x7f026c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f026be00640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f026c162710 0x7f026c0b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39430/0 (socket says 172.21.15.22:39430) 2024-04-16T16:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f026be00640 1 -- 172.21.15.22:0/804375926 learned_addr learned my addr 172.21.15.22:0/804375926 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.173+0000 7f0262a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f026c073110 0x7f026c0b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38102/0 (socket says 172.21.15.22:38102) 2024-04-16T16:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.174+0000 7f026b400640 1 --2- 172.21.15.22:0/804375926 >> v2:172.21.15.43:3300/0 conn(0x7f026c15ea10 0x7f026c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.174+0000 7f0262a00640 1 -- 172.21.15.22:0/804375926 >> v2:172.21.15.43:3300/0 conn(0x7f026c15ea10 msgr2=0x7f026c0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.174+0000 7f0262a00640 1 --2- 172.21.15.22:0/804375926 >> v2:172.21.15.43:3300/0 conn(0x7f026c15ea10 0x7f026c0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.174+0000 7f0262a00640 1 -- 172.21.15.22:0/804375926 >> v1:172.21.15.22:6789/0 conn(0x7f026c162710 legacy=0x7f026c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.174+0000 7f0262a00640 1 -- 172.21.15.22:0/804375926 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c0af170 con 0x7f026c073110 2024-04-16T16:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.174+0000 7f026aa00640 1 -- 172.21.15.22:0/804375926 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350270235 0 0) 0x7f026c0aebb0 con 0x7f026c162710 2024-04-16T16:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.176+0000 7f0262a00640 1 --2- 172.21.15.22:0/804375926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c073110 0x7f026c0b2960 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f026c0afc60 tx=0x7f025402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b611f04c4f296390 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.176+0000 7f026aa00640 1 -- 172.21.15.22:0/804375926 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02540315a0 con 0x7f026c073110 2024-04-16T16:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.176+0000 7f026aa00640 1 -- 172.21.15.22:0/804375926 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0254037070 con 0x7f026c073110 2024-04-16T16:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.176+0000 7f026aa00640 1 -- 172.21.15.22:0/804375926 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254031960 con 0x7f026c073110 2024-04-16T16:21:18.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 -- 172.21.15.22:0/804375926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c073110 msgr2=0x7f026c0b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 --2- 172.21.15.22:0/804375926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c073110 0x7f026c0b2960 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f026c0afc60 tx=0x7f025402b840 comp rx=0 tx=0).stop 2024-04-16T16:21:18.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 -- 172.21.15.22:0/804375926 shutdown_connections 2024-04-16T16:21:18.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 --2- 172.21.15.22:0/804375926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c073110 0x7f026c0b2960 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 --2- 172.21.15.22:0/804375926 >> v2:172.21.15.43:3300/0 conn(0x7f026c15ea10 0x7f026c0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 -- 172.21.15.22:0/804375926 >> 172.21.15.22:0/804375926 conn(0x7f026c062440 msgr2=0x7f026c062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:18.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 -- 172.21.15.22:0/804375926 shutdown_connections 2024-04-16T16:21:18.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.177+0000 7f0272000640 1 -- 172.21.15.22:0/804375926 wait complete. 2024-04-16T16:21:18.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.179+0000 7f0272000640 1 Processor -- start 2024-04-16T16:21:18.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.179+0000 7f0272000640 1 -- start start 2024-04-16T16:21:18.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f0272000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c073110 0x7f026c161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f0272000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c15ea10 0x7f026c14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f0272000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c162710 0x7f026c151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f0272000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f026c15edf0 con 0x7f026c162710 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f0272000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f026c0ae860 con 0x7f026c15ea10 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f0272000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f026c15ef70 con 0x7f026c073110 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f026be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c162710 0x7f026c151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f026be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c162710 0x7f026c151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38106/0 (socket says 172.21.15.22:38106) 2024-04-16T16:21:18.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.180+0000 7f026be00640 1 -- 172.21.15.22:0/900868667 learned_addr learned my addr 172.21.15.22:0/900868667 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026b400640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c073110 0x7f026c161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026be00640 1 -- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c073110 msgr2=0x7f026c161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f0262a00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c15ea10 0x7f026c14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026be00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c073110 0x7f026c161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026be00640 1 -- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c15ea10 msgr2=0x7f026c14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026be00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c15ea10 0x7f026c14ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026be00640 1 -- 172.21.15.22:0/900868667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c1f5180 con 0x7f026c162710 2024-04-16T16:21:18.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026b400640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c073110 0x7f026c161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T16:21:18.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f026be00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c162710 0x7f026c151860 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f026400c6d0 tx=0x7f026400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.181+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264018070 con 0x7f026c162710 2024-04-16T16:21:18.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.182+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0264004d60 con 0x7f026c162710 2024-04-16T16:21:18.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.182+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400a880 con 0x7f026c162710 2024-04-16T16:21:18.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.182+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c1f5440 con 0x7f026c162710 2024-04-16T16:21:18.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.182+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c1f5a00 con 0x7f026c162710 2024-04-16T16:21:18.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.183+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f026c15e570 con 0x7f026c162710 2024-04-16T16:21:18.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.184+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f026401b070 con 0x7f026c162710 2024-04-16T16:21:18.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.185+0000 7f0263e00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f024806ce90 0x7f024806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.185+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7f026408bd50 con 0x7f026c162710 2024-04-16T16:21:18.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.185+0000 7f026b400640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f024806ce90 0x7f024806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.185+0000 7f0263e00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7f0248075130 0x7f0248077550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.185+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 --> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0248077c00 con 0x7f0248075130 2024-04-16T16:21:18.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.185+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f0264092020 con 0x7f026c162710 2024-04-16T16:21:18.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.186+0000 7f026b400640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f024806ce90 0x7f024806f350 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f025c006fd0 tx=0x7f025c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.186+0000 7f0262a00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7f0248075130 0x7f0248077550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.187+0000 7f0262a00640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7f0248075130 0x7f0248077550 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.189+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== osd.7 v2:172.21.15.43:6821/355389441 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0248077c00 con 0x7f0248075130 2024-04-16T16:21:18.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.203+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 --> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f026c04fd90 con 0x7f0248075130 2024-04-16T16:21:18.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.204+0000 7f0263e00640 1 -- 172.21.15.22:0/900868667 <== osd.7 v2:172.21.15.43:6821/355389441 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f026c04fd90 con 0x7f0248075130 2024-04-16T16:21:18.204 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-16T16:21:18.204 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T16:21:18.205 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.205+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7f0248075130 msgr2=0x7f0248077550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.205+0000 7f0272000640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.43:6821/355389441,v1:172.21.15.43:6823/355389441] conn(0x7f0248075130 0x7f0248077550 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.205+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f024806ce90 msgr2=0x7f024806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.205+0000 7f0272000640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f024806ce90 0x7f024806f350 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f025c006fd0 tx=0x7f025c008040 comp rx=0 tx=0).stop 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.205+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c162710 msgr2=0x7f026c151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.205+0000 7f0272000640 1 --2- 172.21.15.22:0/900868667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c162710 0x7f026c151860 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f026400c6d0 tx=0x7f026400cb90 comp rx=0 tx=0).stop 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.205+0000 7f026be00640 1 -- 172.21.15.22:0/900868667 reap_dead start 2024-04-16T16:21:18.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.206+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 shutdown_connections 2024-04-16T16:21:18.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.206+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 >> 172.21.15.22:0/900868667 conn(0x7f026c062440 msgr2=0x7f026c071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:18.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.206+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 shutdown_connections 2024-04-16T16:21:18.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.206+0000 7f0272000640 1 -- 172.21.15.22:0/900868667 wait complete. 2024-04-16T16:21:18.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-16T16:21:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.453+0000 7f57eea00640 1 Processor -- start 2024-04-16T16:21:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.454+0000 7f57eea00640 1 -- start start 2024-04-16T16:21:18.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.455+0000 7f57eea00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f57e80afa60 0x7f57e815be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.455+0000 7f57eea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e806e170 0x7f57e80b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.455+0000 7f57eea00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e8160310 con 0x7f57e80afe40 2024-04-16T16:21:18.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.455+0000 7f57eea00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f57e815c3d0 con 0x7f57e80afa60 2024-04-16T16:21:18.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.455+0000 7f57eea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f57e815c6a0 con 0x7f57e806e170 2024-04-16T16:21:18.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.456+0000 7f57e7e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f57e80afa60 0x7f57e815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.456+0000 7f57eca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e806e170 0x7f57e80b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.456+0000 7f57e7e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f57e80afa60 0x7f57e815be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:33402/0 (socket says 172.21.15.22:33402) 2024-04-16T16:21:18.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.456+0000 7f57e7e00640 1 -- 172.21.15.22:0/4252507883 learned_addr learned my addr 172.21.15.22:0/4252507883 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:18.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.456+0000 7f57df400640 1 --1- 172.21.15.22:0/4252507883 >> v1:172.21.15.43:6789/0 conn(0x7f57e80afe40 0x7f57e815fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.22:41076/0 (socket says 172.21.15.22:41076) 2024-04-16T16:21:18.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.457+0000 7f57e7400640 1 -- 172.21.15.22:0/4252507883 <== mon.1 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823098310 0 0) 0x7f57e8160310 con 0x7f57e80afe40 2024-04-16T16:21:18.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.457+0000 7f57e7400640 1 -- 172.21.15.22:0/4252507883 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57cc005730 con 0x7f57e80afe40 2024-04-16T16:21:18.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.457+0000 7f57eca00640 1 -- 172.21.15.22:0/4252507883 >> v2:172.21.15.43:3300/0 conn(0x7f57e80afa60 msgr2=0x7f57e815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:18.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.457+0000 7f57eca00640 1 --2- 172.21.15.22:0/4252507883 >> v2:172.21.15.43:3300/0 conn(0x7f57e80afa60 0x7f57e815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.457+0000 7f57eca00640 1 -- 172.21.15.22:0/4252507883 >> v1:172.21.15.43:6789/0 conn(0x7f57e80afe40 legacy=0x7f57e815fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.457+0000 7f57eca00640 1 -- 172.21.15.22:0/4252507883 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e815c980 con 0x7f57e806e170 2024-04-16T16:21:18.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.457+0000 7f57e7e00640 1 --2- 172.21.15.22:0/4252507883 >> v2:172.21.15.43:3300/0 conn(0x7f57e80afa60 0x7f57e815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T16:21:18.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.460+0000 7f57eca00640 1 --2- 172.21.15.22:0/4252507883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e806e170 0x7f57e80b4230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009d90 tx=0x7f57e002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6b0e270b33cedd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.461+0000 7f57e7400640 1 -- 172.21.15.22:0/4252507883 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0039070 con 0x7f57e806e170 2024-04-16T16:21:18.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.461+0000 7f57e7400640 1 -- 172.21.15.22:0/4252507883 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e002cc50 con 0x7f57e806e170 2024-04-16T16:21:18.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.461+0000 7f57e7400640 1 -- 172.21.15.22:0/4252507883 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0034440 con 0x7f57e806e170 2024-04-16T16:21:18.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.461+0000 7f57eea00640 1 -- 172.21.15.22:0/4252507883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e806e170 msgr2=0x7f57e80b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.461+0000 7f57eea00640 1 --2- 172.21.15.22:0/4252507883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e806e170 0x7f57e80b4230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009d90 tx=0x7f57e002bea0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.462+0000 7f57eea00640 1 -- 172.21.15.22:0/4252507883 shutdown_connections 2024-04-16T16:21:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.462+0000 7f57eea00640 1 --2- 172.21.15.22:0/4252507883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e806e170 0x7f57e80b4230 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.462+0000 7f57eea00640 1 --2- 172.21.15.22:0/4252507883 >> v2:172.21.15.43:3300/0 conn(0x7f57e80afa60 0x7f57e815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.462+0000 7f57eea00640 1 -- 172.21.15.22:0/4252507883 >> 172.21.15.22:0/4252507883 conn(0x7f57e8062440 msgr2=0x7f57e8062850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.462+0000 7f57eea00640 1 -- 172.21.15.22:0/4252507883 shutdown_connections 2024-04-16T16:21:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.462+0000 7f57eea00640 1 -- 172.21.15.22:0/4252507883 wait complete. 2024-04-16T16:21:18.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.464+0000 7f57eea00640 1 Processor -- start 2024-04-16T16:21:18.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.464+0000 7f57eea00640 1 -- start start 2024-04-16T16:21:18.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57eea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e806e170 0x7f57e8154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57eea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e80afa60 0x7f57e80ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57eea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e80afe40 0x7f57e815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57eea00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57e80b4770 con 0x7f57e80afa60 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57eea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57e815f6e0 con 0x7f57e806e170 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57eea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f57e80b48f0 con 0x7f57e80afe40 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57df400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e80afa60 0x7f57e80ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57df400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e80afa60 0x7f57e80ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38108/0 (socket says 172.21.15.22:38108) 2024-04-16T16:21:18.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.465+0000 7f57df400640 1 -- 172.21.15.22:0/351495887 learned_addr learned my addr 172.21.15.22:0/351495887 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57e7e00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e806e170 0x7f57e8154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57eca00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e80afe40 0x7f57e815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57df400640 1 -- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e80afe40 msgr2=0x7f57e815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57df400640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e80afe40 0x7f57e815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57df400640 1 -- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e806e170 msgr2=0x7f57e8154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57df400640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e806e170 0x7f57e8154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57df400640 1 -- 172.21.15.22:0/351495887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e8155370 con 0x7f57e80afa60 2024-04-16T16:21:18.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.466+0000 7f57df400640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e80afa60 0x7f57e80ce0b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f57d000c410 tx=0x7f57d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.467+0000 7f57e4c00640 1 -- 172.21.15.22:0/351495887 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d00074e0 con 0x7f57e80afa60 2024-04-16T16:21:18.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.467+0000 7f57e4c00640 1 -- 172.21.15.22:0/351495887 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d0007680 con 0x7f57e80afa60 2024-04-16T16:21:18.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.467+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e8155610 con 0x7f57e80afa60 2024-04-16T16:21:18.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.467+0000 7f57e4c00640 1 -- 172.21.15.22:0/351495887 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d00049e0 con 0x7f57e80afa60 2024-04-16T16:21:18.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.467+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e80cd8b0 con 0x7f57e80afa60 2024-04-16T16:21:18.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.468+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e804fd90 con 0x7f57e80afa60 2024-04-16T16:21:18.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.469+0000 7f57e4c00640 1 -- 172.21.15.22:0/351495887 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7f57d001a020 con 0x7f57e80afa60 2024-04-16T16:21:18.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.470+0000 7f57e4c00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f57c406ce90 0x7f57c406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.470+0000 7f57e4c00640 1 -- 172.21.15.22:0/351495887 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7f57d008be50 con 0x7f57e80afa60 2024-04-16T16:21:18.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.470+0000 7f57e7e00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f57c406ce90 0x7f57c406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.471+0000 7f57e7e00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f57c406ce90 0x7f57c406f350 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f57e815eca0 tx=0x7f57d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.475+0000 7f57e4c00640 1 -- 172.21.15.22:0/351495887 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f57d0010300 con 0x7f57e80afa60 2024-04-16T16:21:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.683+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f57e80b4230 con 0x7f57c406ce90 2024-04-16T16:21:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.684+0000 7f57e4c00640 1 -- 172.21.15.22:0/351495887 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57e80b4230 con 0x7f57c406ce90 2024-04-16T16:21:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 7 to deep-scrub 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.686+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f57c406ce90 msgr2=0x7f57c406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.686+0000 7f57eea00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f57c406ce90 0x7f57c406f350 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f57e815eca0 tx=0x7f57d8008040 comp rx=0 tx=0).stop 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e80afa60 msgr2=0x7f57e80ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e80afa60 0x7f57e80ce0b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f57d000c410 tx=0x7f57d000c8d0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 shutdown_connections 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7f57c406ce90 0x7f57c406f350 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f57e80afe40 0x7f57e815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e80afa60 0x7f57e80ce0b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 --2- 172.21.15.22:0/351495887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e806e170 0x7f57e8154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 >> 172.21.15.22:0/351495887 conn(0x7f57e8062440 msgr2=0x7f57e8154650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 shutdown_connections 2024-04-16T16:21:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.687+0000 7f57eea00640 1 -- 172.21.15.22:0/351495887 wait complete. 2024-04-16T16:21:18.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:18.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.929+0000 7fc615c00640 1 Processor -- start 2024-04-16T16:21:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.929+0000 7fc615c00640 1 -- start start 2024-04-16T16:21:18.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.930+0000 7fc615c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 0x7fc610072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.930+0000 7fc615c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc61006dc80 0x7fc6100d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.930+0000 7fc615c00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6101606d0 con 0x7fc610073050 2024-04-16T16:21:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.930+0000 7fc615c00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc610160480 con 0x7fc61006dc80 2024-04-16T16:21:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.930+0000 7fc615c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc6101609b0 con 0x7fc6100afd90 2024-04-16T16:21:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.931+0000 7fc607e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc61006dc80 0x7fc6100d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.931+0000 7fc607e00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc61006dc80 0x7fc6100d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38120/0 (socket says 172.21.15.22:38120) 2024-04-16T16:21:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.931+0000 7fc607e00640 1 -- 172.21.15.22:0/960335235 learned_addr learned my addr 172.21.15.22:0/960335235 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.931+0000 7fc607e00640 1 -- 172.21.15.22:0/960335235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 msgr2=0x7fc610072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.931+0000 7fc607e00640 1 --2- 172.21.15.22:0/960335235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 0x7fc610072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.931+0000 7fc607e00640 1 -- 172.21.15.22:0/960335235 >> v1:172.21.15.43:6789/0 conn(0x7fc610073050 legacy=0x7fc610071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.931+0000 7fc607e00640 1 -- 172.21.15.22:0/960335235 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc610160c90 con 0x7fc61006dc80 2024-04-16T16:21:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.932+0000 7fc607e00640 1 --2- 172.21.15.22:0/960335235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc61006dc80 0x7fc6100d0600 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009870 tx=0x7fc5f802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ec27c5e69fe066 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.933+0000 7fc60e000640 1 -- 172.21.15.22:0/960335235 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80317c0 con 0x7fc61006dc80 2024-04-16T16:21:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.933+0000 7fc60e000640 1 -- 172.21.15.22:0/960335235 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f8037070 con 0x7fc61006dc80 2024-04-16T16:21:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.933+0000 7fc60e000640 1 -- 172.21.15.22:0/960335235 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8031b80 con 0x7fc61006dc80 2024-04-16T16:21:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.933+0000 7fc615c00640 1 -- 172.21.15.22:0/960335235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc61006dc80 msgr2=0x7fc6100d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.933+0000 7fc615c00640 1 --2- 172.21.15.22:0/960335235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc61006dc80 0x7fc6100d0600 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009870 tx=0x7fc5f802b860 comp rx=0 tx=0).stop 2024-04-16T16:21:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.934+0000 7fc615c00640 1 -- 172.21.15.22:0/960335235 shutdown_connections 2024-04-16T16:21:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.934+0000 7fc615c00640 1 --2- 172.21.15.22:0/960335235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc61006dc80 0x7fc6100d0600 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.934+0000 7fc615c00640 1 --2- 172.21.15.22:0/960335235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 0x7fc610072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.934+0000 7fc615c00640 1 -- 172.21.15.22:0/960335235 >> 172.21.15.22:0/960335235 conn(0x7fc610062440 msgr2=0x7fc610062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.934+0000 7fc615c00640 1 -- 172.21.15.22:0/960335235 shutdown_connections 2024-04-16T16:21:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.934+0000 7fc615c00640 1 -- 172.21.15.22:0/960335235 wait complete. 2024-04-16T16:21:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.935+0000 7fc615c00640 1 Processor -- start 2024-04-16T16:21:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.935+0000 7fc615c00640 1 -- start start 2024-04-16T16:21:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.936+0000 7fc615c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc61006dc80 0x7fc6100b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.936+0000 7fc615c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc610073050 0x7fc6100b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.936+0000 7fc615c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 0x7fc61014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.936+0000 7fc615c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6100ce8a0 con 0x7fc610073050 2024-04-16T16:21:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.936+0000 7fc615c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6100b0170 con 0x7fc61006dc80 2024-04-16T16:21:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.936+0000 7fc615c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc6100cea20 con 0x7fc6100afd90 2024-04-16T16:21:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc610073050 0x7fc6100b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc610073050 0x7fc6100b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38122/0 (socket says 172.21.15.22:38122) 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 -- 172.21.15.22:0/4084111522 learned_addr learned my addr 172.21.15.22:0/4084111522 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc60ea00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc61006dc80 0x7fc6100b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 -- 172.21.15.22:0/4084111522 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 msgr2=0x7fc61014c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 0x7fc61014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 -- 172.21.15.22:0/4084111522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc61006dc80 msgr2=0x7fc6100b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc61006dc80 0x7fc6100b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.937+0000 7fc607e00640 1 -- 172.21.15.22:0/4084111522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61014d6f0 con 0x7fc610073050 2024-04-16T16:21:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.938+0000 7fc607e00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc610073050 0x7fc6100b08c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009870 tx=0x7fc5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.938+0000 7fc606a00640 1 -- 172.21.15.22:0/4084111522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8032860 con 0x7fc610073050 2024-04-16T16:21:18.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.938+0000 7fc606a00640 1 -- 172.21.15.22:0/4084111522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f8032a00 con 0x7fc610073050 2024-04-16T16:21:18.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.938+0000 7fc606a00640 1 -- 172.21.15.22:0/4084111522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8032df0 con 0x7fc610073050 2024-04-16T16:21:18.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.938+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6100b25f0 con 0x7fc610073050 2024-04-16T16:21:18.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.938+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6100b2e90 con 0x7fc610073050 2024-04-16T16:21:18.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.939+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61004fd90 con 0x7fc610073050 2024-04-16T16:21:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.940+0000 7fc606a00640 1 -- 172.21.15.22:0/4084111522 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fc5f804c060 con 0x7fc610073050 2024-04-16T16:21:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.941+0000 7fc606a00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5ec06ce90 0x7fc5ec06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.941+0000 7fc606a00640 1 -- 172.21.15.22:0/4084111522 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fc5f80ae500 con 0x7fc610073050 2024-04-16T16:21:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.941+0000 7fc60ea00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5ec06ce90 0x7fc5ec06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:18.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.942+0000 7fc60ea00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5ec06ce90 0x7fc5ec06f350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b810 tx=0x7fc600008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:18.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:18.946+0000 7fc606a00640 1 -- 172.21.15.22:0/4084111522 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5f8040070 con 0x7fc610073050 2024-04-16T16:21:19.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.148+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6100b2980 con 0x7fc5ec06ce90 2024-04-16T16:21:19.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.156+0000 7fc606a00640 1 -- 172.21.15.22:0/4084111522 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251062 (secure 0 0 0) 0x7fc6100b2980 con 0x7fc5ec06ce90 2024-04-16T16:21:19.159 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:19.160 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:19.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5ec06ce90 msgr2=0x7fc5ec06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:19.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5ec06ce90 0x7fc5ec06f350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b810 tx=0x7fc600008040 comp rx=0 tx=0).stop 2024-04-16T16:21:19.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc610073050 msgr2=0x7fc6100b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:19.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc610073050 0x7fc6100b08c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009870 tx=0x7fc5f80046c0 comp rx=0 tx=0).stop 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 shutdown_connections 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc5ec06ce90 0x7fc5ec06f350 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6100afd90 0x7fc61014c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc610073050 0x7fc6100b08c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 --2- 172.21.15.22:0/4084111522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc61006dc80 0x7fc6100b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 >> 172.21.15.22:0/4084111522 conn(0x7fc610062440 msgr2=0x7fc61015dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 shutdown_connections 2024-04-16T16:21:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:19.161+0000 7fc615c00640 1 -- 172.21.15.22:0/4084111522 wait complete. 2024-04-16T16:21:19.180 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-04-16T16:21:17.799202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256584,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718136,"statfs":{"total":773094113280,"available":772831371264,"internally_reserved":0,"allocated":7315456,"data_stored":3746068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003824"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.527940+0000","last_change":"2024-04-16T16:20:56.700692+0000","last_active":"2024-04-16T16:21:12.527940+0000","last_peered":"2024-04-16T16:21:12.527940+0000","last_clean":"2024-04-16T16:21:12.527940+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:21:12.527940+0000","last_undegraded":"2024-04-16T16:21:12.527940+0000","last_fullsized":"2024-04-16T16:21:12.527940+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:01.405645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535125+0000","last_change":"2024-04-16T16:20:56.704487+0000","last_active":"2024-04-16T16:21:12.535125+0000","last_peered":"2024-04-16T16:21:12.535125+0000","last_clean":"2024-04-16T16:21:12.535125+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:21:12.535125+0000","last_undegraded":"2024-04-16T16:21:12.535125+0000","last_fullsized":"2024-04-16T16:21:12.535125+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:18.892594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539516+0000","last_change":"2024-04-16T16:20:56.710584+0000","last_active":"2024-04-16T16:21:12.539516+0000","last_peered":"2024-04-16T16:21:12.539516+0000","last_clean":"2024-04-16T16:21:12.539516+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:21:12.539516+0000","last_undegraded":"2024-04-16T16:21:12.539516+0000","last_fullsized":"2024-04-16T16:21:12.539516+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540906+0000","last_change":"2024-04-16T16:20:56.694479+0000","last_active":"2024-04-16T16:21:12.540906+0000","last_peered":"2024-04-16T16:21:12.540906+0000","last_clean":"2024-04-16T16:21:12.540906+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:21:12.540906+0000","last_undegraded":"2024-04-16T16:21:12.540906+0000","last_fullsized":"2024-04-16T16:21:12.540906+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.527726+0000","last_change":"2024-04-16T16:20:56.687650+0000","last_active":"2024-04-16T16:21:12.527726+0000","last_peered":"2024-04-16T16:21:12.527726+0000","last_clean":"2024-04-16T16:21:12.527726+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:21:12.527726+0000","last_undegraded":"2024-04-16T16:21:12.527726+0000","last_fullsized":"2024-04-16T16:21:12.527726+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:24.566878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534353+0000","last_change":"2024-04-16T16:20:56.696467+0000","last_active":"2024-04-16T16:21:12.534353+0000","last_peered":"2024-04-16T16:21:12.534353+0000","last_clean":"2024-04-16T16:21:12.534353+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:21:12.534353+0000","last_undegraded":"2024-04-16T16:21:12.534353+0000","last_fullsized":"2024-04-16T16:21:12.534353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.529513+0000","last_change":"2024-04-16T16:20:56.702871+0000","last_active":"2024-04-16T16:21:12.529513+0000","last_peered":"2024-04-16T16:21:12.529513+0000","last_clean":"2024-04-16T16:21:12.529513+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:21:12.529513+0000","last_undegraded":"2024-04-16T16:21:12.529513+0000","last_fullsized":"2024-04-16T16:21:12.529513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:35.579815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.533831+0000","last_change":"2024-04-16T16:20:56.711962+0000","last_active":"2024-04-16T16:21:12.533831+0000","last_peered":"2024-04-16T16:21:12.533831+0000","last_clean":"2024-04-16T16:21:12.533831+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:21:12.533831+0000","last_undegraded":"2024-04-16T16:21:12.533831+0000","last_fullsized":"2024-04-16T16:21:12.533831+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:34.290551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.531022+0000","last_change":"2024-04-16T16:20:56.704993+0000","last_active":"2024-04-16T16:21:12.531022+0000","last_peered":"2024-04-16T16:21:12.531022+0000","last_clean":"2024-04-16T16:21:12.531022+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:21:12.531022+0000","last_undegraded":"2024-04-16T16:21:12.531022+0000","last_fullsized":"2024-04-16T16:21:12.531022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:04.365135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.546196+0000","last_change":"2024-04-16T16:20:56.713889+0000","last_active":"2024-04-16T16:21:12.546196+0000","last_peered":"2024-04-16T16:21:12.546196+0000","last_clean":"2024-04-16T16:21:12.546196+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:21:12.546196+0000","last_undegraded":"2024-04-16T16:21:12.546196+0000","last_fullsized":"2024-04-16T16:21:12.546196+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.546258+0000","last_change":"2024-04-16T16:20:56.703335+0000","last_active":"2024-04-16T16:21:12.546258+0000","last_peered":"2024-04-16T16:21:12.546258+0000","last_clean":"2024-04-16T16:21:12.546258+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:21:12.546258+0000","last_undegraded":"2024-04-16T16:21:12.546258+0000","last_fullsized":"2024-04-16T16:21:12.546258+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541059+0000","last_change":"2024-04-16T16:20:56.702421+0000","last_active":"2024-04-16T16:21:12.541059+0000","last_peered":"2024-04-16T16:21:12.541059+0000","last_clean":"2024-04-16T16:21:12.541059+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:21:12.541059+0000","last_undegraded":"2024-04-16T16:21:12.541059+0000","last_fullsized":"2024-04-16T16:21:12.541059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530752+0000","last_change":"2024-04-16T16:20:56.705792+0000","last_active":"2024-04-16T16:21:12.530752+0000","last_peered":"2024-04-16T16:21:12.530752+0000","last_clean":"2024-04-16T16:21:12.530752+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:21:12.530752+0000","last_undegraded":"2024-04-16T16:21:12.530752+0000","last_fullsized":"2024-04-16T16:21:12.530752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:18.850576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530440+0000","last_change":"2024-04-16T16:20:56.700768+0000","last_active":"2024-04-16T16:21:12.530440+0000","last_peered":"2024-04-16T16:21:12.530440+0000","last_clean":"2024-04-16T16:21:12.530440+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:21:12.530440+0000","last_undegraded":"2024-04-16T16:21:12.530440+0000","last_fullsized":"2024-04-16T16:21:12.530440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:33.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530058+0000","last_change":"2024-04-16T16:20:56.699692+0000","last_active":"2024-04-16T16:21:12.530058+0000","last_peered":"2024-04-16T16:21:12.530058+0000","last_clean":"2024-04-16T16:21:12.530058+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:21:12.530058+0000","last_undegraded":"2024-04-16T16:21:12.530058+0000","last_fullsized":"2024-04-16T16:21:12.530058+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:41.724981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534455+0000","last_change":"2024-04-16T16:20:56.716792+0000","last_active":"2024-04-16T16:21:12.534455+0000","last_peered":"2024-04-16T16:21:12.534455+0000","last_clean":"2024-04-16T16:21:12.534455+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:21:12.534455+0000","last_undegraded":"2024-04-16T16:21:12.534455+0000","last_fullsized":"2024-04-16T16:21:12.534455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535031+0000","last_change":"2024-04-16T16:20:56.709293+0000","last_active":"2024-04-16T16:21:12.535031+0000","last_peered":"2024-04-16T16:21:12.535031+0000","last_clean":"2024-04-16T16:21:12.535031+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:21:12.535031+0000","last_undegraded":"2024-04-16T16:21:12.535031+0000","last_fullsized":"2024-04-16T16:21:12.535031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:47.440922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541076+0000","last_change":"2024-04-16T16:20:56.722078+0000","last_active":"2024-04-16T16:21:12.541076+0000","last_peered":"2024-04-16T16:21:12.541076+0000","last_clean":"2024-04-16T16:21:12.541076+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:21:12.541076+0000","last_undegraded":"2024-04-16T16:21:12.541076+0000","last_fullsized":"2024-04-16T16:21:12.541076+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:30.848600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.527854+0000","last_change":"2024-04-16T16:20:56.703752+0000","last_active":"2024-04-16T16:21:12.527854+0000","last_peered":"2024-04-16T16:21:12.527854+0000","last_clean":"2024-04-16T16:21:12.527854+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:21:12.527854+0000","last_undegraded":"2024-04-16T16:21:12.527854+0000","last_fullsized":"2024-04-16T16:21:12.527854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:32.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534621+0000","last_change":"2024-04-16T16:20:56.718849+0000","last_active":"2024-04-16T16:21:12.534621+0000","last_peered":"2024-04-16T16:21:12.534621+0000","last_clean":"2024-04-16T16:21:12.534621+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:21:12.534621+0000","last_undegraded":"2024-04-16T16:21:12.534621+0000","last_fullsized":"2024-04-16T16:21:12.534621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.829545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539800+0000","last_change":"2024-04-16T16:20:56.715256+0000","last_active":"2024-04-16T16:21:12.539800+0000","last_peered":"2024-04-16T16:21:12.539800+0000","last_clean":"2024-04-16T16:21:12.539800+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:21:12.539800+0000","last_undegraded":"2024-04-16T16:21:12.539800+0000","last_fullsized":"2024-04-16T16:21:12.539800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534027+0000","last_change":"2024-04-16T16:20:56.703517+0000","last_active":"2024-04-16T16:21:12.534027+0000","last_peered":"2024-04-16T16:21:12.534027+0000","last_clean":"2024-04-16T16:21:12.534027+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:21:12.534027+0000","last_undegraded":"2024-04-16T16:21:12.534027+0000","last_fullsized":"2024-04-16T16:21:12.534027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:28.081709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539029+0000","last_change":"2024-04-16T16:20:56.719987+0000","last_active":"2024-04-16T16:21:12.539029+0000","last_peered":"2024-04-16T16:21:12.539029+0000","last_clean":"2024-04-16T16:21:12.539029+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:21:12.539029+0000","last_undegraded":"2024-04-16T16:21:12.539029+0000","last_fullsized":"2024-04-16T16:21:12.539029+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.529176+0000","last_change":"2024-04-16T16:20:56.720302+0000","last_active":"2024-04-16T16:21:12.529176+0000","last_peered":"2024-04-16T16:21:12.529176+0000","last_clean":"2024-04-16T16:21:12.529176+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:21:12.529176+0000","last_undegraded":"2024-04-16T16:21:12.529176+0000","last_fullsized":"2024-04-16T16:21:12.529176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:44.839546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.528080+0000","last_change":"2024-04-16T16:20:56.711031+0000","last_active":"2024-04-16T16:21:12.528080+0000","last_peered":"2024-04-16T16:21:12.528080+0000","last_clean":"2024-04-16T16:21:12.528080+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:21:12.528080+0000","last_undegraded":"2024-04-16T16:21:12.528080+0000","last_fullsized":"2024-04-16T16:21:12.528080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:45:24.434925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541769+0000","last_change":"2024-04-16T16:20:56.699535+0000","last_active":"2024-04-16T16:21:12.541769+0000","last_peered":"2024-04-16T16:21:12.541769+0000","last_clean":"2024-04-16T16:21:12.541769+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:21:12.541769+0000","last_undegraded":"2024-04-16T16:21:12.541769+0000","last_fullsized":"2024-04-16T16:21:12.541769+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534731+0000","last_change":"2024-04-16T16:20:56.716226+0000","last_active":"2024-04-16T16:21:12.534731+0000","last_peered":"2024-04-16T16:21:12.534731+0000","last_clean":"2024-04-16T16:21:12.534731+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:21:12.534731+0000","last_undegraded":"2024-04-16T16:21:12.534731+0000","last_fullsized":"2024-04-16T16:21:12.534731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.527851+0000","last_change":"2024-04-16T16:20:56.690730+0000","last_active":"2024-04-16T16:21:12.527851+0000","last_peered":"2024-04-16T16:21:12.527851+0000","last_clean":"2024-04-16T16:21:12.527851+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:21:12.527851+0000","last_undegraded":"2024-04-16T16:21:12.527851+0000","last_fullsized":"2024-04-16T16:21:12.527851+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:22.566150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534449+0000","last_change":"2024-04-16T16:20:56.708786+0000","last_active":"2024-04-16T16:21:12.534449+0000","last_peered":"2024-04-16T16:21:12.534449+0000","last_clean":"2024-04-16T16:21:12.534449+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:21:12.534449+0000","last_undegraded":"2024-04-16T16:21:12.534449+0000","last_fullsized":"2024-04-16T16:21:12.534449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:07:51.397773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539091+0000","last_change":"2024-04-16T16:20:56.720038+0000","last_active":"2024-04-16T16:21:12.539091+0000","last_peered":"2024-04-16T16:21:12.539091+0000","last_clean":"2024-04-16T16:21:12.539091+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:21:12.539091+0000","last_undegraded":"2024-04-16T16:21:12.539091+0000","last_fullsized":"2024-04-16T16:21:12.539091+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:29.067549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.527528+0000","last_change":"2024-04-16T16:20:56.706135+0000","last_active":"2024-04-16T16:21:12.527528+0000","last_peered":"2024-04-16T16:21:12.527528+0000","last_clean":"2024-04-16T16:21:12.527528+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:21:12.527528+0000","last_undegraded":"2024-04-16T16:21:12.527528+0000","last_fullsized":"2024-04-16T16:21:12.527528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:10:18.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534537+0000","last_change":"2024-04-16T16:20:56.707138+0000","last_active":"2024-04-16T16:21:12.534537+0000","last_peered":"2024-04-16T16:21:12.534537+0000","last_clean":"2024-04-16T16:21:12.534537+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:21:12.534537+0000","last_undegraded":"2024-04-16T16:21:12.534537+0000","last_fullsized":"2024-04-16T16:21:12.534537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534687+0000","last_change":"2024-04-16T16:20:56.714674+0000","last_active":"2024-04-16T16:21:12.534687+0000","last_peered":"2024-04-16T16:21:12.534687+0000","last_clean":"2024-04-16T16:21:12.534687+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:21:12.534687+0000","last_undegraded":"2024-04-16T16:21:12.534687+0000","last_fullsized":"2024-04-16T16:21:12.534687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'5","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.550532+0000","last_change":"2024-04-16T16:20:55.704083+0000","last_active":"2024-04-16T16:21:12.550532+0000","last_peered":"2024-04-16T16:21:12.550532+0000","last_clean":"2024-04-16T16:21:12.550532+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:21:12.550532+0000","last_undegraded":"2024-04-16T16:21:12.550532+0000","last_fullsized":"2024-04-16T16:21:12.550532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.546445+0000","last_change":"2024-04-16T16:20:56.716868+0000","last_active":"2024-04-16T16:21:12.546445+0000","last_peered":"2024-04-16T16:21:12.546445+0000","last_clean":"2024-04-16T16:21:12.546445+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:21:12.546445+0000","last_undegraded":"2024-04-16T16:21:12.546445+0000","last_fullsized":"2024-04-16T16:21:12.546445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534933+0000","last_change":"2024-04-16T16:20:55.700645+0000","last_active":"2024-04-16T16:21:12.534933+0000","last_peered":"2024-04-16T16:21:12.534933+0000","last_clean":"2024-04-16T16:21:12.534933+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:21:12.534933+0000","last_undegraded":"2024-04-16T16:21:12.534933+0000","last_fullsized":"2024-04-16T16:21:12.534933+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:54:56.588790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535359+0000","last_change":"2024-04-16T16:20:56.717040+0000","last_active":"2024-04-16T16:21:12.535359+0000","last_peered":"2024-04-16T16:21:12.535359+0000","last_clean":"2024-04-16T16:21:12.535359+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:21:12.535359+0000","last_undegraded":"2024-04-16T16:21:12.535359+0000","last_fullsized":"2024-04-16T16:21:12.535359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535162+0000","last_change":"2024-04-16T16:20:55.698501+0000","last_active":"2024-04-16T16:21:12.535162+0000","last_peered":"2024-04-16T16:21:12.535162+0000","last_clean":"2024-04-16T16:21:12.535162+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:21:12.535162+0000","last_undegraded":"2024-04-16T16:21:12.535162+0000","last_fullsized":"2024-04-16T16:21:12.535162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534872+0000","last_change":"2024-04-16T16:20:56.708709+0000","last_active":"2024-04-16T16:21:12.534872+0000","last_peered":"2024-04-16T16:21:12.534872+0000","last_clean":"2024-04-16T16:21:12.534872+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:21:12.534872+0000","last_undegraded":"2024-04-16T16:21:12.534872+0000","last_fullsized":"2024-04-16T16:21:12.534872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541064+0000","last_change":"2024-04-16T16:20:55.703384+0000","last_active":"2024-04-16T16:21:12.541064+0000","last_peered":"2024-04-16T16:21:12.541064+0000","last_clean":"2024-04-16T16:21:12.541064+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:21:12.541064+0000","last_undegraded":"2024-04-16T16:21:12.541064+0000","last_fullsized":"2024-04-16T16:21:12.541064+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:11:49.472284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534147+0000","last_change":"2024-04-16T16:20:56.703273+0000","last_active":"2024-04-16T16:21:12.534147+0000","last_peered":"2024-04-16T16:21:12.534147+0000","last_clean":"2024-04-16T16:21:12.534147+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:21:12.534147+0000","last_undegraded":"2024-04-16T16:21:12.534147+0000","last_fullsized":"2024-04-16T16:21:12.534147+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:37.220892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530704+0000","last_change":"2024-04-16T16:20:55.688230+0000","last_active":"2024-04-16T16:21:12.530704+0000","last_peered":"2024-04-16T16:21:12.530704+0000","last_clean":"2024-04-16T16:21:12.530704+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:21:12.530704+0000","last_undegraded":"2024-04-16T16:21:12.530704+0000","last_fullsized":"2024-04-16T16:21:12.530704+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:04.947108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534310+0000","last_change":"2024-04-16T16:20:56.706317+0000","last_active":"2024-04-16T16:21:12.534310+0000","last_peered":"2024-04-16T16:21:12.534310+0000","last_clean":"2024-04-16T16:21:12.534310+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:21:12.534310+0000","last_undegraded":"2024-04-16T16:21:12.534310+0000","last_fullsized":"2024-04-16T16:21:12.534310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:18.555574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'2","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.550540+0000","last_change":"2024-04-16T16:20:55.703837+0000","last_active":"2024-04-16T16:21:12.550540+0000","last_peered":"2024-04-16T16:21:12.550540+0000","last_clean":"2024-04-16T16:21:12.550540+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:21:12.550540+0000","last_undegraded":"2024-04-16T16:21:12.550540+0000","last_fullsized":"2024-04-16T16:21:12.550540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.529488+0000","last_change":"2024-04-16T16:20:56.716680+0000","last_active":"2024-04-16T16:21:12.529488+0000","last_peered":"2024-04-16T16:21:12.529488+0000","last_clean":"2024-04-16T16:21:12.529488+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:21:12.529488+0000","last_undegraded":"2024-04-16T16:21:12.529488+0000","last_fullsized":"2024-04-16T16:21:12.529488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:02.372706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541500+0000","last_change":"2024-04-16T16:20:55.699938+0000","last_active":"2024-04-16T16:21:12.541500+0000","last_peered":"2024-04-16T16:21:12.541500+0000","last_clean":"2024-04-16T16:21:12.541500+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:21:12.541500+0000","last_undegraded":"2024-04-16T16:21:12.541500+0000","last_fullsized":"2024-04-16T16:21:12.541500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.533921+0000","last_change":"2024-04-16T16:20:56.709848+0000","last_active":"2024-04-16T16:21:12.533921+0000","last_peered":"2024-04-16T16:21:12.533921+0000","last_clean":"2024-04-16T16:21:12.533921+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:21:12.533921+0000","last_undegraded":"2024-04-16T16:21:12.533921+0000","last_fullsized":"2024-04-16T16:21:12.533921+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:46.864304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530340+0000","last_change":"2024-04-16T16:20:55.695386+0000","last_active":"2024-04-16T16:21:12.530340+0000","last_peered":"2024-04-16T16:21:12.530340+0000","last_clean":"2024-04-16T16:21:12.530340+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:21:12.530340+0000","last_undegraded":"2024-04-16T16:21:12.530340+0000","last_fullsized":"2024-04-16T16:21:12.530340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530869+0000","last_change":"2024-04-16T16:20:56.702662+0000","last_active":"2024-04-16T16:21:12.530869+0000","last_peered":"2024-04-16T16:21:12.530869+0000","last_clean":"2024-04-16T16:21:12.530869+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:21:12.530869+0000","last_undegraded":"2024-04-16T16:21:12.530869+0000","last_fullsized":"2024-04-16T16:21:12.530869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:49.017708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539995+0000","last_change":"2024-04-16T16:20:55.703623+0000","last_active":"2024-04-16T16:21:12.539995+0000","last_peered":"2024-04-16T16:21:12.539995+0000","last_clean":"2024-04-16T16:21:12.539995+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:21:12.539995+0000","last_undegraded":"2024-04-16T16:21:12.539995+0000","last_fullsized":"2024-04-16T16:21:12.539995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539791+0000","last_change":"2024-04-16T16:20:56.723400+0000","last_active":"2024-04-16T16:21:12.539791+0000","last_peered":"2024-04-16T16:21:12.539791+0000","last_clean":"2024-04-16T16:21:12.539791+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:21:12.539791+0000","last_undegraded":"2024-04-16T16:21:12.539791+0000","last_fullsized":"2024-04-16T16:21:12.539791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:37.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535000+0000","last_change":"2024-04-16T16:20:55.694413+0000","last_active":"2024-04-16T16:21:12.535000+0000","last_peered":"2024-04-16T16:21:12.535000+0000","last_clean":"2024-04-16T16:21:12.535000+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:21:12.535000+0000","last_undegraded":"2024-04-16T16:21:12.535000+0000","last_fullsized":"2024-04-16T16:21:12.535000+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:21.591232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.545838+0000","last_change":"2024-04-16T16:20:56.713278+0000","last_active":"2024-04-16T16:21:12.545838+0000","last_peered":"2024-04-16T16:21:12.545838+0000","last_clean":"2024-04-16T16:21:12.545838+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:21:12.545838+0000","last_undegraded":"2024-04-16T16:21:12.545838+0000","last_fullsized":"2024-04-16T16:21:12.545838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540575+0000","last_change":"2024-04-16T16:20:55.702261+0000","last_active":"2024-04-16T16:21:12.540575+0000","last_peered":"2024-04-16T16:21:12.540575+0000","last_clean":"2024-04-16T16:21:12.540575+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:21:12.540575+0000","last_undegraded":"2024-04-16T16:21:12.540575+0000","last_fullsized":"2024-04-16T16:21:12.540575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539806+0000","last_change":"2024-04-16T16:20:56.712767+0000","last_active":"2024-04-16T16:21:12.539806+0000","last_peered":"2024-04-16T16:21:12.539806+0000","last_clean":"2024-04-16T16:21:12.539806+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:21:12.539806+0000","last_undegraded":"2024-04-16T16:21:12.539806+0000","last_fullsized":"2024-04-16T16:21:12.539806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:51.692774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'7","reported_seq":27,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.545574+0000","last_change":"2024-04-16T16:20:55.697106+0000","last_active":"2024-04-16T16:21:12.545574+0000","last_peered":"2024-04-16T16:21:12.545574+0000","last_clean":"2024-04-16T16:21:12.545574+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:21:12.545574+0000","last_undegraded":"2024-04-16T16:21:12.545574+0000","last_fullsized":"2024-04-16T16:21:12.545574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:13.711852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540153+0000","last_change":"2024-04-16T16:20:56.704028+0000","last_active":"2024-04-16T16:21:12.540153+0000","last_peered":"2024-04-16T16:21:12.540153+0000","last_clean":"2024-04-16T16:21:12.540153+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:21:12.540153+0000","last_undegraded":"2024-04-16T16:21:12.540153+0000","last_fullsized":"2024-04-16T16:21:12.540153+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:32.015311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534383+0000","last_change":"2024-04-16T16:20:55.691499+0000","last_active":"2024-04-16T16:21:12.534383+0000","last_peered":"2024-04-16T16:21:12.534383+0000","last_clean":"2024-04-16T16:21:12.534383+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:21:12.534383+0000","last_undegraded":"2024-04-16T16:21:12.534383+0000","last_fullsized":"2024-04-16T16:21:12.534383+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:56:46.276878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540149+0000","last_change":"2024-04-16T16:20:56.718537+0000","last_active":"2024-04-16T16:21:12.540149+0000","last_peered":"2024-04-16T16:21:12.540149+0000","last_clean":"2024-04-16T16:21:12.540149+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:21:12.540149+0000","last_undegraded":"2024-04-16T16:21:12.540149+0000","last_fullsized":"2024-04-16T16:21:12.540149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:58.604083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530129+0000","last_change":"2024-04-16T16:20:55.700778+0000","last_active":"2024-04-16T16:21:12.530129+0000","last_peered":"2024-04-16T16:21:12.530129+0000","last_clean":"2024-04-16T16:21:12.530129+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:21:12.530129+0000","last_undegraded":"2024-04-16T16:21:12.530129+0000","last_fullsized":"2024-04-16T16:21:12.530129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:21.223928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.530071+0000","last_change":"2024-04-16T16:20:56.712943+0000","last_active":"2024-04-16T16:21:12.530071+0000","last_peered":"2024-04-16T16:21:12.530071+0000","last_clean":"2024-04-16T16:21:12.530071+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:21:12.530071+0000","last_undegraded":"2024-04-16T16:21:12.530071+0000","last_fullsized":"2024-04-16T16:21:12.530071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:27.482652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541798+0000","last_change":"2024-04-16T16:20:55.700889+0000","last_active":"2024-04-16T16:21:12.541798+0000","last_peered":"2024-04-16T16:21:12.541798+0000","last_clean":"2024-04-16T16:21:12.541798+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:21:12.541798+0000","last_undegraded":"2024-04-16T16:21:12.541798+0000","last_fullsized":"2024-04-16T16:21:12.541798+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:04.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.539387+0000","last_change":"2024-04-16T16:20:56.720365+0000","last_active":"2024-04-16T16:21:12.539387+0000","last_peered":"2024-04-16T16:21:12.539387+0000","last_clean":"2024-04-16T16:21:12.539387+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:21:12.539387+0000","last_undegraded":"2024-04-16T16:21:12.539387+0000","last_fullsized":"2024-04-16T16:21:12.539387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":24,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.538077+0000","last_change":"2024-04-16T16:20:55.705450+0000","last_active":"2024-04-16T16:21:12.538077+0000","last_peered":"2024-04-16T16:21:12.538077+0000","last_clean":"2024-04-16T16:21:12.538077+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:21:12.538077+0000","last_undegraded":"2024-04-16T16:21:12.538077+0000","last_fullsized":"2024-04-16T16:21:12.538077+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:12:41.261866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.542195+0000","last_change":"2024-04-16T16:20:56.721758+0000","last_active":"2024-04-16T16:21:12.542195+0000","last_peered":"2024-04-16T16:21:12.542195+0000","last_clean":"2024-04-16T16:21:12.542195+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:21:12.542195+0000","last_undegraded":"2024-04-16T16:21:12.542195+0000","last_fullsized":"2024-04-16T16:21:12.542195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:35.700383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535186+0000","last_change":"2024-04-16T16:20:55.691154+0000","last_active":"2024-04-16T16:21:12.535186+0000","last_peered":"2024-04-16T16:21:12.535186+0000","last_clean":"2024-04-16T16:21:12.535186+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:21:12.535186+0000","last_undegraded":"2024-04-16T16:21:12.535186+0000","last_fullsized":"2024-04-16T16:21:12.535186+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:48.698225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.542504+0000","last_change":"2024-04-16T16:20:56.708684+0000","last_active":"2024-04-16T16:21:12.542504+0000","last_peered":"2024-04-16T16:21:12.542504+0000","last_clean":"2024-04-16T16:21:12.542504+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:21:12.542504+0000","last_undegraded":"2024-04-16T16:21:12.542504+0000","last_fullsized":"2024-04-16T16:21:12.542504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534844+0000","last_change":"2024-04-16T16:20:55.699664+0000","last_active":"2024-04-16T16:21:12.534844+0000","last_peered":"2024-04-16T16:21:12.534844+0000","last_clean":"2024-04-16T16:21:12.534844+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:21:12.534844+0000","last_undegraded":"2024-04-16T16:21:12.534844+0000","last_fullsized":"2024-04-16T16:21:12.534844+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534729+0000","last_change":"2024-04-16T16:20:56.712157+0000","last_active":"2024-04-16T16:21:12.534729+0000","last_peered":"2024-04-16T16:21:12.534729+0000","last_clean":"2024-04-16T16:21:12.534729+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:21:12.534729+0000","last_undegraded":"2024-04-16T16:21:12.534729+0000","last_fullsized":"2024-04-16T16:21:12.534729+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.132467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541916+0000","last_change":"2024-04-16T16:20:55.702354+0000","last_active":"2024-04-16T16:21:12.541916+0000","last_peered":"2024-04-16T16:21:12.541916+0000","last_clean":"2024-04-16T16:21:12.541916+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:21:12.541916+0000","last_undegraded":"2024-04-16T16:21:12.541916+0000","last_fullsized":"2024-04-16T16:21:12.541916+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:21:50.973007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540087+0000","last_change":"2024-04-16T16:20:56.712536+0000","last_active":"2024-04-16T16:21:12.540087+0000","last_peered":"2024-04-16T16:21:12.540087+0000","last_clean":"2024-04-16T16:21:12.540087+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:21:12.540087+0000","last_undegraded":"2024-04-16T16:21:12.540087+0000","last_fullsized":"2024-04-16T16:21:12.540087+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:49.712653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:13.944194+0000","last_change":"2024-04-16T16:21:13.944244+0000","last_active":"2024-04-16T16:21:13.944194+0000","last_peered":"2024-04-16T16:21:13.944194+0000","last_clean":"2024-04-16T16:21:13.944194+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:21:13.944194+0000","last_undegraded":"2024-04-16T16:21:13.944194+0000","last_fullsized":"2024-04-16T16:21:13.944194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:13.944012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:13.944012+0000","last_clean_scrub_stamp":"2024-04-16T16:21:13.944012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:13:20.129744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540461+0000","last_change":"2024-04-16T16:20:56.705284+0000","last_active":"2024-04-16T16:21:12.540461+0000","last_peered":"2024-04-16T16:21:12.540461+0000","last_clean":"2024-04-16T16:21:12.540461+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:21:12.540461+0000","last_undegraded":"2024-04-16T16:21:12.540461+0000","last_fullsized":"2024-04-16T16:21:12.540461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:06.747513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'3","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535563+0000","last_change":"2024-04-16T16:20:55.691520+0000","last_active":"2024-04-16T16:21:12.535563+0000","last_peered":"2024-04-16T16:21:12.535563+0000","last_clean":"2024-04-16T16:21:12.535563+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:21:12.535563+0000","last_undegraded":"2024-04-16T16:21:12.535563+0000","last_fullsized":"2024-04-16T16:21:12.535563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:22:34.964542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534994+0000","last_change":"2024-04-16T16:20:56.714025+0000","last_active":"2024-04-16T16:21:12.534994+0000","last_peered":"2024-04-16T16:21:12.534994+0000","last_clean":"2024-04-16T16:21:12.534994+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:21:12.534994+0000","last_undegraded":"2024-04-16T16:21:12.534994+0000","last_fullsized":"2024-04-16T16:21:12.534994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:14.407483+0000","last_change":"2024-04-16T16:21:14.407535+0000","last_active":"2024-04-16T16:21:14.407483+0000","last_peered":"2024-04-16T16:21:14.407483+0000","last_clean":"2024-04-16T16:21:14.407483+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:21:14.407483+0000","last_undegraded":"2024-04-16T16:21:14.407483+0000","last_fullsized":"2024-04-16T16:21:14.407483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:14.407265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:14.407265+0000","last_clean_scrub_stamp":"2024-04-16T16:21:14.407265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:23.802275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534359+0000","last_change":"2024-04-16T16:20:56.715573+0000","last_active":"2024-04-16T16:21:12.534359+0000","last_peered":"2024-04-16T16:21:12.534359+0000","last_clean":"2024-04-16T16:21:12.534359+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:21:12.534359+0000","last_undegraded":"2024-04-16T16:21:12.534359+0000","last_fullsized":"2024-04-16T16:21:12.534359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540603+0000","last_change":"2024-04-16T16:20:55.700653+0000","last_active":"2024-04-16T16:21:12.540603+0000","last_peered":"2024-04-16T16:21:12.540603+0000","last_clean":"2024-04-16T16:21:12.540603+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:21:12.540603+0000","last_undegraded":"2024-04-16T16:21:12.540603+0000","last_fullsized":"2024-04-16T16:21:12.540603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:30.271546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.542070+0000","last_change":"2024-04-16T16:20:56.691557+0000","last_active":"2024-04-16T16:21:12.542070+0000","last_peered":"2024-04-16T16:21:12.542070+0000","last_clean":"2024-04-16T16:21:12.542070+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:21:12.542070+0000","last_undegraded":"2024-04-16T16:21:12.542070+0000","last_fullsized":"2024-04-16T16:21:12.542070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:27.340875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.546450+0000","last_change":"2024-04-16T16:20:55.701272+0000","last_active":"2024-04-16T16:21:12.546450+0000","last_peered":"2024-04-16T16:21:12.546450+0000","last_clean":"2024-04-16T16:21:12.546450+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:21:12.546450+0000","last_undegraded":"2024-04-16T16:21:12.546450+0000","last_fullsized":"2024-04-16T16:21:12.546450+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.542687+0000","last_change":"2024-04-16T16:20:56.714215+0000","last_active":"2024-04-16T16:21:12.542687+0000","last_peered":"2024-04-16T16:21:12.542687+0000","last_clean":"2024-04-16T16:21:12.542687+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:21:12.542687+0000","last_undegraded":"2024-04-16T16:21:12.542687+0000","last_fullsized":"2024-04-16T16:21:12.542687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:28.491803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535009+0000","last_change":"2024-04-16T16:20:55.704363+0000","last_active":"2024-04-16T16:21:12.535009+0000","last_peered":"2024-04-16T16:21:12.535009+0000","last_clean":"2024-04-16T16:21:12.535009+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:21:12.535009+0000","last_undegraded":"2024-04-16T16:21:12.535009+0000","last_fullsized":"2024-04-16T16:21:12.535009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.545997+0000","last_change":"2024-04-16T16:20:56.713088+0000","last_active":"2024-04-16T16:21:12.545997+0000","last_peered":"2024-04-16T16:21:12.545997+0000","last_clean":"2024-04-16T16:21:12.545997+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:21:12.545997+0000","last_undegraded":"2024-04-16T16:21:12.545997+0000","last_fullsized":"2024-04-16T16:21:12.545997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.531265+0000","last_change":"2024-04-16T16:20:55.703477+0000","last_active":"2024-04-16T16:21:12.531265+0000","last_peered":"2024-04-16T16:21:12.531265+0000","last_clean":"2024-04-16T16:21:12.531265+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:21:12.531265+0000","last_undegraded":"2024-04-16T16:21:12.531265+0000","last_fullsized":"2024-04-16T16:21:12.531265+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:15.228538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.535010+0000","last_change":"2024-04-16T16:20:56.707864+0000","last_active":"2024-04-16T16:21:12.535010+0000","last_peered":"2024-04-16T16:21:12.535010+0000","last_clean":"2024-04-16T16:21:12.535010+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:21:12.535010+0000","last_undegraded":"2024-04-16T16:21:12.535010+0000","last_fullsized":"2024-04-16T16:21:12.535010+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.541404+0000","last_change":"2024-04-16T16:20:55.701244+0000","last_active":"2024-04-16T16:21:12.541404+0000","last_peered":"2024-04-16T16:21:12.541404+0000","last_clean":"2024-04-16T16:21:12.541404+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:21:12.541404+0000","last_undegraded":"2024-04-16T16:21:12.541404+0000","last_fullsized":"2024-04-16T16:21:12.541404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:05.648133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534185+0000","last_change":"2024-04-16T16:20:56.707897+0000","last_active":"2024-04-16T16:21:12.534185+0000","last_peered":"2024-04-16T16:21:12.534185+0000","last_clean":"2024-04-16T16:21:12.534185+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:21:12.534185+0000","last_undegraded":"2024-04-16T16:21:12.534185+0000","last_fullsized":"2024-04-16T16:21:12.534185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:42.907490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.546007+0000","last_change":"2024-04-16T16:20:55.704100+0000","last_active":"2024-04-16T16:21:12.546007+0000","last_peered":"2024-04-16T16:21:12.546007+0000","last_clean":"2024-04-16T16:21:12.546007+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:21:12.546007+0000","last_undegraded":"2024-04-16T16:21:12.546007+0000","last_fullsized":"2024-04-16T16:21:12.546007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.540418+0000","last_change":"2024-04-16T16:20:56.720972+0000","last_active":"2024-04-16T16:21:12.540418+0000","last_peered":"2024-04-16T16:21:12.540418+0000","last_clean":"2024-04-16T16:21:12.540418+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:21:12.540418+0000","last_undegraded":"2024-04-16T16:21:12.540418+0000","last_fullsized":"2024-04-16T16:21:12.540418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:46.510421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.531452+0000","last_change":"2024-04-16T16:20:55.697786+0000","last_active":"2024-04-16T16:21:12.531452+0000","last_peered":"2024-04-16T16:21:12.531452+0000","last_clean":"2024-04-16T16:21:12.531452+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:21:12.531452+0000","last_undegraded":"2024-04-16T16:21:12.531452+0000","last_fullsized":"2024-04-16T16:21:12.531452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:30:26.672161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.545684+0000","last_change":"2024-04-16T16:20:56.714275+0000","last_active":"2024-04-16T16:21:12.545684+0000","last_peered":"2024-04-16T16:21:12.545684+0000","last_clean":"2024-04-16T16:21:12.545684+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:21:12.545684+0000","last_undegraded":"2024-04-16T16:21:12.545684+0000","last_fullsized":"2024-04-16T16:21:12.545684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.545901+0000","last_change":"2024-04-16T16:20:55.698327+0000","last_active":"2024-04-16T16:21:12.545901+0000","last_peered":"2024-04-16T16:21:12.545901+0000","last_clean":"2024-04-16T16:21:12.545901+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:21:12.545901+0000","last_undegraded":"2024-04-16T16:21:12.545901+0000","last_fullsized":"2024-04-16T16:21:12.545901+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.534041+0000","last_change":"2024-04-16T16:20:56.708340+0000","last_active":"2024-04-16T16:21:12.534041+0000","last_peered":"2024-04-16T16:21:12.534041+0000","last_clean":"2024-04-16T16:21:12.534041+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:21:12.534041+0000","last_undegraded":"2024-04-16T16:21:12.534041+0000","last_fullsized":"2024-04-16T16:21:12.534041+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:07.708495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.533981+0000","last_change":"2024-04-16T16:20:55.692470+0000","last_active":"2024-04-16T16:21:12.533981+0000","last_peered":"2024-04-16T16:21:12.533981+0000","last_clean":"2024-04-16T16:21:12.533981+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:21:12.533981+0000","last_undegraded":"2024-04-16T16:21:12.533981+0000","last_fullsized":"2024-04-16T16:21:12.533981+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:20.735190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.533931+0000","last_change":"2024-04-16T16:20:56.720232+0000","last_active":"2024-04-16T16:21:12.533931+0000","last_peered":"2024-04-16T16:21:12.533931+0000","last_clean":"2024-04-16T16:21:12.533931+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:21:12.533931+0000","last_undegraded":"2024-04-16T16:21:12.533931+0000","last_fullsized":"2024-04-16T16:21:12.533931+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:55.649605+0000","last_clean_scrub_stamp":"2024-04-16T16:20:55.649605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:34.266414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.529625+0000","last_change":"2024-04-16T16:20:55.702982+0000","last_active":"2024-04-16T16:21:12.529625+0000","last_peered":"2024-04-16T16:21:12.529625+0000","last_clean":"2024-04-16T16:21:12.529625+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:21:12.529625+0000","last_undegraded":"2024-04-16T16:21:12.529625+0000","last_fullsized":"2024-04-16T16:21:12.529625+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:20:54.635176+0000","last_clean_scrub_stamp":"2024-04-16T16:20:54.635176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:05.020022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":251,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:12.538188+0000","last_change":"2024-04-16T16:16:37.519205+0000","last_active":"2024-04-16T16:21:12.538188+0000","last_peered":"2024-04-16T16:21:12.538188+0000","last_clean":"2024-04-16T16:21:12.538188+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:21:12.538188+0000","last_undegraded":"2024-04-16T16:21:12.538188+0000","last_fullsized":"2024-04-16T16:21:12.538188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:16:36.427669+0000","last_clean_scrub_stamp":"2024-04-16T16:16:36.427669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:14.754750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1359872,"data_stored":910592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":320064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":320716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":321676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":320120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":320120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":761856,"data_stored":320154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1368064,"data_stored":912626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:19.187 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.187 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.187 INFO:tasks.ceph:pgid 9.3d last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.188 INFO:tasks.ceph:pgid 9.3c last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.188 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.188 INFO:tasks.ceph:pgid 9.3a last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.188 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.188 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.188 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.189 INFO:tasks.ceph:pgid 9.36 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.189 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.189 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.189 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.189 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.189 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.190 INFO:tasks.ceph:pgid 9.30 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.190 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.190 INFO:tasks.ceph:pgid 9.2e last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.190 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.190 INFO:tasks.ceph:pgid 9.2c last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.190 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.193 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.193 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.193 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.193 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.193 INFO:tasks.ceph:pgid 9.26 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.194 INFO:tasks.ceph:pgid 9.25 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.194 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.194 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.194 INFO:tasks.ceph:pgid 9.22 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.194 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.194 INFO:tasks.ceph:pgid 9.20 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.195 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.195 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.195 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.195 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.195 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.195 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.195 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.196 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.196 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.196 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.196 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.196 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.196 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.197 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.197 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.197 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.197 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.197 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.197 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.197 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.198 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.198 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.198 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.198 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.198 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.199 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.199 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.199 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.199 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.199 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.199 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.199 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.200 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.200 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.200 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.200 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.200 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.200 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.201 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.201 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.201 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.201 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.201 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.201 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.202 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.202 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.202 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.202 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.202 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.202 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.203 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.203 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.203 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.203 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.203 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.203 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.203 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.204 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.204 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.204 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.204 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-04-16T16:20:55.649605+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.204 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-16T16:20:54.635176+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=20, tm_sec=54, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.204 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T16:16:36.427669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=16, tm_sec=36, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=16, tm_min=21, tm_sec=11, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T16:21:19.204 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T16:21:24.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2024-04-16T16:21:30.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2024-04-16T16:21:37.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~33s 2024-04-16T16:21:37.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:37.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:39.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T16:21:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.421+0000 7fc7f5a00640 1 Processor -- start 2024-04-16T16:21:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.421+0000 7fc7f5a00640 1 -- start start 2024-04-16T16:21:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7f5a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc7f015b790 0x7fc7f015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7f5a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00d0b80 0x7fc7f006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7f5a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f0071b00 con 0x7fc7f00728c0 2024-04-16T16:21:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7f5a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f0072430 con 0x7fc7f015b790 2024-04-16T16:21:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7f5a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f0071de0 con 0x7fc7f00d0b80 2024-04-16T16:21:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7efe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc7f015b790 0x7fc7f015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7efe00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc7f015b790 0x7fc7f015fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.22:53662/0 (socket says 172.21.15.22:53662) 2024-04-16T16:21:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.423+0000 7fc7efe00640 1 -- 172.21.15.22:0/130397188 learned_addr learned my addr 172.21.15.22:0/130397188 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.424+0000 7fc7f5000640 1 --2- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00d0b80 0x7fc7f006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.424+0000 7fc7efe00640 1 -- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00d0b80 msgr2=0x7fc7f006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.424+0000 7fc7efe00640 1 --2- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00d0b80 0x7fc7f006cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.424+0000 7fc7efe00640 1 -- 172.21.15.22:0/130397188 >> v1:172.21.15.43:6789/0 conn(0x7fc7f00728c0 legacy=0x7fc7f00d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.424+0000 7fc7efe00640 1 -- 172.21.15.22:0/130397188 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f00720c0 con 0x7fc7f015b790 2024-04-16T16:21:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.425+0000 7fc7efe00640 1 --2- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 0x7fc7f015fd50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009870 tx=0x7fc7e002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e42e5caa2ed58355 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:39.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.426+0000 7fc7ef400640 1 -- 172.21.15.22:0/130397188 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0034070 con 0x7fc7f015b790 2024-04-16T16:21:39.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.426+0000 7fc7ef400640 1 -- 172.21.15.22:0/130397188 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e0030840 con 0x7fc7f015b790 2024-04-16T16:21:39.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.426+0000 7fc7ef400640 1 -- 172.21.15.22:0/130397188 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0030c10 con 0x7fc7f015b790 2024-04-16T16:21:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 -- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 msgr2=0x7fc7f015fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 0x7fc7f015fd50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009870 tx=0x7fc7e002b980 comp rx=0 tx=0).stop 2024-04-16T16:21:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 -- 172.21.15.22:0/130397188 shutdown_connections 2024-04-16T16:21:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00d0b80 0x7fc7f006cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/130397188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 0x7fc7f015fd50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 -- 172.21.15.22:0/130397188 >> 172.21.15.22:0/130397188 conn(0x7fc7f0062440 msgr2=0x7fc7f0062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 -- 172.21.15.22:0/130397188 shutdown_connections 2024-04-16T16:21:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.427+0000 7fc7f5a00640 1 -- 172.21.15.22:0/130397188 wait complete. 2024-04-16T16:21:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.429+0000 7fc7f5a00640 1 Processor -- start 2024-04-16T16:21:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.429+0000 7fc7f5a00640 1 -- start start 2024-04-16T16:21:39.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.430+0000 7fc7f5a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00728c0 0x7fc7f0157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.430+0000 7fc7f5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7f00d0b80 0x7fc7f00b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.430+0000 7fc7f5a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 0x7fc7f0158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.430+0000 7fc7f5a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00cc7c0 con 0x7fc7f00d0b80 2024-04-16T16:21:39.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.430+0000 7fc7f5a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00afde0 con 0x7fc7f015b790 2024-04-16T16:21:39.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.430+0000 7fc7f5a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f00cc940 con 0x7fc7f00728c0 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7f00d0b80 0x7fc7f00b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7f00d0b80 0x7fc7f00b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37208/0 (socket says 172.21.15.22:37208) 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 -- 172.21.15.22:0/1017992533 learned_addr learned my addr 172.21.15.22:0/1017992533 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7efe00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00728c0 0x7fc7f0157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7f5000640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 0x7fc7f0158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 -- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00728c0 msgr2=0x7fc7f0157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00728c0 0x7fc7f0157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 -- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 msgr2=0x7fc7f0158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 0x7fc7f0158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 -- 172.21.15.22:0/1017992533 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0157e50 con 0x7fc7f00d0b80 2024-04-16T16:21:39.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.431+0000 7fc7e7400640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7f00d0b80 0x7fc7f00b0c20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800c400 tx=0x7fc7d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:39.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.432+0000 7fc7ecc00640 1 -- 172.21.15.22:0/1017992533 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80052d0 con 0x7fc7f00d0b80 2024-04-16T16:21:39.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.432+0000 7fc7ecc00640 1 -- 172.21.15.22:0/1017992533 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d8005490 con 0x7fc7f00d0b80 2024-04-16T16:21:39.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.432+0000 7fc7ecc00640 1 -- 172.21.15.22:0/1017992533 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8007260 con 0x7fc7f00d0b80 2024-04-16T16:21:39.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.432+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f0158130 con 0x7fc7f00d0b80 2024-04-16T16:21:39.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.432+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01589f0 con 0x7fc7f00d0b80 2024-04-16T16:21:39.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.433+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f0075f30 con 0x7fc7f00d0b80 2024-04-16T16:21:39.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.434+0000 7fc7ecc00640 1 -- 172.21.15.22:0/1017992533 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fc7d8007400 con 0x7fc7f00d0b80 2024-04-16T16:21:39.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.435+0000 7fc7ecc00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc7cc06ce90 0x7fc7cc06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.435+0000 7fc7ecc00640 1 -- 172.21.15.22:0/1017992533 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fc7d808bbf0 con 0x7fc7f00d0b80 2024-04-16T16:21:39.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.435+0000 7fc7efe00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc7cc06ce90 0x7fc7cc06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.436+0000 7fc7efe00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc7cc06ce90 0x7fc7cc06f350 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0036000 tx=0x7fc7e003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:39.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.440+0000 7fc7ecc00640 1 -- 172.21.15.22:0/1017992533 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc7d8059710 con 0x7fc7f00d0b80 2024-04-16T16:21:39.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.636+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 --> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7f01553f0 con 0x7fc7cc06ce90 2024-04-16T16:21:39.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.643+0000 7fc7ecc00640 1 -- 172.21.15.22:0/1017992533 <== mgr.4104 v2:172.21.15.22:6832/1860401634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251987 (secure 0 0 0) 0x7fc7f01553f0 con 0x7fc7cc06ce90 2024-04-16T16:21:39.645 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:39.646 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-16T16:21:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc7cc06ce90 msgr2=0x7fc7cc06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc7cc06ce90 0x7fc7cc06f350 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0036000 tx=0x7fc7e003b040 comp rx=0 tx=0).stop 2024-04-16T16:21:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7f00d0b80 msgr2=0x7fc7f00b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7f00d0b80 0x7fc7f00b0c20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800c400 tx=0x7fc7d800c8c0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 shutdown_connections 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc7cc06ce90 0x7fc7cc06f350 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f015b790 0x7fc7f0158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7f00d0b80 0x7fc7f00b0c20 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 --2- 172.21.15.22:0/1017992533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7f00728c0 0x7fc7f0157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.647+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 >> 172.21.15.22:0/1017992533 conn(0x7fc7f0062440 msgr2=0x7fc7f006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.648+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 shutdown_connections 2024-04-16T16:21:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.648+0000 7fc7f5a00640 1 -- 172.21.15.22:0/1017992533 wait complete. 2024-04-16T16:21:39.663 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-16T16:21:37.807493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256552,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718168,"statfs":{"total":773094113280,"available":772831404032,"internally_reserved":0,"allocated":7315456,"data_stored":3746068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005296"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:17.473757+0000","last_change":"2024-04-16T16:21:17.473795+0000","last_active":"2024-04-16T16:21:17.473757+0000","last_peered":"2024-04-16T16:21:17.473757+0000","last_clean":"2024-04-16T16:21:17.473757+0000","last_became_active":"2024-04-16T16:20:56.700372+0000","last_became_peered":"2024-04-16T16:20:56.700372+0000","last_unstale":"2024-04-16T16:21:17.473757+0000","last_undegraded":"2024-04-16T16:21:17.473757+0000","last_fullsized":"2024-04-16T16:21:17.473757+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:17.473638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:17.473638+0000","last_clean_scrub_stamp":"2024-04-16T16:21:17.473638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:03:24.196740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:18.253752+0000","last_change":"2024-04-16T16:21:18.253781+0000","last_active":"2024-04-16T16:21:18.253752+0000","last_peered":"2024-04-16T16:21:18.253752+0000","last_clean":"2024-04-16T16:21:18.253752+0000","last_became_active":"2024-04-16T16:20:56.704171+0000","last_became_peered":"2024-04-16T16:20:56.704171+0000","last_unstale":"2024-04-16T16:21:18.253752+0000","last_undegraded":"2024-04-16T16:21:18.253752+0000","last_fullsized":"2024-04-16T16:21:18.253752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:18.253651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:18.253651+0000","last_clean_scrub_stamp":"2024-04-16T16:21:18.253651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:56:41.866164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:23.124739+0000","last_change":"2024-04-16T16:21:23.124791+0000","last_active":"2024-04-16T16:21:23.124739+0000","last_peered":"2024-04-16T16:21:23.124739+0000","last_clean":"2024-04-16T16:21:23.124739+0000","last_became_active":"2024-04-16T16:20:56.710194+0000","last_became_peered":"2024-04-16T16:20:56.710194+0000","last_unstale":"2024-04-16T16:21:23.124739+0000","last_undegraded":"2024-04-16T16:21:23.124739+0000","last_fullsized":"2024-04-16T16:21:23.124739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:23.124539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:23.124539+0000","last_clean_scrub_stamp":"2024-04-16T16:21:23.124539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:25.375622+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:24.234081+0000","last_change":"2024-04-16T16:21:24.234180+0000","last_active":"2024-04-16T16:21:24.234081+0000","last_peered":"2024-04-16T16:21:24.234081+0000","last_clean":"2024-04-16T16:21:24.234081+0000","last_became_active":"2024-04-16T16:20:56.693853+0000","last_became_peered":"2024-04-16T16:20:56.693853+0000","last_unstale":"2024-04-16T16:21:24.234081+0000","last_undegraded":"2024-04-16T16:21:24.234081+0000","last_fullsized":"2024-04-16T16:21:24.234081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:24.233885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:24.233885+0000","last_clean_scrub_stamp":"2024-04-16T16:21:24.233885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:02.850695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:15.427973+0000","last_change":"2024-04-16T16:21:15.428011+0000","last_active":"2024-04-16T16:21:15.427973+0000","last_peered":"2024-04-16T16:21:15.427973+0000","last_clean":"2024-04-16T16:21:15.427973+0000","last_became_active":"2024-04-16T16:20:56.687322+0000","last_became_peered":"2024-04-16T16:20:56.687322+0000","last_unstale":"2024-04-16T16:21:15.427973+0000","last_undegraded":"2024-04-16T16:21:15.427973+0000","last_fullsized":"2024-04-16T16:21:15.427973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:15.427867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:15.427867+0000","last_clean_scrub_stamp":"2024-04-16T16:21:15.427867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:11:42.016619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.906479+0000","last_change":"2024-04-16T16:21:19.906532+0000","last_active":"2024-04-16T16:21:19.906479+0000","last_peered":"2024-04-16T16:21:19.906479+0000","last_clean":"2024-04-16T16:21:19.906479+0000","last_became_active":"2024-04-16T16:20:56.695794+0000","last_became_peered":"2024-04-16T16:20:56.695794+0000","last_unstale":"2024-04-16T16:21:19.906479+0000","last_undegraded":"2024-04-16T16:21:19.906479+0000","last_fullsized":"2024-04-16T16:21:19.906479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:19.906264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:19.906264+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.906264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:42.812234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:24.210873+0000","last_change":"2024-04-16T16:21:24.210927+0000","last_active":"2024-04-16T16:21:24.210873+0000","last_peered":"2024-04-16T16:21:24.210873+0000","last_clean":"2024-04-16T16:21:24.210873+0000","last_became_active":"2024-04-16T16:20:56.702583+0000","last_became_peered":"2024-04-16T16:20:56.702583+0000","last_unstale":"2024-04-16T16:21:24.210873+0000","last_undegraded":"2024-04-16T16:21:24.210873+0000","last_fullsized":"2024-04-16T16:21:24.210873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:24.210679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:24.210679+0000","last_clean_scrub_stamp":"2024-04-16T16:21:24.210679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:24.884031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:31.096593+0000","last_change":"2024-04-16T16:21:31.096653+0000","last_active":"2024-04-16T16:21:31.096593+0000","last_peered":"2024-04-16T16:21:31.096593+0000","last_clean":"2024-04-16T16:21:31.096593+0000","last_became_active":"2024-04-16T16:20:56.711123+0000","last_became_peered":"2024-04-16T16:20:56.711123+0000","last_unstale":"2024-04-16T16:21:31.096593+0000","last_undegraded":"2024-04-16T16:21:31.096593+0000","last_fullsized":"2024-04-16T16:21:31.096593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:31.096367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:31.096367+0000","last_clean_scrub_stamp":"2024-04-16T16:21:31.096367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:49.196138+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:25.230094+0000","last_change":"2024-04-16T16:21:25.230180+0000","last_active":"2024-04-16T16:21:25.230094+0000","last_peered":"2024-04-16T16:21:25.230094+0000","last_clean":"2024-04-16T16:21:25.230094+0000","last_became_active":"2024-04-16T16:20:56.704719+0000","last_became_peered":"2024-04-16T16:20:56.704719+0000","last_unstale":"2024-04-16T16:21:25.230094+0000","last_undegraded":"2024-04-16T16:21:25.230094+0000","last_fullsized":"2024-04-16T16:21:25.230094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:25.229883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:25.229883+0000","last_clean_scrub_stamp":"2024-04-16T16:21:25.229883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:20:18.765436+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:21.368796+0000","last_change":"2024-04-16T16:21:21.368982+0000","last_active":"2024-04-16T16:21:21.368796+0000","last_peered":"2024-04-16T16:21:21.368796+0000","last_clean":"2024-04-16T16:21:21.368796+0000","last_became_active":"2024-04-16T16:20:56.713469+0000","last_became_peered":"2024-04-16T16:20:56.713469+0000","last_unstale":"2024-04-16T16:21:21.368796+0000","last_undegraded":"2024-04-16T16:21:21.368796+0000","last_fullsized":"2024-04-16T16:21:21.368796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:21.368469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:21.368469+0000","last_clean_scrub_stamp":"2024-04-16T16:21:21.368469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:24.322947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:18.346635+0000","last_change":"2024-04-16T16:21:18.346715+0000","last_active":"2024-04-16T16:21:18.346635+0000","last_peered":"2024-04-16T16:21:18.346635+0000","last_clean":"2024-04-16T16:21:18.346635+0000","last_became_active":"2024-04-16T16:20:56.703060+0000","last_became_peered":"2024-04-16T16:20:56.703060+0000","last_unstale":"2024-04-16T16:21:18.346635+0000","last_undegraded":"2024-04-16T16:21:18.346635+0000","last_fullsized":"2024-04-16T16:21:18.346635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:18.346450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:18.346450+0000","last_clean_scrub_stamp":"2024-04-16T16:21:18.346450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:55.935519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:26.282408+0000","last_change":"2024-04-16T16:21:26.282460+0000","last_active":"2024-04-16T16:21:26.282408+0000","last_peered":"2024-04-16T16:21:26.282408+0000","last_clean":"2024-04-16T16:21:26.282408+0000","last_became_active":"2024-04-16T16:20:56.702059+0000","last_became_peered":"2024-04-16T16:20:56.702059+0000","last_unstale":"2024-04-16T16:21:26.282408+0000","last_undegraded":"2024-04-16T16:21:26.282408+0000","last_fullsized":"2024-04-16T16:21:26.282408+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:26.282218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:26.282218+0000","last_clean_scrub_stamp":"2024-04-16T16:21:26.282218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:13.540103+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:21.366495+0000","last_change":"2024-04-16T16:21:21.366552+0000","last_active":"2024-04-16T16:21:21.366495+0000","last_peered":"2024-04-16T16:21:21.366495+0000","last_clean":"2024-04-16T16:21:21.366495+0000","last_became_active":"2024-04-16T16:20:56.705494+0000","last_became_peered":"2024-04-16T16:20:56.705494+0000","last_unstale":"2024-04-16T16:21:21.366495+0000","last_undegraded":"2024-04-16T16:21:21.366495+0000","last_fullsized":"2024-04-16T16:21:21.366495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:21.366310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:21.366310+0000","last_clean_scrub_stamp":"2024-04-16T16:21:21.366310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:53.199357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:22.147034+0000","last_change":"2024-04-16T16:21:22.147279+0000","last_active":"2024-04-16T16:21:22.147034+0000","last_peered":"2024-04-16T16:21:22.147034+0000","last_clean":"2024-04-16T16:21:22.147034+0000","last_became_active":"2024-04-16T16:20:56.698621+0000","last_became_peered":"2024-04-16T16:20:56.698621+0000","last_unstale":"2024-04-16T16:21:22.147034+0000","last_undegraded":"2024-04-16T16:21:22.147034+0000","last_fullsized":"2024-04-16T16:21:22.147034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:22.146652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:22.146652+0000","last_clean_scrub_stamp":"2024-04-16T16:21:22.146652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:25:24.739078+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:21.181622+0000","last_change":"2024-04-16T16:21:21.181673+0000","last_active":"2024-04-16T16:21:21.181622+0000","last_peered":"2024-04-16T16:21:21.181622+0000","last_clean":"2024-04-16T16:21:21.181622+0000","last_became_active":"2024-04-16T16:20:56.699308+0000","last_became_peered":"2024-04-16T16:20:56.699308+0000","last_unstale":"2024-04-16T16:21:21.181622+0000","last_undegraded":"2024-04-16T16:21:21.181622+0000","last_fullsized":"2024-04-16T16:21:21.181622+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:21.181430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:21.181430+0000","last_clean_scrub_stamp":"2024-04-16T16:21:21.181430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:06.358120+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:27.982952+0000","last_change":"2024-04-16T16:21:27.983049+0000","last_active":"2024-04-16T16:21:27.982952+0000","last_peered":"2024-04-16T16:21:27.982952+0000","last_clean":"2024-04-16T16:21:27.982952+0000","last_became_active":"2024-04-16T16:20:56.711328+0000","last_became_peered":"2024-04-16T16:20:56.711328+0000","last_unstale":"2024-04-16T16:21:27.982952+0000","last_undegraded":"2024-04-16T16:21:27.982952+0000","last_fullsized":"2024-04-16T16:21:27.982952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:27.982710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:27.982710+0000","last_clean_scrub_stamp":"2024-04-16T16:21:27.982710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:59:43.257219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:17.256884+0000","last_change":"2024-04-16T16:21:17.256908+0000","last_active":"2024-04-16T16:21:17.256884+0000","last_peered":"2024-04-16T16:21:17.256884+0000","last_clean":"2024-04-16T16:21:17.256884+0000","last_became_active":"2024-04-16T16:20:56.708977+0000","last_became_peered":"2024-04-16T16:20:56.708977+0000","last_unstale":"2024-04-16T16:21:17.256884+0000","last_undegraded":"2024-04-16T16:21:17.256884+0000","last_fullsized":"2024-04-16T16:21:17.256884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:17.256769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:17.256769+0000","last_clean_scrub_stamp":"2024-04-16T16:21:17.256769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:18.925916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:33.168307+0000","last_change":"2024-04-16T16:21:33.168405+0000","last_active":"2024-04-16T16:21:33.168307+0000","last_peered":"2024-04-16T16:21:33.168307+0000","last_clean":"2024-04-16T16:21:33.168307+0000","last_became_active":"2024-04-16T16:20:56.721536+0000","last_became_peered":"2024-04-16T16:20:56.721536+0000","last_unstale":"2024-04-16T16:21:33.168307+0000","last_undegraded":"2024-04-16T16:21:33.168307+0000","last_fullsized":"2024-04-16T16:21:33.168307+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:33.168045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:33.168045+0000","last_clean_scrub_stamp":"2024-04-16T16:21:33.168045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:49.202259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:18.439237+0000","last_change":"2024-04-16T16:21:18.439257+0000","last_active":"2024-04-16T16:21:18.439237+0000","last_peered":"2024-04-16T16:21:18.439237+0000","last_clean":"2024-04-16T16:21:18.439237+0000","last_became_active":"2024-04-16T16:20:56.702639+0000","last_became_peered":"2024-04-16T16:20:56.702639+0000","last_unstale":"2024-04-16T16:21:18.439237+0000","last_undegraded":"2024-04-16T16:21:18.439237+0000","last_fullsized":"2024-04-16T16:21:18.439237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:18.439142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:18.439142+0000","last_clean_scrub_stamp":"2024-04-16T16:21:18.439142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:30.580114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:33.084387+0000","last_change":"2024-04-16T16:21:33.084491+0000","last_active":"2024-04-16T16:21:33.084387+0000","last_peered":"2024-04-16T16:21:33.084387+0000","last_clean":"2024-04-16T16:21:33.084387+0000","last_became_active":"2024-04-16T16:20:56.718567+0000","last_became_peered":"2024-04-16T16:20:56.718567+0000","last_unstale":"2024-04-16T16:21:33.084387+0000","last_undegraded":"2024-04-16T16:21:33.084387+0000","last_fullsized":"2024-04-16T16:21:33.084387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:33.084168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:33.084168+0000","last_clean_scrub_stamp":"2024-04-16T16:21:33.084168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:42.121625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:26.175632+0000","last_change":"2024-04-16T16:21:26.175684+0000","last_active":"2024-04-16T16:21:26.175632+0000","last_peered":"2024-04-16T16:21:26.175632+0000","last_clean":"2024-04-16T16:21:26.175632+0000","last_became_active":"2024-04-16T16:20:56.713342+0000","last_became_peered":"2024-04-16T16:20:56.713342+0000","last_unstale":"2024-04-16T16:21:26.175632+0000","last_undegraded":"2024-04-16T16:21:26.175632+0000","last_fullsized":"2024-04-16T16:21:26.175632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:26.175421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:26.175421+0000","last_clean_scrub_stamp":"2024-04-16T16:21:26.175421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:49.081391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:26.214202+0000","last_change":"2024-04-16T16:21:26.214260+0000","last_active":"2024-04-16T16:21:26.214202+0000","last_peered":"2024-04-16T16:21:26.214202+0000","last_clean":"2024-04-16T16:21:26.214202+0000","last_became_active":"2024-04-16T16:20:56.701288+0000","last_became_peered":"2024-04-16T16:20:56.701288+0000","last_unstale":"2024-04-16T16:21:26.214202+0000","last_undegraded":"2024-04-16T16:21:26.214202+0000","last_fullsized":"2024-04-16T16:21:26.214202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:26.214000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:26.214000+0000","last_clean_scrub_stamp":"2024-04-16T16:21:26.214000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:50.590742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:28.166760+0000","last_change":"2024-04-16T16:21:28.166869+0000","last_active":"2024-04-16T16:21:28.166760+0000","last_peered":"2024-04-16T16:21:28.166760+0000","last_clean":"2024-04-16T16:21:28.166760+0000","last_became_active":"2024-04-16T16:20:56.719274+0000","last_became_peered":"2024-04-16T16:20:56.719274+0000","last_unstale":"2024-04-16T16:21:28.166760+0000","last_undegraded":"2024-04-16T16:21:28.166760+0000","last_fullsized":"2024-04-16T16:21:28.166760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:28.166494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:28.166494+0000","last_clean_scrub_stamp":"2024-04-16T16:21:28.166494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:57.346435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:23.419999+0000","last_change":"2024-04-16T16:21:23.420052+0000","last_active":"2024-04-16T16:21:23.419999+0000","last_peered":"2024-04-16T16:21:23.419999+0000","last_clean":"2024-04-16T16:21:23.419999+0000","last_became_active":"2024-04-16T16:20:56.719830+0000","last_became_peered":"2024-04-16T16:20:56.719830+0000","last_unstale":"2024-04-16T16:21:23.419999+0000","last_undegraded":"2024-04-16T16:21:23.419999+0000","last_fullsized":"2024-04-16T16:21:23.419999+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:23.419742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:23.419742+0000","last_clean_scrub_stamp":"2024-04-16T16:21:23.419742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:32.135272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.385132+0000","last_change":"2024-04-16T16:21:20.385190+0000","last_active":"2024-04-16T16:21:20.385132+0000","last_peered":"2024-04-16T16:21:20.385132+0000","last_clean":"2024-04-16T16:21:20.385132+0000","last_became_active":"2024-04-16T16:20:56.706247+0000","last_became_peered":"2024-04-16T16:20:56.706247+0000","last_unstale":"2024-04-16T16:21:20.385132+0000","last_undegraded":"2024-04-16T16:21:20.385132+0000","last_fullsized":"2024-04-16T16:21:20.385132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:20.384889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:20.384889+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.384889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:30.696821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:25.235782+0000","last_change":"2024-04-16T16:21:25.235834+0000","last_active":"2024-04-16T16:21:25.235782+0000","last_peered":"2024-04-16T16:21:25.235782+0000","last_clean":"2024-04-16T16:21:25.235782+0000","last_became_active":"2024-04-16T16:20:56.699182+0000","last_became_peered":"2024-04-16T16:20:56.699182+0000","last_unstale":"2024-04-16T16:21:25.235782+0000","last_undegraded":"2024-04-16T16:21:25.235782+0000","last_fullsized":"2024-04-16T16:21:25.235782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:25.235581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:25.235581+0000","last_clean_scrub_stamp":"2024-04-16T16:21:25.235581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:37.294471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:26.975837+0000","last_change":"2024-04-16T16:21:26.975892+0000","last_active":"2024-04-16T16:21:26.975837+0000","last_peered":"2024-04-16T16:21:26.975837+0000","last_clean":"2024-04-16T16:21:26.975837+0000","last_became_active":"2024-04-16T16:20:56.710937+0000","last_became_peered":"2024-04-16T16:20:56.710937+0000","last_unstale":"2024-04-16T16:21:26.975837+0000","last_undegraded":"2024-04-16T16:21:26.975837+0000","last_fullsized":"2024-04-16T16:21:26.975837+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:26.975630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:26.975630+0000","last_clean_scrub_stamp":"2024-04-16T16:21:26.975630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:43.009843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:16.434790+0000","last_change":"2024-04-16T16:21:16.434847+0000","last_active":"2024-04-16T16:21:16.434790+0000","last_peered":"2024-04-16T16:21:16.434790+0000","last_clean":"2024-04-16T16:21:16.434790+0000","last_became_active":"2024-04-16T16:20:56.689832+0000","last_became_peered":"2024-04-16T16:20:56.689832+0000","last_unstale":"2024-04-16T16:21:16.434790+0000","last_undegraded":"2024-04-16T16:21:16.434790+0000","last_fullsized":"2024-04-16T16:21:16.434790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:16.434676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:16.434676+0000","last_clean_scrub_stamp":"2024-04-16T16:21:16.434676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:04.341034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:29.076515+0000","last_change":"2024-04-16T16:21:29.076626+0000","last_active":"2024-04-16T16:21:29.076515+0000","last_peered":"2024-04-16T16:21:29.076515+0000","last_clean":"2024-04-16T16:21:29.076515+0000","last_became_active":"2024-04-16T16:20:56.708506+0000","last_became_peered":"2024-04-16T16:20:56.708506+0000","last_unstale":"2024-04-16T16:21:29.076515+0000","last_undegraded":"2024-04-16T16:21:29.076515+0000","last_fullsized":"2024-04-16T16:21:29.076515+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:29.076240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:29.076240+0000","last_clean_scrub_stamp":"2024-04-16T16:21:29.076240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:27:06.038975+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:29.167229+0000","last_change":"2024-04-16T16:21:29.167281+0000","last_active":"2024-04-16T16:21:29.167229+0000","last_peered":"2024-04-16T16:21:29.167229+0000","last_clean":"2024-04-16T16:21:29.167229+0000","last_became_active":"2024-04-16T16:20:56.719661+0000","last_became_peered":"2024-04-16T16:20:56.719661+0000","last_unstale":"2024-04-16T16:21:29.167229+0000","last_undegraded":"2024-04-16T16:21:29.167229+0000","last_fullsized":"2024-04-16T16:21:29.167229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:29.166985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:29.166985+0000","last_clean_scrub_stamp":"2024-04-16T16:21:29.166985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:52.409974+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.398800+0000","last_change":"2024-04-16T16:21:19.398858+0000","last_active":"2024-04-16T16:21:19.398800+0000","last_peered":"2024-04-16T16:21:19.398800+0000","last_clean":"2024-04-16T16:21:19.398800+0000","last_became_active":"2024-04-16T16:20:56.705801+0000","last_became_peered":"2024-04-16T16:20:56.705801+0000","last_unstale":"2024-04-16T16:21:19.398800+0000","last_undegraded":"2024-04-16T16:21:19.398800+0000","last_fullsized":"2024-04-16T16:21:19.398800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:19.398603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:19.398603+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.398603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:03.684820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.918051+0000","last_change":"2024-04-16T16:21:20.918108+0000","last_active":"2024-04-16T16:21:20.918051+0000","last_peered":"2024-04-16T16:21:20.918051+0000","last_clean":"2024-04-16T16:21:20.918051+0000","last_became_active":"2024-04-16T16:20:56.706807+0000","last_became_peered":"2024-04-16T16:20:56.706807+0000","last_unstale":"2024-04-16T16:21:20.918051+0000","last_undegraded":"2024-04-16T16:21:20.918051+0000","last_fullsized":"2024-04-16T16:21:20.918051+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:20.917842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:20.917842+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.917842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:53.349946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:24.944176+0000","last_change":"2024-04-16T16:21:24.944236+0000","last_active":"2024-04-16T16:21:24.944176+0000","last_peered":"2024-04-16T16:21:24.944176+0000","last_clean":"2024-04-16T16:21:24.944176+0000","last_became_active":"2024-04-16T16:20:56.712670+0000","last_became_peered":"2024-04-16T16:20:56.712670+0000","last_unstale":"2024-04-16T16:21:24.944176+0000","last_undegraded":"2024-04-16T16:21:24.944176+0000","last_fullsized":"2024-04-16T16:21:24.944176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:24.943933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:24.943933+0000","last_clean_scrub_stamp":"2024-04-16T16:21:24.943933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:31.022090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'5","reported_seq":32,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:17.875504+0000","last_change":"2024-04-16T16:21:17.875555+0000","last_active":"2024-04-16T16:21:17.875504+0000","last_peered":"2024-04-16T16:21:17.875504+0000","last_clean":"2024-04-16T16:21:17.875504+0000","last_became_active":"2024-04-16T16:20:55.703571+0000","last_became_peered":"2024-04-16T16:20:55.703571+0000","last_unstale":"2024-04-16T16:21:17.875504+0000","last_undegraded":"2024-04-16T16:21:17.875504+0000","last_fullsized":"2024-04-16T16:21:17.875504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'5","last_scrub_stamp":"2024-04-16T16:21:17.875341+0000","last_deep_scrub":"63'5","last_deep_scrub_stamp":"2024-04-16T16:21:17.875341+0000","last_clean_scrub_stamp":"2024-04-16T16:21:17.875341+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:56.516287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:23.329603+0000","last_change":"2024-04-16T16:21:23.329707+0000","last_active":"2024-04-16T16:21:23.329603+0000","last_peered":"2024-04-16T16:21:23.329603+0000","last_clean":"2024-04-16T16:21:23.329603+0000","last_became_active":"2024-04-16T16:20:56.716599+0000","last_became_peered":"2024-04-16T16:20:56.716599+0000","last_unstale":"2024-04-16T16:21:23.329603+0000","last_undegraded":"2024-04-16T16:21:23.329603+0000","last_fullsized":"2024-04-16T16:21:23.329603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:23.329286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:23.329286+0000","last_clean_scrub_stamp":"2024-04-16T16:21:23.329286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.171484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'2","reported_seq":27,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:24.239108+0000","last_change":"2024-04-16T16:21:24.239167+0000","last_active":"2024-04-16T16:21:24.239108+0000","last_peered":"2024-04-16T16:21:24.239108+0000","last_clean":"2024-04-16T16:21:24.239108+0000","last_became_active":"2024-04-16T16:20:55.700399+0000","last_became_peered":"2024-04-16T16:20:55.700399+0000","last_unstale":"2024-04-16T16:21:24.239108+0000","last_undegraded":"2024-04-16T16:21:24.239108+0000","last_fullsized":"2024-04-16T16:21:24.239108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-04-16T16:21:24.238849+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-04-16T16:21:24.238849+0000","last_clean_scrub_stamp":"2024-04-16T16:21:24.238849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:21.932564+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:28.965777+0000","last_change":"2024-04-16T16:21:28.965888+0000","last_active":"2024-04-16T16:21:28.965777+0000","last_peered":"2024-04-16T16:21:28.965777+0000","last_clean":"2024-04-16T16:21:28.965777+0000","last_became_active":"2024-04-16T16:20:56.709845+0000","last_became_peered":"2024-04-16T16:20:56.709845+0000","last_unstale":"2024-04-16T16:21:28.965777+0000","last_undegraded":"2024-04-16T16:21:28.965777+0000","last_fullsized":"2024-04-16T16:21:28.965777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:28.965544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:28.965544+0000","last_clean_scrub_stamp":"2024-04-16T16:21:28.965544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:37.775606+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:15.558018+0000","last_change":"2024-04-16T16:21:14.934885+0000","last_active":"2024-04-16T16:21:15.558018+0000","last_peered":"2024-04-16T16:21:15.558018+0000","last_clean":"2024-04-16T16:21:15.558018+0000","last_became_active":"2024-04-16T16:20:55.696961+0000","last_became_peered":"2024-04-16T16:20:55.696961+0000","last_unstale":"2024-04-16T16:21:15.558018+0000","last_undegraded":"2024-04-16T16:21:15.558018+0000","last_fullsized":"2024-04-16T16:21:15.558018+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-04-16T16:21:14.934629+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-04-16T16:21:14.934629+0000","last_clean_scrub_stamp":"2024-04-16T16:21:14.934629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:15.607981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:22.904585+0000","last_change":"2024-04-16T16:21:22.904686+0000","last_active":"2024-04-16T16:21:22.904585+0000","last_peered":"2024-04-16T16:21:22.904585+0000","last_clean":"2024-04-16T16:21:22.904585+0000","last_became_active":"2024-04-16T16:20:56.708433+0000","last_became_peered":"2024-04-16T16:20:56.708433+0000","last_unstale":"2024-04-16T16:21:22.904585+0000","last_undegraded":"2024-04-16T16:21:22.904585+0000","last_fullsized":"2024-04-16T16:21:22.904585+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:22.904313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:22.904313+0000","last_clean_scrub_stamp":"2024-04-16T16:21:22.904313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:46.147303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:22.220511+0000","last_change":"2024-04-16T16:21:22.220570+0000","last_active":"2024-04-16T16:21:22.220511+0000","last_peered":"2024-04-16T16:21:22.220511+0000","last_clean":"2024-04-16T16:21:22.220511+0000","last_became_active":"2024-04-16T16:20:55.703074+0000","last_became_peered":"2024-04-16T16:20:55.703074+0000","last_unstale":"2024-04-16T16:21:22.220511+0000","last_undegraded":"2024-04-16T16:21:22.220511+0000","last_fullsized":"2024-04-16T16:21:22.220511+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-04-16T16:21:22.220302+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-04-16T16:21:22.220302+0000","last_clean_scrub_stamp":"2024-04-16T16:21:22.220302+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:37.828130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:25.228252+0000","last_change":"2024-04-16T16:21:25.228305+0000","last_active":"2024-04-16T16:21:25.228252+0000","last_peered":"2024-04-16T16:21:25.228252+0000","last_clean":"2024-04-16T16:21:25.228252+0000","last_became_active":"2024-04-16T16:20:56.702132+0000","last_became_peered":"2024-04-16T16:20:56.702132+0000","last_unstale":"2024-04-16T16:21:25.228252+0000","last_undegraded":"2024-04-16T16:21:25.228252+0000","last_fullsized":"2024-04-16T16:21:25.228252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:25.228048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:25.228048+0000","last_clean_scrub_stamp":"2024-04-16T16:21:25.228048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:28.909375+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":27,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:17.169103+0000","last_change":"2024-04-16T16:21:17.169186+0000","last_active":"2024-04-16T16:21:17.169103+0000","last_peered":"2024-04-16T16:21:17.169103+0000","last_clean":"2024-04-16T16:21:17.169103+0000","last_became_active":"2024-04-16T16:20:55.687929+0000","last_became_peered":"2024-04-16T16:20:55.687929+0000","last_unstale":"2024-04-16T16:21:17.169103+0000","last_undegraded":"2024-04-16T16:21:17.169103+0000","last_fullsized":"2024-04-16T16:21:17.169103+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-04-16T16:21:17.168918+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-04-16T16:21:17.168918+0000","last_clean_scrub_stamp":"2024-04-16T16:21:17.168918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:08.029735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:16.284957+0000","last_change":"2024-04-16T16:21:16.285011+0000","last_active":"2024-04-16T16:21:16.284957+0000","last_peered":"2024-04-16T16:21:16.284957+0000","last_clean":"2024-04-16T16:21:16.284957+0000","last_became_active":"2024-04-16T16:20:56.706052+0000","last_became_peered":"2024-04-16T16:20:56.706052+0000","last_unstale":"2024-04-16T16:21:16.284957+0000","last_undegraded":"2024-04-16T16:21:16.284957+0000","last_fullsized":"2024-04-16T16:21:16.284957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:16.284763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:16.284763+0000","last_clean_scrub_stamp":"2024-04-16T16:21:16.284763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:50.804456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'2","reported_seq":27,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:16.915576+0000","last_change":"2024-04-16T16:21:16.915641+0000","last_active":"2024-04-16T16:21:16.915576+0000","last_peered":"2024-04-16T16:21:16.915576+0000","last_clean":"2024-04-16T16:21:16.915576+0000","last_became_active":"2024-04-16T16:20:55.702631+0000","last_became_peered":"2024-04-16T16:20:55.702631+0000","last_unstale":"2024-04-16T16:21:16.915576+0000","last_undegraded":"2024-04-16T16:21:16.915576+0000","last_fullsized":"2024-04-16T16:21:16.915576+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-04-16T16:21:16.915362+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-04-16T16:21:16.915362+0000","last_clean_scrub_stamp":"2024-04-16T16:21:16.915362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:19.166445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:22.375173+0000","last_change":"2024-04-16T16:21:22.375226+0000","last_active":"2024-04-16T16:21:22.375173+0000","last_peered":"2024-04-16T16:21:22.375173+0000","last_clean":"2024-04-16T16:21:22.375173+0000","last_became_active":"2024-04-16T16:20:56.714948+0000","last_became_peered":"2024-04-16T16:20:56.714948+0000","last_unstale":"2024-04-16T16:21:22.375173+0000","last_undegraded":"2024-04-16T16:21:22.375173+0000","last_fullsized":"2024-04-16T16:21:22.375173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:22.374931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:22.374931+0000","last_clean_scrub_stamp":"2024-04-16T16:21:22.374931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:08.450308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:17.297876+0000","last_change":"2024-04-16T16:21:17.297928+0000","last_active":"2024-04-16T16:21:17.297876+0000","last_peered":"2024-04-16T16:21:17.297876+0000","last_clean":"2024-04-16T16:21:17.297876+0000","last_became_active":"2024-04-16T16:20:55.699529+0000","last_became_peered":"2024-04-16T16:20:55.699529+0000","last_unstale":"2024-04-16T16:21:17.297876+0000","last_undegraded":"2024-04-16T16:21:17.297876+0000","last_fullsized":"2024-04-16T16:21:17.297876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:17.297677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:17.297677+0000","last_clean_scrub_stamp":"2024-04-16T16:21:17.297677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:44.253733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:30.050353+0000","last_change":"2024-04-16T16:21:30.050480+0000","last_active":"2024-04-16T16:21:30.050353+0000","last_peered":"2024-04-16T16:21:30.050353+0000","last_clean":"2024-04-16T16:21:30.050353+0000","last_became_active":"2024-04-16T16:20:56.708083+0000","last_became_peered":"2024-04-16T16:20:56.708083+0000","last_unstale":"2024-04-16T16:21:30.050353+0000","last_undegraded":"2024-04-16T16:21:30.050353+0000","last_fullsized":"2024-04-16T16:21:30.050353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:30.050158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:30.050158+0000","last_clean_scrub_stamp":"2024-04-16T16:21:30.050158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:41.532586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:18.177151+0000","last_change":"2024-04-16T16:21:18.177220+0000","last_active":"2024-04-16T16:21:18.177151+0000","last_peered":"2024-04-16T16:21:18.177151+0000","last_clean":"2024-04-16T16:21:18.177151+0000","last_became_active":"2024-04-16T16:20:55.694948+0000","last_became_peered":"2024-04-16T16:20:55.694948+0000","last_unstale":"2024-04-16T16:21:18.177151+0000","last_undegraded":"2024-04-16T16:21:18.177151+0000","last_fullsized":"2024-04-16T16:21:18.177151+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:18.176805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:18.176805+0000","last_clean_scrub_stamp":"2024-04-16T16:21:18.176805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:58.227583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:23.179093+0000","last_change":"2024-04-16T16:21:23.179179+0000","last_active":"2024-04-16T16:21:23.179093+0000","last_peered":"2024-04-16T16:21:23.179093+0000","last_clean":"2024-04-16T16:21:23.179093+0000","last_became_active":"2024-04-16T16:20:56.702294+0000","last_became_peered":"2024-04-16T16:20:56.702294+0000","last_unstale":"2024-04-16T16:21:23.179093+0000","last_undegraded":"2024-04-16T16:21:23.179093+0000","last_fullsized":"2024-04-16T16:21:23.179093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:23.178887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:23.178887+0000","last_clean_scrub_stamp":"2024-04-16T16:21:23.178887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:13:29.364620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:21.115275+0000","last_change":"2024-04-16T16:21:21.115329+0000","last_active":"2024-04-16T16:21:21.115275+0000","last_peered":"2024-04-16T16:21:21.115275+0000","last_clean":"2024-04-16T16:21:21.115275+0000","last_became_active":"2024-04-16T16:20:55.703274+0000","last_became_peered":"2024-04-16T16:20:55.703274+0000","last_unstale":"2024-04-16T16:21:21.115275+0000","last_undegraded":"2024-04-16T16:21:21.115275+0000","last_fullsized":"2024-04-16T16:21:21.115275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:21.115018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:21.115018+0000","last_clean_scrub_stamp":"2024-04-16T16:21:21.115018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:00:59.133778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:34.175895+0000","last_change":"2024-04-16T16:21:34.175949+0000","last_active":"2024-04-16T16:21:34.175895+0000","last_peered":"2024-04-16T16:21:34.175895+0000","last_clean":"2024-04-16T16:21:34.175895+0000","last_became_active":"2024-04-16T16:20:56.723078+0000","last_became_peered":"2024-04-16T16:20:56.723078+0000","last_unstale":"2024-04-16T16:21:34.175895+0000","last_undegraded":"2024-04-16T16:21:34.175895+0000","last_fullsized":"2024-04-16T16:21:34.175895+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:34.175699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:34.175699+0000","last_clean_scrub_stamp":"2024-04-16T16:21:34.175699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:59:49.450208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:23.247563+0000","last_change":"2024-04-16T16:21:23.247617+0000","last_active":"2024-04-16T16:21:23.247563+0000","last_peered":"2024-04-16T16:21:23.247563+0000","last_clean":"2024-04-16T16:21:23.247563+0000","last_became_active":"2024-04-16T16:20:55.693981+0000","last_became_peered":"2024-04-16T16:20:55.693981+0000","last_unstale":"2024-04-16T16:21:23.247563+0000","last_undegraded":"2024-04-16T16:21:23.247563+0000","last_fullsized":"2024-04-16T16:21:23.247563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:23.247350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:23.247350+0000","last_clean_scrub_stamp":"2024-04-16T16:21:23.247350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:36:31.186287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.350625+0000","last_change":"2024-04-16T16:21:20.350722+0000","last_active":"2024-04-16T16:21:20.350625+0000","last_peered":"2024-04-16T16:21:20.350625+0000","last_clean":"2024-04-16T16:21:20.350625+0000","last_became_active":"2024-04-16T16:20:56.712718+0000","last_became_peered":"2024-04-16T16:20:56.712718+0000","last_unstale":"2024-04-16T16:21:20.350625+0000","last_undegraded":"2024-04-16T16:21:20.350625+0000","last_fullsized":"2024-04-16T16:21:20.350625+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:20.350285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:20.350285+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.350285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:14:56.715991+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":31,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.113864+0000","last_change":"2024-04-16T16:21:20.114060+0000","last_active":"2024-04-16T16:21:20.113864+0000","last_peered":"2024-04-16T16:21:20.113864+0000","last_clean":"2024-04-16T16:21:20.113864+0000","last_became_active":"2024-04-16T16:20:55.701892+0000","last_became_peered":"2024-04-16T16:20:55.701892+0000","last_unstale":"2024-04-16T16:21:20.113864+0000","last_undegraded":"2024-04-16T16:21:20.113864+0000","last_fullsized":"2024-04-16T16:21:20.113864+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2024-04-16T16:21:20.113576+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2024-04-16T16:21:20.113576+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.113576+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:13:26.299308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:25.168674+0000","last_change":"2024-04-16T16:21:25.168727+0000","last_active":"2024-04-16T16:21:25.168674+0000","last_peered":"2024-04-16T16:21:25.168674+0000","last_clean":"2024-04-16T16:21:25.168674+0000","last_became_active":"2024-04-16T16:20:56.712376+0000","last_became_peered":"2024-04-16T16:20:56.712376+0000","last_unstale":"2024-04-16T16:21:25.168674+0000","last_undegraded":"2024-04-16T16:21:25.168674+0000","last_fullsized":"2024-04-16T16:21:25.168674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:25.168483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:25.168483+0000","last_clean_scrub_stamp":"2024-04-16T16:21:25.168483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:16.383183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'7","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.188222+0000","last_change":"2024-04-16T16:21:19.188288+0000","last_active":"2024-04-16T16:21:19.188222+0000","last_peered":"2024-04-16T16:21:19.188222+0000","last_clean":"2024-04-16T16:21:19.188222+0000","last_became_active":"2024-04-16T16:20:55.696792+0000","last_became_peered":"2024-04-16T16:20:55.696792+0000","last_unstale":"2024-04-16T16:21:19.188222+0000","last_undegraded":"2024-04-16T16:21:19.188222+0000","last_fullsized":"2024-04-16T16:21:19.188222+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'7","last_scrub_stamp":"2024-04-16T16:21:19.188008+0000","last_deep_scrub":"63'7","last_deep_scrub_stamp":"2024-04-16T16:21:19.188008+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.188008+0000","objects_scrubbed":4,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:13.251057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:27.321009+0000","last_change":"2024-04-16T16:21:27.321065+0000","last_active":"2024-04-16T16:21:27.321009+0000","last_peered":"2024-04-16T16:21:27.321009+0000","last_clean":"2024-04-16T16:21:27.321009+0000","last_became_active":"2024-04-16T16:20:56.702997+0000","last_became_peered":"2024-04-16T16:20:56.702997+0000","last_unstale":"2024-04-16T16:21:27.321009+0000","last_undegraded":"2024-04-16T16:21:27.321009+0000","last_fullsized":"2024-04-16T16:21:27.321009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:27.320817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:27.320817+0000","last_clean_scrub_stamp":"2024-04-16T16:21:27.320817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:08:23.068985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.268222+0000","last_change":"2024-04-16T16:21:20.268346+0000","last_active":"2024-04-16T16:21:20.268222+0000","last_peered":"2024-04-16T16:21:20.268222+0000","last_clean":"2024-04-16T16:21:20.268222+0000","last_became_active":"2024-04-16T16:20:55.691141+0000","last_became_peered":"2024-04-16T16:20:55.691141+0000","last_unstale":"2024-04-16T16:21:20.268222+0000","last_undegraded":"2024-04-16T16:21:20.268222+0000","last_fullsized":"2024-04-16T16:21:20.268222+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-04-16T16:21:20.267918+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-04-16T16:21:20.267918+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.267918+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:23.724171+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:27.135785+0000","last_change":"2024-04-16T16:21:27.135874+0000","last_active":"2024-04-16T16:21:27.135785+0000","last_peered":"2024-04-16T16:21:27.135785+0000","last_clean":"2024-04-16T16:21:27.135785+0000","last_became_active":"2024-04-16T16:20:56.716020+0000","last_became_peered":"2024-04-16T16:20:56.716020+0000","last_unstale":"2024-04-16T16:21:27.135785+0000","last_undegraded":"2024-04-16T16:21:27.135785+0000","last_fullsized":"2024-04-16T16:21:27.135785+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:27.135545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:27.135545+0000","last_clean_scrub_stamp":"2024-04-16T16:21:27.135545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:59.567649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:18.346268+0000","last_change":"2024-04-16T16:21:18.346320+0000","last_active":"2024-04-16T16:21:18.346268+0000","last_peered":"2024-04-16T16:21:18.346268+0000","last_clean":"2024-04-16T16:21:18.346268+0000","last_became_active":"2024-04-16T16:20:55.700489+0000","last_became_peered":"2024-04-16T16:20:55.700489+0000","last_unstale":"2024-04-16T16:21:18.346268+0000","last_undegraded":"2024-04-16T16:21:18.346268+0000","last_fullsized":"2024-04-16T16:21:18.346268+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:18.346064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:18.346064+0000","last_clean_scrub_stamp":"2024-04-16T16:21:18.346064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:37.422740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:26.253766+0000","last_change":"2024-04-16T16:21:26.253818+0000","last_active":"2024-04-16T16:21:26.253766+0000","last_peered":"2024-04-16T16:21:26.253766+0000","last_clean":"2024-04-16T16:21:26.253766+0000","last_became_active":"2024-04-16T16:20:56.711134+0000","last_became_peered":"2024-04-16T16:20:56.711134+0000","last_unstale":"2024-04-16T16:21:26.253766+0000","last_undegraded":"2024-04-16T16:21:26.253766+0000","last_fullsized":"2024-04-16T16:21:26.253766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:26.253559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:26.253559+0000","last_clean_scrub_stamp":"2024-04-16T16:21:26.253559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:28.504642+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.223153+0000","last_change":"2024-04-16T16:21:19.223271+0000","last_active":"2024-04-16T16:21:19.223153+0000","last_peered":"2024-04-16T16:21:19.223153+0000","last_clean":"2024-04-16T16:21:19.223153+0000","last_became_active":"2024-04-16T16:20:55.699713+0000","last_became_peered":"2024-04-16T16:20:55.699713+0000","last_unstale":"2024-04-16T16:21:19.223153+0000","last_undegraded":"2024-04-16T16:21:19.223153+0000","last_fullsized":"2024-04-16T16:21:19.223153+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:19.222899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:19.222899+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.222899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:00.737399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:30.174182+0000","last_change":"2024-04-16T16:21:30.174234+0000","last_active":"2024-04-16T16:21:30.174182+0000","last_peered":"2024-04-16T16:21:30.174182+0000","last_clean":"2024-04-16T16:21:30.174182+0000","last_became_active":"2024-04-16T16:20:56.719787+0000","last_became_peered":"2024-04-16T16:20:56.719787+0000","last_unstale":"2024-04-16T16:21:30.174182+0000","last_undegraded":"2024-04-16T16:21:30.174182+0000","last_fullsized":"2024-04-16T16:21:30.174182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:30.173955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:30.173955+0000","last_clean_scrub_stamp":"2024-04-16T16:21:30.173955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:02.294639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:22.139975+0000","last_change":"2024-04-16T16:21:22.140045+0000","last_active":"2024-04-16T16:21:22.139975+0000","last_peered":"2024-04-16T16:21:22.139975+0000","last_clean":"2024-04-16T16:21:22.139975+0000","last_became_active":"2024-04-16T16:20:55.705055+0000","last_became_peered":"2024-04-16T16:20:55.705055+0000","last_unstale":"2024-04-16T16:21:22.139975+0000","last_undegraded":"2024-04-16T16:21:22.139975+0000","last_fullsized":"2024-04-16T16:21:22.139975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'8","last_scrub_stamp":"2024-04-16T16:21:22.139769+0000","last_deep_scrub":"61'8","last_deep_scrub_stamp":"2024-04-16T16:21:22.139769+0000","last_clean_scrub_stamp":"2024-04-16T16:21:22.139769+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:08.888477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:32.136671+0000","last_change":"2024-04-16T16:21:32.136728+0000","last_active":"2024-04-16T16:21:32.136671+0000","last_peered":"2024-04-16T16:21:32.136671+0000","last_clean":"2024-04-16T16:21:32.136671+0000","last_became_active":"2024-04-16T16:20:56.721401+0000","last_became_peered":"2024-04-16T16:20:56.721401+0000","last_unstale":"2024-04-16T16:21:32.136671+0000","last_undegraded":"2024-04-16T16:21:32.136671+0000","last_fullsized":"2024-04-16T16:21:32.136671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:32.136474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:32.136474+0000","last_clean_scrub_stamp":"2024-04-16T16:21:32.136474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:05:06.656167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":27,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.268600+0000","last_change":"2024-04-16T16:21:19.268768+0000","last_active":"2024-04-16T16:21:19.268600+0000","last_peered":"2024-04-16T16:21:19.268600+0000","last_clean":"2024-04-16T16:21:19.268600+0000","last_became_active":"2024-04-16T16:20:55.690876+0000","last_became_peered":"2024-04-16T16:20:55.690876+0000","last_unstale":"2024-04-16T16:21:19.268600+0000","last_undegraded":"2024-04-16T16:21:19.268600+0000","last_fullsized":"2024-04-16T16:21:19.268600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-04-16T16:21:19.268284+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-04-16T16:21:19.268284+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.268284+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:20.899557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:29.301241+0000","last_change":"2024-04-16T16:21:29.301292+0000","last_active":"2024-04-16T16:21:29.301241+0000","last_peered":"2024-04-16T16:21:29.301241+0000","last_clean":"2024-04-16T16:21:29.301241+0000","last_became_active":"2024-04-16T16:20:56.706346+0000","last_became_peered":"2024-04-16T16:20:56.706346+0000","last_unstale":"2024-04-16T16:21:29.301241+0000","last_undegraded":"2024-04-16T16:21:29.301241+0000","last_fullsized":"2024-04-16T16:21:29.301241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:29.301015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:29.301015+0000","last_clean_scrub_stamp":"2024-04-16T16:21:29.301015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:52.544005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:15.892690+0000","last_change":"2024-04-16T16:21:15.892869+0000","last_active":"2024-04-16T16:21:15.892690+0000","last_peered":"2024-04-16T16:21:15.892690+0000","last_clean":"2024-04-16T16:21:15.892690+0000","last_became_active":"2024-04-16T16:20:55.696320+0000","last_became_peered":"2024-04-16T16:20:55.696320+0000","last_unstale":"2024-04-16T16:21:15.892690+0000","last_undegraded":"2024-04-16T16:21:15.892690+0000","last_fullsized":"2024-04-16T16:21:15.892690+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-04-16T16:21:15.892460+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-04-16T16:21:15.892460+0000","last_clean_scrub_stamp":"2024-04-16T16:21:15.892460+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:20:09.428012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:32.105843+0000","last_change":"2024-04-16T16:21:32.105897+0000","last_active":"2024-04-16T16:21:32.105843+0000","last_peered":"2024-04-16T16:21:32.105843+0000","last_clean":"2024-04-16T16:21:32.105843+0000","last_became_active":"2024-04-16T16:20:56.711870+0000","last_became_peered":"2024-04-16T16:20:56.711870+0000","last_unstale":"2024-04-16T16:21:32.105843+0000","last_undegraded":"2024-04-16T16:21:32.105843+0000","last_fullsized":"2024-04-16T16:21:32.105843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:32.105635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:32.105635+0000","last_clean_scrub_stamp":"2024-04-16T16:21:32.105635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:39.511819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":27,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:21.188718+0000","last_change":"2024-04-16T16:21:21.188778+0000","last_active":"2024-04-16T16:21:21.188718+0000","last_peered":"2024-04-16T16:21:21.188718+0000","last_clean":"2024-04-16T16:21:21.188718+0000","last_became_active":"2024-04-16T16:20:55.701851+0000","last_became_peered":"2024-04-16T16:20:55.701851+0000","last_unstale":"2024-04-16T16:21:21.188718+0000","last_undegraded":"2024-04-16T16:21:21.188718+0000","last_fullsized":"2024-04-16T16:21:21.188718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'1","last_scrub_stamp":"2024-04-16T16:21:21.188528+0000","last_deep_scrub":"61'1","last_deep_scrub_stamp":"2024-04-16T16:21:21.188528+0000","last_clean_scrub_stamp":"2024-04-16T16:21:21.188528+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:00:59.207288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:24.143181+0000","last_change":"2024-04-16T16:21:24.143233+0000","last_active":"2024-04-16T16:21:24.143181+0000","last_peered":"2024-04-16T16:21:24.143181+0000","last_clean":"2024-04-16T16:21:24.143181+0000","last_became_active":"2024-04-16T16:20:56.712262+0000","last_became_peered":"2024-04-16T16:20:56.712262+0000","last_unstale":"2024-04-16T16:21:24.143181+0000","last_undegraded":"2024-04-16T16:21:24.143181+0000","last_fullsized":"2024-04-16T16:21:24.143181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:24.142945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:24.142945+0000","last_clean_scrub_stamp":"2024-04-16T16:21:24.142945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:47:02.783891+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:13.944194+0000","last_change":"2024-04-16T16:21:13.944244+0000","last_active":"2024-04-16T16:21:13.944194+0000","last_peered":"2024-04-16T16:21:13.944194+0000","last_clean":"2024-04-16T16:21:13.944194+0000","last_became_active":"2024-04-16T16:20:55.697094+0000","last_became_peered":"2024-04-16T16:20:55.697094+0000","last_unstale":"2024-04-16T16:21:13.944194+0000","last_undegraded":"2024-04-16T16:21:13.944194+0000","last_fullsized":"2024-04-16T16:21:13.944194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:13.944012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:13.944012+0000","last_clean_scrub_stamp":"2024-04-16T16:21:13.944012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:13:20.129744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:28.342022+0000","last_change":"2024-04-16T16:21:28.342078+0000","last_active":"2024-04-16T16:21:28.342022+0000","last_peered":"2024-04-16T16:21:28.342022+0000","last_clean":"2024-04-16T16:21:28.342022+0000","last_became_active":"2024-04-16T16:20:56.704042+0000","last_became_peered":"2024-04-16T16:20:56.704042+0000","last_unstale":"2024-04-16T16:21:28.342022+0000","last_undegraded":"2024-04-16T16:21:28.342022+0000","last_fullsized":"2024-04-16T16:21:28.342022+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:28.341832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:28.341832+0000","last_clean_scrub_stamp":"2024-04-16T16:21:28.341832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:40.824694+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'3","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:21.242472+0000","last_change":"2024-04-16T16:21:21.242621+0000","last_active":"2024-04-16T16:21:21.242472+0000","last_peered":"2024-04-16T16:21:21.242472+0000","last_clean":"2024-04-16T16:21:21.242472+0000","last_became_active":"2024-04-16T16:20:55.690748+0000","last_became_peered":"2024-04-16T16:20:55.690748+0000","last_unstale":"2024-04-16T16:21:21.242472+0000","last_undegraded":"2024-04-16T16:21:21.242472+0000","last_fullsized":"2024-04-16T16:21:21.242472+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'3","last_scrub_stamp":"2024-04-16T16:21:21.242203+0000","last_deep_scrub":"63'3","last_deep_scrub_stamp":"2024-04-16T16:21:21.242203+0000","last_clean_scrub_stamp":"2024-04-16T16:21:21.242203+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:12:32.303368+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:23.937727+0000","last_change":"2024-04-16T16:21:23.937900+0000","last_active":"2024-04-16T16:21:23.937727+0000","last_peered":"2024-04-16T16:21:23.937727+0000","last_clean":"2024-04-16T16:21:23.937727+0000","last_became_active":"2024-04-16T16:20:56.713468+0000","last_became_peered":"2024-04-16T16:20:56.713468+0000","last_unstale":"2024-04-16T16:21:23.937727+0000","last_undegraded":"2024-04-16T16:21:23.937727+0000","last_fullsized":"2024-04-16T16:21:23.937727+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:23.937493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:23.937493+0000","last_clean_scrub_stamp":"2024-04-16T16:21:23.937493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:56.058177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:14.407483+0000","last_change":"2024-04-16T16:21:14.407535+0000","last_active":"2024-04-16T16:21:14.407483+0000","last_peered":"2024-04-16T16:21:14.407483+0000","last_clean":"2024-04-16T16:21:14.407483+0000","last_became_active":"2024-04-16T16:20:55.694288+0000","last_became_peered":"2024-04-16T16:20:55.694288+0000","last_unstale":"2024-04-16T16:21:14.407483+0000","last_undegraded":"2024-04-16T16:21:14.407483+0000","last_fullsized":"2024-04-16T16:21:14.407483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:14.407265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:14.407265+0000","last_clean_scrub_stamp":"2024-04-16T16:21:14.407265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:48:23.802275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:25.977855+0000","last_change":"2024-04-16T16:21:25.977909+0000","last_active":"2024-04-16T16:21:25.977855+0000","last_peered":"2024-04-16T16:21:25.977855+0000","last_clean":"2024-04-16T16:21:25.977855+0000","last_became_active":"2024-04-16T16:20:56.715293+0000","last_became_peered":"2024-04-16T16:20:56.715293+0000","last_unstale":"2024-04-16T16:21:25.977855+0000","last_undegraded":"2024-04-16T16:21:25.977855+0000","last_fullsized":"2024-04-16T16:21:25.977855+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:25.977559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:25.977559+0000","last_clean_scrub_stamp":"2024-04-16T16:21:25.977559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:05:00.497252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:18.264936+0000","last_change":"2024-04-16T16:21:18.264987+0000","last_active":"2024-04-16T16:21:18.264936+0000","last_peered":"2024-04-16T16:21:18.264936+0000","last_clean":"2024-04-16T16:21:18.264936+0000","last_became_active":"2024-04-16T16:20:55.699739+0000","last_became_peered":"2024-04-16T16:20:55.699739+0000","last_unstale":"2024-04-16T16:21:18.264936+0000","last_undegraded":"2024-04-16T16:21:18.264936+0000","last_fullsized":"2024-04-16T16:21:18.264936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:18.264753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:18.264753+0000","last_clean_scrub_stamp":"2024-04-16T16:21:18.264753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:22:29.613377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:23.205252+0000","last_change":"2024-04-16T16:21:23.205303+0000","last_active":"2024-04-16T16:21:23.205252+0000","last_peered":"2024-04-16T16:21:23.205252+0000","last_clean":"2024-04-16T16:21:23.205252+0000","last_became_active":"2024-04-16T16:20:56.691057+0000","last_became_peered":"2024-04-16T16:20:56.691057+0000","last_unstale":"2024-04-16T16:21:23.205252+0000","last_undegraded":"2024-04-16T16:21:23.205252+0000","last_fullsized":"2024-04-16T16:21:23.205252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:23.205015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:23.205015+0000","last_clean_scrub_stamp":"2024-04-16T16:21:23.205015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:03.321827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:16.340805+0000","last_change":"2024-04-16T16:21:16.340878+0000","last_active":"2024-04-16T16:21:16.340805+0000","last_peered":"2024-04-16T16:21:16.340805+0000","last_clean":"2024-04-16T16:21:16.340805+0000","last_became_active":"2024-04-16T16:20:55.700949+0000","last_became_peered":"2024-04-16T16:20:55.700949+0000","last_unstale":"2024-04-16T16:21:16.340805+0000","last_undegraded":"2024-04-16T16:21:16.340805+0000","last_fullsized":"2024-04-16T16:21:16.340805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-04-16T16:21:16.340628+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-04-16T16:21:16.340628+0000","last_clean_scrub_stamp":"2024-04-16T16:21:16.340628+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:35.499459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:30.259026+0000","last_change":"2024-04-16T16:21:30.259078+0000","last_active":"2024-04-16T16:21:30.259026+0000","last_peered":"2024-04-16T16:21:30.259026+0000","last_clean":"2024-04-16T16:21:30.259026+0000","last_became_active":"2024-04-16T16:20:56.713909+0000","last_became_peered":"2024-04-16T16:20:56.713909+0000","last_unstale":"2024-04-16T16:21:30.259026+0000","last_undegraded":"2024-04-16T16:21:30.259026+0000","last_fullsized":"2024-04-16T16:21:30.259026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:30.258841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:30.258841+0000","last_clean_scrub_stamp":"2024-04-16T16:21:30.258841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:02.379525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"63'1","reported_seq":26,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:18.912229+0000","last_change":"2024-04-16T16:21:18.912296+0000","last_active":"2024-04-16T16:21:18.912229+0000","last_peered":"2024-04-16T16:21:18.912229+0000","last_clean":"2024-04-16T16:21:18.912229+0000","last_became_active":"2024-04-16T16:20:55.703280+0000","last_became_peered":"2024-04-16T16:20:55.703280+0000","last_unstale":"2024-04-16T16:21:18.912229+0000","last_undegraded":"2024-04-16T16:21:18.912229+0000","last_fullsized":"2024-04-16T16:21:18.912229+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'1","last_scrub_stamp":"2024-04-16T16:21:18.912040+0000","last_deep_scrub":"63'1","last_deep_scrub_stamp":"2024-04-16T16:21:18.912040+0000","last_clean_scrub_stamp":"2024-04-16T16:21:18.912040+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:10.126740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.364731+0000","last_change":"2024-04-16T16:21:19.364831+0000","last_active":"2024-04-16T16:21:19.364731+0000","last_peered":"2024-04-16T16:21:19.364731+0000","last_clean":"2024-04-16T16:21:19.364731+0000","last_became_active":"2024-04-16T16:20:56.712726+0000","last_became_peered":"2024-04-16T16:20:56.712726+0000","last_unstale":"2024-04-16T16:21:19.364731+0000","last_undegraded":"2024-04-16T16:21:19.364731+0000","last_fullsized":"2024-04-16T16:21:19.364731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:19.364451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:19.364451+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.364451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:25:12.732555+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.334764+0000","last_change":"2024-04-16T16:21:20.334820+0000","last_active":"2024-04-16T16:21:20.334764+0000","last_peered":"2024-04-16T16:21:20.334764+0000","last_clean":"2024-04-16T16:21:20.334764+0000","last_became_active":"2024-04-16T16:20:55.703181+0000","last_became_peered":"2024-04-16T16:20:55.703181+0000","last_unstale":"2024-04-16T16:21:20.334764+0000","last_undegraded":"2024-04-16T16:21:20.334764+0000","last_fullsized":"2024-04-16T16:21:20.334764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:20.334562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:20.334562+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.334562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:31.347518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:21.888787+0000","last_change":"2024-04-16T16:21:21.888891+0000","last_active":"2024-04-16T16:21:21.888787+0000","last_peered":"2024-04-16T16:21:21.888787+0000","last_clean":"2024-04-16T16:21:21.888787+0000","last_became_active":"2024-04-16T16:20:56.707589+0000","last_became_peered":"2024-04-16T16:20:56.707589+0000","last_unstale":"2024-04-16T16:21:21.888787+0000","last_undegraded":"2024-04-16T16:21:21.888787+0000","last_fullsized":"2024-04-16T16:21:21.888787+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:21.888561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:21.888561+0000","last_clean_scrub_stamp":"2024-04-16T16:21:21.888561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:34.371423+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.224435+0000","last_change":"2024-04-16T16:21:20.224487+0000","last_active":"2024-04-16T16:21:20.224435+0000","last_peered":"2024-04-16T16:21:20.224435+0000","last_clean":"2024-04-16T16:21:20.224435+0000","last_became_active":"2024-04-16T16:20:55.700921+0000","last_became_peered":"2024-04-16T16:20:55.700921+0000","last_unstale":"2024-04-16T16:21:20.224435+0000","last_undegraded":"2024-04-16T16:21:20.224435+0000","last_fullsized":"2024-04-16T16:21:20.224435+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:20.224158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:20.224158+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.224158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:29:33.829521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:27.168366+0000","last_change":"2024-04-16T16:21:27.168451+0000","last_active":"2024-04-16T16:21:27.168366+0000","last_peered":"2024-04-16T16:21:27.168366+0000","last_clean":"2024-04-16T16:21:27.168366+0000","last_became_active":"2024-04-16T16:20:56.707599+0000","last_became_peered":"2024-04-16T16:20:56.707599+0000","last_unstale":"2024-04-16T16:21:27.168366+0000","last_undegraded":"2024-04-16T16:21:27.168366+0000","last_fullsized":"2024-04-16T16:21:27.168366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:27.168166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:27.168166+0000","last_clean_scrub_stamp":"2024-04-16T16:21:27.168166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:12.401367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:17.343052+0000","last_change":"2024-04-16T16:21:17.343127+0000","last_active":"2024-04-16T16:21:17.343052+0000","last_peered":"2024-04-16T16:21:17.343052+0000","last_clean":"2024-04-16T16:21:17.343052+0000","last_became_active":"2024-04-16T16:20:55.703833+0000","last_became_peered":"2024-04-16T16:20:55.703833+0000","last_unstale":"2024-04-16T16:21:17.343052+0000","last_undegraded":"2024-04-16T16:21:17.343052+0000","last_fullsized":"2024-04-16T16:21:17.343052+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:17.342850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:17.342850+0000","last_clean_scrub_stamp":"2024-04-16T16:21:17.342850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:57.273060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:31.132335+0000","last_change":"2024-04-16T16:21:31.132399+0000","last_active":"2024-04-16T16:21:31.132335+0000","last_peered":"2024-04-16T16:21:31.132335+0000","last_clean":"2024-04-16T16:21:31.132335+0000","last_became_active":"2024-04-16T16:20:56.720635+0000","last_became_peered":"2024-04-16T16:20:56.720635+0000","last_unstale":"2024-04-16T16:21:31.132335+0000","last_undegraded":"2024-04-16T16:21:31.132335+0000","last_fullsized":"2024-04-16T16:21:31.132335+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:31.132088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:31.132088+0000","last_clean_scrub_stamp":"2024-04-16T16:21:31.132088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:37.210246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:20.228905+0000","last_change":"2024-04-16T16:21:20.229006+0000","last_active":"2024-04-16T16:21:20.228905+0000","last_peered":"2024-04-16T16:21:20.228905+0000","last_clean":"2024-04-16T16:21:20.228905+0000","last_became_active":"2024-04-16T16:20:55.697388+0000","last_became_peered":"2024-04-16T16:20:55.697388+0000","last_unstale":"2024-04-16T16:21:20.228905+0000","last_undegraded":"2024-04-16T16:21:20.228905+0000","last_fullsized":"2024-04-16T16:21:20.228905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:20.228674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:20.228674+0000","last_clean_scrub_stamp":"2024-04-16T16:21:20.228674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:46.328687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:22.358563+0000","last_change":"2024-04-16T16:21:22.358681+0000","last_active":"2024-04-16T16:21:22.358563+0000","last_peered":"2024-04-16T16:21:22.358563+0000","last_clean":"2024-04-16T16:21:22.358563+0000","last_became_active":"2024-04-16T16:20:56.713994+0000","last_became_peered":"2024-04-16T16:20:56.713994+0000","last_unstale":"2024-04-16T16:21:22.358563+0000","last_undegraded":"2024-04-16T16:21:22.358563+0000","last_fullsized":"2024-04-16T16:21:22.358563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:22.358193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:22.358193+0000","last_clean_scrub_stamp":"2024-04-16T16:21:22.358193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:57.557188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:15.387080+0000","last_change":"2024-04-16T16:21:15.387130+0000","last_active":"2024-04-16T16:21:15.387080+0000","last_peered":"2024-04-16T16:21:15.387080+0000","last_clean":"2024-04-16T16:21:15.387080+0000","last_became_active":"2024-04-16T16:20:55.698010+0000","last_became_peered":"2024-04-16T16:20:55.698010+0000","last_unstale":"2024-04-16T16:21:15.387080+0000","last_undegraded":"2024-04-16T16:21:15.387080+0000","last_fullsized":"2024-04-16T16:21:15.387080+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:15.386832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:15.386832+0000","last_clean_scrub_stamp":"2024-04-16T16:21:15.386832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:11.724662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:28.120086+0000","last_change":"2024-04-16T16:21:28.120231+0000","last_active":"2024-04-16T16:21:28.120086+0000","last_peered":"2024-04-16T16:21:28.120086+0000","last_clean":"2024-04-16T16:21:28.120086+0000","last_became_active":"2024-04-16T16:20:56.707700+0000","last_became_peered":"2024-04-16T16:20:56.707700+0000","last_unstale":"2024-04-16T16:21:28.120086+0000","last_undegraded":"2024-04-16T16:21:28.120086+0000","last_fullsized":"2024-04-16T16:21:28.120086+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:28.119857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:28.119857+0000","last_clean_scrub_stamp":"2024-04-16T16:21:28.119857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:03:48.408610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:22.234633+0000","last_change":"2024-04-16T16:21:22.234691+0000","last_active":"2024-04-16T16:21:22.234633+0000","last_peered":"2024-04-16T16:21:22.234633+0000","last_clean":"2024-04-16T16:21:22.234633+0000","last_became_active":"2024-04-16T16:20:55.692136+0000","last_became_peered":"2024-04-16T16:20:55.692136+0000","last_unstale":"2024-04-16T16:21:22.234633+0000","last_undegraded":"2024-04-16T16:21:22.234633+0000","last_fullsized":"2024-04-16T16:21:22.234633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:22.234387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:22.234387+0000","last_clean_scrub_stamp":"2024-04-16T16:21:22.234387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:18.114414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:34.111091+0000","last_change":"2024-04-16T16:21:34.111148+0000","last_active":"2024-04-16T16:21:34.111091+0000","last_peered":"2024-04-16T16:21:34.111091+0000","last_clean":"2024-04-16T16:21:34.111091+0000","last_became_active":"2024-04-16T16:20:56.719960+0000","last_became_peered":"2024-04-16T16:20:56.719960+0000","last_unstale":"2024-04-16T16:21:34.111091+0000","last_undegraded":"2024-04-16T16:21:34.111091+0000","last_fullsized":"2024-04-16T16:21:34.111091+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:34.110811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:34.110811+0000","last_clean_scrub_stamp":"2024-04-16T16:21:34.110811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:00.387369+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.343563+0000","last_change":"2024-04-16T16:21:19.343615+0000","last_active":"2024-04-16T16:21:19.343563+0000","last_peered":"2024-04-16T16:21:19.343563+0000","last_clean":"2024-04-16T16:21:19.343563+0000","last_became_active":"2024-04-16T16:20:55.702560+0000","last_became_peered":"2024-04-16T16:20:55.702560+0000","last_unstale":"2024-04-16T16:21:19.343563+0000","last_undegraded":"2024-04-16T16:21:19.343563+0000","last_fullsized":"2024-04-16T16:21:19.343563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T16:21:19.343369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T16:21:19.343369+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.343369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:22:15.681200+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"63'119","reported_seq":262,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-16T16:21:19.148612+0000","last_change":"2024-04-16T16:21:19.148682+0000","last_active":"2024-04-16T16:21:19.148612+0000","last_peered":"2024-04-16T16:21:19.148612+0000","last_clean":"2024-04-16T16:21:19.148612+0000","last_became_active":"2024-04-16T16:16:37.516729+0000","last_became_peered":"2024-04-16T16:16:37.516729+0000","last_unstale":"2024-04-16T16:21:19.148612+0000","last_undegraded":"2024-04-16T16:21:19.148612+0000","last_fullsized":"2024-04-16T16:21:19.148612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'119","last_scrub_stamp":"2024-04-16T16:21:19.148414+0000","last_deep_scrub":"63'119","last_deep_scrub_stamp":"2024-04-16T16:21:19.148414+0000","last_clean_scrub_stamp":"2024-04-16T16:21:19.148414+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:25:21.740841+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1359872,"data_stored":910592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":757760,"data_stored":320064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":765952,"data_stored":320716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":770048,"data_stored":321676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":765952,"data_stored":320120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":765952,"data_stored":320120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":761856,"data_stored":320154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1368064,"data_stored":912626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T16:21:39.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-16T16:21:39.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.917+0000 7faa95a00640 1 Processor -- start 2024-04-16T16:21:39.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.917+0000 7faa95a00640 1 -- start start 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa95a00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faa9015c840 0x7faa900d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa95a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faa9006e930 0x7faa900d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa95a00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa9015cc20 con 0x7faa900cc830 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa95a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7faa900ce390 con 0x7faa9006e930 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa95a00640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7faa9006dda0 con 0x7faa9015c840 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa95000640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faa9006e930 0x7faa900d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa87400640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faa900cc830 0x7faa90160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51406/0 (socket says 172.21.15.22:51406) 2024-04-16T16:21:39.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.919+0000 7faa87400640 1 -- 172.21.15.22:0/2077411378 learned_addr learned my addr 172.21.15.22:0/2077411378 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-04-16T16:21:39.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.920+0000 7faa95000640 1 -- 172.21.15.22:0/2077411378 >> v2:172.21.15.43:3300/0 conn(0x7faa9015c840 msgr2=0x7faa900d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.920+0000 7faa95000640 1 --2- 172.21.15.22:0/2077411378 >> v2:172.21.15.43:3300/0 conn(0x7faa9015c840 0x7faa900d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.920+0000 7faa95000640 1 -- 172.21.15.22:0/2077411378 >> v1:172.21.15.22:6789/0 conn(0x7faa900cc830 legacy=0x7faa90160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.920+0000 7faa8f400640 1 -- 172.21.15.22:0/2077411378 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166093853 0 0) 0x7faa78001110 con 0x7faa900cc830 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.920+0000 7faa95000640 1 -- 172.21.15.22:0/2077411378 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9006d800 con 0x7faa9006e930 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.921+0000 7faa95000640 1 --2- 172.21.15.22:0/2077411378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa9006e930 0x7faa900d0840 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faa900b56b0 tx=0x7faa8802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23089bdd886cee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.921+0000 7faa8f400640 1 -- 172.21.15.22:0/2077411378 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88039070 con 0x7faa9006e930 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.921+0000 7faa8f400640 1 -- 172.21.15.22:0/2077411378 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8802cbf0 con 0x7faa9006e930 2024-04-16T16:21:39.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.921+0000 7faa8f400640 1 -- 172.21.15.22:0/2077411378 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88034440 con 0x7faa9006e930 2024-04-16T16:21:39.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 -- 172.21.15.22:0/2077411378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa9006e930 msgr2=0x7faa900d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 --2- 172.21.15.22:0/2077411378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa9006e930 0x7faa900d0840 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faa900b56b0 tx=0x7faa8802be40 comp rx=0 tx=0).stop 2024-04-16T16:21:39.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 -- 172.21.15.22:0/2077411378 shutdown_connections 2024-04-16T16:21:39.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 --2- 172.21.15.22:0/2077411378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa9006e930 0x7faa900d0840 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 --2- 172.21.15.22:0/2077411378 >> v2:172.21.15.43:3300/0 conn(0x7faa9015c840 0x7faa900d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 -- 172.21.15.22:0/2077411378 >> 172.21.15.22:0/2077411378 conn(0x7faa90062440 msgr2=0x7faa90062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:39.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 -- 172.21.15.22:0/2077411378 shutdown_connections 2024-04-16T16:21:39.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.922+0000 7faa95a00640 1 -- 172.21.15.22:0/2077411378 wait complete. 2024-04-16T16:21:39.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.924+0000 7faa95a00640 1 Processor -- start 2024-04-16T16:21:39.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.924+0000 7faa95a00640 1 -- start start 2024-04-16T16:21:39.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa95a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa9006e930 0x7faa9014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa95a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa900cc830 0x7faa900ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa95a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9015c840 0x7faa900aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa95a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa900ce8a0 con 0x7faa900cc830 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa95a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faa900ce5c0 con 0x7faa9015c840 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa95a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faa900ceb80 con 0x7faa9006e930 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa900cc830 0x7faa900ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa900cc830 0x7faa900ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53280/0 (socket says 172.21.15.22:53280) 2024-04-16T16:21:39.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 -- 172.21.15.22:0/153944574 learned_addr learned my addr 172.21.15.22:0/153944574 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:39.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 -- 172.21.15.22:0/153944574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa9006e930 msgr2=0x7faa9014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa9006e930 0x7faa9014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa95000640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9015c840 0x7faa900aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 -- 172.21.15.22:0/153944574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9015c840 msgr2=0x7faa900aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9015c840 0x7faa900aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.925+0000 7faa87400640 1 -- 172.21.15.22:0/153944574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa900b4b50 con 0x7faa900cc830 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.926+0000 7faa87400640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa900cc830 0x7faa900ae860 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c780 tx=0x7faa7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.926+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78018070 con 0x7faa900cc830 2024-04-16T16:21:39.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.926+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa780072d0 con 0x7faa900cc830 2024-04-16T16:21:39.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.926+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780047e0 con 0x7faa900cc830 2024-04-16T16:21:39.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.926+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa900b4e30 con 0x7faa900cc830 2024-04-16T16:21:39.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.926+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa900b53f0 con 0x7faa900cc830 2024-04-16T16:21:39.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.927+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa90075f30 con 0x7faa900cc830 2024-04-16T16:21:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.928+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7faa7801b070 con 0x7faa900cc830 2024-04-16T16:21:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.929+0000 7faa8cc00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa6c06ce90 0x7faa6c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.929+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7faa7808ba00 con 0x7faa900cc830 2024-04-16T16:21:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.929+0000 7faa8fe00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa6c06ce90 0x7faa6c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:39.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.930+0000 7faa8fe00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa6c06ce90 0x7faa6c06f350 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa90068df0 tx=0x7faa80006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:39.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:39.934+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa9015cc20 con 0x7faa900cc830 2024-04-16T16:21:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.138+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7faa90062e80 con 0x7faa900cc830 2024-04-16T16:21:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.144+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v19)=0 v19) ==== 123+0+0 (secure 0 0 0) 0x7faa78059520 con 0x7faa900cc830 2024-04-16T16:21:40.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.147+0000 7faa8cc00640 1 -- 172.21.15.22:0/153944574 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faa78091080 con 0x7faa900cc830 2024-04-16T16:21:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa6c06ce90 msgr2=0x7faa6c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa6c06ce90 0x7faa6c06f350 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa90068df0 tx=0x7faa80006bf0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa900cc830 msgr2=0x7faa900ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa900cc830 0x7faa900ae860 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c780 tx=0x7faa7800cc40 comp rx=0 tx=0).stop 2024-04-16T16:21:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 shutdown_connections 2024-04-16T16:21:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7faa6c06ce90 0x7faa6c06f350 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9015c840 0x7faa900aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa900cc830 0x7faa900ae860 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 --2- 172.21.15.22:0/153944574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa9006e930 0x7faa9014e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 >> 172.21.15.22:0/153944574 conn(0x7faa90062440 msgr2=0x7faa9014f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:40.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 shutdown_connections 2024-04-16T16:21:40.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.150+0000 7faa95a00640 1 -- 172.21.15.22:0/153944574 wait complete. 2024-04-16T16:21:40.159 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:21:40.160+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:21:40.159 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:21:40.160+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:21:40.159 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:21:40.161+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:21:40.160 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:21:40.161+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:21:40.160 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-04-16T16:21:40.161+0000 7f04e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-16T16:21:40.168 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T16:21:40.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T16:21:40.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.359+0000 7fc866a00640 1 Processor -- start 2024-04-16T16:21:40.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.359+0000 7fc866a00640 1 -- start start 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc866a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 0x7fc8600b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc866a00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8600cc810 0x7fc86006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc866a00640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86006d160 con 0x7fc86006ee80 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc866a00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc86006cf10 con 0x7fc8600cc810 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc866a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc86006d440 con 0x7fc86006eaa0 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc864c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8600cc810 0x7fc86006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc864c00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8600cc810 0x7fc86006df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53306/0 (socket says 172.21.15.22:53306) 2024-04-16T16:21:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.361+0000 7fc864c00640 1 -- 172.21.15.22:0/609515549 learned_addr learned my addr 172.21.15.22:0/609515549 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:40.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.362+0000 7fc865600640 1 --2- 172.21.15.22:0/609515549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 0x7fc8600b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:40.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.362+0000 7fc864c00640 1 -- 172.21.15.22:0/609515549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 msgr2=0x7fc8600b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T16:21:40.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.362+0000 7fc864c00640 1 --2- 172.21.15.22:0/609515549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 0x7fc8600b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.362+0000 7fc864c00640 1 -- 172.21.15.22:0/609515549 >> v1:172.21.15.43:6789/0 conn(0x7fc86006ee80 legacy=0x7fc86015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.362+0000 7fc864c00640 1 -- 172.21.15.22:0/609515549 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86006d720 con 0x7fc8600cc810 2024-04-16T16:21:40.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.363+0000 7fc864c00640 1 --2- 172.21.15.22:0/609515549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86006df00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009870 tx=0x7fc84c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fa45d25a15fb23 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.363+0000 7fc85fe00640 1 -- 172.21.15.22:0/609515549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c034070 con 0x7fc8600cc810 2024-04-16T16:21:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.363+0000 7fc85fe00640 1 -- 172.21.15.22:0/609515549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc84c030840 con 0x7fc8600cc810 2024-04-16T16:21:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.363+0000 7fc85fe00640 1 -- 172.21.15.22:0/609515549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c030c30 con 0x7fc8600cc810 2024-04-16T16:21:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 -- 172.21.15.22:0/609515549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 msgr2=0x7fc86006df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 --2- 172.21.15.22:0/609515549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86006df00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009870 tx=0x7fc84c02b980 comp rx=0 tx=0).stop 2024-04-16T16:21:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 -- 172.21.15.22:0/609515549 shutdown_connections 2024-04-16T16:21:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 --2- 172.21.15.22:0/609515549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86006df00 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 --2- 172.21.15.22:0/609515549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 0x7fc8600b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 -- 172.21.15.22:0/609515549 >> 172.21.15.22:0/609515549 conn(0x7fc860062440 msgr2=0x7fc860062820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:40.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 -- 172.21.15.22:0/609515549 shutdown_connections 2024-04-16T16:21:40.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.364+0000 7fc866a00640 1 -- 172.21.15.22:0/609515549 wait complete. 2024-04-16T16:21:40.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.366+0000 7fc866a00640 1 Processor -- start 2024-04-16T16:21:40.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.366+0000 7fc866a00640 1 -- start start 2024-04-16T16:21:40.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 0x7fc860150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc86006ee80 0x7fc8601523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc86006e440 con 0x7fc8600cc810 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc8600b4360 con 0x7fc86006ee80 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc86015c910 con 0x7fc86006eaa0 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86015b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53312/0 (socket says 172.21.15.22:53312) 2024-04-16T16:21:40.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 -- 172.21.15.22:0/2210667438 learned_addr learned my addr 172.21.15.22:0/2210667438 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc864c00640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc86006ee80 0x7fc8601523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 -- 172.21.15.22:0/2210667438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 msgr2=0x7fc860150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 0x7fc860150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 -- 172.21.15.22:0/2210667438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc86006ee80 msgr2=0x7fc8601523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc86006ee80 0x7fc8601523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.367+0000 7fc866000640 1 -- 172.21.15.22:0/2210667438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86015bcc0 con 0x7fc8600cc810 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.368+0000 7fc866000640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86015b780 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c7d0 tx=0x7fc85800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:40.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.368+0000 7fc85d600640 1 -- 172.21.15.22:0/2210667438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858003b70 con 0x7fc8600cc810 2024-04-16T16:21:40.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.368+0000 7fc85d600640 1 -- 172.21.15.22:0/2210667438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc858003d30 con 0x7fc8600cc810 2024-04-16T16:21:40.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.368+0000 7fc85d600640 1 -- 172.21.15.22:0/2210667438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85800aab0 con 0x7fc8600cc810 2024-04-16T16:21:40.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.368+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc860151620 con 0x7fc8600cc810 2024-04-16T16:21:40.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.368+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc860151be0 con 0x7fc8600cc810 2024-04-16T16:21:40.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.369+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc860075f30 con 0x7fc8600cc810 2024-04-16T16:21:40.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.370+0000 7fc85d600640 1 -- 172.21.15.22:0/2210667438 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 91550+0+0 (secure 0 0 0) 0x7fc85800ac50 con 0x7fc8600cc810 2024-04-16T16:21:40.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.371+0000 7fc85d600640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc84006ce90 0x7fc84006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T16:21:40.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.371+0000 7fc85d600640 1 -- 172.21.15.22:0/2210667438 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5795+0+0 (secure 0 0 0) 0x7fc85808c540 con 0x7fc8600cc810 2024-04-16T16:21:40.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.372+0000 7fc865600640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc84006ce90 0x7fc84006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T16:21:40.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.372+0000 7fc865600640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc84006ce90 0x7fc84006f350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc854006fd0 tx=0x7fc854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T16:21:40.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.376+0000 7fc85d600640 1 -- 172.21.15.22:0/2210667438 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc85805a0f0 con 0x7fc8600cc810 2024-04-16T16:21:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.614+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc860068b70 con 0x7fc8600cc810 2024-04-16T16:21:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.615+0000 7fc85d600640 1 -- 172.21.15.22:0/2210667438 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+4357 (secure 0 0 0) 0x7fc8580599f0 con 0x7fc8600cc810 2024-04-16T16:21:40.614 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-16T16:21:40.614 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4005390609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4005390609},{"type":"v1","addr":"172.21.15.43:6835","nonce":4005390609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5350,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3406985834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3406985834},{"type":"v1","addr":"172.21.15.43:6833","nonce":3406985834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T16:20:56.164231+0000","modified":"2024-04-16T16:21:15.535895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6264":{"gid":6264,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6836/1482042737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1482042737},{"type":"v1","addr":"172.21.15.22:6836","nonce":1482042737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6264,"qdb_cluster":[6264]},"id":4}]} 2024-04-16T16:21:40.614 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 39 2024-04-16T16:21:40.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc84006ce90 msgr2=0x7fc84006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc84006ce90 0x7fc84006f350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc854006fd0 tx=0x7fc854008040 comp rx=0 tx=0).stop 2024-04-16T16:21:40.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 msgr2=0x7fc86015b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T16:21:40.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86015b780 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c7d0 tx=0x7fc85800cc90 comp rx=0 tx=0).stop 2024-04-16T16:21:40.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 shutdown_connections 2024-04-16T16:21:40.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:6832/1860401634,v1:172.21.15.22:6833/1860401634] conn(0x7fc84006ce90 0x7fc84006f350 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8600cc810 0x7fc86015b780 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc86006ee80 0x7fc8601523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 --2- 172.21.15.22:0/2210667438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc86006eaa0 0x7fc860150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T16:21:40.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.618+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 >> 172.21.15.22:0/2210667438 conn(0x7fc860062440 msgr2=0x7fc8600cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T16:21:40.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.619+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 shutdown_connections 2024-04-16T16:21:40.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-04-16T16:21:40.619+0000 7fc866a00640 1 -- 172.21.15.22:0/2210667438 wait complete. 2024-04-16T16:21:40.634 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-16T16:21:40.635 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T16:21:40.635 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T16:21:40.635 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:40.656 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T16:21:40.657 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T16:21:40.657 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:40.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:21:40.657 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-04-16T16:21:40.664 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T16:21:40.665 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T16:21:40.665 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:40.687 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T16:21:40.688 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T16:21:40.688 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:40.752 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T16:21:40.752 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T16:21:40.752 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-16T16:21:40.752 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:40.799 INFO:tasks.ceph.osd.0:Stopped 2024-04-16T16:21:40.799 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-16T16:21:40.799 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:40.865 INFO:tasks.ceph.osd.1:Stopped 2024-04-16T16:21:40.865 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-16T16:21:40.865 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:40.933 INFO:tasks.ceph.osd.2:Stopped 2024-04-16T16:21:40.933 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-16T16:21:40.933 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:41.031 INFO:tasks.ceph.osd.3:Stopped 2024-04-16T16:21:41.031 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-16T16:21:41.031 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:41.112 INFO:tasks.ceph.osd.4:Stopped 2024-04-16T16:21:41.112 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-16T16:21:41.112 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:41.191 INFO:tasks.ceph.osd.5:Stopped 2024-04-16T16:21:41.192 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-16T16:21:41.192 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:41.261 INFO:tasks.ceph.osd.6:Stopped 2024-04-16T16:21:41.261 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-16T16:21:41.261 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:41.347 INFO:tasks.ceph.osd.7:Stopped 2024-04-16T16:21:41.347 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T16:21:41.348 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-16T16:21:41.348 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:41.425 INFO:tasks.ceph.mgr.y:Stopped 2024-04-16T16:21:41.425 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-16T16:21:41.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:42.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-16T16:21:42.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-16T16:21:47.527 INFO:tasks.ceph.mgr.x:Stopped 2024-04-16T16:21:47.528 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T16:21:47.528 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-16T16:21:47.528 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:47.582 INFO:tasks.ceph.mon.a:Stopped 2024-04-16T16:21:47.582 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-16T16:21:47.582 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:47.627 INFO:tasks.ceph.mon.b:Stopped 2024-04-16T16:21:47.628 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-16T16:21:47.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T16:21:47.667 INFO:tasks.ceph.mon.c:Stopped 2024-04-16T16:21:47.667 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T16:21:47.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-04-16T16:21:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-16T16:21:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-16T16:21:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-16T16:21:47.787 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:21:47.787 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-16T16:21:48.045 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:21:48.045 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-16T16:21:48.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:21:48.211 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-16T16:21:48.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:21:48.357 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-16T16:21:48.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:21:48.545 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-16T16:21:48.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:21:48.799 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-16T16:21:48.948 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:21:48.948 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-16T16:21:49.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:21:49.113 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-16T16:21:49.278 INFO:tasks.ceph:Archiving mon data... 2024-04-16T16:21:49.279 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/data/mon.a.tgz 2024-04-16T16:21:49.280 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-04-16T16:21:49.339 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.XzCKXp8RRH 2024-04-16T16:21:49.340 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XzCKXp8RRH 2024-04-16T16:21:49.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.XzCKXp8RRH 2024-04-16T16:21:49.748 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.XzCKXp8RRH is 619KB 2024-04-16T16:21:49.863 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.XzCKXp8RRH 2024-04-16T16:21:49.921 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/data/mon.b.tgz 2024-04-16T16:21:49.921 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-16T16:21:49.980 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.k5Vwmi44hU 2024-04-16T16:21:49.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.k5Vwmi44hU 2024-04-16T16:21:50.254 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.k5Vwmi44hU 2024-04-16T16:21:50.416 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.k5Vwmi44hU is 846KB 2024-04-16T16:21:50.539 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.k5Vwmi44hU 2024-04-16T16:21:50.599 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/data/mon.c.tgz 2024-04-16T16:21:50.599 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-16T16:21:50.652 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.9fMTpdTGig 2024-04-16T16:21:50.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9fMTpdTGig 2024-04-16T16:21:50.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.9fMTpdTGig 2024-04-16T16:21:51.090 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.9fMTpdTGig is 846KB 2024-04-16T16:21:51.212 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.9fMTpdTGig 2024-04-16T16:21:51.272 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T16:21:51.272 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T16:21:51.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T16:21:51.446 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T16:21:51.506 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T16:21:51.506 INFO:tasks.ceph:Archiving crash dumps... 2024-04-16T16:21:51.509 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/remote/smithi022/crash 2024-04-16T16:21:51.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T16:21:51.618 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/remote/smithi043/crash 2024-04-16T16:21:51.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T16:21:51.722 INFO:tasks.ceph:Shutting down logrotate 2024-04-16T16:21:51.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:51.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:51.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:51.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T16:21:52.069 INFO:tasks.ceph:Compressing logs... 2024-04-16T16:21:52.070 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T16:21:52.077 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T16:21:52.172 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57146.log 2024-04-16T16:21:52.174 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-04-16T16:21:52.175 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70397.log 2024-04-16T16:21:52.175 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57146.log.gz 2024-04-16T16:21:52.176 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-16T16:21:52.176 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42999.log 2024-04-16T16:21:52.177 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2024-04-16T16:21:52.177 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2024-04-16T16:21:52.178 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44275.log 2024-04-16T16:21:52.178 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70397.log.gz 2024-04-16T16:21:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37170.log 2024-04-16T16:21:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.1.42999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42999.log.gz 2024-04-16T16:21:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41465.log 2024-04-16T16:21:52.180 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67884.log 2024-04-16T16:21:52.180 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2024-04-16T16:21:52.180 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.44275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44275.log.gz 2024-04-16T16:21:52.181 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56080.log 2024-04-16T16:21:52.181 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42481.log 2024-04-16T16:21:52.181 INFO:teuthology.orchestra.run.smithi043.stderr: 88.1%/var/log/ceph/ceph-client.1.41465.log: -- replaced with /var/log/ceph/ceph-client.admin.37170.log.gz 2024-04-16T16:21:52.181 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41465.log.gz 2024-04-16T16:21:52.181 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37010.log 2024-04-16T16:21:52.182 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.1.42481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42481.log.gz 2024-04-16T16:21:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57524.log 2024-04-16T16:21:52.183 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67884.log.gz 2024-04-16T16:21:52.183 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41648.log 2024-04-16T16:21:52.183 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56080.log.gz 2024-04-16T16:21:52.185 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57524.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57524.log.gz 2024-04-16T16:21:52.185 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-16T16:21:52.185 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41446.log 2024-04-16T16:21:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42477.log 2024-04-16T16:21:52.186 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37010.log.gz 2024-04-16T16:21:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.1.41446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41446.log.gz 2024-04-16T16:21:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42995.log 2024-04-16T16:21:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.1.42477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42477.log.gz 2024-04-16T16:21:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T16:21:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.1.42995.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-16T16:21:52.188 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42995.log.gz 2024-04-16T16:21:52.189 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67343.log 2024-04-16T16:21:52.189 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41648.log.gz 2024-04-16T16:21:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41342.log 2024-04-16T16:21:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67343.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67343.log.gz 2024-04-16T16:21:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45600.log 2024-04-16T16:21:52.190 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68136.log 2024-04-16T16:21:52.190 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41342.log.gz 2024-04-16T16:21:52.192 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45600.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45600.log.gz 2024-04-16T16:21:52.192 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45348.log 2024-04-16T16:21:52.192 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41816.log 2024-04-16T16:21:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-16T16:21:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36930.log 2024-04-16T16:21:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.4.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T16:21:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41864.log 2024-04-16T16:21:52.195 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36930.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-16T16:21:52.195 INFO:teuthology.orchestra.run.smithi043.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-16T16:21:52.195 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36930.log.gz 2024-04-16T16:21:52.195 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.3.41864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41864.log.gz 2024-04-16T16:21:52.196 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-16T16:21:52.196 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68136.log.gz 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45348.log.gz 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49378.log 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41732.log 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41816.log.gz 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.49378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57230.log 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49378.log.gz 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67487.log 2024-04-16T16:21:52.197 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41732.log.gz 2024-04-16T16:21:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56740.log 2024-04-16T16:21:52.199 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57230.log.gz 2024-04-16T16:21:52.200 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37050.log 2024-04-16T16:21:52.200 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36890.log 2024-04-16T16:21:52.200 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37050.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-16T16:21:52.200 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37050.log.gz 2024-04-16T16:21:52.200 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-04-16T16:21:52.201 INFO:teuthology.orchestra.run.smithi043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36890.log.gz 2024-04-16T16:21:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67487.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67487.log.gz 2024-04-16T16:21:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41984.log 2024-04-16T16:21:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47690.log 2024-04-16T16:21:52.202 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56740.log.gz 2024-04-16T16:21:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56525.log 2024-04-16T16:21:52.202 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41984.log.gz 2024-04-16T16:21:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46857.log 2024-04-16T16:21:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56525.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47690.log.gz 2024-04-16T16:21:52.204 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36970.log 2024-04-16T16:21:52.204 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37130.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T16:21:52.204 INFO:teuthology.orchestra.run.smithi043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2024-04-16T16:21:52.205 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36970.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-16T16:21:52.205 INFO:teuthology.orchestra.run.smithi043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36970.log.gz 2024-04-16T16:21:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46047.log 2024-04-16T16:21:52.206 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56525.log.gz 2024-04-16T16:21:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46857.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46857.log.gz 2024-04-16T16:21:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42068.log 2024-04-16T16:21:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37371.log 2024-04-16T16:21:52.208 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46047.log.gz 2024-04-16T16:21:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42068.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42068.log.gz 2024-04-16T16:21:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58867.log 2024-04-16T16:21:52.209 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37090.log 2024-04-16T16:21:52.209 INFO:teuthology.orchestra.run.smithi043.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T16:21:52.210 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-16T16:21:52.210 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41860.log 2024-04-16T16:21:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.37371.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37371.log.gz 2024-04-16T16:21:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2024-04-16T16:21:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66602.log 2024-04-16T16:21:52.211 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58867.log.gz 2024-04-16T16:21:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37090.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-16T16:21:52.212 INFO:teuthology.orchestra.run.smithi043.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37090.log.gz 2024-04-16T16:21:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.3.41860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41860.log.gz 2024-04-16T16:21:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-16T16:21:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66871.log 2024-04-16T16:21:52.214 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2024-04-16T16:21:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66602.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66602.log.gz 2024-04-16T16:21:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48776.log 2024-04-16T16:21:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45222.log 2024-04-16T16:21:52.215 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66871.log.gz 2024-04-16T16:21:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68010.log 2024-04-16T16:21:52.216 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48776.log.gz 2024-04-16T16:21:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68645.log 2024-04-16T16:21:52.217 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45222.log.gz 2024-04-16T16:21:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46467.log 2024-04-16T16:21:52.218 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68010.log.gz 2024-04-16T16:21:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68914.log 2024-04-16T16:21:52.218 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68645.log.gz 2024-04-16T16:21:52.219 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2024-04-16T16:21:52.219 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46467.log.gz 2024-04-16T16:21:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67926.log 2024-04-16T16:21:52.221 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68914.log.gz 2024-04-16T16:21:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57088.log 2024-04-16T16:21:52.221 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gz 2024-04-16T16:21:52.222 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48296.log 2024-04-16T16:21:52.222 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67926.log.gz 2024-04-16T16:21:52.223 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2024-04-16T16:21:52.223 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57088.log.gz 2024-04-16T16:21:52.224 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45963.log 2024-04-16T16:21:52.224 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48296.log.gz 2024-04-16T16:21:52.225 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47193.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2024-04-16T16:21:52.225 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2024-04-16T16:21:52.226 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56417.log 2024-04-16T16:21:52.226 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45963.log.gz 2024-04-16T16:21:52.227 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57837.log 2024-04-16T16:21:52.227 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2024-04-16T16:21:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58909.log 2024-04-16T16:21:52.228 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56417.log.gz 2024-04-16T16:21:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57837.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57837.log.gz 2024-04-16T16:21:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42619.log 2024-04-16T16:21:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68603.log 2024-04-16T16:21:52.230 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58909.log.gz 2024-04-16T16:21:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46941.log 2024-04-16T16:21:52.231 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42619.log.gz 2024-04-16T16:21:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68094.log 2024-04-16T16:21:52.232 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68603.log.gz 2024-04-16T16:21:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46941.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46941.log.gz 2024-04-16T16:21:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46713.log 2024-04-16T16:21:52.234 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46209.log 2024-04-16T16:21:52.234 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68094.log.gz 2024-04-16T16:21:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41942.log 2024-04-16T16:21:52.235 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46713.log.gz 2024-04-16T16:21:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68476.log 2024-04-16T16:21:52.236 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46209.log.gz 2024-04-16T16:21:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41942.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41942.log.gz 2024-04-16T16:21:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57482.log 2024-04-16T16:21:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46899.log 2024-04-16T16:21:52.238 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68476.log.gz 2024-04-16T16:21:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56962.log 2024-04-16T16:21:52.239 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57482.log.gz 2024-04-16T16:21:52.240 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46899.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46899.log.gz 2024-04-16T16:21:52.240 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58430.log 2024-04-16T16:21:52.241 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48884.log 2024-04-16T16:21:52.241 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56962.log.gz 2024-04-16T16:21:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46773.log 2024-04-16T16:21:52.243 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58430.log.gz 2024-04-16T16:21:52.243 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58304.log 2024-04-16T16:21:52.244 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48884.log.gz 2024-04-16T16:21:52.244 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46773.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46773.log.gz 2024-04-16T16:21:52.244 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66913.log 2024-04-16T16:21:52.245 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68956.log 2024-04-16T16:21:52.245 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58304.log.gz 2024-04-16T16:21:52.246 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68315.log 2024-04-16T16:21:52.246 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66913.log.gz 2024-04-16T16:21:52.247 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58180.log 2024-04-16T16:21:52.247 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68956.log.gz 2024-04-16T16:21:52.248 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68315.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68315.log.gz 2024-04-16T16:21:52.248 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46131.log 2024-04-16T16:21:52.249 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70145.log 2024-04-16T16:21:52.250 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58180.log.gz 2024-04-16T16:21:52.250 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58518.log 2024-04-16T16:21:52.251 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46131.log.gz 2024-04-16T16:21:52.251 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58388.log 2024-04-16T16:21:52.251 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70145.log.gz 2024-04-16T16:21:52.252 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48548.log 2024-04-16T16:21:52.253 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58518.log.gz 2024-04-16T16:21:52.253 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58388.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58388.log.gz 2024-04-16T16:21:52.253 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59077.log 2024-04-16T16:21:52.254 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58699.log 2024-04-16T16:21:52.255 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48548.log.gz 2024-04-16T16:21:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.59077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56656.log 2024-04-16T16:21:52.256 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59077.log.gz 2024-04-16T16:21:52.256 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2024-04-16T16:21:52.257 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58699.log.gz 2024-04-16T16:21:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56656.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56656.log.gz 2024-04-16T16:21:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59389.log 2024-04-16T16:21:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68220.log 2024-04-16T16:21:52.259 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2024-04-16T16:21:52.259 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.59389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67285.log 2024-04-16T16:21:52.260 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59389.log.gz 2024-04-16T16:21:52.260 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57440.log 2024-04-16T16:21:52.261 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68220.log.gz 2024-04-16T16:21:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67285.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67285.log.gz 2024-04-16T16:21:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57711.log 2024-04-16T16:21:52.262 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45558.log 2024-04-16T16:21:52.263 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57440.log.gz 2024-04-16T16:21:52.263 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48157.log 2024-04-16T16:21:52.264 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57711.log.gz 2024-04-16T16:21:52.265 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66560.log 2024-04-16T16:21:52.265 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45558.log.gz 2024-04-16T16:21:52.265 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-04-16T16:21:52.266 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48157.log.gz 2024-04-16T16:21:52.267 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46005.log 2024-04-16T16:21:52.267 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66560.log.gz 2024-04-16T16:21:52.268 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42954.log 2024-04-16T16:21:52.268 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-04-16T16:21:52.269 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68689.log 2024-04-16T16:21:52.269 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46005.log.gz 2024-04-16T16:21:52.270 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66518.log 2024-04-16T16:21:52.270 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42954.log.gz 2024-04-16T16:21:52.271 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58951.log 2024-04-16T16:21:52.271 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68689.log.gz 2024-04-16T16:21:52.272 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43706.log 2024-04-16T16:21:52.272 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66518.log.gz 2024-04-16T16:21:52.273 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56207.log 2024-04-16T16:21:52.273 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58951.log.gz 2024-04-16T16:21:52.274 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2024-04-16T16:21:52.275 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43706.log.gz 2024-04-16T16:21:52.275 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69763.log 2024-04-16T16:21:52.275 INFO:teuthology.orchestra.run.smithi022.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56207.log.gz 2024-04-16T16:21:52.276 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45810.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.42915.log -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2024-04-16T16:21:52.276 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-04-16T16:21:52.277 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-16T16:21:52.278 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69763.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69763.log.gz 2024-04-16T16:21:52.278 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57188.log 2024-04-16T16:21:52.279 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41690.log 2024-04-16T16:21:52.279 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-04-16T16:21:52.280 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-04-16T16:21:52.280 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57188.log.gz 2024-04-16T16:21:52.281 INFO:teuthology.orchestra.run.smithi022.stderr:gzip/var/log/ceph/ceph-client.admin.41690.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47567.log 2024-04-16T16:21:52.281 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41690.log.gz 2024-04-16T16:21:52.282 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57963.log 2024-04-16T16:21:52.282 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-04-16T16:21:52.283 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2024-04-16T16:21:52.283 INFO:teuthology.orchestra.run.smithi022.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47567.log.gz 2024-04-16T16:21:52.284 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48506.log 2024-04-16T16:21:52.284 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57963.log.gz 2024-04-16T16:21:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2024-04-16T16:21:52.285 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2024-04-16T16:21:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43748.log 2024-04-16T16:21:52.286 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48506.log.gz 2024-04-16T16:21:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42960.log 2024-04-16T16:21:52.287 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz 2024-04-16T16:21:52.289 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45096.log 2024-04-16T16:21:52.289 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43748.log.gz 2024-04-16T16:21:52.289 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57046.log 2024-04-16T16:21:52.290 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42960.log.gz 2024-04-16T16:21:52.290 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45096.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.45096.log.gz 2024-04-16T16:21:52.291 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49322.log 2024-04-16T16:21:52.292 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67117.log 2024-04-16T16:21:52.292 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57046.log.gz 2024-04-16T16:21:52.292 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.49322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67968.log 2024-04-16T16:21:52.293 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49322.log.gz 2024-04-16T16:21:52.293 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46815.log 2024-04-16T16:21:52.294 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67117.log.gz 2024-04-16T16:21:52.294 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66476.log 2024-04-16T16:21:52.295 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67968.log.gz 2024-04-16T16:21:52.296 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46815.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46815.log.gz 2024-04-16T16:21:52.296 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48069.log 2024-04-16T16:21:52.297 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70512.log 2024-04-16T16:21:52.297 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66476.log.gz 2024-04-16T16:21:52.298 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69082.log 2024-04-16T16:21:52.298 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48069.log.gz 2024-04-16T16:21:52.299 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68561.log 2024-04-16T16:21:52.299 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70512.log.gz 2024-04-16T16:21:52.300 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42292.log 2024-04-16T16:21:52.300 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69082.log.gz 2024-04-16T16:21:52.301 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66740.log 2024-04-16T16:21:52.302 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68561.log.gz 2024-04-16T16:21:52.303 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69668.log 2024-04-16T16:21:52.303 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2024-04-16T16:21:52.303 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69166.log 2024-04-16T16:21:52.304 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66740.log.gz 2024-04-16T16:21:52.304 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56824.log 2024-04-16T16:21:52.305 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69668.log.gz 2024-04-16T16:21:52.305 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42614.log 2024-04-16T16:21:52.306 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69166.log.gz 2024-04-16T16:21:52.307 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56824.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56824.log.gz 2024-04-16T16:21:52.307 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47817.log 2024-04-16T16:21:52.308 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42614.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T16:21:52.308 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42614.log.gz 2024-04-16T16:21:52.309 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47817.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47817.log.gz 2024-04-16T16:21:52.309 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59265.log 2024-04-16T16:21:52.310 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48422.log 2024-04-16T16:21:52.311 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.59265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59265.log.gz 2024-04-16T16:21:52.311 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-04-16T16:21:52.312 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48422.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip 2024-04-16T16:21:52.312 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2024-04-16T16:21:52.312 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48422.log.gz 2024-04-16T16:21:52.313 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47235.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-04-16T16:21:52.313 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57398.log 2024-04-16T16:21:52.314 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58741.log 2024-04-16T16:21:52.314 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2024-04-16T16:21:52.315 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57795.log 2024-04-16T16:21:52.315 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57398.log.gz 2024-04-16T16:21:52.316 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42288.log 2024-04-16T16:21:52.316 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58741.log.gz 2024-04-16T16:21:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57753.log 2024-04-16T16:21:52.317 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57795.log.gz 2024-04-16T16:21:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-04-16T16:21:52.318 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42288.log.gz 2024-04-16T16:21:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2024-04-16T16:21:52.320 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57753.log.gz 2024-04-16T16:21:52.320 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69889.log 2024-04-16T16:21:52.320 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-04-16T16:21:52.321 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59269.log 2024-04-16T16:21:52.321 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2024-04-16T16:21:52.322 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67403.log 2024-04-16T16:21:52.322 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69889.log.gz 2024-04-16T16:21:52.323 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.59269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59269.log.gz 2024-04-16T16:21:52.323 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43412.log 2024-04-16T16:21:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37481.log 2024-04-16T16:21:52.324 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67403.log.gz 2024-04-16T16:21:52.325 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-04-16T16:21:52.325 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43412.log.gz 2024-04-16T16:21:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.37481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67613.log 2024-04-16T16:21:52.326 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37481.log.gz 2024-04-16T16:21:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2024-04-16T16:21:52.327 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-04-16T16:21:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69584.log 2024-04-16T16:21:52.328 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67613.log.gz 2024-04-16T16:21:52.329 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56375.log 2024-04-16T16:21:52.330 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2024-04-16T16:21:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69584.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69584.log.gz 2024-04-16T16:21:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49076.log 2024-04-16T16:21:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68052.log 2024-04-16T16:21:52.332 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56375.log.gz 2024-04-16T16:21:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.49076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49076.log.gz 2024-04-16T16:21:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66698.log 2024-04-16T16:21:52.333 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44753.log 2024-04-16T16:21:52.333 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68052.log.gz 2024-04-16T16:21:52.334 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66698.log.gz 2024-04-16T16:21:52.334 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56291.log 2024-04-16T16:21:52.335 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.2.44753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2024-04-16T16:21:52.335 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44753.log.gz 2024-04-16T16:21:52.336 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45642.log 2024-04-16T16:21:52.336 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56291.log.gz 2024-04-16T16:21:52.337 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42950.log 2024-04-16T16:21:52.338 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2024-04-16T16:21:52.338 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45642.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45642.log.gz 2024-04-16T16:21:52.338 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43664.log 2024-04-16T16:21:52.339 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49072.log 2024-04-16T16:21:52.340 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42950.log.gz 2024-04-16T16:21:52.340 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-04-16T16:21:52.340 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43664.log.gz 2024-04-16T16:21:52.341 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.49072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49072.log.gz 2024-04-16T16:21:52.341 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69350.log 2024-04-16T16:21:52.342 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46293.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-04-16T16:21:52.342 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44749.log 2024-04-16T16:21:52.343 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-04-16T16:21:52.344 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69350.log.gz 2024-04-16T16:21:52.344 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.2.44749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44749.log.gz 2024-04-16T16:21:52.344 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69805.log 2024-04-16T16:21:52.345 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42627.log: gzip -5 89.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-04-16T16:21:52.345 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.45138.log 2024-04-16T16:21:52.346 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68998.log 2024-04-16T16:21:52.347 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69805.log.gz 2024-04-16T16:21:52.347 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2024-04-16T16:21:52.347 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45138.log.gz 2024-04-16T16:21:52.348 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45432.log 2024-04-16T16:21:52.348 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68998.log.gz 2024-04-16T16:21:52.349 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.49238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-04-16T16:21:52.349 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2024-04-16T16:21:52.350 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45432.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-16T16:21:52.350 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45432.log.gz 2024-04-16T16:21:52.351 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66955.log 2024-04-16T16:21:52.352 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2024-04-16T16:21:52.352 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45390.log 2024-04-16T16:21:52.353 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48338.log 2024-04-16T16:21:52.353 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66955.log.gz 2024-04-16T16:21:52.354 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45390.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45390.log.gz 2024-04-16T16:21:52.355 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42110.log 2024-04-16T16:21:52.356 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2024-04-16T16:21:52.356 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48338.log.gz 2024-04-16T16:21:52.357 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42110.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42110.log.gz 2024-04-16T16:21:52.357 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47775.log 2024-04-16T16:21:52.358 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68733.log 2024-04-16T16:21:52.358 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2024-04-16T16:21:52.359 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47775.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47775.log.gz 2024-04-16T16:21:52.359 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69542.log 2024-04-16T16:21:52.360 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48734.log 2024-04-16T16:21:52.361 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68733.log.gz 2024-04-16T16:21:52.362 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69542.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69542.log.gz 2024-04-16T16:21:52.362 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41468.log 2024-04-16T16:21:52.363 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58611.log 2024-04-16T16:21:52.363 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48734.log.gz 2024-04-16T16:21:52.364 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41468.log.gz 2024-04-16T16:21:52.364 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66434.log 2024-04-16T16:21:52.365 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43160.log 2024-04-16T16:21:52.366 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58611.log.gz 2024-04-16T16:21:52.366 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66434.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66434.log.gz 2024-04-16T16:21:52.367 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66997.log 2024-04-16T16:21:52.367 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58262.log 2024-04-16T16:21:52.368 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43160.log.gz 2024-04-16T16:21:52.369 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66997.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66997.log.gz 2024-04-16T16:21:52.369 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-04-16T16:21:52.370 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69292.log 2024-04-16T16:21:52.370 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58262.log.gz 2024-04-16T16:21:52.371 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42628.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-04-16T16:21:52.371 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-04-16T16:21:52.372 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2024-04-16T16:21:52.373 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69292.log.gz 2024-04-16T16:21:52.373 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41900.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-04-16T16:21:52.374 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56249.log 2024-04-16T16:21:52.374 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69250.log 2024-04-16T16:21:52.375 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2024-04-16T16:21:52.376 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56249.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56249.log.gz 2024-04-16T16:21:52.376 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67841.log 2024-04-16T16:21:52.377 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48113.log 2024-04-16T16:21:52.377 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69250.log.gz 2024-04-16T16:21:52.378 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67841.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67841.log.gz 2024-04-16T16:21:52.378 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43622.log 2024-04-16T16:21:52.379 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69847.log 2024-04-16T16:21:52.380 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48113.log.gz 2024-04-16T16:21:52.380 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-04-16T16:21:52.380 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43622.log.gz 2024-04-16T16:21:52.381 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70015.log 2024-04-16T16:21:52.382 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69847.log.gz 2024-04-16T16:21:52.383 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.44970.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-04-16T16:21:52.383 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67529.log 2024-04-16T16:21:52.384 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47025.log 2024-04-16T16:21:52.384 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70015.log.gz 2024-04-16T16:21:52.385 INFO:teuthology.orchestra.run.smithi043.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-16T16:21:52.385 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68784.log 2024-04-16T16:21:52.385 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67529.log.gz 2024-04-16T16:21:52.386 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67781.log 2024-04-16T16:21:52.386 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47025.log.gz 2024-04-16T16:21:52.387 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68784.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68784.log.gz 2024-04-16T16:21:52.387 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48674.log 2024-04-16T16:21:52.388 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42280.log 2024-04-16T16:21:52.389 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67781.log.gz 2024-04-16T16:21:52.390 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48674.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48674.log.gz 2024-04-16T16:21:52.390 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59569.log 2024-04-16T16:21:52.391 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70313.log 2024-04-16T16:21:52.391 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42280.log.gz 2024-04-16T16:21:52.392 INFO:teuthology.orchestra.run.smithi043.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-16T16:21:52.392 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.59569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48208.log 2024-04-16T16:21:52.392 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59569.log.gz 2024-04-16T16:21:52.393 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58783.log 2024-04-16T16:21:52.394 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70313.log.gz 2024-04-16T16:21:52.395 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56122.log 2024-04-16T16:21:52.395 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48208.log.gz 2024-04-16T16:21:52.396 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58783.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58783.log.gz 2024-04-16T16:21:52.396 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67445.log 2024-04-16T16:21:52.397 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57566.log 2024-04-16T16:21:52.397 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56122.log.gz 2024-04-16T16:21:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67445.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67445.log.gz 2024-04-16T16:21:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67039.log 2024-04-16T16:21:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45726.log 2024-04-16T16:21:52.400 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57566.log.gz 2024-04-16T16:21:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67039.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67039.log.gz 2024-04-16T16:21:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58474.log 2024-04-16T16:21:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46509.log 2024-04-16T16:21:52.402 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45726.log.gz 2024-04-16T16:21:52.403 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58474.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58474.log.gz 2024-04-16T16:21:52.403 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31085.log 2024-04-16T16:21:52.404 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59347.log 2024-04-16T16:21:52.404 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46509.log.gz 2024-04-16T16:21:52.405 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.tmp-client.admin.31085.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31085.log.gz 2024-04-16T16:21:52.405 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56698.log 2024-04-16T16:21:52.406 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.59347.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-16T16:21:52.407 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59347.log.gz 2024-04-16T16:21:52.407 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56698.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56698.log.gz 2024-04-16T16:21:52.408 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48632.log 2024-04-16T16:21:52.409 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58825.log 2024-04-16T16:21:52.410 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48632.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48632.log.gz 2024-04-16T16:21:52.410 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47943.log 2024-04-16T16:21:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47901.log 2024-04-16T16:21:52.413 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58825.log: /var/log/ceph/ceph-client.admin.47943.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58825.log.gz 2024-04-16T16:21:52.413 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66326.log 2024-04-16T16:21:52.413 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47943.log.gz 2024-04-16T16:21:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47901.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47901.log.gz 2024-04-16T16:21:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68872.log 2024-04-16T16:21:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45054.log 2024-04-16T16:21:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66326.log: /var/log/ceph/ceph-client.admin.68872.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66326.log.gz 2024-04-16T16:21:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.68872.log.gz --verbose 2024-04-16T16:21:52.417 INFO:teuthology.orchestra.run.smithi022.stderr: -- /var/log/ceph/ceph-client.admin.69040.log 2024-04-16T16:21:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70187.log 2024-04-16T16:21:52.419 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45054.log.gz 2024-04-16T16:21:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69040.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69040.log.gz 2024-04-16T16:21:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57004.log 2024-04-16T16:21:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48590.log 2024-04-16T16:21:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70187.log: /var/log/ceph/ceph-client.admin.57004.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70187.log.gz 2024-04-16T16:21:52.422 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.57004.log.gz -5 2024-04-16T16:21:52.422 INFO:teuthology.orchestra.run.smithi022.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67655.log 2024-04-16T16:21:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48590.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48590.log.gz 2024-04-16T16:21:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2024-04-16T16:21:52.425 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56459.log 2024-04-16T16:21:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67655.log: /var/log/ceph/ceph-client.admin.57356.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67655.log.gz 2024-04-16T16:21:52.426 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gz 2024-04-16T16:21:52.426 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43496.log 2024-04-16T16:21:52.428 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66392.log 2024-04-16T16:21:52.428 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56459.log.gz 2024-04-16T16:21:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43496.log.gz 2024-04-16T16:21:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43286.log 2024-04-16T16:21:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43454.log 2024-04-16T16:21:52.431 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43286.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66392.log.gz 2024-04-16T16:21:52.431 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43286.log.gz 2024-04-16T16:21:52.432 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41604.log 2024-04-16T16:21:52.432 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43454.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43454.log.gz 2024-04-16T16:21:52.433 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41510.log 2024-04-16T16:21:52.434 INFO:teuthology.orchestra.run.smithi022.stderr:gzip/var/log/ceph/ceph-client.admin.41604.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66272.log 2024-04-16T16:21:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41510.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41604.log.gz 2024-04-16T16:21:52.435 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41510.log.gz 2024-04-16T16:21:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69626.log 2024-04-16T16:21:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57669.log 2024-04-16T16:21:52.437 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66272.log.gz 2024-04-16T16:21:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69626.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69626.log.gz 2024-04-16T16:21:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56782.log 2024-04-16T16:21:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-04-16T16:21:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56782.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57669.log.gz 2024-04-16T16:21:52.441 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.56782.log.gz -5 2024-04-16T16:21:52.441 INFO:teuthology.orchestra.run.smithi022.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70229.log 2024-04-16T16:21:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46251.log 2024-04-16T16:21:52.442 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-04-16T16:21:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70229.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70229.log.gz 2024-04-16T16:21:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-04-16T16:21:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2024-04-16T16:21:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47277.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46251.log.gz 2024-04-16T16:21:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48818.log 2024-04-16T16:21:52.446 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-04-16T16:21:52.447 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42281.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2024-04-16T16:21:52.447 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70103.log 2024-04-16T16:21:52.448 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47067.log 2024-04-16T16:21:52.450 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70103.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48818.log.gz 2024-04-16T16:21:52.450 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70103.log.gz 2024-04-16T16:21:52.450 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70566.log 2024-04-16T16:21:52.451 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45852.log 2024-04-16T16:21:52.451 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47067.log.gz 2024-04-16T16:21:52.452 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70566.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70566.log.gz 2024-04-16T16:21:52.452 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-04-16T16:21:52.453 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58569.log 2024-04-16T16:21:52.454 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45852.log.gz 2024-04-16T16:21:52.455 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-04-16T16:21:52.455 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68826.log 2024-04-16T16:21:52.456 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37113.log 2024-04-16T16:21:52.456 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58569.log.gz 2024-04-16T16:21:52.457 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68826.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68826.log.gz 2024-04-16T16:21:52.458 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-16T16:21:52.458 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.37113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49280.log 2024-04-16T16:21:52.459 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mgr.y.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.37113.log.gz 2024-04-16T16:21:52.460 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-04-16T16:21:52.461 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.49280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-04-16T16:21:52.461 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49280.log.gz 2024-04-16T16:21:52.466 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57879.log 2024-04-16T16:21:52.466 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-04-16T16:21:52.466 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43580.log 2024-04-16T16:21:52.466 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-04-16T16:21:52.466 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68395.log 2024-04-16T16:21:52.466 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57879.log.gz 2024-04-16T16:21:52.467 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43538.log 2024-04-16T16:21:52.467 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43580.log.gz 2024-04-16T16:21:52.468 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44886.log 2024-04-16T16:21:52.468 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68395.log.gz 2024-04-16T16:21:52.469 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67159.log 2024-04-16T16:21:52.469 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43538.log.gz 2024-04-16T16:21:52.470 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.44886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41409.log 2024-04-16T16:21:52.471 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44886.log.gz 2024-04-16T16:21:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57314.log 2024-04-16T16:21:52.473 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67159.log.gz 2024-04-16T16:21:52.473 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49154.log 2024-04-16T16:21:52.474 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41409.log.gz 2024-04-16T16:21:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44427.log 2024-04-16T16:21:52.475 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57314.log.gz 2024-04-16T16:21:52.476 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.49154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58005.log 2024-04-16T16:21:52.476 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49154.log.gz 2024-04-16T16:21:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.44427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58346.log 2024-04-16T16:21:52.478 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44427.log.gz 2024-04-16T16:21:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45684.log 2024-04-16T16:21:52.479 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58005.log.gz 2024-04-16T16:21:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69973.log 2024-04-16T16:21:52.481 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58346.log.gz 2024-04-16T16:21:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56038.log 2024-04-16T16:21:52.482 INFO:teuthology.orchestra.run.smithi022.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45684.log.gz 2024-04-16T16:21:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-04-16T16:21:52.483 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69973.log.gz 2024-04-16T16:21:52.484 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56038.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-16T16:21:52.484 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56038.log.gz 2024-04-16T16:21:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46377.log 2024-04-16T16:21:52.486 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-04-16T16:21:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2024-04-16T16:21:52.488 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-16T16:21:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44928.log 2024-04-16T16:21:52.488 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46377.log.gz 2024-04-16T16:21:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69721.log 2024-04-16T16:21:52.490 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2024-04-16T16:21:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.44928.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70271.log 2024-04-16T16:21:52.491 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44928.log.gz 2024-04-16T16:21:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69721.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69721.log.gz 2024-04-16T16:21:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58657.log 2024-04-16T16:21:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70271.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70271.log.gz 2024-04-16T16:21:52.494 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45516.log 2024-04-16T16:21:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69208.log 2024-04-16T16:21:52.496 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58657.log.gz 2024-04-16T16:21:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59431.log 2024-04-16T16:21:52.498 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45516.log.gz 2024-04-16T16:21:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66644.log 2024-04-16T16:21:52.499 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69208.log.gz 2024-04-16T16:21:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.59431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67739.log 2024-04-16T16:21:52.500 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59431.log.gz 2024-04-16T16:21:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66644.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66644.log.gz 2024-04-16T16:21:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57921.log 2024-04-16T16:21:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67739.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T16:21:52.503 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67739.log.gz 2024-04-16T16:21:52.504 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-16T16:21:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49196.log 2024-04-16T16:21:52.505 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57921.log.gz 2024-04-16T16:21:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-16T16:21:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.49196.log: gzip 85.6% -- replaced with /var/log/ceph/ceph.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49196.log.gz 2024-04-16T16:21:52.508 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-04-16T16:21:52.509 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2024-04-16T16:21:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41197.log 2024-04-16T16:21:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42618.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-04-16T16:21:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41197.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41197.log.gz 2024-04-16T16:21:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48464.log 2024-04-16T16:21:52.515 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47985.log 2024-04-16T16:21:52.516 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48464.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48464.log.gz 2024-04-16T16:21:52.518 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47985.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47985.log.gz 2024-04-16T16:21:52.519 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43790.log 2024-04-16T16:21:52.520 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-16T16:21:52.522 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43790.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43790.log.gz 2024-04-16T16:21:52.524 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67201.log 2024-04-16T16:21:52.525 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66230.log 2024-04-16T16:21:52.527 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69931.log 2024-04-16T16:21:52.528 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67201.log.gz 2024-04-16T16:21:52.529 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.66230.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66230.log.gz 2024-04-16T16:21:52.529 INFO:teuthology.orchestra.run.smithi022.stderr: /var/log/ceph/ceph-client.admin.46983.log 2024-04-16T16:21:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69931.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69931.log.gz 2024-04-16T16:21:52.533 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42625.log 2024-04-16T16:21:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46983.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46983.log.gz 2024-04-16T16:21:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42625.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42625.log.gz 2024-04-16T16:21:52.537 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42026.log 2024-04-16T16:21:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2024-04-16T16:21:52.541 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42026.log.gz 2024-04-16T16:21:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59515.log 2024-04-16T16:21:52.547 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45768.log: /var/log/ceph/ceph-client.admin.59515.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69124.log 2024-04-16T16:21:52.547 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2024-04-16T16:21:52.548 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59515.log.gz 2024-04-16T16:21:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43202.log 2024-04-16T16:21:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.69124.log: /var/log/ceph/ceph-client.admin.43202.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43202.log.gz 2024-04-16T16:21:52.555 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70355.log 2024-04-16T16:21:52.558 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69124.log.gz/var/log/ceph/ceph-client.admin.70355.log: 2024-04-16T16:21:52.559 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57272.log 2024-04-16T16:21:52.559 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-16T16:21:52.561 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68518.log 2024-04-16T16:21:52.563 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57272.log: -- replaced with /var/log/ceph/ceph-client.admin.70355.log.gz 2024-04-16T16:21:52.564 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57272.log.gz 2024-04-16T16:21:52.565 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58100.log 2024-04-16T16:21:52.569 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.58100.log: /var/log/ceph/ceph-client.admin.68518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2024-04-16T16:21:52.571 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68518.log.gz 2024-04-16T16:21:52.572 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58100.log.gz 2024-04-16T16:21:52.573 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41278.log 2024-04-16T16:21:52.577 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41278.log: /var/log/ceph/ceph-client.admin.45306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48027.log 2024-04-16T16:21:52.579 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2024-04-16T16:21:52.580 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41278.log.gz 2024-04-16T16:21:52.581 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-04-16T16:21:52.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.48027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2024-04-16T16:21:52.585 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42959.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48027.log.gz 2024-04-16T16:21:52.586 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47319.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43244.log 2024-04-16T16:21:52.587 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-04-16T16:21:52.588 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2024-04-16T16:21:52.590 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-04-16T16:21:52.594 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.43244.log: /var/log/ceph/ceph-client.admin.42958.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47445.log 2024-04-16T16:21:52.595 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43244.log.gz 2024-04-16T16:21:52.596 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-04-16T16:21:52.597 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2024-04-16T16:21:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.47445.log: /var/log/ceph/ceph-client.admin.47648.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59473.log 2024-04-16T16:21:52.602 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47445.log.gz 2024-04-16T16:21:52.603 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2024-04-16T16:21:52.604 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67571.log 2024-04-16T16:21:52.609 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.59473.log: /var/log/ceph/ceph-client.admin.67571.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56333.log 2024-04-16T16:21:52.609 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59473.log.gz 2024-04-16T16:21:52.610 INFO:teuthology.orchestra.run.smithi043.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-16T16:21:52.610 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67571.log.gz 2024-04-16T16:21:52.614 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56333.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56333.log.gz 2024-04-16T16:21:52.614 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2024-04-16T16:21:52.615 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-16T16:21:52.615 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m0.482s 2024-04-16T16:21:52.615 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m1.733s 2024-04-16T16:21:52.615 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m0.270s 2024-04-16T16:21:52.617 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2024-04-16T16:21:52.618 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-04-16T16:21:52.620 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44294.log 2024-04-16T16:21:52.620 INFO:teuthology.orchestra.run.smithi022.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-16T16:21:52.622 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46635.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2024-04-16T16:21:52.623 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67697.log 2024-04-16T16:21:52.624 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.44294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44294.log.gz 2024-04-16T16:21:52.626 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67697.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67697.log.gz 2024-04-16T16:21:52.626 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42622.log 2024-04-16T16:21:52.628 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59011.log 2024-04-16T16:21:52.629 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42622.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42622.log.gz 2024-04-16T16:21:52.631 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.59011.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59011.log.gz 2024-04-16T16:21:52.632 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67243.log 2024-04-16T16:21:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68178.log 2024-04-16T16:21:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.67243.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67243.log.gz 2024-04-16T16:21:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.68178.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68178.log.gz 2024-04-16T16:21:52.637 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56920.log 2024-04-16T16:21:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2024-04-16T16:21:52.640 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.56920.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56920.log.gz 2024-04-16T16:21:52.641 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.45012.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2024-04-16T16:21:52.642 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42613.log 2024-04-16T16:21:52.643 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41858.log 2024-04-16T16:21:52.645 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.42613.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42613.log.gz 2024-04-16T16:21:52.646 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.41858.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41858.log.gz 2024-04-16T16:21:52.647 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-16T16:21:52.649 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47859.log 2024-04-16T16:21:52.651 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.47859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70061.log 2024-04-16T16:21:52.655 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70061.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47859.log.gz 2024-04-16T16:21:52.655 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2024-04-16T16:21:52.657 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70471.log 2024-04-16T16:21:52.659 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70061.log.gz 2024-04-16T16:21:52.660 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.46089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57626.log 2024-04-16T16:21:52.661 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.70471.log: 88.3% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70471.log.gz 2024-04-16T16:21:52.662 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz 2024-04-16T16:21:52.664 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.57626.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57626.log.gz 2024-04-16T16:21:52.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-16T16:21:52.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-16T16:21:52.743 INFO:teuthology.orchestra.run.smithi022.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-16T16:21:52.870 INFO:teuthology.orchestra.run.smithi022.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-16T16:21:52.882 INFO:teuthology.orchestra.run.smithi022.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-16T16:21:52.882 INFO:teuthology.orchestra.run.smithi022.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-16T16:21:52.969 INFO:teuthology.orchestra.run.smithi022.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-16T16:21:53.572 INFO:teuthology.orchestra.run.smithi022.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-16T16:21:53.643 INFO:teuthology.orchestra.run.smithi022.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-16T16:21:53.648 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-04-16T16:21:53.649 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m1.519s 2024-04-16T16:21:53.649 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m4.401s 2024-04-16T16:21:53.649 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m1.257s 2024-04-16T16:21:53.650 INFO:tasks.ceph:Archiving logs... 2024-04-16T16:21:53.650 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/remote/smithi022/log 2024-04-16T16:21:53.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T16:21:54.546 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/remote/smithi043/log 2024-04-16T16:21:54.547 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T16:21:54.950 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T16:21:54.960 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T16:21:54.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T16:21:54.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T16:21:55.128 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T16:21:55.137 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T16:21:55.137 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T16:21:55.145 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T16:21:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-04-16T16:21:55.203 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-04-16T16:21:55.205 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T16:21:55.205 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-04-16T16:21:55.205 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +2065us[+2074us] +/- 58ms 2024-04-16T16:21:55.206 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -2289us[-2279us] +/- 57ms 2024-04-16T16:21:55.206 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +283us[ +293us] +/- 63ms 2024-04-16T16:21:55.206 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:21:55.213 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T16:21:55.213 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-16T16:21:55.214 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +2073us[+2077us] +/- 58ms 2024-04-16T16:21:55.214 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -2294us[-2290us] +/- 57ms 2024-04-16T16:21:55.214 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +288us[ +293us] +/- 63ms 2024-04-16T16:21:55.214 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T16:21:55.215 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T16:21:55.224 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T16:21:55.224 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T16:21:55.233 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T16:21:55.484 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T16:21:55.686 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T16:21:55.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:21:55.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T16:21:55.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:21:55.903 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T16:21:55.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T16:21:55.925 INFO:teuthology.task.internal:Duration was 895.533722 seconds 2024-04-16T16:21:55.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T16:21:55.934 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T16:21:55.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T16:21:55.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T16:21:56.111 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T16:21:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T16:21:56.602 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T16:21:56.603 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-04-16T16:21:56.603 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T16:21:56.670 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-04-16T16:21:56.670 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T16:21:56.753 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T16:21:56.753 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T16:21:56.760 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T16:21:56.857 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T16:21:56.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T16:21:56.863 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T16:21:57.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T16:21:57.070 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T16:21:57.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T16:21:57.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T16:21:57.279 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T16:21:57.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T16:21:57.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T16:21:57.406 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-04-16T16:21:57.414 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-04-16T16:21:57.474 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T16:21:57.524 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi022.front.sepia.ceph.com, flagging run as failed 2024-04-16T16:21:57.524 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T16:21:57.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:21:57.583 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T16:21:57.595 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T16:21:57.595 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/remote/smithi022 2024-04-16T16:21:57.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T16:22:05.221 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-16T16:22:05.234 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219/remote/smithi022/coredump/1713284457.68396.core.gz: gzip compressed data, was "1713284457.68396.core", last modified: Tue Apr 16 16:21:57 2024, max compression, original size modulo 2^32 266887168 2024-04-16T16:22:05.234 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-16T16:22:06.260 INFO:teuthology.task.internal: core looks like: /tmp/tmps9g_irg_: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-04-16T16:22:06.285 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i c 2024-04-16T16:22:06.285 DEBUG:teuthology.orchestra.run.smithi022:> which 'ceph-mds -f --cluster ceph -i c' 2024-04-16T16:22:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:/usr/bin/which: invalid option -- 'f' 2024-04-16T16:22:06.349 INFO:teuthology.orchestra.run.smithi022.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-04-16T16:22:06.349 INFO:teuthology.orchestra.run.smithi022.stderr:/usr/bin/which: no c in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-16T16:22:06.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:22:06.350 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mds 2024-04-16T16:22:06.350 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph 2024-04-16T16:22:06.351 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: "which 'ceph-mds -f --cluster ceph -i c'" 2024-04-16T16:22:06.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T16:22:06.375 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T16:22:06.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T16:22:06.433 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T16:22:06.433 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T16:22:06.444 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T16:22:06.499 INFO:teuthology.orchestra.run.smithi022.stdout: 395587 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest 2024-04-16T16:22:06.499 INFO:teuthology.orchestra.run.smithi022.stdout: 395598 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest/archive 2024-04-16T16:22:06.499 INFO:teuthology.orchestra.run.smithi022.stdout: 395386 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest/archive/syslog 2024-04-16T16:22:06.500 INFO:teuthology.orchestra.run.smithi022.stdout: 395166 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 16:06 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T16:22:06.500 INFO:teuthology.orchestra.run.smithi022.stdout: 395167 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 16:06 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T16:22:06.500 INFO:teuthology.orchestra.run.smithi022.stdout: 395169 196 -rw-r--r-- 1 ubuntu ubuntu 197119 Apr 16 16:21 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T16:22:06.500 INFO:teuthology.orchestra.run.smithi022.stdout: 655363 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest/archive/audit 2024-04-16T16:22:06.500 INFO:teuthology.orchestra.run.smithi022.stdout: 655646 176 -rw------- 1 ubuntu ubuntu 177944 Apr 16 16:21 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T16:22:06.500 INFO:teuthology.orchestra.run.smithi022.stdout: 395613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 16:20 /home/ubuntu/cephtest/archive/coredump 2024-04-16T16:22:06.500 INFO:teuthology.orchestra.run.smithi022.stdout: 395168 17876 -rw------- 1 root root 266887168 Apr 16 16:20 /home/ubuntu/cephtest/archive/coredump/1713284457.68396.core 2024-04-16T16:22:06.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T16:22:06.503 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T16:22:06.503 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: "which 'ceph-mds -f --cluster ceph -i c'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-16T16:22:06.514 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T16:22:06.523 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T16:22:06.534 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi022 with status 1: "which 'ceph-mds -f --cluster ceph -i c'" 2024-04-16T16:22:06.534 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T16:22:06.541 INFO:teuthology.orchestra.run.smithi043.stdout: 393996 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest 2024-04-16T16:22:06.541 INFO:teuthology.orchestra.run.smithi043.stdout: 393997 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest/archive 2024-04-16T16:22:06.541 INFO:teuthology.orchestra.run.smithi043.stdout: 393999 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest/archive/syslog 2024-04-16T16:22:06.542 INFO:teuthology.orchestra.run.smithi043.stdout: 393968 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 16:06 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T16:22:06.542 INFO:teuthology.orchestra.run.smithi043.stdout: 393969 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 16:06 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T16:22:06.542 INFO:teuthology.orchestra.run.smithi043.stdout: 393970 188 -rw-r--r-- 1 ubuntu ubuntu 190401 Apr 16 16:21 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T16:22:06.542 INFO:teuthology.orchestra.run.smithi043.stdout: 655363 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 16:21 /home/ubuntu/cephtest/archive/audit 2024-04-16T16:22:06.542 INFO:teuthology.orchestra.run.smithi043.stdout: 655646 136 -rw------- 1 ubuntu ubuntu 136576 Apr 16 16:21 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T16:22:06.543 INFO:teuthology.orchestra.run.smithi043.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T16:22:06.567 DEBUG:teuthology.nuke:shortname: smithi022 2024-04-16T16:22:06.567 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T16:22:06.590 DEBUG:teuthology.nuke:shortname: smithi043 2024-04-16T16:22:06.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T16:22:06.593 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:58:04.701781', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPJHceKDWBWrA3P7NlLyWqCEfZ7PnHzplxQVWgsRWiLLAM52o1kV61YEqfhi+Z44Q974Yf+kh3R74I0q1qRzxE='} 2024-04-16T16:22:06.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:58:04.703137', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuK7DzoqdlBifQdg4JImyaNVX1bjRkaVTmL+PsxSAWksF2pK6w3uEep/1OrX2TCA6O8pbVUHSncTFiIHceCw7I='} 2024-04-16T16:22:06.646 INFO:teuthology.orchestra.console.smithi022:Power off 2024-04-16T16:22:06.646 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T16:22:06.672 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-04-16T16:22:06.672 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T16:22:06.686 INFO:teuthology.orchestra.console.smithi043:Power off 2024-04-16T16:22:06.686 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T16:22:06.696 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-16T16:22:06.709 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2024-04-16T16:22:06.709 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T16:22:06.730 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-16T16:22:10.698 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T16:22:10.731 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T16:22:10.809 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-16T16:22:10.843 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-16T16:22:14.810 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T16:22:14.844 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T16:22:14.921 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-16T16:22:14.953 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-16T16:22:15.023 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-04-16T16:22:15.054 INFO:teuthology.orchestra.console.smithi043:Power off completed 2024-04-16T16:22:15.160 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 client.1-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} duration: 895.5337221622467 failure_reason: 'Test failure: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=72ab6c9cf717440488bb41d1ceb9ef43 status: fail success: false 2024-04-16T16:22:15.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T16:22:15.249 INFO:teuthology.run:FAIL